summaryrefslogtreecommitdiffstats
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Use ctest_test and APPEND to correctly report passed and failed test numbers ↵Larry Knox2022-11-021-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | in CDash (#2208) * Change how HPC tests are executed * Move ctest_test commands for serial and parallel tests into cmake files. * Update checks for uploading Test.xml to CDash. * Correct cmake scripots. * Remove extraneous characters. * Add ctest_start (APPEND). * Add binary directories to scripts running ctest_test. * Correct parameters for appending Test.xml. * Set CTEST_SITE and CTEST_BUILD_NAME. * Try to pass site and build_name to ctest_test sripts. * Add site name and build name for ctest_test commands vi environment. * Revert "Try to pass site and build_name to ctest_test sripts." This reverts commit d364aaf0fa65ee7f9e222b2633ee916d50afbc42. * Correct typo in src/CMakeLists.txt. * Update batch scripts to run ctest_test scripts. Co-authored-by: Allen Byrne <byrn@hdfgroup.org>
* Correct the CMake link for MPI (#2198)Allen Byrne2022-11-011-6/+6
|
* Update copyright headers (#2184)Larry Knox2022-11-01446-454/+46
| | | | | * Updated source file copyright headers to remove "Copyright by the Board of Trustees of the University of Illinois", which is kept in the top-level COPYING file.
* Fix for documentation misunderstanding on m1 Intel builds (#2188)Allen Byrne2022-10-261-4/+4
|
* Update develop branch version to 1.13.4-1 (#2189)Larry Knox2022-10-262-4/+4
| | | | | | * Updated version to 1.13.4-1 after creating hdf5_1_13_3 branch for 1.13.3 release. Added new version to exceptions in lines 74-5 of src/H5.c
* Removed the file, func, line args in the _async APIs fpr doxygen (#2179)Scot Breitenfeld2022-10-2511-8/+287
| | | | | | | | | | | | | | | | | | | | | | | | | * Removed the: file, func, line args in the _async APIs from the doxygen arguments. Documented H5ESclean. * format fixes * fixed DOXYGEN_PREDEFINED * Fixed the #ifdet logic for doxygen, added missing multi-dataset va_args * format fixes * Use H5_DOXYGEN instead of H5_DOXYGEN_FORTRAN * reordered multidataset declarations * alt. for H5Aclose_async and H5Acreate_async * made doxgyen API into seperate blocks * updated codespell * Committing clang-format changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Port VOL User Guide to doxygen (#2165)Allen Byrne2022-10-251-11/+526
| | | | | | | | | * Port VOL User Guide to doxygen * Fix spelling * Committing clang-format changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Implement option for using CMake GNUInstallDirs (#2175)Allen Byrne2022-10-251-2/+2
| | | | | * Implement option for using CMake GNUInstallDirs * Add release notes
* fixed error code returned for H5Aexits (#2180)Scot Breitenfeld2022-10-251-2/+2
|
* Fix problem with variable length attributes being accessed through multiple ↵Neil Fortner2022-10-251-0/+4
| | | | | | | | | | | file handles (#2181) * Fix bug with variable length attributes being accessed through multiple file handles. * Committing clang-format changes Co-authored-by: Neil Fortner <nfortne2@localhost.localdomain> Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Multi Dataset (#2120)Neil Fortner2022-10-1923-2961/+4384
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Fix bug with cross platform compatibility of references within vlens. No testing yet. * Merge from multi_rd_wd_coll_io to a more recent branch from develop. Untested, probably does not work yet. * Committing clang-format changes * Committing clang-format changes * Fix many bugs in multi dataset branch. Mostly works, some issues in SWMR tests. * Committing clang-format changes * Disable test in swmr.c that was failing due to bug in HDF5 unrelated to multi dataset. * Committing clang-format changes * Fixed fortran multi-dataset tests * Fixed xlf errors * Added benchmark code for multi-datasets * loops over datasets * added missing error arg. * Added gnuplot formatting * Jonathan Kim original MD benchmarking code * updated MD benchmarking code * code clean-up * Only make files in feature test mode * misc clean-up * removed TEST_MDSET_NO_LAST_DSET_2ND_PROC option * Committing clang-format changes * Change multi dataset API to use arrays of individual parameters instead of the parameter struct. * Committing clang-format changes * Update to new multi dataset Fortran API and tests. (#1724) * Update to new multi dataset Fortran API and tests. * Sync Fortran with develop. * skipping h5pget_mpio_actual_io_mode_f for now * Fixed issue with dxpl_id, changed to variable size dim. (#1770) * Remove "is_coll_broken" field from H5D_io_info_t struct * Committing clang-format changes * Minor cleanup in multi dataset code. * Committing clang-format changes * Clean up in multi dataset code. * Committing clang-format changes * Committing clang-format changes * Fix speeling * Fix bug in parallel compression. Switch base_maddr in io_info to be a union. * Committing clang-format changes * Implement selection I/O support with multi dataset. Will be broken in parallel until PR 1803 is merged to develop then the MDS branch. * Committing clang-format changes * Spelling * Fix bug in multi dataset that could cause errors when only some of the datasets in the multi dataset I/O used type conversion. * Committing clang-format changes * Integrate multi dataset APIs with VOL layer. Add async versions of multi dataset APIs. * Committing clang-format changes * Spelling fixes * Fix bug in non-parallel HDF5 compilation. * Committing clang-format changes * Fix potential memory/free list error. Minor performance fix. Other minor changes. * Committing clang-format changes * Fix memory leak with memory dataspace for I/O. * Committing clang-format changes * Fix stack variables too large. Rename H5D_dset_info_t to H5D_dset_io_info_t. * Committing clang-format changes * Remove mem_space_alloc field from H5D_dset_io_info_t. Each function is now responsible for freeing any spaces it adds to dset_info. * Committing clang-format changes * fixed _multi Fortran declaration * Refactor various things in (mostly) the serial I/O code path to make things more maintainable. * Committing clang-format changes * updated to array based, doxygen, and examples * Reinstate H5D_chunk_map_t, stored (via pointer) inside H5D_dset_io_info_t. * Change from calloc to malloc for H5D_dset_io_info_t and H5D_chunk_map_t. Switch temporary dset_infos to be local stack variables. * Committing clang-format changes * format cleanup * format cleanup * added coll and ind * Modify all parallel I/O paths to take dset_info instead of assuming dset_info[0]. * Committing clang-format changes * fixed output * Rework parallel I/O code to work properly with multi dataset in more cases. Fix bug in parallel compression. * Committing clang-format changes * Prevent H5D__multi_chunk_collective_io() from messing up collective opt property for other datasets in I/O. Other minor cleanup. Add new test case to t_pmulti_dset.c for H5FD_MPIO_INDIVIDUAL_IO, disabled for now due to failures apparently unrelated to multi dataset code. * Fix spelling * Committing clang-format changes * Replace N log N algorithm for finding chunk in H5D__multi_chunk_collective_io() with O(N) algorithm, and remove use of io_info->sel_pieces in that function. * Committing clang-format changes * Replace sel_pieces skiplist in io_info with flat array of pointers, use qsort in I/O routine only when necessary. * Committing clang-format changes * Add new test case to mdset.c * Committing clang-format changes * Fix spelling * Very minor fix in H5VL__native_dataset_read() * Fix bug that could affect filtered parallel multi-dataset I/O. * Add RM entries for H5Dread_multi(), H5Dread_multi_async(), H5Dwrite_multi(), and H5Dwrite_multi_async() * Unskip test in swmr.c * Committing clang-format changes * Eliminate H5D__pre_read and H5D__pre_write * Remove examples/ph5mdsettest.c. Will fix and re-add as a test. * Enable hyperslab combinations in mdset test * Committing clang-format changes * Clarify H5Dread/write_multi documentation. * Fix bugs in multi-dataset I/O. Expand serial multi dataset test. Update macro in parallel multi dataset test. * Committing clang-format changes * Spelling * Remove obsolete entry in bin/trace * Rework type conversion buffer allocation. Only one buffer is shared between datasets in mdset mode, and it is malloced instead of calloced. * Committing clang-format changes * Fix bug in error handling in H5D__read/write * added multi-dataset fortran check with optional dataset creation id (#2150) * removed dup. dll entry * Address comments from code review. * Remove spurious changes in H5Fmpi.c * Fix issue with reading unallocated datasets in multi-dataset mode. Address other comments from code review. * Committing clang-format changes * Delay chunk index lookup from io_init to mdio_init so it doesn't add overhead to single dataset I/O. * Committing clang-format changes * Fix inappropriate use of piece_count * updated copyright on new file, removed benchmark from testing dir. Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: M. Scot Breitenfeld <brtnfld@hdfgroup.org> Co-authored-by: Dana Robinson <43805+derobins@users.noreply.github.com>
* Fix for HDFFV-10840: Instead of using fill->buf for datatype conversion (#2153)vchoi-hdfgroup2022-10-141-14/+11
| | | | | | | | | | * Fix for HDFFV-10840: Instead of using fill->buf for datatype conversion if it is large enough, a buffer is allocated regardless so that the element in fill->buf can later be reclaimed. Valgrind is run on test/set_extent.c and there is no memory leak. * Add information of this fix to release notes. Co-authored-by: vchoi <vchoi@jelly.ad.hdfgroup.org>
* Cleans final production mode warnings from H5Shyper.c (#2163)Dana Robinson2022-10-141-160/+226
| | | | | | | | | | | | | | | | | | | * H5S__hyper_free_span_info() returns herr_t (not checked) * Set up H5S__hyper_free_span_info() error handling * Set up H5S__hyper_free_span() error handling * Added error handling to H5S_HYPER_ADVANCE_SPAN * Handled errors in H5S__hyper_iter_get_seq_list_gen() * Added a production mode build target for -Werror * Committing clang-format changes * Updated names for -Werror checks Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Subfiling Fortran wrapper work. (#2143)Scot Breitenfeld2022-10-061-0/+1
| | | | | | | | | | | | | | | | | * added C ref. for Fortran constants * added C ref. for Fortran constants * move constant paramters to H5* module listing * added back comment * Fortran subfiling and ioc FD with tests. H5Pset/get_mpi_params wrappers with tests, misc.. parallel test clean-up. * misc. fixes * fixed CMake testpar issues, formatted, misc. updates * updated tests
* Subfiling testing fix and documentation (#2132)jhendersonHDF2022-09-304-9/+59
| | | | | | | | | * Fix a sporadic failure in Subfiling VFD tests * Subfiling VFD - add note to H5Pget_fapl_subfiling documentation Adds note about how H5Pget_fapl_subfiling only returns the original settings on a FAPL and those settings could have been modified by the Subfiling VFD's environment variables
* Fixed an issue that could occur when combining hyperslab selections (#2122)Neil Fortner2022-09-271-2/+2
|
* Restructure ref manual presentation (#2123)Allen Byrne2022-09-271-24/+10
|
* Use case-insensitive comparison for headers fix #2100 (#2101)Frank Berghaus2022-09-214-1/+49
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Use case-inseneitive comparison for headers HTTP headers should be case-insensitive. Use case-insensitive string comparisons when working with HTTP header responses to ensure compatibility. * Revert "Use case-inseneitive comparison for headers" This reverts commit a02f591723506b62b7208449be6eef7122120398 * Ignore case when searching HTTP header responses Looking up the Content-Length in the header returned by S3 storage endpoints should ignore case. To guarantee portability implement a function for case-insensitive string search, because it is non-standard. * Add an _ after H5 for the strcasestr implementation It is a private function and should sport that underscore. * Remove author comment from the doc comment * Use search function defined by system if available Check whether the system provides a function implementing case insensitive string searches. Only use the custom implementation if the system does not provide the functionality. * Add tests for case-insensitive search Basic tests: - Search for empty string - Search with exact match - Search with case-insensitive match - search with no match * Enforce clang-format style Some variable definitions in the th5_system tests did not conform to clang-format's expectations. Updated the offending lines. * Correct comment describing test case * Added some spaces to please clang-format * Ignore discarding const Ask the compiler to ignore discarding the const when retunring a match from H5_strcasestr Co-authored-by: Frank Berghaus <frank.berghaus@mpcdf.mpg.de>
* Updates VOL capabilities flags (#2105)Dana Robinson2022-09-1711-33/+80
| | | | | | | | | | | | | | | * Added feature/vol_cap_flags branch to GitHub actions * Convert unsigned cap flag field to uint64_t and add flags * Committing clang-format changes * Convert unsigned cap flag field to uint64_t and add flags * Committing clang-format changes * Updates the VOL struct version number Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Use doxygen snippets for common tables (#2104)Allen Byrne2022-09-165-743/+120
|
* Subfiling VFD updates (#2106)jhendersonHDF2022-09-1610-2241/+3380
|
* develop Merge doxygen from 1.12 branch (#2095)Allen Byrne2022-09-1424-186/+14053
|
* Fix memory bug in selection I/O (#2096)Neil Fortner2022-09-141-14/+18
| | | | | | * Fix memory bug in selection I/O * Change error messages for calls to H5I_remove() in H5FD_read/write_selection()
* Update CMake code to 3.18 minimum version (#2080)Allen Byrne2022-09-031-1/+1
| | | | | * Update CMake code to 3.18 minimum version * Updated release note
* Updates onion VFD major error codes (#2076)Dana Robinson2022-08-314-49/+49
|
* Address review comments from downstream merge of #2016 (#2073)Neil Fortner2022-08-311-3/+5
|
* Fortran module directory improvements (#2060)Dana Robinson2022-08-231-0/+1
| | | | | | * Removes the module directory from the Automake flags as this generated a large number of "missing include directory" warnings and is unecessary * Adds the module path to libhdf5.settings
* Fix inappropriate use of HGOTO_ERROR (#2055)Neil Fortner2022-08-221-1/+1
|
* Quiets Automake rules in src directory (#2051)Dana Robinson2022-08-222-10/+12
| | | | | * Quiets Automake rules in src directory * Fix whitespace
* [WIP] Add Developer build mode to CMake (#1659)jhendersonHDF2022-08-2011-116/+114
| | | | | | | | | | | | | | | | * Add Developer build mode to CMake * Set a few CMake variables for Developer build modes * Refactor enabling of debug and developer-level compile definitions * Convert cache debugging macros to normal ifdef style Normal ifdef-style instead of if-style allows build system to define macros without warning about redefining macros with different values (0 vs. 1) * Add HDF5 Developer compile definitions to testing files * Temporarily disable -fanalyzer flag for GCC 12+ Developer builds
* Fixes codespell issues (#2032)Dana Robinson2022-08-173-9/+9
| | | | | * Fixes codespell issues * Fixed another typo
* Fix bug in attribute type conversion wiith compound types (#2016)Neil Fortner2022-08-161-9/+44
| | | | | | | | | | | | | * Fix bug in attribute type conversion where the background buffer would not be initialized with the destination contents when necessary. Other minor simplification. * Committing clang-format changes * Fix warnings. * Address review comments. Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Update version to 1.13.3-1 after creating hdf5_1_13_2 branch for 1.13.2 (#2004)Larry Knox2022-08-122-4/+4
| | | | release. Added new version to exceptions in line 75 of src/H5.c.
* Revert "Increment version to 1.13.3-1 after creating hdf5_1_13_2 branch for ↵Larry Knox2022-08-121-2/+2
| | | | | | | | release" This reverts commit c58558e872d529da6eda327183ca2d14cfa91b95. H5TEST-tcheck_version-release failed.
* Increment version to 1.13.3-1 after creating hdf5_1_13_2 branch for releaseLarry Knox2022-08-121-2/+2
| | | | of HDF5 1.13.2.
* Fix typos found in src/ subdirectory (#1983)luzpaz2022-08-1050-73/+73
| | | Found via `codespell -q 3 -S ./release_docs,./bin/trace,./hl/tools/h5watch/h5watch.c,./tools/test/h5jam/tellub.c -L isnt,inout,nd,parms,parm,ba,offsetP,ser,ois,had,fiter,fo,clude,refere,minnum,offsetp,creat,ans:,eiter,lastr,ans,isn\'t,ifset,sur,trun,dne,tthe,hda,filname,te,htmp,minnum,ake,gord,numer,ro,oce`
* Remove usage of libgen.h (#1984)jhendersonHDF2022-08-104-6/+0
|
* Subfiling VFD - tidying up and fixing a few new testing failures (#1977)jhendersonHDF2022-08-097-1481/+522
| | | | | | | | | | | | | | | | | | | * Rename Subfiling IOC "thread_pool_count" field to "thread_pool_size" * Add simple HDF5 example for Subfiling VFD * Subfiling VFD - never cache app topology as it may change * Subfiling VFD - cleanup unused funtionality and tidy up some TODOs * Subfiling VFD - tidy up subfiling error handling in H5subfiling_common.c * Subfiling VFD - show number of failed I/O requests on close * Subfiling VFD - Update file cmp callback after switching to MPI I/O VFD * Amend RELEASE.txt with info about h5fuse.sh and Subfiling limitations * Subfiling VFD - switch to using H5_basename and H5_dirname
* Turns off clang optimizations on a couple of onion VFD functions (#1976)Dana Robinson2022-08-083-2/+15
| | | Ancient clang (7.7.3 on OS X) emits problematic code with -O2 or -O3
* Fixes some badness in the onion VFD revision comment code (#1975)Dana Robinson2022-08-082-13/+20
| | | | | | | * Fixes some badness in the revision comment code * Committing clang-format changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* H5Dchunk_iter now passes offsets in units of dataset elements, fix #1419 (#1969)Mark Kittisopikul2022-08-072-14/+23
| | | | | | | | | | | * H5Dchunk_iter now passes chunk dimension scaled offsets, fix #1419 * Update docs for H5Dchunk_iter, H5Dget_chunk_info* Modified description for `H5Dchunk_iter`, `H5Dget_chunk_info`, and `H5Dget_chunk_info_by_coord` to the following * offset Logical position of the chunk’s first element in units of dataset elements * filter_mask Bitmask indicating the filters used when the chunk was written * size Chunk size in bytes, 0 if the chunk does not exist
* Set entry pointer mem type for vector I/O in collective metadata writes (#1961)jhendersonHDF2022-08-071-7/+5
|
* Fix issues in tools code after Subfiling VFD updates (#1973)jhendersonHDF2022-08-062-17/+32
|
* Adds platform-independent basename and dirname (#1951)Dana Robinson2022-08-055-0/+321
| | | | | | | | | | | | | | | | | | | | * Adds platform-independent basename and dirname * Tidy up H5_dirname and H5_basename implementations and add tests * Committing clang-format changes * Fix misspelling * Several fixes for H5_dirname/H5_basename from review * Committing clang-format changes * Add reason to VERIFY_STR macros in th5_system.c * Use H5MM_free instead of HDfree in H5_dirname/H5_basename tests Co-authored-by: Jordan Henderson <jhenderson@hdfgroup.org> Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Sanity checks for H5Xcreate_anon functions to make sure the IDs passed in ↵raylu-hdf2022-08-053-1/+16
| | | | | | | | | are valid (#1967) * Sanity checks for H5Xcreate_anon functions to make sure the IDs passed in are valid. * Removed unnecessary sanity checks. Co-authored-by: songyulu <songyulu@jelly.ad.hdfgroup.org>
* Subfiling updates for release (#1963)jhendersonHDF2022-08-048-536/+925
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Remove generated file h5fuse.sh * Link pthreads library when Subfiling VFD is built * Switch to MPI I/O driver for Subfiling HDF5 stub file * Rough first implementation for Subfiling file deletion * Subfiling VFD - get file dirname for file deletion * Subfiling VFD - set lock callback to NULL for now to avoid performance issues * Committing clang-format changes * Minor tidying up of Subfiling testing * Fixups for Subfiling VFD support in tools * Tidy up Subfiling public interface and add Doxygen * Respect Subfiling configuration settings from application * Add release note for Subfiling VFD * Committing clang-format changes * Committing clang-format changes * Shorten some Subfiling environment variable names Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Onion VFD (#1953)Dana Robinson2022-08-0215-5/+3754
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Onion VFD feature * Fixes onion VFD errors with non-sec2 backing store VFDs * Disables the onion VFD tests w/ ph5diff * Disables non-sec2 VFDs as onion VFD backing stores * Committing clang-format changes * Formatted source * Typo * Adds onion VFD tools tests to CMake * Fixes for v16 API compatibility * Memset structs to avoid bad frees on errors * H5Dwrite() calls now use H5T_NATIVE_INT as the memory type vs LE * Properly decodes checksums on BE machines * Be more careful about uint64_t to haddr_t/hsize_t conversions * Another fix for BE data comparison * Removed double underscores from onion constants * Replace hard-coded onion header string w/ constant * Fixes cleanup paths in H5FD__onion_ingest_history() * Fixed use of size_t revision numbers * Fix h5dump revision count format string Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Removes the Win32 macro for strdup (#1960)Dana Robinson2022-08-011-1/+0
| | | | Windows has strdup() so there's no need for this. We already ignore all the other "underscore" string functions.
* Removes Windows getlogin() equivalents (#1958)Dana Robinson2022-08-013-21/+0
| | | This function is no longer used in the library
* Removes (void *) cast from memset on Windows (#1957)Dana Robinson2022-08-011-1/+0
| | | | The comments claim this fixes an MSVC warning. Let's see if that's still true.