summaryrefslogtreecommitdiffstats
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'new_vds_feature_vfd_swmr' of ↵vchoi2022-04-217-92/+93
|\ | | | | | | https://github.com/vchoi-hdfgroup/hdf5 into new_vds_feature_vfd_swmr
| * Committing clang-format changesgithub-actions2022-04-217-98/+99
| |
* | 1) Fix spelling errorsvchoi2022-04-212-12/+12
|/ | | | 2) Fix couple routine names due to FUNC_ENTER_PACKAGE.
* Modifications to:vchoi2022-04-2115-99/+505
| | | | | | | | | | | | A) Allow automatic generation of metadata file names for VDS support B) Allow VFD SWMR reader to open an existing HDF5 file either before the VFD SWMR writer has opened it or after it has closed. C) Remove the usage of H5P_FILE_ACCESS_ANY_VFD. D) Add H5FD_FEAT_SUPPORTS_VFD_SWMR feature flag. E) Do not map H5FD_MEM_GHEAP to H5FD_MEM_DRAW when vfd swmr IS enabled; map H5FD_MEM_GHEAP to H5FD_MEM_DRAW when vfd swmr is NOT enabled. For details regarding #A and #B above, see version 9 of the RFC.
* VFD SWMR: Merges from develop (#1670)Dana Robinson2022-04-21267-2463/+2356
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Cleans up SWMR test scripts (both legacy and VFD) * Brings over format source changes for Java * Normalization of HL, Fortran, C++, Java w/ develop * Removes the STATIC flavor of FUNC_ENTER macros (#1622) * Removes the STATIC flavor of FUNC_ENTER macros * Remove H5_NO_ALIGNMENT_RESTRICTIONS (#1426) * Do not conditionally compile code that uses a pointer dereference and assignment to copy a potentially unaligned variable to aligned automatic storage, or vice versa. Instead, always use naked `memcpy(3)`s. Disassembling the generated code reveals that the `memcpy(3)`s optimize (`-O3`) to a single `mov` instruction for x86_64, which is not strict about alignment. This change reduces the size of code and scripts by 143 lines, eases our way to cross-compilation, and avoids invoking undefined behavior. * Committing clang-format changes * Per discussion, use HD and add comments. Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> * Removes unused definitions from module headers (#1624) * Misc stuff from develop (includes some parallel things) * Brings over SWMR test quiet mode changes from develop Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* VFD SWMR: Normalization with develop and cleanup (#1559)Dana Robinson2022-03-3125-1934/+73
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Brought over plugin and test script changes * Removes remaining register keywords (#1481) * Fixed warnings in the aux process code * Minor fixes from develop * Minor changes from develop, fixed format warnings * Formatted source * Added HD prefix to timespec_get * Cleanup in new files * Removes the MANIFEST file and unused release files (#1497) * Removes the MANIFEST file and unused release files * Updated tar command * checkposix corrections * More checkposix fixes * Ripped out unused instrumentation functionality * Brought over cache tagging changes from develop * Changes to tagged metadata expulsion iteration * Fixed typo * Brought over H5O__free() changes from develop * Brings (unused) parallel page buffer test in line with develop * Moved the functionality in supervise.subr to test_vfd_swmr.sh * Tools VFD parameter updates * Committing clang-format changes * H5F VFD SWMR refactoring * Committing clang-format changes * Misc changes * Acceptance test cleanup * HD prefix * H5_get_option instead of getopt * Some bool fixes * Changes to VFD SWMR acceptance tests * Minor cleanup * Use AC_MSG_RESULT/AC_MSG_ERROR/AC_MSG_WARN instead of echo (#1532) * Merges from develop Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* VFD SWMR: Normalization with develop (#1506)Dana Robinson2022-03-2346-1518/+1131
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Brought over plugin and test script changes * Removes remaining register keywords (#1481) * Fixed warnings in the aux process code * Minor fixes from develop * Minor changes from develop, fixed format warnings * Formatted source * Added HD prefix to timespec_get * Cleanup in new files * Removes the MANIFEST file and unused release files (#1497) * Removes the MANIFEST file and unused release files * Updated tar command * checkposix corrections * More checkposix fixes * Ripped out unused instrumentation functionality * Brought over cache tagging changes from develop * Changes to tagged metadata expulsion iteration * Fixed typo * Brought over H5O__free() changes from develop * Brings (unused) parallel page buffer test in line with develop * Moved the functionality in supervise.subr to test_vfd_swmr.sh * Tools VFD parameter updates * Committing clang-format changes * H5F VFD SWMR refactoring * Committing clang-format changes * Misc changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* VFD SWMR: normalization with develop (#1472)Dana Robinson2022-03-06244-5765/+11443
| | | Much normalization with develop. Still needs tools changes wrt VFD plugins.
* VFD SWMR: Aux process changes (#1451)Dana Robinson2022-02-1811-11/+0
| | | | | | | | | | | * Removed the aux process submodule * Directly added aux process files after submodule delete * Updated Akadio copyright on appropriate files * Committing clang-format changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Updated VFD SWMR's Akadio licenseDana Robinson2022-02-1711-21/+37
|
* Committing clang-format changesgithub-actions2022-01-041-9/+8
|
* Merge branch 'group_tests_issues' of https://github.com/vchoi-hdfgroup/hdf5 ↵vchoi2022-01-042-7/+7
|\ | | | | | | into group_tests_issues
| * Committing clang-format changesgithub-actions2021-12-212-7/+7
| |
* | (A) Address issue #2 and issue #4 of the group test failures.vchoi2022-01-043-6/+56
|/ | | | | | | | | | | | | | | | | | | | See Kent's documentation "Designed to Fail Tests and Issues". (a) Fix for issue #2: --Print out meaningful message about max_lag when there is checksum error in loading an entry via H5C__load_entry(). --H5C.c: H5C_protect() (b) Fix for issue #4: --Allocate more space when the copy of the index read from the metadata file is bigger than the existing size --H5Fvfd_swmr.c: H5F_vfd_swmr_reader_end_of_tick() (B) When putting the old index into the delayed free list, use the old writer_index_offset instead of the current writer_index_offset --H5Fvfd_swmr.c: vfd_swmr_enlarge_shadow_index() (C) When there is error form calling H5F_vfd_swmr_process_eot_queue() in VFD_SWMR_ENTER(err) and VFD_SWMR_LEAVE(err), should report FAIL instead of "err" --H5private.h: VFD_SWMR_ENTER and VFD_SWMR_LEAVE macros (D) Add tests to verify issue #2 and issue #4 are fixed.
* Address issue #1 and issue #3 of the group test failures.vchoi2021-12-213-1/+56
| | | | | | | | See Kent's documentation "Designed to Fail Tests and Issues". (A) Fix for issue #1: HDassert the < and = cases between old and new entry length. John will take care of the > case. (B) Fix for issue #3: set the cache copy of page_size again if different from f->shared->fs_page_size.
* Fix the failure triggered by running the bigset test with 2D dataset that ↵vchoi2021-12-141-10/+12
| | | | | | | expands for more than 200 times. It is due to the indexing error for the metadata file index and the change list array.
* VFD SWMR: Normalization with develop (#1270)Dana Robinson2021-12-0835-890/+591
| | | Brings many October-November changes from develop
* Clang format changes.vchoi2021-12-071-1/+1
|
* Changes to address feedback from PR review.vchoi2021-12-072-7/+9
|
* Committing clang-format changesgithub-actions2021-11-177-306/+308
|
* 1) Core changes for adding NFS/updater support as described in the RFC.vchoi2021-11-1711-127/+902
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | src/H5Pfapl.c src/H5Fvfd_swmr.c src/H5Fpublic.h src/H5Fpkg.h src/H5Fprivate.h 2) For VFD SWMR testing, add private property for checksum generation of metadata files: src/H5Fint.c src/H5Fvfd_swmr.c src/H5Pfapl.c src/H5Fpkg.h src/H5Fprivate.h 3) Fix the following in H5F_vfd_swmr_init() and H5F_vfd_swmr_close_or_flush(): (a) Allocate metadata file index right after metadata file header. (b) Set tick number to 0 when creating header and index for file open case. (c) Remove tick number increment at file close. src/H5Fvfd_swmr.c src/H5Ftest.c 4) To be consistent with the RFC, change the name for field "chksum" to "checksum" in struct H5FD_vfd_swmr_idx_entry_t: src/H5FDprivate.h src/H5FDtest.c src/H5FDvfd_swmr.c src/H5Ftest.c src/H5PB.c 4) Add tests for NFS/updater test/vfd_swmr.c 5) Modify common routine init_vfd_swmr_config() to accept updater_file_path test/vfd_swmr_common.c test/vfd_swmr_common.h 6) Changes to the tests due to the common routine init_vfd_swmr_config(): test/vfd_swmr_addrem_writer.c test/vfd_swmr_attrdset_writer.c test/vfd_swmr_bigset_writer.c test/vfd_swmr_dsetchks_writer.c test/vfd_swmr_dsetops_writer.c test/vfd_swmr_generator.c test/vfd_swmr_gfail_writer.c test/vfd_swmr_gperf_writer.c test/vfd_swmr_group_writer.c test/vfd_swmr_reader.c test/vfd_swmr_remove_reader.c test/vfd_swmr_remove_writer.c test/vfd_swmr_sparse_reader.c test/vfd_swmr_sparse_writer.c test/vfd_swmr_vlstr_reader.c test/vfd_swmr_vlstr_writer.c test/vfd_swmr_writer.c test/page_buffer.c
* Committing clang-format changesgithub-actions2021-11-021-5/+5
|
* Make entry log code as a #define macro as John suggests.myang62021-11-023-4/+13
|
* Committing clang-format changesgithub-actions2021-11-023-9/+7
|
* 1. Close the log file when the file closing flag is true in ↵myang62021-11-024-38/+44
| | | | | | | | H5F_vfd_swmr_close_or_flush(). 2. Move the log test to the group performance test code with an option. 3. Use constant variables for log message lengths. 4. Misc. clean-up.
* Committing clang-format changesgithub-actions2021-10-291-1/+1
|
* Update comments to use the HDF5 timer for the log feature.myang62021-10-293-12/+9
|
* Committing clang-format changesgithub-actions2021-10-293-23/+23
|
* Use HDF5 timer functionmyang62021-10-293-26/+18
|
* Committing clang-format changesgithub-actions2021-10-281-3/+3
|
* Add macros to make windows ignore the HDgetclock_time().myang62021-10-282-0/+14
|
* Revise a comment to trigger another github checkmyang62021-10-281-2/+2
|
* Committing clang-format changesgithub-actions2021-10-282-8/+8
|
* Modify comments.Muqun Yang2021-10-283-10/+19
|
* Committing clang-format changesgithub-actions2021-10-272-37/+36
|
* Add comments, descriptions for the VFD log feature.myang62021-10-274-77/+127
|
* Committing clang-format changesgithub-actions2021-10-251-1/+0
|
* Remove the compiler warnings.Muqun Yang2021-10-253-1/+28
|
* Committing clang-format changesgithub-actions2021-10-253-3/+3
|
* Update comments, formats etc.myang62021-10-254-36/+36
|
* Committing clang-format changesgithub-actions2021-10-254-15/+13
|
* add macro, need to debug an error caused by using the macromyang62021-10-254-16/+34
|
* Still need to support the NULL pointer in the log report function.myang62021-10-201-0/+4
|
* Committing clang-format changesgithub-actions2021-10-181-1/+1
|
* Merge branch 'vfd_swmr_log' of https://github.com/kyang2014/hdf5 into ↵Muqun Yang2021-10-181-1/+1
|\ | | | | | | vfd_swmr_log
| * Committing clang-format changesgithub-actions2021-10-181-1/+1
| |
* | Revise the H5Fopen log test.Muqun Yang2021-10-182-3/+5
|/
* Merge branch 'vfd_swmr_log' of https://github.com/kyang2014/hdf5 into ↵myang62021-10-184-36/+33
|\ | | | | | | vfd_swmr_log
| * Committing clang-format changesgithub-actions2021-10-184-35/+32
| |
* | Make sure to check the file point.myang62021-10-181-0/+2
|/