summaryrefslogtreecommitdiffstats
path: root/src/H5Pfapl.c
Commit message (Collapse)AuthorAgeFilesLines
* VFD SWMR: Normalization with develop (#1270)Dana Robinson2021-12-081-5/+3
| | | Brings many October-November changes from develop
* Committing clang-format changesgithub-actions2021-11-171-13/+13
|
* 1) Core changes for adding NFS/updater support as described in the RFC.vchoi2021-11-171-7/+55
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | src/H5Pfapl.c src/H5Fvfd_swmr.c src/H5Fpublic.h src/H5Fpkg.h src/H5Fprivate.h 2) For VFD SWMR testing, add private property for checksum generation of metadata files: src/H5Fint.c src/H5Fvfd_swmr.c src/H5Pfapl.c src/H5Fpkg.h src/H5Fprivate.h 3) Fix the following in H5F_vfd_swmr_init() and H5F_vfd_swmr_close_or_flush(): (a) Allocate metadata file index right after metadata file header. (b) Set tick number to 0 when creating header and index for file open case. (c) Remove tick number increment at file close. src/H5Fvfd_swmr.c src/H5Ftest.c 4) To be consistent with the RFC, change the name for field "chksum" to "checksum" in struct H5FD_vfd_swmr_idx_entry_t: src/H5FDprivate.h src/H5FDtest.c src/H5FDvfd_swmr.c src/H5Ftest.c src/H5PB.c 4) Add tests for NFS/updater test/vfd_swmr.c 5) Modify common routine init_vfd_swmr_config() to accept updater_file_path test/vfd_swmr_common.c test/vfd_swmr_common.h 6) Changes to the tests due to the common routine init_vfd_swmr_config(): test/vfd_swmr_addrem_writer.c test/vfd_swmr_attrdset_writer.c test/vfd_swmr_bigset_writer.c test/vfd_swmr_dsetchks_writer.c test/vfd_swmr_dsetops_writer.c test/vfd_swmr_generator.c test/vfd_swmr_gfail_writer.c test/vfd_swmr_gperf_writer.c test/vfd_swmr_group_writer.c test/vfd_swmr_reader.c test/vfd_swmr_remove_reader.c test/vfd_swmr_remove_writer.c test/vfd_swmr_sparse_reader.c test/vfd_swmr_sparse_writer.c test/vfd_swmr_vlstr_reader.c test/vfd_swmr_vlstr_writer.c test/vfd_swmr_writer.c test/page_buffer.c
* Committing clang-format changesgithub-actions2021-10-151-1/+1
|
* Test to just write a log file for H5Fopen. Add a testing routine ↵myang62021-10-151-0/+4
| | | | vfd_swmr_log_writer.c.
* VFD SWMR: Normalization with develop (#1078)Dana Robinson2021-10-061-0/+58
| | | Brings many changes from develop, particularly VOL changes for async
* Much normalization with develop (#701)Dana Robinson2021-05-281-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Brings CMake updates from develop * Brings reduction in pedantic casts from develop * Purges UFAIL from the library (#637) * Committing clang-format changes * Purges UFAIL from the library * H5HL_insert change requested in PR Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> * Removes gratuitous (double)x.yF casts (#632) * Committing clang-format changes * Removes gratuitous (double)x.yF casts * Committing clang-format changes Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> * Committing clang-format changes * Cleans up a const warning left over from previous constification (#633) * Committing clang-format changes * Adds consts to a few global variables * Cleans up a const warning left over from previous constification Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> * Formatted source * Bring over some VOL registration changes * VOL cleanup * H5VL_request_status_t substitutions * H5F.c cleanup * Minor API tweaks from develop * Moves H5G package init/teardown to H5Gint.c * H5G cleanup * H5M cleanup * H5SM cleanup * H5T cleanup * H5R cleanup * H5Lpublic.h cleanup * H5L cleanup * H5O cleanup * H5A, H5CS, and H5AC cleanup * Moved H5A init/teardown code to H5Aint.c * Moves H5D I/O functions to H5D.c * H5D cleanup * Misc minor cleanup * H5P close cleanup * H5Tpublic.h cleanup * Fixes err_compat test * H5PLpublic.h cleanup * Updates H5Ppublic.h * H5Fpublic.h updates * H5A.c cleanup * Brings over H5Aexists and related changes * Brings CMake shell testing changes from develop * Close callback changes * H5R and H5Tcommit normalization * err_compat test works now * H5O tweaks * Updates VOL registration code * Brings over H5VL_create_object * H5Tconv.c reformatting * H5T.c tweaks * Brings datatype and reference updates from develop * Brings VOL plugin loading changes from develop * Brings event sets from develop * Brings async functions over * Tools changes * Brings over many tools changes from develop * Brings VOL flags from develop * Fixes h5dump double/float tests * Updates h5repack tests * Brings h5diff test changes from develop * Last h5dump changes * Brings test changes from develop * Committing clang-format changes * Tidied h5_testing() * Brings chunk iteration code + misc from develop * Updates vds test * Enables external link parallel test * Brings updated property lists from develop * H5G changes from develop * H5MF cleanup * Brings vfd_swmr test back into CMake * Updates threadsafe test * Updates plist test * Brings recent changes from develop Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com>
* Brings atom-->ID and other ID-related changes from developDana Robinson2021-05-051-48/+48
|
* Brings more develop code over, especially DoxygenDana Robinson2021-05-031-8/+3
|
* Brings many parallel changes from developDana Robinson2021-04-071-163/+110
|
* Brings trace changes from developDana Robinson2021-04-061-16/+13
|
* Brings file locking changes from developDana Robinson2021-03-251-8/+130
|
* Updates license url and history docsDana Robinson2021-03-251-1/+1
|
* Formats the source and updates the gcc warning pragmasDana Robinson2021-03-251-1294/+1337
|
* Use the DECODE macro with the correct signedness for the variable.David Young2020-08-311-4/+4
|
* Change H5F_open to perform deduplication of open VFDs in a more flexible way,David Young2020-07-301-0/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | using the new routine H5FDdeduplicate(). Simplify H5F_open() a bit, pushing some of the configuration checks into the SMWR VFD. For example, check that page buffering is enabled in H5FD_vfd_swmr_open() instead of in H5F_open(). Compare VFD SWMR configurations in H5FD_vfd_swmr_dedup() instead of in H5F_open(). Clone the default file-access property list at a new file-access property list ID, H5P_FILE_ACCESS_ANY_VFD. The new ID is used to indicate that if the file that's being opened is already open under an existing virtual file, and if that virtual file would not ordinarily be opened with the default FAPL, then it's ok to use that virtual file. Add a new optional method, `dedup`, to H5FD_class_t, and use it to customize a VFD's deduplication. Customize the SWMR VFD's deduplication. Make it honor H5P_FILE_ACCESS_ANY_VFD Embed the VFD SWMR configuration in the H5FD_vfd_swmr_t to facilitate comparison of configuration between new and old SWMR virtual files. In H5F__sfile_search(), match using a pointer comparison instead of H5FD_cmp(), because we will only ever enter H5F__sfile_search() with a deduplicated H5FD_t *.
* Don't check an unsigned integer for being negative. Quiets a GCC warning.David Young2020-07-141-1/+1
|
* Make a VFD SWMR writer use the SWMR VFD, to facilitate avoiding conflictingDavid Young2020-07-101-5/+2
| | | | | | multiple opens of the same file with VFD SWMR---i.e., twice for writing, or for reading and for writing. In the long run, this will help me encapsulate more of the SWMR functionality in the VFD, too.
* Repair a bunch of H5_ATTR_SANITY_CHECK uses that should have beenDavid Young2020-05-201-2/+1
| | | | | H5_ATTR_NDEBUG_UNUSED. This really makes me wonder what else I have screwed up in this merge....
* Trim trailing whitespaceQuincey Koziol2020-05-201-1/+1
|
* H5_HAVE_PARALLEL, _DEBUG_API, etc. Add attributes to some variables andDavid Young2020-05-201-1/+2
| | | | parameters that are unused under some configurations.
* Updated the 'const memory free' changes based on PR feedback.Dana Robinson2020-05-201-17/+4
|
* Added a free wrapper that lets us free constant pointers withoutDana Robinson2020-05-201-7/+10
| | | | | | | generating warnings. Also, brought the const-ness of the VOL connector info in line with the VFD info (not visible externally).
* fix unused related warningskmu2020-05-201-4/+4
|
* Numerous changes supporting a floating shadow index:David Young2020-02-031-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | Add to the H5F_shared_t (!) a new member that tells the index in the shadow file where the index should be written. Allocate shadow filespace for the header and the index separately so that the index can float. Update tests to match the expected original location of the index. Introduce vfd_swmr_enlarge_shadow_index(), a routine that allocates space in the shadow file for a new index that has (up to) twice as many entries as the old index, allocates a new in-core index of the same size, and copies the old in-core index to the new. Call vfd_swmr_enlarge_shadow_index() in H5PB_vfd_swmr__update_index() when the in-core index has too few slots. In the comment at the top of H5FD__vfd_swmr_load_hdr_and_idx(), describe the protocol that it follows, now, when it reads the shadow header and index. Delete some dead code in the function and add a bit of diagnostic code. TBD quiet the diagnostic code. In H5F_vfd_swmr_init(), follow the protocol: write the index, first, then the header. Modify property-list checks and tests to reserve no fewer than two pages at the front of the shadow file for the header and index.
* Merge all of my changes from merge-back-to-feature-vfd_swmr-attempt-1,David Young2019-12-091-142/+1021
| | | | | | | | including the merge of `hdffv/hdf5/develop`, back to the branch that Vailin and I share. Now I need to put this branch on a fork with a less confusing name than vchoi_fork!
* Modifications for the following items in the punch list:Vailin Choi2019-11-141-4/+10
| | | | | | | | | (A) #5: Add the "pb_expansion_threshold" field to the "H5F_vfd_swmr_config_t" structure and update H5Pset_vfd_swmr_config() and H5Pget_vfd_swmr_config() accordingly (B) #13 bullet 2: Comment H5F_vfd_swmr_config_t in H5Fpublic.h properly (copied from John's description in the RFC) (C) Change the field name "vfd_swmr_writer" to "writer" in "struct H5F_vfd_swmr_config_t" (as indicated on page 11 in the RFC) and all references to it
* Good-bye md_open_tries.David Young2019-11-141-5/+0
|
* Use h5_retry_init/_next to retry loading the SWMR shadow file.David Young2019-09-121-0/+5
|
* (1) Fix for accumulator issue #1 as described in John's previous checkinVailin Choi2018-12-021-1/+2
| | | | | | (2) Test files for encoding/decoding property lists (3) Fix test failures for PB statistics in test/page_buffer.c (Will double check with John later about PB statistics collection)
* Third batch of checkin:Vailin Choi2018-09-281-2/+2
| | | | | | | | | | 1) Free space manager for the metadata file 2) Delayed free space release linked list 3) H5F_update_vfd_swmr_metadata_file() 3) VFD SWMR driver: read callback 4) Flushing for VFD SWMR 5) Port one concurrent test from swmr test set 6) Bug fixes and refactoring
* Merge branch 'develop' of ↵Vailin Choi2018-09-261-128/+128
|\ | | | | | | | | | | | | | | | | | | https://bitbucket.hdfgroup.org/scm/~vchoi/my_hdf5_fork into feature/vfd_swmr Conflicts: src/H5AC.c src/H5F.c src/H5Pfapl.c Resolve conflicts for H5AC.c, H5F.c and H5Pfapl.c
| * Normalization with vol_integration (property lists, file drivers,Dana Robinson2018-09-211-129/+129
| | | | | | | | other misc).
* | Second batch of checkin:Vailin Choi2018-09-041-1/+11
| | | | | | | | | | | | | | | | 1) Define driver for the VFD SWMR reader 2) Implement VFD SWMR open callback 3) Implement H5FD_vfd_swmr_get_tick_and_idx() 4) Load and decode metadata file header and index 4) Closing for VFD SWMR
* | Preliminary checkins for implementation done so far:Vailin Choi2018-08-141-0/+213
|/ | | | | | | | | | | | 1) Public routines: H5Pget/set_vfd_swmr_config 2) Public routine: H5Fvfd_swmr_end_tick 3) Initialization when opening a file with VFD SWMR writer 4) Tests in test/vfd_swmr.c for VFD SWMR 5) Fix a bug in src/H5Fint.c: when error is encountered after the root group is created Note the following: --This is WORK IN PROGRESS and will subject to change as implementation goes. --There is test failure form enc_dec_plist.c: I will fix this when changes to the property list are settled. --The branch is updated with the latest from develop as of 8/14/2018
* Fixed HDFFV-10404Binh-Minh Ribler2018-07-131-10/+10
| | | | | | | | | Description: Applied the typo fixes from user's report. The previous pull request couldn't be merged because it was too old, and it was too complicated for me to resolve conflicts. Platform tested: Linux/64 (jelly) - very minor
* Revert "Merge pull request #1116 in HDFFV/hdf5 from ↵hdftest2018-06-241-11/+11
| | | | | | | ~HDFTEST/hdf5_hft:hdf5_1_10 to develop" This reverts commit e9f476dad47ce593f13dacb77b1cc664d1f24e7b, reversing changes made to 2ff00b1b937ebe36ac6ddf590c16a4c27fc0b053.
* Merge pull request #943 in HDFFV/hdf5 from develop to hdf5_1_10Larry Knox2018-03-131-0/+21
|\ | | | | | | | | | | | | | | | | | | | | | | | | * commit '9247388c3d14510341ea3f07847ce2cbb6e44a8e': Rework new tests into one macro Added a "won't fix" RELEASE.txt entry for HDFFV-10356. Fix CMake test names Fixed typo Add release note for HDFFFV-10397. Added a fix for HDFFV-10358. Fixed documentation Description: - Updated the description of copy constructor for clarification. - Removed unnecessary comments. Platforms tested: Linux/64 (jelly) Enhancement to the tool h5clear (HDFFV-10360) Fix for HDFFV-10209 VDS SWMR test failure Free the object header when there are chksum retries.
| * Enhancement to the tool h5clear (HDFFV-10360)Vailin Choi2018-03-121-0/+21
| |
| * HDDFV-10414 correct location of error changeAllen Byrne2018-03-071-91/+91
| |
| * HDFFV-10414 restore Ctl char - do we really need these anymoreAllen Byrne2018-03-051-89/+89
| |
| * HDFFV-10414 change minor error_numberAllen Byrne2018-03-051-101/+101
| |
| * Modifications made based on comments from pull request.Vailin Choi2018-02-071-18/+18
| |
| * Merge branch develop into bugfix/version_boundsVailin Choi2018-01-121-469/+470
| |\
| * \ Merge branch 'develop' into bugfix/version_boundsVailin Choi2017-12-081-15/+13
| |\ \ | | | | | | | | | | | | Merge from develop.
| * | | Initial checkin for library version boundsVailin Choi2017-10-031-33/+145
| | | | | | | | | | | | | | | | Code changes to provide versioning support when adding to the enumerated defines for H5F_libver_t.
* | | | Needs to sync with lib version and Sencode.M. Scot Breitenfeld2018-03-071-121/+234
| | | |
* | | | synced with developM. Scot Breitenfeld2018-01-051-469/+469
|\ \ \ \ | | |_|/ | |/| |
| * | | HDFFV-9724 Corrected files and verified testsAllen Byrne2017-12-281-469/+469
| | | |
| * | | Revert "Merge pull request #826 in HDFFV/hdf5 from ~BYRN/hdf5_adb:develop to ↵lrknox2017-12-221-469/+469
| | | | | | | | | | | | | | | | | | | | | | | | | | | | develop" This reverts commit b1223dd653e65e076af92b2dfe236f3704da81c8, reversing changes made to b25f123f5f5e25c1447a6a02861cb7c7265c12f2.