summaryrefslogtreecommitdiffstats
path: root/test/vfd_swmr_bigset_writer.c
Commit message (Collapse)AuthorAgeFilesLines
* Updated VFD SWMR's Akadio licenseDana Robinson2022-02-171-0/+1
|
* Committing clang-format changesgithub-actions2022-01-041-11/+12
|
* Rearragned how the auxiliary process is tested: let the test script launch ↵Ray Lu2022-01-041-29/+16
| | | | it if the --enable-aux-process option is enabled during configure.
* Added the option to run the auxiliary process ('-A'). For now, it's enabled ↵Ray Lu2021-12-171-3/+146
| | | | by hand for testing.
* Committing clang-format changesgithub-actions2021-11-171-1/+2
|
* 1) Core changes for adding NFS/updater support as described in the RFC.vchoi2021-11-171-3/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | src/H5Pfapl.c src/H5Fvfd_swmr.c src/H5Fpublic.h src/H5Fpkg.h src/H5Fprivate.h 2) For VFD SWMR testing, add private property for checksum generation of metadata files: src/H5Fint.c src/H5Fvfd_swmr.c src/H5Pfapl.c src/H5Fpkg.h src/H5Fprivate.h 3) Fix the following in H5F_vfd_swmr_init() and H5F_vfd_swmr_close_or_flush(): (a) Allocate metadata file index right after metadata file header. (b) Set tick number to 0 when creating header and index for file open case. (c) Remove tick number increment at file close. src/H5Fvfd_swmr.c src/H5Ftest.c 4) To be consistent with the RFC, change the name for field "chksum" to "checksum" in struct H5FD_vfd_swmr_idx_entry_t: src/H5FDprivate.h src/H5FDtest.c src/H5FDvfd_swmr.c src/H5Ftest.c src/H5PB.c 4) Add tests for NFS/updater test/vfd_swmr.c 5) Modify common routine init_vfd_swmr_config() to accept updater_file_path test/vfd_swmr_common.c test/vfd_swmr_common.h 6) Changes to the tests due to the common routine init_vfd_swmr_config(): test/vfd_swmr_addrem_writer.c test/vfd_swmr_attrdset_writer.c test/vfd_swmr_bigset_writer.c test/vfd_swmr_dsetchks_writer.c test/vfd_swmr_dsetops_writer.c test/vfd_swmr_generator.c test/vfd_swmr_gfail_writer.c test/vfd_swmr_gperf_writer.c test/vfd_swmr_group_writer.c test/vfd_swmr_reader.c test/vfd_swmr_remove_reader.c test/vfd_swmr_remove_writer.c test/vfd_swmr_sparse_reader.c test/vfd_swmr_sparse_writer.c test/vfd_swmr_vlstr_reader.c test/vfd_swmr_vlstr_writer.c test/vfd_swmr_writer.c test/page_buffer.c
* Committing clang-format changesgithub-actions2021-11-011-14/+20
|
* Two purposes for this PR:Songyu Lu2021-11-011-24/+42
| | | | | 1. added an option to enable the legacy SWMR in vfd_swmr_bigset_writer.c. 2. adjusted the options for big set test to make sure it passes the exhaustive test in testvfdswmr.sh.in.
* Committing clang-format changesgithub-actions2021-09-141-15/+21
|
* Changed fprintf to HDfprintf and also printed out the write speed for ↵Songyu Lu2021-09-141-193/+207
| | | | performance information.
* Committing clang-format changesgithub-actions2021-09-131-7/+7
|
* Some minor changes and more comments.Songyu Lu2021-09-131-16/+39
|
* Add a function call to allocate space early during H5Dcreate and H5Dextend.Songyu Lu2021-09-031-8/+14
|
* Committing clang-format changesgithub-actions2021-09-011-91/+121
|
* Some important updates to the test: added test for 3D datasets and several ↵Songyu Lu2021-09-011-198/+468
| | | | new command-line options.
* Merge branch 'feature/vfd_swmr' of https://github.com/raylu-hdf/hdf5 into ↵Songyu Lu2021-08-271-0/+5
|\ | | | | | | raylu_bigset_test
| * Modifications as indicated by valgrind --tool=memcheck for the following files:vchoi2021-08-171-4/+9
| | | | | | | | | | | | | | | | | | | | | | (1) test/vfd_swmr_attrdset_writer.c Free memory for variable length string + cleanup (2) test/vfd_swmr_bigset_writer.c Free memory for s.dataset and s.sources (3) test/vfd_swmr_vlstr_reader.c Free memory for content[] Also fix a bug in test/testvfdswmr.sh.in so that os_groups_seg test will only be executed when specified.
| * (1)vchoi2021-08-101-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | src/H5Fvfd_swmr.c --enable or disable raw data flush depending on configuration (2) vfd_swmr_dsetchks_writer.c vfd_swmr_dsetops_writer.c --modifications to test/verify when flushing of raw data is enabled/disabled --refactor coding (3) testvfdswmr.sh.in --add testing with/without flush of raw data to tests: dsetchks and dsetops (4) vfd_swmr_attrdset_writer.c --pass true for flushing raw data to the common routine init_vfd_swmr_config() --refactor coding so that it has similar format as the other two tests: dsetops and dsetchks (5) vfd_swmr_addrem_writer.c vfd_swmr_bigset_writer.c vfd_swmr_generator.c vfd_swmr_group_writer.c vfd_swmr_reader.c vfd_swmr_remove_reader.c vfd_swmr_remove_writer.c vfd_swmr_sparse_reader.c vfd_swmr_sparse_writer.c vfd_swmr_vlstr_reader.c vfd_swmr_vlstr_writer.c vfd_swmr_writer.c vfd_swmr_zoo_writer.c --pass true for flushing raw data to the common routine init_vfd_swmr_config()
* | Minor change: move the end tick function to just before the file is closed.Songyu Lu2021-07-151-11/+11
| |
* | Merge branch 'feature/vfd_swmr' of https://github.com/raylu-hdf/hdf5 into ↵Songyu Lu2021-07-141-14/+8
|\ \ | |/ | | | | raylu_bigset_test
| * Modifications to common routines used by VFD SWMR tests:vchoi2021-07-131-7/+4
| | | | | | | | | | | | (1) Add a parameter page_buf_size to the common routine vfd_swmr_create_fapl(). (2) Add a new common routine vfd_swmr_create_fcpl() to set the file space strategy and file space page size. VFD SWMR tests are modified accordingly to call the above routines.
* | Committing clang-format changesgithub-actions2021-07-081-166/+230
| |
* | 1. Added the test for 3D datasets;Songyu Lu2021-07-081-295/+518
| | | | | | | | 2. Added performance measurement.
* | Committing clang-format changesgithub-actions2021-06-071-105/+144
| |
* | Some simple format changes.Songyu Lu2021-06-071-55/+53
| |
* | Some changes to the big set test:Songyu Lu2021-06-031-419/+1205
|/ | | | | | 1. changed the signal handling to named pipes for communication between the writer and reader; 2. the writer writes as many chunks within a tick then notify the reader to verify the data; 3. some refactoring work.
* Fixed 1.6 compatibility issues and ran source formatterDana Robinson2021-03-261-1/+1
|
* Updates license url and history docsDana Robinson2021-03-251-12/+11
|
* Formats the source and updates the gcc warning pragmasDana Robinson2021-03-251-410/+343
|
* Excludes VFD SWMR acceptance tests on WindowsDana Robinson2021-03-101-3/+16
| | | | Via #ifdefs, not build system
* Replaces basename and dirname with code that will work everywhereDana Robinson2021-03-091-1/+2
|
* Makes libgen.h functions ready for implementation on WindowsDana Robinson2021-03-021-2/+1
|
* Removed most C library include lines from testsDana Robinson2021-03-021-2/+0
|
* Corrected a typo in the comment.songyulu2021-02-151-1/+1
|
* Added some comments.songyulu2021-02-121-1/+4
|
* Adding the test case for fixed-array chunked dataset and VDS.songyulu2021-02-121-4/+24
|
* (1) Add new routine to configure for VFD SWMR: init_vfd_swmr_config()vchoi2021-02-021-2/+6
| | | | | | (2) Revise routine to setup fapl for VFD SWMR legacy and other integration tests: vfd_swmr_create_fapl() (3) Update all VFD SWMR integration tests to use the above two routines (4) Clean up VFD SWMR legacy tests: turn on compression in test script, remove #ifdef OUT H5Fflush(), message file name
* Move below_speed_limit() from vfd_swmr_bigset_writer.c toDavid Young2020-09-171-24/+0
| | | | vfd_swmr_common.c, document it, and fix a bug.
* Rewrap lines.David Young2020-09-031-25/+27
|
* Individually track the steps verified on each dataset. Take careDavid Young2020-09-031-5/+19
| | | | not to skip a step.
* Give an overview of the bigsets test in a mega-comment at the top. Also,David Young2020-09-031-1/+79
| | | | | describe the test pattern. And while I'm here, repair a comment, s/writer/reader/.
* Call the shadow files bigset-shadow-<number> for some <number>,David Young2020-08-211-1/+1
| | | | to avoid unlikely shadow-file clashes.
* Sleep 1/10s between H5Dopen() tries. Make a couple of warning/error messagesDavid Young2020-08-181-2/+6
| | | | more clear/correct.
* Perform the dataset opens in reverse order to their creation, and ifDavid Young2020-08-181-5/+49
| | | | | | | | | | | | H5Dopen fails, rapidly retry up to 9,999 times. Log H5Dopen failures, but log no more than once every five seconds to avoid spamming the terminal. With these changes, it's easier for the reader to open the last dataset before the writer created it, but the reader recovers instead of quitting with an error. It should only be necessary to retry opening the *last* dataset; all previous datasets should open on one try if the last is open.
* Add to the "bigset" writer a `-M` command-line option that enables the use ofDavid Young2020-07-211-70/+110
| | | | | | | multiple files with virtual datasets. Add to vfd_swmr_create_fapl() printf(3)-like arguments for setting the shadow filename. Update all callers.
* Fix a copy-pasto in an error message.David Young2020-07-101-1/+1
|
* Move the dapl initialization to state_init and, if VDS is enabled,David Young2020-07-101-7/+10
| | | | set the virtual view to "first missing."
* Fix a bug where I was trying to store `ndatasets * 4` source-datasetDavid Young2020-07-071-93/+155
| | | | | handles in 4 variables and, of course, failing. Refactor the dataspace/dataset initialization.
* Use native byte order unless big-endian is specified with `-b` option.David Young2020-07-021-12/+19
|
* Add a VDS mode to the bigset test.David Young2020-06-301-7/+197
|
generated by cgit v0.12 at 2024-09-02 09:53:40 (GMT)