summaryrefslogtreecommitdiffstats
path: root/test/cross_read.c
diff options
context:
space:
mode:
authorNeil Fortner <fortnern@gmail.com>2022-03-29 03:34:18 (GMT)
committerGitHub <noreply@github.com>2022-03-29 03:34:18 (GMT)
commit0d3182c7da6bdcd896cbc311b36ee762cf38d37a (patch)
tree977cca26f3e1a763499a92eaf57e17eb5c53d3e7 /test/cross_read.c
parent80f9af144c117becacd7a1e9fe6af4ca31ab31c1 (diff)
downloadhdf5-0d3182c7da6bdcd896cbc311b36ee762cf38d37a.zip
hdf5-0d3182c7da6bdcd896cbc311b36ee762cf38d37a.tar.gz
hdf5-0d3182c7da6bdcd896cbc311b36ee762cf38d37a.tar.bz2
Fix bugs in test/vfd.c (#1538)
* Added support for vector I/O calls to the VFD layer, and associated test code. Note that this includes the optimization to allow shortened sizes and types arrays to allow more space efficient representations of vectors in which all entries are of the same size and/or type. See the Selection I/o RFC for further details. Tested serial and parallel, debug and production on Charis. serial and parallel debug only on Jelly. * ran code formatter quick serial build and test on jelly * Add H5FD_read_selection() and H5FD_write_selection(). Currently only translate to scalar calls. Fix const buf in H5FD_write_vector(). * Format source * Fix comments * Added vector read / write support to the MPIO VFD, with associated test code (see testpar/t_vfd.c). Note that this implementation does NOT support vector entries of size greater than 2 GB. This must be repaired before release, but it should be good enough for correctness testing. As MPIO requires vector I/O requests to be sorted in increasing address order, also added a vector sort utility in H5FDint.c This function is tested in passing by the MPIO vector I/O extension. In passing, repaired a bug in size / type vector extension management in H5FD_read/write_vector() Tested parallel debug and production on charis and Jelly. * Ran source code formatter * Minor optimization to vector I/O request sort routine. Tested parallel / debug on Jelly. * Add selection I/O to chunk code, used when: not using chunk cache, no datatype conversion, no I/O filters, no page buffer, not using collective I/O. Requires global variable H5_use_selection_io_g be set to TRUE. Implemented selection to vector I/O transaltion at the file driver layer. * Fix formatting unrelated to previous change to stop github from complaining. * Add full API support for selection I/O. Add tests for this. * Added "ctl" callback to the VFD interfance, and the associated H5FDctl() and H5FD_ctl() calls. Modified the MPIO VFD accordingly -- specifically: Added ctl() call with op-code support to expose rank, size, and communicator. Modified H5FD_mpi_get_rank(), H5FD_mpi_get_size(), and H5FD_mpi_get_comm() to use the new ctl() callback. In passing removed the const qualifier from the file parameter of these functions, as the file parameter of the ctl callback is not const. Deleted the old H5FD__mpio_mpi_rank(), H5FD__mpio_mpi_size(), and H5FD__mpio_communicator() calls from the MPIO VFD. Deleted H5FD_class_mpi_t from H5FDprivate.h, and modified the MPIO VFD accordingly. Note that all VFDs now use H5FD_class_t, with no special class for VFDs that that support MPI. Some minor touch ups to the Neil's selection I/O mods in passing. Tested serial and parallel, debug and production on charis and jelly. * Implement selection I/O for contiguous datasets. Fix bug in selection I/O translation. Add const qualifiers to some internal selection I/O routines to maintain const-correctness while avoiding memcpys. * Add support for independent parallel I/O with selection I/O. Add HDF5_USE_SELECTION_IO env var to control selection I/O (default off). * Implement parallel collective support for selection I/O. * Fix comments and run formatter. * Committing clang-format changes * Run formatter * Update selection IO branch with develop (#1215) Merged branch 'develop' into selection_io * Sync with develop (#1262) Updated the branch with develop changes. * Committing clang-format changes * fixed spelling (#1353) * Implement big I/O support for vector I/O requests in the MPIO file driver. * Committing clang-format changes * Update dummy file driver in h5test.c to match new struct. * Fix another outdated H5FD_class_t struct. * Free arrays in H5FD__mpio_read/write_vector() as soon as they're not needed, to cut down on memory usage during I/O. * Committing clang-format changes * Address comments from code review. Fix const warnings with H5S_SEL_ITER_INIT(). * Committing clang-format changes * Fix warnings in selection I/O code * Refactor H5FD__mpio_read/write_vector() to bring common code for constructing MPI Datatype into a shared function. * Committing clang-format changes * Fix bugs in selection I/O code. * Fix bugs in selection I/O code * Address comments from review. Add "version" field to H5FD_class_t struct and accompanying H5FD_CLASS_VERSION macro. * Committing clang-format changes * Committing clang-format changes * Address comments from selection I/O PR * Committing clang-format changes * Fix spelling * Fix bugs int test/vfd.c Co-authored-by: mainzer <mainzer#hdfgroup.org> Co-authored-by: jrmainzer <72230804+jrmainzer@users.noreply.github.com> Co-authored-by: github-actions <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Scot Breitenfeld <brtnfld@hdfgroup.org>
Diffstat (limited to 'test/cross_read.c')
0 files changed, 0 insertions, 0 deletions