diff options
| author | jhendersonHDF <jhenderson@hdfgroup.org> | 2023-12-27 22:28:41 (GMT) |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-12-27 22:28:41 (GMT) |
| commit | 6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85 (patch) | |
| tree | c4215cf360c4a3350aa5315939622b982390df53 /release_docs | |
| parent | 695efa94dfcd62c5ef42d03a7f1425c4105819df (diff) | |
| download | hdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.zip hdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.tar.gz hdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.tar.bz2 | |
Implement optimized support for vector I/O in Subfiling VFD (#3896)
Vector I/O requests are now processed within a single
set of I/O call batches, rather than each I/O vector
entry (tuple constructed from the types, addrs, sizes
and bufs arrays) being processed individually. This allows I/O to be
more efficiently parallelized among the I/O concentrator processes
during large I/O requests.
* Fixed some calculations and add test cases for issues spotted from review
* Removed a variable that was compensating for previous miscalculations
Diffstat (limited to 'release_docs')
| -rw-r--r-- | release_docs/RELEASE.txt | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/release_docs/RELEASE.txt b/release_docs/RELEASE.txt index fb2769d..dda3852 100644 --- a/release_docs/RELEASE.txt +++ b/release_docs/RELEASE.txt @@ -278,6 +278,16 @@ New Features Library: -------- + - Implemented optimized support for vector I/O in the Subfiling VFD + + Previously, the Subfiling VFD would handle vector I/O requests by + breaking them down into individual I/O requests, one for each entry + in the I/O vectors provided. This could result in poor I/O performance + for features in HDF5 that utilize vector I/O, such as parallel I/O + to filtered datasets. The Subfiling VFD now properly handles vector + I/O requests in their entirety, resulting in fewer I/O calls, improved + vector I/O performance and improved vector I/O memory efficiency. + - Added a simple cache to the read-only S3 (ros3) VFD The read-only S3 VFD now caches the first N bytes of a file stored |