summaryrefslogtreecommitdiffstats
path: root/release_docs
diff options
context:
space:
mode:
authorjhendersonHDF <jhenderson@hdfgroup.org>2023-12-27 22:28:41 (GMT)
committerGitHub <noreply@github.com>2023-12-27 22:28:41 (GMT)
commit6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85 (patch)
treec4215cf360c4a3350aa5315939622b982390df53 /release_docs
parent695efa94dfcd62c5ef42d03a7f1425c4105819df (diff)
downloadhdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.zip
hdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.tar.gz
hdf5-6ffc55c6d9c1f3a30e4db1bc71c452c50952ee85.tar.bz2
Implement optimized support for vector I/O in Subfiling VFD (#3896)
Vector I/O requests are now processed within a single set of I/O call batches, rather than each I/O vector entry (tuple constructed from the types, addrs, sizes and bufs arrays) being processed individually. This allows I/O to be more efficiently parallelized among the I/O concentrator processes during large I/O requests. * Fixed some calculations and add test cases for issues spotted from review * Removed a variable that was compensating for previous miscalculations
Diffstat (limited to 'release_docs')
-rw-r--r--release_docs/RELEASE.txt10
1 files changed, 10 insertions, 0 deletions
diff --git a/release_docs/RELEASE.txt b/release_docs/RELEASE.txt
index fb2769d..dda3852 100644
--- a/release_docs/RELEASE.txt
+++ b/release_docs/RELEASE.txt
@@ -278,6 +278,16 @@ New Features
Library:
--------
+ - Implemented optimized support for vector I/O in the Subfiling VFD
+
+ Previously, the Subfiling VFD would handle vector I/O requests by
+ breaking them down into individual I/O requests, one for each entry
+ in the I/O vectors provided. This could result in poor I/O performance
+ for features in HDF5 that utilize vector I/O, such as parallel I/O
+ to filtered datasets. The Subfiling VFD now properly handles vector
+ I/O requests in their entirety, resulting in fewer I/O calls, improved
+ vector I/O performance and improved vector I/O memory efficiency.
+
- Added a simple cache to the read-only S3 (ros3) VFD
The read-only S3 VFD now caches the first N bytes of a file stored