| Commit message (Collapse) | Author | Age | Files | Lines |
| |
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Setup a macro, H5_HAVE_NOFILL, to indicate if Dataset no fill feature
is supported. If not, --no-fill is an invalid option.
Platforms tested:
modi4.
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Fix the POSIX read/write part to check the return code of
Seek/read/write correctly.
Platforms tested:
LLNL SP
|
|
|
|
|
|
|
|
|
|
| |
Features.
Description:
print library version information in help page too.
Specify the nofill feature supported in v1.5 only.
Print the values of the KB, MB and GB in case a user wants to see them.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
| |
Feature.
Description:
Will print standard library name if program name is not given
for the print_version().
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
update project file
Description:
forget updating dset_cpp and dset_cppdll in order to erase linking errors.
Solution:
update it
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Option Update
Description:
Updated the options so that it takes the following:
--api=AL -A AL where AL is a comma separated list of the values
"posix", "mpiio", and "phdf5". You can run any mixture of them
you wish.
--debug=DL -D DL where DL is a comma separated list of values
[1-4], r, and t. You can run any mixture of them.
Platforms tested:
Linux-pp
|
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
update install_windows.txt
remove hdf4-related stuff in the install_windows.txt
modify the this file to reflect the retirement of HAVE_*** in HDF5 configuration process.
Description:
1) hdf4 related tools have been moved out of HDF5 CVS tree, The install doc should reflect this.
2) Albert finished macro changes from HAVE_*** to H5_HAVE_***. The doc should reflect this.
Solution:
Platforms tested:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Merged in a bunch of changes Quincey made. Added some of mine
here and there.
Description:
Below is Quincey's summary.
The -r and -t changes were changed to "-D r" and "-D t" as they are
of the debug purposes. Need to save option letters for hundreds of
future features.
The nofill for chunk storage is not supported since v1.4 does not have
the feature.
- Added option (-r) to display the throughput when doing I/O on just the
dataset data. This is somewhat redundant for the posix I/O functions
and MPI-I/O, but it's useful for HDF5.
- Added option (-t) to display the times along with the throughputs.
- Added options (-a <size> and -T <size>) to align objects in the HDF5 file.
These are ignored for posix and MPI-I/O benchmarks.
- Added option (-c) to create the HDF5 datasets using chunked storage.
The chunks are created with the same size as the buffer size used for
I/O, so all I/O to the dataset is chunk-aligned.
- Changed code to allow 0-sized datasets to be created. This is useful
when measuring the overhead for creating lots of datasets in HDF5.
- Cleaned up code to eliminate warnings and modularize things better.
Platforms tested:
modi4 (pp)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The term RAWIO was confusing (lacking a better term).
It was intended to represent the "raw" way of doing I/O such that
an application may use the open/read/write interface (actually Posix)
or the parallel file system's native API (e.g. gpfs_open).
It was too confusing to mean multiple things.
Solution:
Split the RAW IO into two different IO API, POSIX and NATIVE.
Posix is a standard that some applications that have used it for
the serial version, may want to continue using it in the parallel
environment.
Changed the output and variable/macro/what-not names from RAWxxx
to POSIXxxx. No algorithm changes.
Platforms tested:
modi4(pp), eirene(serial)
|
|
|
|
|
|
|
|
|
|
| |
Code Cleanup
Description:
Compilers moaned about those unused mpi_err variables.
Solution:
Removed them for now. Will make it cleaner later.
Platforms tested:
modi4(pp), eirene.
|
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Guard against getting into metadata broadcast in write routine and improve
some error handling.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
| |
Feature
Description:
moved the routines of setting up and dumping MPI-info object to
test library so that it is avaiable for all tests too.
Platforms tested:
modi4(pp), eirene (serial)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Document Bug fix/Code improvement below:
Description:
Currently, the chunk data allocation routine invoked to allocate space for
the entire dataset is inefficient. It writes out each chunk in the dataset,
whether it is already allocated or not. Additionally, this happens not
only when it is created, but also anytime it is opened for writing, or the
dataset is extended. Worse, there's too much parallel I/O syncronization,
which slows things down even more.
Solution:
Only attempt to write out chunks that don't already exist. Additionally,
share the I/O writing between all the nodes, instead of writing everything
with process 0. Then, only block with MPI_Barrier if chunks were actually
created.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix/Code improvement.
Description:
Currently, the chunk data allocation routine invoked to allocate space for
the entire dataset is inefficient. It writes out each chunk in the dataset,
whether it is already allocated or not. Additionally, this happens not
only when it is created, but also anytime it is opened for writing, or the
dataset is extended. Worse, there's too much parallel I/O syncronization,
which slows things down even more.
Solution:
Only attempt to write out chunks that don't already exist. Additionally,
share the I/O writing between all the nodes, instead of writing everything
with process 0. Then, only block with MPI_Barrier if chunks were actually
created.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
| |
corrected a typo in a printf statement.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Added a global MPI_Info object to be used by all applicable IO API (MPI-IO
and PHDF5). Added a function to set up the info object according to
$HDF5_MPI_INFO if set.
Platforms tested:
LLNL Blue/frost
|
|
|
|
|
|
|
| |
Removed some local macro definition, instead use the macros defined
by the hdf5 library configure.
Platforms tested:
LLNL blue
|
|
|
|
|
|
|
| |
Corrected typos in the FUNC_ENTER macros of H5FD_sec2_flush and
H5FD_log_flush.
Platforms tested:
modi4 (just tested it compiled fine.)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup/Performance enhancement
Description:
The code to extend the file size in H5FD_mpio_flush is getting run even when
the file size doesn't change. Also, it's sort of sidestepping MPI-I/O when
extending the file, instead of using MPI-I/O features to set the file's size
Solution:
Only extend the file's size when the allocated size has increased. Also
use MPI_File_set_size() to change the file's size. (Including barrier).
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
| |
Document Bug Fix
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
When H5Freopen is called, the file to reopen's 'intent' (read/write
permissions, etc) is not being copied to the new file's 'intent'
information.
Solution:
Copy it. :-)
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Calling MPI_Get_count needs to be done with the same MPI type as was used
for the transfer and we are always using MPI_BYTE, even when a different
MPI type was used for the transfer.
Solution:
Only query MPI_Get_count with MPI_BYTE when we really used MPI_BYTE for the
transfer. Wait for later to query MPI_Get_count with other MPI types.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Performance enhancement
Description:
Doing an MPI_File_sync() just before a file is closed causing a large
performance loss.
Solution:
Add flag to MPI file driver to avoid performance the MPI_File_sync() when
the flag is set before a call to H5F_flush().
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
| |
Document performance enhancement
|
|
|
|
|
|
|
| |
Dumb bug fix. Forgot a debug printing statement.
Removed it.
Platforms tested:
Burrwhite (linux 2.4) parallel.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Was not able to handle data size (file size) larger than 32bits.
Was using long, which is only 4 bytes big in SP, thus overflowing
into negative when trying to address 2GB or larger.
Solution:
Changed those variables involved in file size/offset calculation
to type off_t. (If a certain system/compiler has off_t defined
as 4 bytes, it can't write to file size larger than 2GB anyway.)
Note that the lseek of SP with -D_LARGE_FILE still fails for
offset larger than 2GB (works for 2GB). That has to be fixed
soon.
Platforms tested:
LLNL blue/frost.
|
|
|
|
|
|
|
|
|
| |
Purpose:
Code clean-up
Description:
Removed unused HAVE_XXXX macros from the H5f90i.h file.
Platforms tested:
HP-UX 11.00 (kelgia) and IRIX64-6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Put quotes around some of the shell environment variables sothat, if
htey're blank, then they won't cause the shell to output a "too many
arguments" warning during configuration.
Platforms tested:
Linux
|
|
|
|
|
|
|
| |
Doc oversight
Description:
Added my initials and the date to the note I just added.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
The parallel I/O file driver is optimized to only write metadata with one
process (and broadcast the results to the other processes). This is
currently enabled by a separate call to H5FD_mpio_tas_allsame() before
each metadata write to the file. This can easily lead to problems where
the prelude function call is omitted before the actual write code or, in
a threaded environment, lead to race condititions where the value set is
reset before being used.
Solution:
Since we only want to write metadata from one process, key off of the 'type'
parameter (which has information about whether the data being written it
metadata or raw data) to H5FD_mpio_write() as the method for determining
whether to only write from one process or not.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
| |
Update release notes about rotating metadata writes.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New Feature
Description:
Currently, only process 0 writes metadata to disk, leading to a potential
performance bottleneck as the other processors wait for it to catch up.
Solution:
Rotate the metadata responsibilities among all processes, speading out the
work.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
| |
Update
Description:
Updated the description of how to use Intel compilers to compile HDF5
software...
|
|
|
|
|
|
|
|
|
|
|
| |
Small code cleanup/improvement
Description:
Query the MPI rank only once and store it in the file structure for each
process.
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
IBM SP was complaining some file not closed when MPI_Finalize is called.
It turned out I duplicated the MPI_File_open when I added the
code to print MPI_error_string. That was dumb.
Solution:
Removed the extra MPI_File_open.
Platforms tested:
IBM SP Blue.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
Updating h5dread/write_f parameters
Description:
fortran/h5d_FORTRAN.html
h5dread/write_f -- in the 'reference' versions, which yesterday's
revisions missed):
Added new overloading to dims parameter description.
Corrected prior dims type and noted that it is deprecated and
will be removed in 1.6.
fortran/h5a_FORTRAN.html
Updated "Last modified" tag to reflect yesterday's revisions.
Tested:
IE 5
|
|
|
|
|
|
|
|
|
| |
Update
Description:
Synched the 1.4 branch's performance tests with the 1.5 branch's
performance tests...
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
Bugfix -- Closes #702
Description:
Commented out references to and descriptions of unimplemented
H5S functions. Particularly in the UG document, Dataspaces.html.
H5Sopen H5Slock H5Ssubspace
H5Scommit H5Sselect_op H5Ssubspace_name
H5Sis_subspace H5Sselect_order H5Ssubspace_location
Added explanatory "Note to developers" in comments near top of
Dataspaces.html.
Platforms tested:
IE 5
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Remove incorrect call to MPI_Barrier() in data I/O loop
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
Update description of h5dread/write_f and h5aread/write_f dims parameter.
Description:
h5dread/write_f, h5aread/write_f
Added new overloading to dims parameter description.
Noted that prior dims type is deprecated and will be removed in 1.6.
Platforms tested:
IE 5
|
|
|
|
|
|
|
|
| |
Purpose:
Maintenance
Description:
Added information about Parallel Fortran Support for HP-UX 11.00 SysV
and write/read overloaded subroutines (bug #670)
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
erase windows warnings
Description:
Use the original code of chunk.c since windows warnings increase with the modified one.
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
| |
Purpose:
erase windows warnings
Description:
Solution:
Platforms tested:
windows 2000, linux 2.2.18
|
|
|
|
|
|
|
|
|
| |
Purpose:
erase windows warnings
Description:
Solution:
Platforms tested:
windows 2000,linux 2.2.18
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
1. code clean-up
2. bug fix
Description:
1. windows complian data casting from large size to small size
use H5_ASSIGN_OVERFLOW and H5_CHECK_OVERFLOW to erase some warnings
2. in H5TB.c, cmp_addr is used to compare two different address. However, cmp_addr is defined as
an unsigned integer which may cause problems when the difference is negative.
Solution:
2. Use H5Fcmp_address macro to replace cmp_addr in H5TB.c.
Platforms tested:
linux 2.2.18 and windows 2000
|
|
|
|
|
|
|
|
|
| |
Purpose:
code clean-up to erase windows warnings
Description:
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Fix the debugging compiler flags for non-production builds.
Platforms tested:
Solaris 2.7 (arabica)
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
code clean up to erase windows warnings
Description:
need to clean up more
Solution:
Platforms tested:
window 2000, linux
|