| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
|
|
|
|
|
|
| |
Documentation.
Description:
Added some description of what the transfer buffers, block size, etc.
actually do.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
More small tweaks with the contiguous POSIX I/O case.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
POSIX contigous pattern error corrected.
Added detection if xfer buffer is actually too big.
Added environment variables settings in help page.
Platforms tested:
modi4 pp
|
|
|
|
|
|
|
|
|
|
|
| |
Revert previous reversion... :-)
Description:
Found that the bug was actually in the library, not the benchmark, so
revert back to the previous version I checked in.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
CVS merges went kablooey on us (it's a technical term).
Solution:
Remerged my changes with Quincey's changes.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Lots of changes.
Description:
Added the "block size" stuff for MPI-I/O.
Rearranged the engine to use bytes as the basic unit for everything,
instead of converting back and forth between ints & bytes.
Hoisted lots of invariant code out of main benchmark loop.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
The nerror needed a (long_long) cast in order to print correctly
by HDfprintf.
Also block off the compiling of the gpfs stubs since they are not
used yet. This eliminated some compiler warnings of defined but not
used routines.
Platforms tested:
modi4, eirene, burrwhite.
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Feature Revision
Description:
We're now forgetting the file size and concentrating on how many
elements per process per dataset we want to write.
The user specifies how many datasets, how many processes to run, and
how many elements each process is going to write per dataset. We can
calculate the size of the file from that information.
Platforms tested:
Linux (pp)
|
|
|
|
|
|
|
|
|
|
| |
New feature
Description:
Restored the old code for interleaved access for POSIX API.
Added interleaved access for PHDF5 API.
MPIO API for interleaved access is not working yet.
Platforms tested:
Modi4(pp), serial, eirene (pp).
|
|
|
|
|
|
|
|
|
|
|
| |
Feature Add
Description:
Install the h5perf program (previously called pio_perf). This
required the libh5test library to be compiled statically. I copied
how things were compiled statically for the h5tools library into the
test/Makefile.in.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
| |
New Feature
Description:
Added support for collective I/O with MPI and HDF5 access methods.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
|
|
| |
New Feature
Description:
Added interleaved block pattern to MPI and HDF5 access methods. Also,
changed the blocks to just use the same size as the regular blocks for I/O,
instead of a separate block size.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Removed more compiler warnings, etc.
Platforms tested:
Linux 2.2.x (eirene) w/parallel
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Turn on more warnings in the IRIX builds and clean them up.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel, both -n32 and the default (-64?) mode
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Copyright Fix
Description:
Switched the copyright statements from the old, bad version to the
new version we got from the lawyers. Note: not every file was
changed. There are some files which have copyrights not to NCSA (see
the Stream VFD and some of the GIF conversion modules didn't have
copyrights, so I didn't know if they were from others or from us). I
left those alone. If others think they should be changed, please
feel free to do so.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
| |
added the printing of library version information to the
standard parameter output. A form of identification of which
version of library is being benchmark'ed.
Platforms tested:
eirene, modi4.
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix.
Description:
H5Fopen call was using H5P_DEFAULT instead of file access flags
Solution:
Changed H5P_DEFAULT to H5F_ACC_RDONLY
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
| |
Added the '-D v' option for "verify data correctness".
Platforms tested:
modi4, eirene, burrwhite (all pp).
|
|
|
|
|
|
|
|
| |
Update
Description:
Updated the PIO stuff with the changes for the 1.5 branch.
Platforms tested:
Linux (parallel)
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Still was calling the POSIX stuff "Raw".
Solution:
Changed name to POSIX instead of Raw...
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
| |
Add Report Generator
Description:
This is a generator for ASCII and Excel(tm)(c) reports generated by
the pio_perf benchmark we run. There are instructions at the top of
the file on how to run the program and the input format it expects,
etc.
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New feature
Description:
pio_perf.c:
per_engine.c:
folded in the new feature from v1.5.
New feature added is the interleaved I/O performance test.
Only POSIX interface is implemented for now. The MPIO and PHDF5
will be added later.
pio_perf.h:
Added a few macros to print rank and size of MPI_COMM_WORLD in
a unifed style.
Platforms tested:
modi4, eirene, burrwhite
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Show IO API types selected. (Changed the default setting algorithm
slightly.)
Solution:
[details about the changes, algorithm, etc...]
[Please as detail as you can since your own explanation is
better than others guessing it from the code.]
Platforms tested:
[machines you have tested the changed version. This is absolute
important. Test it out on at least two or three different platforms
such as Big-endian-32bit (SUN/IRIX), little-endian-32(LINUX) and
64-bit (IRIX64/UNICOS/DEC-ALPHA) would be good.]
|
|
|
|
|
|
|
| |
Renamed pio_info_g as h5_io_info_g to better reflect its
general purpose.
Platforms tested:
eirene(pp)
|
|
|
|
|
|
|
|
|
| |
Sync with v1.5 changes.
(Including the H5_WANT_H5_V1_4_COMPAT code is okay since it will never
be true in v1.4)
Did another Dependencies regeneration too.
Platforms tested:
eirene(pp)
|
|
|
|
|
|
| |
updated the Dependencies file
Platforms tested:
no test.
|
|
|
|
|
|
| |
Sync it with the v1.5
Platforms tested:
eirene(pp)
|
|
|
|
|
|
| |
Sync it with the v1.5 copy.
Platforms tested:
eirene(pp);
|
|
|
|
|
|
|
|
| |
Folded recent changes of v1.5 to v1.4.
(Added feature to print bench test parameters/options.
Fixed pio_info_g duplicated declarations.)
Platforms tested:
eirene(pp)
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Setup a macro, H5_HAVE_NOFILL, to indicate if Dataset no fill feature
is supported. If not, --no-fill is an invalid option.
Platforms tested:
modi4.
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Fix the POSIX read/write part to check the return code of
Seek/read/write correctly.
Platforms tested:
LLNL SP
|
|
|
|
|
|
|
|
|
|
| |
Features.
Description:
print library version information in help page too.
Specify the nofill feature supported in v1.5 only.
Print the values of the KB, MB and GB in case a user wants to see them.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Option Update
Description:
Updated the options so that it takes the following:
--api=AL -A AL where AL is a comma separated list of the values
"posix", "mpiio", and "phdf5". You can run any mixture of them
you wish.
--debug=DL -D DL where DL is a comma separated list of values
[1-4], r, and t. You can run any mixture of them.
Platforms tested:
Linux-pp
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Merged in a bunch of changes Quincey made. Added some of mine
here and there.
Description:
Below is Quincey's summary.
The -r and -t changes were changed to "-D r" and "-D t" as they are
of the debug purposes. Need to save option letters for hundreds of
future features.
The nofill for chunk storage is not supported since v1.4 does not have
the feature.
- Added option (-r) to display the throughput when doing I/O on just the
dataset data. This is somewhat redundant for the posix I/O functions
and MPI-I/O, but it's useful for HDF5.
- Added option (-t) to display the times along with the throughputs.
- Added options (-a <size> and -T <size>) to align objects in the HDF5 file.
These are ignored for posix and MPI-I/O benchmarks.
- Added option (-c) to create the HDF5 datasets using chunked storage.
The chunks are created with the same size as the buffer size used for
I/O, so all I/O to the dataset is chunk-aligned.
- Changed code to allow 0-sized datasets to be created. This is useful
when measuring the overhead for creating lots of datasets in HDF5.
- Cleaned up code to eliminate warnings and modularize things better.
Platforms tested:
modi4 (pp)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The term RAWIO was confusing (lacking a better term).
It was intended to represent the "raw" way of doing I/O such that
an application may use the open/read/write interface (actually Posix)
or the parallel file system's native API (e.g. gpfs_open).
It was too confusing to mean multiple things.
Solution:
Split the RAW IO into two different IO API, POSIX and NATIVE.
Posix is a standard that some applications that have used it for
the serial version, may want to continue using it in the parallel
environment.
Changed the output and variable/macro/what-not names from RAWxxx
to POSIXxxx. No algorithm changes.
Platforms tested:
modi4(pp), eirene(serial)
|
|
|
|
|
|
|
|
|
| |
Feature
Description:
moved the routines of setting up and dumping MPI-info object to
test library so that it is avaiable for all tests too.
Platforms tested:
modi4(pp), eirene (serial)
|
|
|
|
|
|
| |
corrected a typo in a printf statement.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Added a global MPI_Info object to be used by all applicable IO API (MPI-IO
and PHDF5). Added a function to set up the info object according to
$HDF5_MPI_INFO if set.
Platforms tested:
LLNL Blue/frost
|
|
|
|
|
|
|
| |
Removed some local macro definition, instead use the macros defined
by the hdf5 library configure.
Platforms tested:
LLNL blue
|
|
|
|
|
|
|
| |
Dumb bug fix. Forgot a debug printing statement.
Removed it.
Platforms tested:
Burrwhite (linux 2.4) parallel.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Was not able to handle data size (file size) larger than 32bits.
Was using long, which is only 4 bytes big in SP, thus overflowing
into negative when trying to address 2GB or larger.
Solution:
Changed those variables involved in file size/offset calculation
to type off_t. (If a certain system/compiler has off_t defined
as 4 bytes, it can't write to file size larger than 2GB anyway.)
Note that the lseek of SP with -D_LARGE_FILE still fails for
offset larger than 2GB (works for 2GB). That has to be fixed
soon.
Platforms tested:
LLNL blue/frost.
|
|
|
|
|
|
|
|
|
| |
Update
Description:
Synched the 1.4 branch's performance tests with the 1.5 branch's
performance tests...
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Remove incorrect call to MPI_Barrier() in data I/O loop
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
erase windows warnings
Description:
Use the original code of chunk.c since windows warnings increase with the modified one.
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
| |
Purpose:
code clean-up to erase windows warnings
Description:
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Duplicate declaraction of print_indent() in the header and source
files.
Solution:
Made the function "static" again.
Platforms tested:
Arabica
|
|
|
|
|
|
|
|
|
| |
Update
Description:
Print out the other debugging statements if the debugging level is
set higher.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
|
| |
Fix
Description:
Needed to throw a few more fixes in there to get the time reporting
down.
Solution:
The time reporting is available from debugging level 4. It'll show
all the information per processor.
Platforms tested:
Linux
|
|
|
|
|
|
|
| |
Update
Description:
Added some higher level debugging statements. If you set the "-D"
option to "4", then you'll get to see how the timer behaves.
|