| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Copyright Fix
Description:
Switched the copyright statements from the old, bad version to the
new version we got from the lawyers. Note: not every file was
changed. There are some files which have copyrights not to NCSA (see
the Stream VFD and some of the GIF conversion modules didn't have
copyrights, so I didn't know if they were from others or from us). I
left those alone. If others think they should be changed, please
feel free to do so.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
| |
added the printing of library version information to the
standard parameter output. A form of identification of which
version of library is being benchmark'ed.
Platforms tested:
eirene, modi4.
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix.
Description:
H5Fopen call was using H5P_DEFAULT instead of file access flags
Solution:
Changed H5P_DEFAULT to H5F_ACC_RDONLY
Platforms tested:
IRIX64 6.5 (modi4) w/parallel
|
|
|
|
|
|
| |
Added the '-D v' option for "verify data correctness".
Platforms tested:
modi4, eirene, burrwhite (all pp).
|
|
|
|
|
|
|
|
| |
Update
Description:
Updated the PIO stuff with the changes for the 1.5 branch.
Platforms tested:
Linux (parallel)
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Still was calling the POSIX stuff "Raw".
Solution:
Changed name to POSIX instead of Raw...
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
| |
Add Report Generator
Description:
This is a generator for ASCII and Excel(tm)(c) reports generated by
the pio_perf benchmark we run. There are instructions at the top of
the file on how to run the program and the input format it expects,
etc.
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New feature
Description:
pio_perf.c:
per_engine.c:
folded in the new feature from v1.5.
New feature added is the interleaved I/O performance test.
Only POSIX interface is implemented for now. The MPIO and PHDF5
will be added later.
pio_perf.h:
Added a few macros to print rank and size of MPI_COMM_WORLD in
a unifed style.
Platforms tested:
modi4, eirene, burrwhite
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Show IO API types selected. (Changed the default setting algorithm
slightly.)
Solution:
[details about the changes, algorithm, etc...]
[Please as detail as you can since your own explanation is
better than others guessing it from the code.]
Platforms tested:
[machines you have tested the changed version. This is absolute
important. Test it out on at least two or three different platforms
such as Big-endian-32bit (SUN/IRIX), little-endian-32(LINUX) and
64-bit (IRIX64/UNICOS/DEC-ALPHA) would be good.]
|
|
|
|
|
|
|
| |
Renamed pio_info_g as h5_io_info_g to better reflect its
general purpose.
Platforms tested:
eirene(pp)
|
|
|
|
|
|
|
|
|
| |
Sync with v1.5 changes.
(Including the H5_WANT_H5_V1_4_COMPAT code is okay since it will never
be true in v1.4)
Did another Dependencies regeneration too.
Platforms tested:
eirene(pp)
|
|
|
|
|
|
| |
updated the Dependencies file
Platforms tested:
no test.
|
|
|
|
|
|
| |
Sync it with the v1.5
Platforms tested:
eirene(pp)
|
|
|
|
|
|
| |
Sync it with the v1.5 copy.
Platforms tested:
eirene(pp);
|
|
|
|
|
|
|
|
| |
Folded recent changes of v1.5 to v1.4.
(Added feature to print bench test parameters/options.
Fixed pio_info_g duplicated declarations.)
Platforms tested:
eirene(pp)
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Setup a macro, H5_HAVE_NOFILL, to indicate if Dataset no fill feature
is supported. If not, --no-fill is an invalid option.
Platforms tested:
modi4.
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Fix the POSIX read/write part to check the return code of
Seek/read/write correctly.
Platforms tested:
LLNL SP
|
|
|
|
|
|
|
|
|
|
| |
Features.
Description:
print library version information in help page too.
Specify the nofill feature supported in v1.5 only.
Print the values of the KB, MB and GB in case a user wants to see them.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Option Update
Description:
Updated the options so that it takes the following:
--api=AL -A AL where AL is a comma separated list of the values
"posix", "mpiio", and "phdf5". You can run any mixture of them
you wish.
--debug=DL -D DL where DL is a comma separated list of values
[1-4], r, and t. You can run any mixture of them.
Platforms tested:
Linux-pp
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Merged in a bunch of changes Quincey made. Added some of mine
here and there.
Description:
Below is Quincey's summary.
The -r and -t changes were changed to "-D r" and "-D t" as they are
of the debug purposes. Need to save option letters for hundreds of
future features.
The nofill for chunk storage is not supported since v1.4 does not have
the feature.
- Added option (-r) to display the throughput when doing I/O on just the
dataset data. This is somewhat redundant for the posix I/O functions
and MPI-I/O, but it's useful for HDF5.
- Added option (-t) to display the times along with the throughputs.
- Added options (-a <size> and -T <size>) to align objects in the HDF5 file.
These are ignored for posix and MPI-I/O benchmarks.
- Added option (-c) to create the HDF5 datasets using chunked storage.
The chunks are created with the same size as the buffer size used for
I/O, so all I/O to the dataset is chunk-aligned.
- Changed code to allow 0-sized datasets to be created. This is useful
when measuring the overhead for creating lots of datasets in HDF5.
- Cleaned up code to eliminate warnings and modularize things better.
Platforms tested:
modi4 (pp)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The term RAWIO was confusing (lacking a better term).
It was intended to represent the "raw" way of doing I/O such that
an application may use the open/read/write interface (actually Posix)
or the parallel file system's native API (e.g. gpfs_open).
It was too confusing to mean multiple things.
Solution:
Split the RAW IO into two different IO API, POSIX and NATIVE.
Posix is a standard that some applications that have used it for
the serial version, may want to continue using it in the parallel
environment.
Changed the output and variable/macro/what-not names from RAWxxx
to POSIXxxx. No algorithm changes.
Platforms tested:
modi4(pp), eirene(serial)
|
|
|
|
|
|
|
|
|
| |
Feature
Description:
moved the routines of setting up and dumping MPI-info object to
test library so that it is avaiable for all tests too.
Platforms tested:
modi4(pp), eirene (serial)
|
|
|
|
|
|
| |
corrected a typo in a printf statement.
Platforms tested:
modi4
|
|
|
|
|
|
|
|
|
|
| |
feature
Description:
Added a global MPI_Info object to be used by all applicable IO API (MPI-IO
and PHDF5). Added a function to set up the info object according to
$HDF5_MPI_INFO if set.
Platforms tested:
LLNL Blue/frost
|
|
|
|
|
|
|
| |
Removed some local macro definition, instead use the macros defined
by the hdf5 library configure.
Platforms tested:
LLNL blue
|
|
|
|
|
|
|
| |
Dumb bug fix. Forgot a debug printing statement.
Removed it.
Platforms tested:
Burrwhite (linux 2.4) parallel.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Was not able to handle data size (file size) larger than 32bits.
Was using long, which is only 4 bytes big in SP, thus overflowing
into negative when trying to address 2GB or larger.
Solution:
Changed those variables involved in file size/offset calculation
to type off_t. (If a certain system/compiler has off_t defined
as 4 bytes, it can't write to file size larger than 2GB anyway.)
Note that the lseek of SP with -D_LARGE_FILE still fails for
offset larger than 2GB (works for 2GB). That has to be fixed
soon.
Platforms tested:
LLNL blue/frost.
|
|
|
|
|
|
|
|
|
| |
Update
Description:
Synched the 1.4 branch's performance tests with the 1.5 branch's
performance tests...
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Remove incorrect call to MPI_Barrier() in data I/O loop
Platforms tested:
IRIX64 6.5 (modi4)
|
|
|
|
|
|
|
|
|
|
| |
Purpose:
erase windows warnings
Description:
Use the original code of chunk.c since windows warnings increase with the modified one.
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
| |
Purpose:
code clean-up to erase windows warnings
Description:
Solution:
Platforms tested:
windows 2000
|
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Duplicate declaraction of print_indent() in the header and source
files.
Solution:
Made the function "static" again.
Platforms tested:
Arabica
|
|
|
|
|
|
|
|
|
| |
Update
Description:
Print out the other debugging statements if the debugging level is
set higher.
Platforms tested:
Linux
|
|
|
|
|
|
|
|
|
|
|
|
| |
Fix
Description:
Needed to throw a few more fixes in there to get the time reporting
down.
Solution:
The time reporting is available from debugging level 4. It'll show
all the information per processor.
Platforms tested:
Linux
|
|
|
|
|
|
|
| |
Update
Description:
Added some higher level debugging statements. If you set the "-D"
option to "4", then you'll get to see how the timer behaves.
|
|
|
|
|
| |
Platforms tested:
eirene
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
The symbol "RAW" is already defined in some ioctl.h files.
Changed it to RAWIO.
Platforms tested:
Tflops.
(I am commiting this from TFLOPS. Will check it out immediate
to test on local machines.)
|
|
|
|
|
|
|
|
| |
Code improvement
Description:
Changed stat to HDstat macro for portability.
Platforms tested:
eirene.
|
|
|
|
|
|
|
|
|
| |
Bug fix.
Description:
Put in the Bug fix Kent applied to v1.5 (use HDfstat instead of just
fstat.)
Platforms tested:
Eirene
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Platform dependent code related to the struct stat and fstat
calls polluted source codes. Hard to maintain.
Solution:
Platform dependent code are moved to H5private.h and then internal
code can #include H5private.h. Repeat those macro definition for
the stdio and multi drivers since they area examples for writing
a virtual file driver. They must not use any internal code.
Platforms tested:
eirene (parallel), modi4 (serial including gass driver.)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
So, for Raw I/O in parallel, if you open a file with truncation by
multiple processes, it looks as if one process could open the file
and start writing to it while another process also opens the file
with truncation, thus wiping out all of the stuff the first process
wrote to the file.
This is bad.
Also added some garbage collection to the pio_perf routine to reclaim
the space taken by some of the tables.
Solution:
Placed an MPI_Barrier() statement after the Raw open()/create() call
so that all processes are synced up before they start writing to the
file.
Added free() calls to the tables which weren't being free'd.
Platforms tested:
Linux-pp (eirene)
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bone-headed Bug Fix
Description:
There were blanks being put into the output. The cause: the
"print_indent()" routine was printing indents for all of the
processes, but only process 0 should have been printing them out at
all (since process 0 is the one which prints out the reports).
Solution:
Check to make sure that we're process 0 before printing the indents.
Platforms tested:
Linux
|
|
|
|
|
|
|
| |
updated the Dependencies files via "gmake depend".
Some how this must be done with --srcdir configure option. That is odd.
Platforms tested:
visual inspected "cvs diff" output.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Change default actions.
Description:
Change the default maximum number of processes (-P) to use all processes
instead of just 1 (old default). Someone most likely wants to test
the I/O performance with all processes involved.
Also starts performance measurement with maximum number of processes
and decrement it with each loop. If the performance measurement
needs to restart, it can run with fewer processes if those loops
have completed.
Platforms tested:
modi4 and eirene.
|
|
|
|
|
|
|
| |
Remove perf and mpi-perf from the parallel test targets since their
functions are replaced by pio_perf.
Platforms tested:
modi4 and eirene, both parallel modes.
|
|
|
|
|
|
|
|
| |
Feature Add
Description:
Added the performance measuring tool to the 1.4 branch.
Platforms tested:
Linux(pp)
|
| |
|
| |
|
|
|
|
|
|
|
|
|
|
| |
Extension
Description:
int64_t type is not available everywhere.
#include H5private.h which has platform dependent hooks
to define int64_t to something available.
Platforms tested:
Tflops, modi4 (parallel), eirene(PP)
|