| Commit message (Collapse) | Author | Age | Files | Lines |
|---|
| |
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Removed more compiler warnings, etc.
Platforms tested:
Linux 2.2.x (eirene) w/parallel
|
| |
|
|
|
|
|
|
|
|
| |
Code cleanup
Description:
Turn on more warnings in the IRIX builds and clean them up.
Platforms tested:
IRIX64 6.5 (modi4) w/parallel, both -n32 and the default (-64?) mode
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
Copyright Fix
Description:
Switched the copyright statements from the old, bad version to the
new version we got from the lawyers. Note: not every file was
changed. There are some files which have copyrights not to NCSA (see
the Stream VFD and some of the GIF conversion modules didn't have
copyrights, so I didn't know if they were from others or from us). I
left those alone. If others think they should be changed, please
feel free to do so.
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
| |
added the printing of library version information to the
standard parameter output. A form of identification of which
version of library is being benchmark'ed.
Platforms tested:
eirene, modi4.
|
| |
|
|
|
|
| |
Added the '-D v' option for "verify data correctness".
Platforms tested:
modi4, eirene, burrwhite (all pp).
|
| |
|
|
|
|
|
|
| |
Update
Description:
Updated the PIO stuff with the changes for the 1.5 branch.
Platforms tested:
Linux (parallel)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
New feature
Description:
pio_perf.c:
per_engine.c:
folded in the new feature from v1.5.
New feature added is the interleaved I/O performance test.
Only POSIX interface is implemented for now. The MPIO and PHDF5
will be added later.
pio_perf.h:
Added a few macros to print rank and size of MPI_COMM_WORLD in
a unifed style.
Platforms tested:
modi4, eirene, burrwhite
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
Show IO API types selected. (Changed the default setting algorithm
slightly.)
Solution:
[details about the changes, algorithm, etc...]
[Please as detail as you can since your own explanation is
better than others guessing it from the code.]
Platforms tested:
[machines you have tested the changed version. This is absolute
important. Test it out on at least two or three different platforms
such as Big-endian-32bit (SUN/IRIX), little-endian-32(LINUX) and
64-bit (IRIX64/UNICOS/DEC-ALPHA) would be good.]
|
| |
|
|
|
|
|
| |
Renamed pio_info_g as h5_io_info_g to better reflect its
general purpose.
Platforms tested:
eirene(pp)
|
| |
|
|
|
|
|
|
| |
Folded recent changes of v1.5 to v1.4.
(Added feature to print bench test parameters/options.
Fixed pio_info_g duplicated declarations.)
Platforms tested:
eirene(pp)
|
| |
|
|
|
|
|
|
|
| |
feature
Description:
Setup a macro, H5_HAVE_NOFILL, to indicate if Dataset no fill feature
is supported. If not, --no-fill is an invalid option.
Platforms tested:
modi4.
|
| |
|
|
|
|
|
|
|
|
| |
Features.
Description:
print library version information in help page too.
Specify the nofill feature supported in v1.5 only.
Print the values of the KB, MB and GB in case a user wants to see them.
Platforms tested:
modi4
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Option Update
Description:
Updated the options so that it takes the following:
--api=AL -A AL where AL is a comma separated list of the values
"posix", "mpiio", and "phdf5". You can run any mixture of them
you wish.
--debug=DL -D DL where DL is a comma separated list of values
[1-4], r, and t. You can run any mixture of them.
Platforms tested:
Linux-pp
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Merged in a bunch of changes Quincey made. Added some of mine
here and there.
Description:
Below is Quincey's summary.
The -r and -t changes were changed to "-D r" and "-D t" as they are
of the debug purposes. Need to save option letters for hundreds of
future features.
The nofill for chunk storage is not supported since v1.4 does not have
the feature.
- Added option (-r) to display the throughput when doing I/O on just the
dataset data. This is somewhat redundant for the posix I/O functions
and MPI-I/O, but it's useful for HDF5.
- Added option (-t) to display the times along with the throughputs.
- Added options (-a <size> and -T <size>) to align objects in the HDF5 file.
These are ignored for posix and MPI-I/O benchmarks.
- Added option (-c) to create the HDF5 datasets using chunked storage.
The chunks are created with the same size as the buffer size used for
I/O, so all I/O to the dataset is chunk-aligned.
- Changed code to allow 0-sized datasets to be created. This is useful
when measuring the overhead for creating lots of datasets in HDF5.
- Cleaned up code to eliminate warnings and modularize things better.
Platforms tested:
modi4 (pp)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
The term RAWIO was confusing (lacking a better term).
It was intended to represent the "raw" way of doing I/O such that
an application may use the open/read/write interface (actually Posix)
or the parallel file system's native API (e.g. gpfs_open).
It was too confusing to mean multiple things.
Solution:
Split the RAW IO into two different IO API, POSIX and NATIVE.
Posix is a standard that some applications that have used it for
the serial version, may want to continue using it in the parallel
environment.
Changed the output and variable/macro/what-not names from RAWxxx
to POSIXxxx. No algorithm changes.
Platforms tested:
modi4(pp), eirene(serial)
|
| |
|
|
|
|
|
|
|
| |
Feature
Description:
moved the routines of setting up and dumping MPI-info object to
test library so that it is avaiable for all tests too.
Platforms tested:
modi4(pp), eirene (serial)
|
| |
|
|
|
|
| |
corrected a typo in a printf statement.
Platforms tested:
modi4
|
| |
|
|
|
|
|
|
|
|
| |
feature
Description:
Added a global MPI_Info object to be used by all applicable IO API (MPI-IO
and PHDF5). Added a function to set up the info object according to
$HDF5_MPI_INFO if set.
Platforms tested:
LLNL Blue/frost
|
| |
|
|
|
|
|
| |
Dumb bug fix. Forgot a debug printing statement.
Removed it.
Platforms tested:
Burrwhite (linux 2.4) parallel.
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
Was not able to handle data size (file size) larger than 32bits.
Was using long, which is only 4 bytes big in SP, thus overflowing
into negative when trying to address 2GB or larger.
Solution:
Changed those variables involved in file size/offset calculation
to type off_t. (If a certain system/compiler has off_t defined
as 4 bytes, it can't write to file size larger than 2GB anyway.)
Note that the lseek of SP with -D_LARGE_FILE still fails for
offset larger than 2GB (works for 2GB). That has to be fixed
soon.
Platforms tested:
LLNL blue/frost.
|
| |
|
|
|
|
|
|
|
| |
Update
Description:
Synched the 1.4 branch's performance tests with the 1.5 branch's
performance tests...
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
Duplicate declaraction of print_indent() in the header and source
files.
Solution:
Made the function "static" again.
Platforms tested:
Arabica
|
| |
|
|
|
|
|
|
|
| |
Update
Description:
Print out the other debugging statements if the debugging level is
set higher.
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
|
|
|
|
| |
Fix
Description:
Needed to throw a few more fixes in there to get the time reporting
down.
Solution:
The time reporting is available from debugging level 4. It'll show
all the information per processor.
Platforms tested:
Linux
|
| |
|
|
|
|
|
| |
Update
Description:
Added some higher level debugging statements. If you set the "-D"
option to "4", then you'll get to see how the timer behaves.
|
| |
|
|
|
|
|
|
|
|
|
| |
Bug fix
Description:
The symbol "RAW" is already defined in some ioctl.h files.
Changed it to RAWIO.
Platforms tested:
Tflops.
(I am commiting this from TFLOPS. Will check it out immediate
to test on local machines.)
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
Bug Fix
Description:
So, for Raw I/O in parallel, if you open a file with truncation by
multiple processes, it looks as if one process could open the file
and start writing to it while another process also opens the file
with truncation, thus wiping out all of the stuff the first process
wrote to the file.
This is bad.
Also added some garbage collection to the pio_perf routine to reclaim
the space taken by some of the tables.
Solution:
Placed an MPI_Barrier() statement after the Raw open()/create() call
so that all processes are synced up before they start writing to the
file.
Added free() calls to the tables which weren't being free'd.
Platforms tested:
Linux-pp (eirene)
|
| |
|
|
|
|
|
|
|
|
|
|
|
| |
Bone-headed Bug Fix
Description:
There were blanks being put into the output. The cause: the
"print_indent()" routine was printing indents for all of the
processes, but only process 0 should have been printing them out at
all (since process 0 is the one which prints out the reports).
Solution:
Check to make sure that we're process 0 before printing the indents.
Platforms tested:
Linux
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
| |
Change default actions.
Description:
Change the default maximum number of processes (-P) to use all processes
instead of just 1 (old default). Someone most likely wants to test
the I/O performance with all processes involved.
Also starts performance measurement with maximum number of processes
and decrement it with each loop. If the performance measurement
needs to restart, it can run with fewer processes if those loops
have completed.
Platforms tested:
modi4 and eirene.
|
| |
|
