summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r11951] Purpose:MuQun Yang2006-02-163-4/+71
| | | | | | | | | | | | | | | | Enhance collective chunk IO supports Description: Add a new test to check the correctness of the HDF5 library behavior for collective IO mode when one process doesn't have any contribution for IO. Solution: Platforms tested: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 Misc. update:
* [svn-r11950] Purpose:MuQun Yang2006-02-164-468/+1701
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Enhanced collective chunk IO supports Description: 1. When using collective IO with chunking storage without any tuning, performance may become worse under some circumstances. 2. Current HDF5 handles raw-data IO per chunk. So for many small chunks, many small IOs will be passed into MPI-IO. That may cause bad performance. 3. For one IO per chunk case, sometimes performance with collective is worse than performance with independent. An obvious case is when only one process is doing IO and all other process are not doing IO, the collective IO will only add overheads for communication. We want to avoid this case. Some management inside our library needs to be done. Solution: - Added managements of collective IO supports for chunking storage inside parallel HDF5 1) Implemented One IO with collective mode for all chunks in the application by building one MPI derived datatype accross all chunks. 2) Implemented the decision-making support to do collective IO inside MPI-IO per chunk. 3) Added the decision-making support to do one IO accross all chunks or to do multiple IOs with each IO per chunk. 4) Added the support to handle the case some processes won't do any IOs in collectively. 5) Some MPI-IO package(mpich 1.2.6 or lower, e.g.) cannot handle collective IO correctly for the case when some processes have no contributions to IOs, a special macro is added to change collective IO mode to independent IO mode inside HDF5 library. Platforms tested: Parallel: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 SDSC Teragrid mpich-1.2.5 Linux(Tungsten) mpich-1.2.6 Altix(NCSA cobalt) Seq: Linux(heping) Misc. update:
* [svn-r11949] Purpose:Fang Guo2006-02-161-1/+1
| | | | | | | | | | | Remove deleteline.bat and add in tooltest.bat Description: Solution: Platforms tested: Misc. update:
* [svn-r11948] Purpose:Fang Guo2006-02-161-15/+0
| | | | | | | | | | | Batch file Improvement Description: This batch file is not necessary for new batch files Solution: Platforms tested: Misc. update:
* [svn-r11947] Purpose:Fang Guo2006-02-162-1/+22
| | | | | | | | | | | Add in copyright information Description: Solution: Platforms tested: Misc. update:
* [svn-r11946] Purpose:Fang Guo2006-02-161-238/+177
| | | | | | | | | | | Batch File Improvement Description: Make tool test batch files easier to maintain Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11945] Purpose:Fang Guo2006-02-161-984/+399
| | | | | | | | | | | Batch file improvement Description: Make tool test batch files easier to maintain Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11944] Purpose:Fang Guo2006-02-161-0/+248
| | | | | | | | | | | Batch file improvement Description: This batch file will be call by all of the tool test batch files Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11943] Purpose:MuQun Yang2006-02-161-0/+32
| | | | | | | | | | | | Added descriptions for the current collective chunk IO supports. Description: Solution: Platforms tested: Misc. update:
* [svn-r11942] Purpose:MuQun Yang2006-02-162-0/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add collective chunk IO supports Description: Added a macro hdf5_mpi_special_collective_io_works to filter out some mpi-io packages that don't support collective IO for no IO contributions in some processes. Solution: 1. "hdf5_mpi_special_collective_io_works=${hdf5_mpi_special_collective_io_works= 'no'}" has been added at the end of file ia64-linux-gnu and linux-gnulibc1 2. Some comments are added in ia64-linux-gnu and linux-gnulibc1. 3. Documents are added inside RELEASE.txt. Platforms tested: Parallel: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 SDSC Teragrid mpich-1.2.5 Linux(Tungsten) mpich-1.2.6 Altix(NCSA cobalt) Seq: Linux(heping) Misc. update:
* [svn-r11941] Purpose:Fang Guo2006-02-161-395/+167
| | | | | | | | | | | Batch file improvement Description: Make tool test batch files easier to maintain Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11940] Purpose:Fang Guo2006-02-161-2476/+580
| | | | | | | | | | | Batch file improvement Description: Make tool tests batch files easier to maintain Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11939] Purpose:MuQun Yang2006-02-162-1/+46
| | | | | | | | | | | | | | | | | | | | | | | | | | Supports for collective chunk IO inside parallel HDF5 Description: Added a macro hdf5_mpi_special_collective_io_works to filter out some mpi-io packages that don't support collective IO for no IO contributions in some processes. Solution: Using AC_CACHE_VAL to do the job. Platforms tested: Parallel: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 SDSC Teragrid mpich-1.2.5 Linux(Tungsten) mpich-1.2.6 Altix(NCSA cobalt) Seq: Linux(heping) Misc. update:
* [svn-r11938] Purpose:Fang Guo2006-02-161-1142/+385
| | | | | | | | | | | Batch file improvement Description: Make tool tests batch file easier to maintain Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11937] Purpose:Albert Cheng2006-02-152-2/+21
| | | | | | | | | | | | | New feature. Description: Added the feature to make a release tarball for the documents tree too. Platforms tested: Feature code was created by James. I just did some touch up and tested it by hand in heping. I am checking it in while he is absent. Misc. update:
* [svn-r11935] Purpose:Albert Cheng2006-02-151-2/+2
| | | | | | | | | | | | | | | | | | Cleanup Description: v1.7: Removed some debug files left by previous change. Uncommented the removal of the temporary working directory. v1.6: Moved the code of removal of the temporary working directory to a later location in order to stay in sync with v1.7. (The later location is needed for v1.7 code but makes no different to v1.6) Platforms tested: Tested by hand.
* [svn-r11932] Purpose:Pedro Vicente Nunes2006-02-104-24/+96
| | | | | | | | | | | | | | | bug fix Description: the --disable-hl switch was causing linking errors on gif2h5 that uses image api (bugzilla #1) Solution: used the condional macro for hl to build gif2h5 Platforms tested: linux Misc. update:
* [svn-r11931] Purpose:Pedro Vicente Nunes2006-02-096-12/+12
| | | | | | | | | | | | | | | | bug fix Description: the linking order in Makefile.am of the gif2h5 tool was causing linking errors on some configurations (pgcc, --disable-shared) Solution: changed the order of the linking (hl before hdf5) Platforms tested: linux, several configurations solaris Misc. update:
* [svn-r11926] Purpose:Pedro Vicente Nunes2006-02-082-4/+4
| | | | | | | | | | | | | | | bug fix Description: the build order of the several folders was causing linking errors Solution: changed the "." to be the last to avoid it Platforms tested: linux Misc. update:
* [svn-r11925] Purpose:Fang Guo2006-02-071-1886/+1888
| | | | | | | | | | | Windows Maintenance Description: Update all.sln Solution: Platforms tested: Misc. update:
* [svn-r11924] Purpose:Fang Guo2006-02-071-2/+2
| | | | | | | | | | | Maintenance on Windows Description: Change project settings to include path to H5IM.h Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11923] Purpose:Fang Guo2006-02-071-2/+2
| | | | | | | | | | | Maintenance on Windows Description: Change project settings to include the path to H5IM.h Solution: Platforms tested: Misc. update:
* [svn-r11922] Purpose:Fang Guo2006-02-071-163/+169
| | | | | | | | | | | Maintenance on Windows Description: Add hdf hl library as the dependency of gifconv and gifconvdll Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11920] Purpose:Albert Cheng2006-02-071-0/+7
| | | | | | | | | | | | improvement. Description: Release must be run at the top of the hdf5 source directory. Added a test to verify this condition at the beginning of the command. Platforms tested: Tested by hand.
* [svn-r11919] Purpose:Pedro Vicente Nunes2006-02-062-10/+0
| | | | | | | | | | | | | some code cleaning Description: Solution: Platforms tested: none Misc. update:
* [svn-r11918] Purpose:Pedro Vicente Nunes2006-02-068-662/+89
| | | | | | | | | | | | | | | | bug fix , bugzilla bug #1 Description: the gif2h5 was not writing HDF5 images correctly Solution: use the Image API to write the image, rewrote the writing functionY Platforms tested: linux solaris Misc. update:
* [svn-r11916] Purpose:James Laird2006-02-012-6/+18
| | | | | | | | | | | | | | | | Bug fix in release script Description: release --private should create a release without changing the current version of the library. This wasn't working for the libtool version, which was getting bumped regardless. Solution: Fixed the release and h5vers scripts to leave the source directory unchanged when bin/release --private is run. Platforms tested: mir (changes to scripts only)
* [svn-r11915] Purpose:John Mainzer2006-01-311-7/+19
| | | | | | | | | | | | | | | | | | | Attempt to ensure that the parallel cache test runs at a reasonable speed with large numbers of processors. Description: In some cases, the number of random locks and unlocks was a multiple of the MPI rank. Solution: Use rank % 4 instead of simply rank. Platforms tested: copper Misc. update:
* [svn-r11914] Purpose:Fang Guo2006-01-311-0/+2
| | | | | | | | | | | Add in cache_api.dsp and cache_apidll.dsp Description: Solution: Platforms tested: Misc. update:
* [svn-r11913] Purpose:Fang Guo2006-01-312-0/+4
| | | | | | | | | | | Windows Maintenance Description: Add in cache_api.dsp and cache_apidll.dsp Solution: Platforms tested: Misc. update:
* [svn-r11912] Purpose:Fang Guo2006-01-311-1862/+1892
| | | | | | | | | | | Maintenance on Windows Description: Update all.sln to include cache_api.dsp and cache_apidll.dsp Solution: Platforms tested: Misc. update:
* [svn-r11911] Purpose:Fang Guo2006-01-311-0/+42
| | | | | | | | | | | Maintenance on Windows Description: Update workspace to include cache_api.dsp and cache_apidll.dsp Solution: Platforms tested: Misc. update:
* [svn-r11910] Purpose:Fang Guo2006-01-311-0/+4
| | | | | | | | | | | Maintenance on Windows Description: Add cache_common.c into cachedll.dsp Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11909] Purpose:Fang Guo2006-01-311-0/+4
| | | | | | | | | | | Maintenance on Windows Description: Add cache_common.c into project cache.dsp Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11908] Purpose:Fang Guo2006-01-311-0/+7
| | | | | | | | | | | Maintenance on Windows Description: Add tests for cache_api.dsp and cache_apidll.dsp Solution: Platforms tested: Misc. update:
* [svn-r11907] Purpose:Fang Guo2006-01-311-0/+109
| | | | | | | | | | | Maintenance on Windows Description: Add new tests cache_apidll.dsp Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11906] Purpose:Fang Guo2006-01-311-0/+111
| | | | | | | | | | | Mintainance on Windows Description: Add new tests cache_api.dsp Solution: Platforms tested: Windows XP Misc. update:
* [svn-r11904] Purpose:John Mainzer2006-01-291-0/+3487
| | | | | | | | | | | | | | | | | | | | | Add a file that I forgot in my last checkin. Description: t_cache.c is the source file for the new parallel metadata cache test. Solution: See above. Platforms tested: h5committested before the last checkin. Will run another h5committest shortly, but it shouldn't be necessary as there are no new changes. Misc. update:
* [svn-r11903] Purpose:John Mainzer2006-01-293-0/+6564
| | | | | | | | | | | | | | | | | | | | | | Add files that I forgot in my last checkin. Description: cache_api.c cache_common.c cache_common.h are new files that result from breaking the old cache test into two tests. Solution: See above. Platforms tested: h5committested before the last checkin. Will run another h5committest shortly, but it shouldn't be necessary as there are no new changes. Misc. update:
* [svn-r11901] Purpose:Quincey Koziol2006-01-281-0/+82
| | | | | | | | | | | | | | Bug fix/additional tests Description: Add additional tests for holding open an object of a given type (dataset, group, etc) while incorrectly trying to open that object with a different type of API routine (i.e. using the group open call on a dataset, etc.) Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r11899] Purpose:Quincey Koziol2006-01-2817-170/+1313
| | | | | | | | | | | | | | | | Bug fix & new feature Description: Support variable-length datatypes in compact data storage and chunked data storage, along with attributes. Bug fix on the H5T_vlen_set_loc to allow for changing the file on a variable-length datatype on disk. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4 Can't h5committest right now, due to missing cache files.
* [svn-r11897] Purpose:John Mainzer2006-01-2711-6490/+922
| | | | | | | | | | | | | | | | | | | | | | | | | | | | 1) Add parallel test for metadata cache 2) Split serial test for metadata cache into two parts 3) Fix bug in which cache was flushed needlessly when the cache wasn't full. 4) Performance improvements 5) Update API for parallel cache coherency bug fix. Description: See above. Solution: See above. Platforms tested: h5committest Misc. update:
* [svn-r11896] Purpose:John Mainzer2006-01-271-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | 1) Add parallel test for metadata cache 2) Split serial test for metadata cache into two parts 3) Fix bug in which cache was flushed needlessly when the cache wasn't full. 4) Performance improvements Description: See above. Solution: See above. Platforms tested: h5committest Misc. update:
* [svn-r11895] Purpose:Leon Arber2006-01-271-9/+16
| | | | | | | | | | | | | | | Bug fix. Description: Seems like some compilers don't like the "inline" function spec. Solution: Removed the inline description for the sub_time function. Platforms tested: heping and tg-login. Misc. update:
* [svn-r11894] Purpose:Leon Arber2006-01-263-12/+137
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Feature, address bug #426 Description: The h5perf test now also keeps track of the time it takes to: open a file: Time between start of open and start first read/write close a file: Time between end of last read/write and end of close. This information is only displayed if debug output printing is enabled (level 3 or higher) Solution: The test actually has all of the data necessary to compute the time it takes to open and close a file; it just wasn't recording it. Added 4 new timers: HDF5_FILE_READ_OPEN HDF5_FILE_READ_CLOSE HDF5_FILE_WRITE_OPEN HDF5_FILE_WRITE_CLOSE that keep track of the time to open/close a file opened for reading/writing. Platforms tested: heping and mir Misc. update:
* [svn-r11891] Purpose: Small bug fixElena Pourmal2006-01-251-1/+3
| | | | | | | | | | | | | | | | Description: h5_group example didn't work on VMS; it turned out that a group was not closed and since the default file close degree is "weak", file was not closed either. When program attempted to open the same file, system reported an error since the file was "locked by another user". UNIX systems apperently do not care and open the same file without any problem. Solution: Added H5Gclose calls. Platforms tested: VMS server and heping Misc. update:
* [svn-r11889] Purpose:Quincey Koziol2006-01-241-0/+1
| | | | | | | | | | Bug fix Description: Fix compile problem with C++ compiler after recent changes. Platforms tested: FreeBSD 4.11 (sleipnir) w/CC=g++
* [svn-r11886] Purpose:Quincey Koziol2006-01-2353-1279/+1198
| | | | | | | | | | | | | Code cleanup Description: Check in some of the code cleanups from working on the external link support. (This doesn't include any of the external link features) Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX.4 (amazon) Linux 2.4
* [svn-r11884] Snapshot version 1.7 release 57HDF Admin2006-01-227-17/+17
|
* [svn-r11883] Purpose: Fixed bugBinh-Minh Ribler2006-01-181-2/+0
| | | | | | | | | | Description: Removed the call to h5_test from dsets.cpp, since resetting the library made the C++ global constants become invalid. Platforms tested: Linux 2.4 (heping) SunOS 5.8 64-bit (sol)