summaryrefslogtreecommitdiffstats
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r12125] Purpose:Quincey Koziol2006-03-217-340/+597
| | | | | | | | | | | | | | | Code checkpoint Description: Update fractal heap code to insert & read heaps up to 64MB in size (with my current configuration paramaters) and add initial support for iteratively walking down nested indirect blocks. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4 (chicago) Solaris 9 (shanti) Linux 2.4 (mir) w/64-bit
* [svn-r12123] Purpose:MuQun Yang2006-03-201-12/+14
| | | | | | | | | | | | | | Add more comments Description: Add more comments to H5Dmpio.c, which describes a little bit more about collective IO management. Solution: Platforms tested: Only test at heping since only comments were added. Misc. update:
* [svn-r12122] Purpose:Quincey Koziol2006-03-185-5/+164
| | | | | | | | | | | Code update Description: Add basics of routine for reading information back out of a fractal heap. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r12118] Purpose:Quincey Koziol2006-03-181-10/+25
| | | | | | | | | | | | | Checkpoint code Description: Rework code to support increasing size of root indirect block, in order to add [at least] a second row of direct blocks. Platforms tested: FreeBSD 4.11 (sleipnir) Solaris 9 (shanti) w/64-bit Linux 2.4 (mir)
* [svn-r12117] Purpose:MuQun Yang2006-03-181-38/+25
| | | | | | | | | | | | | | | | | | | | | Enhancing the optimiziation of collective IO per chunk Description: When the user does one of the following two things: 1. to do collective IO per chunk without using our optimization code 2. or the user passes the percent of number of process per chunk to be 0 when choosing to do collective IO per chunk It is not necessary that the library uses MPI-IO collective calls to do any optimization. Solution: Modify the code so that no MPI communication-involved analyses will be done for the above cases. Chunk addresses are obtained globally and IO modes are assigned to collective always. Platforms tested: h5committest Misc. update:
* [svn-r12115] Purpose: Change codes in a more appropriate way.Raymond Lu2006-03-175-28/+33
| | | | | | | | | | | | Description: Yesterday, H5E_NONE_MAJOR and H5E_NONE_MINOR were added to error API by hand. Solution: Today, correct the change by hand with the tool hdf5/bin/make_err. The change by hand is only in src/H5err.txt. Platforms tested: fuss - simple change. Misc. update:
* [svn-r12114] Purpose:Quincey Koziol2006-03-171-7/+11
| | | | | | | | | | | | Code cleanup Description: Re-alphabetize the POSIX routines (again). Also, add proper prototype to HDrand() definition. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r12113] Purpose:Leon Arber2006-03-171-3/+0
| | | | | | | | | | | | | | | Bug fix Description: There was a duplicate definition for HDsrandom and HDsrand left over in H5private.h Solution: Removed the two duplicate definitions. Platforms tested: heping (minor change) Misc. update:
* [svn-r12111] Purpose:MuQun Yang2006-03-171-11/+44
| | | | | | | | | | | | | minor change for collective code Description: Solution: Platforms tested: mir Misc. update:
* [svn-r12110] Purpose:Leon Arber2006-03-162-16/+23
| | | | | | | | | | | | | | | | | | Optimization Description: Get rid of unnecessary function call for systems that don't have rand_r. Solution: If rand_r isn't present on a system, then macros can be used to simply call the underlying random function instead of calling the HDrand/HDsrand functions that keep track of the random seed within the library. Platforms tested: heping (minor change) Misc. update:
* [svn-r12109] Purpose: Backward compatibility supportRaymond Lu2006-03-164-2/+28
| | | | | | | | | Description: Added H5E_NONE_MAJOR and H5E_NONE_MINOR as a major and minor error message. Their messages are "no error", but because the old library had them, they're added in for backward compatibility. Platforms tested: fuss - simple change.
* [svn-r12108] Purpose:Quincey Koziol2006-03-162-33/+37
| | | | | | | | | | | | | Code cleanup Description: Move VAX floating-point definitions down by the other machine specific ones. Re-work the version handling for VAX byte ordered floating-point numbers. Version numbers ought to be strictly increasing, not a bit-field. Platforms tested: FreeBSD 4.11 (sleipnir)
* [svn-r12107] Purpose: Minor changeRaymond Lu2006-03-161-3/+3
| | | | | | | Description: Changed macro from VMS to H5_VMS. Platforms tested: no test needed.
* [svn-r12104] Purpose:Quincey Koziol2006-03-161-2/+2
| | | | | | | | | | Code cleanup Description: Re-alphabetize POSIX macros. Platforms tested: None, just eyeballed, too minor.
* [svn-r12102] Purpose:Quincey Koziol2006-03-161-11/+2
| | | | | | | | | | Code cleanup Description: Clean up formatting & comments, etc. Platforms tested: None, very minor
* [svn-r12093] Purpose:Quincey Koziol2006-03-1513-197/+715
| | | | | | | | | | | | | Code checkpoint Description: Checkpoint fractal heap changes - mostly internal changes to better handle more direct blocks from root indirect block. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4 (chicago) Mac OS X (amazon)
* [svn-r12091] Purpose: Support for VAX floating-point types.Raymond Lu2006-03-145-47/+238
| | | | | | | | | | | | Solution: Support VAX float and double types with new byte order. There're some details not yet included, 1. the alignment detection for VAX order in H5detect.c. 2. support for special values in library conversion functions. 3. the infinity for VAX in H5T_init_inf. 4. support for VAX types in printing hexadecimal format. Platforms tested: h5committest and fuss.
* [svn-r12090] Purpose:MuQun Yang2006-03-146-25/+223
| | | | | | | | | | | | | | | | | | | New APIs to add for collective chunk IO Description: Three new APIs H5Pset_dxpl_mpio_chunk_opt_ratio H5Pset_dxpl_mpio_chunk_opt_num H5Pset_dxpl_mpio_chunk_opt for optional optimization choices from users. Solution: Haven't added tests yet, won't affect other parts of the library. Will add tests after urgent investigations of memory leaking problems from NASA Aura team. Platforms tested: heping: both parallel and sequential shanti Misc. update:
* [svn-r12085] Purpose:Quincey Koziol2006-03-141-1/+1
| | | | | | | | | | Bug fix Description: Correct function name in FUNC_ENTER macro. Platforms tested: None, just eyeballed, too minor to require more.
* [svn-r12084] Purpose:Quincey Koziol2006-03-1315-280/+2153
| | | | | | | | | | | | | | | | Code checkpoint Description: The fractal heap code is reasonably stable and is passing all its current tests, so checkpoint everything with CVS. Also, add "statistics" module for v2 B-trees code, which is only a stub right now. Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX (amazon) Linux 2.4 (chicago)
* [svn-r12083] Snapshot version 1.7 release 58HDF Admin2006-03-132-3/+3
|
* [svn-r12082] Purpose:Quincey Koziol2006-03-123-3/+3
| | | | | | | | | | | Bug fix Description: Clean up a few code mis-matches that crept in during the last checkin. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5commitest
* [svn-r12081] Purpose:Quincey Koziol2006-03-112-12/+80
| | | | | | | | | | | New feature Description: Update "power of two" macro and add "general" log2() routine. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r12080] Purpose:Quincey Koziol2006-03-111-0/+30
| | | | | | | | | | | | New feature Description: Add "variable-length" 32-bit encode/decode macros, matching the other 64-bit ones, for later use in the fractal heap code. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor for full h5committest
* [svn-r12079] Purpose:Quincey Koziol2006-03-115-1/+11
| | | | | | | | | | | Update code Description: Add a new error value, for later use. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor for full committest
* [svn-r12078] Purpose:Quincey Koziol2006-03-112-41/+222
| | | | | | | | | | | | New features Description: Add "find node greater than or equal to key" and "remove first" operations to skip lists. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r12077] Purpose:Quincey Koziol2006-03-114-11/+17
| | | | | | | | | | | Code cleanup Description: Fix/update formatting, clean up typos, etc. Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r12054] Purpose: VMS portElena Pourmal2006-03-092-0/+21
| | | | | | | | | | | | Description: Made small changes to sec2 driver to reflect that VMS systems ino_t is 1dim array of size 3; all changes are marked with H5_VMS variable. Defined HDremove macro for VMS to remove multiple versions of the files. Solution: Platforms tested: heping, VMS server Misc. update:
* [svn-r12035] Purpose:Fang Guo2006-03-071-2/+2
| | | | | | | | | | | | | | Description: Two functions (HDsrand and HDrand) are not declared. They caused compiling errors on Windows. Declare these two functions: H5_DLL int HDrand(); H5_DLL void HDsrand(unsigned int seed); Solution: Platforms tested: Windows XP and heping Misc. update:
* [svn-r12021] Purpose:Leon Arber2006-03-071-2/+2
| | | | | | | | | | | | | | | Bug fix. Description: Fix typo. srand/srandom don't return anything, so don't attempt to return their value. Solution: Platforms tested: heping Misc. update:
* [svn-r12019] Purpose:Leon Arber2006-03-074-17/+57
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug fix/Feature Description: Modify the library to use rand_r, when available, instead of srand. If rand_r is not available, it will try to use srandom/random, and then finally fall back to srand/rand. Solution: A couple places in the library use the srand() function to seed the random number generator. This can cause problems on certain platforms and could theoretically cause problems for users who expect a certain sequence of random numbers following their own call to srand(). Most platforms have an implementation of rand_r, which is identical to rand, except that it allows for explicit storage of the seed value. The configure script will now check for the existence of rand_r to facilitate its use in the library. Two new functions are added, to replace the macros HDsrand/HDrand. These functions are HDrand and HDsrand. HDrand will call rand_r, if available, or random(), if available, and fall back to rand() if neither of those is available. HDsrand will store the seed value locally, if rand_r is available. Otherwise, it will call srandom if available, and fall back to srand otherwise. Platforms tested: heping, mir. Really need to test on Red Storm, since that platform motivated this fix, but the machine is currently not available. Misc. update:
* [svn-r12017] Purpose:Quincey Koziol2006-03-072-3/+3
| | | | | | | | | | | | | | Bug fix Description: Correct problem with new log2(n) routine on 64-bit machines. Solution: Put some casts in to make certain that the values are computed as 32-bit integers. Platforms tested: Linux 2.4 (mir) - 64-bit
* [svn-r12007] Purpose:Quincey Koziol2006-03-051-1/+1
| | | | | | | | | | Bug fix Description: Fix typo in H5HF_dblock_debug() prototype Platforms tested: FreeBSD 4.11 (sleipnir)
* [svn-r12004] Purpose:Quincey Koziol2006-03-0419-169/+1697
| | | | | | | | | | | | | | | | | New feature & code cleanup Description: Update fractal heap to be able to insert objects into a direct block hanging off the header. Extract "octal dump" code into separate routine so that both the local heaps & fractal heaps can use it. Other code cleanups & support to get this far. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4
* [svn-r12003] Purpose:Quincey Koziol2006-03-042-32/+39
| | | | | | | | | | | Code cleanup Description: Fix some warnings & formatting issues Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4
* [svn-r11993] Purpose:James Laird2006-03-011-22/+22
| | | | | | | | | | | | | | Added HL examples Description: Examples existed for the HL lite, image, and table interfaces, but were never included in the distro... until now! Solution: Added source files to CVS, updated Makefile and MANIFEST. Platforms tested: mir, heping, shanti
* [svn-r11991] Purpose:Albert Cheng2006-03-012-15/+7
| | | | | | | | | | | | | | | | | Porting. Description: Red Storm's lustre used srand and rand to initialize their user mode of lustre. HDF5 also uses srand and that messes up Lustre. Solution: Use -DRED_STORM to block out the HDF5 code that calls srand. This is a temporary fix since Lustre has fixed its code from calling srand and rand but the fix is not deployed at Red_storm yet. Platforms tested: Tested at Red-Storm.
* [svn-r11968] Purpose:Quincey Koziol2006-02-2713-3506/+3769
| | | | | | | | | | | | | | Incrementtal checkin Description: Revise & update v2 B-tree code to separate the internal package-specific routines from the library-callable "private" routines. Similar updates for the fractal heap code. Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX (amazon)
* [svn-r11967] Purpose:Quincey Koziol2006-02-2718-60/+1190
| | | | | | | | | | | | | | | New feature Description: Check in initial "fractal heap" code, for supporting the group redesign. Also, remove some remnants of the segmented heap/block tracker/B+tree code which I didn't find during the last pass. Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX (amazon) Linux 2.4
* [svn-r11966] Purpose:Quincey Koziol2006-02-279-458/+296
| | | | | | | | | | | | Code cleanup Description: Style fixes for consistency & other minor cleanups Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX (amazon) Linux 2.4
* [svn-r11965] Purpose:Quincey Koziol2006-02-2428-5011/+35
| | | | | | | | | | | | Maintenance Description: Remove half-built (half-baked? :-) implementation of B+tree, block tracker and segmented heaps. (In preparation for starting the new heap coding) Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4 (heping)
* [svn-r11964] Purpose:MuQun Yang2006-02-231-6/+37
| | | | | | | | | | | | | | | | | | | | | | | | | | | bug fix Description: ret_value is not set to SUCCEED in H5D_mpio_select_write That causes the 64-bit intel compiler unhappy. It will give a non-zero number and cause the testing fake failure. Another one is picked up by cmpi again. For one optimization case, another variable is not initialized properly and compiler set an unhappy number, cause the test failed. Solution: Properly initialize those variables. Platforms tested: teragrid:parallel mir:parallel heping: parallel and sequential tungsten:parallel Misc. update: h5committest doesn't finish due to no space left on device. parallel tests still failed at tungsten with cmpi. It looks like it was a bug from cmpi.
* [svn-r11963] Purpose:MuQun Yang2006-02-221-0/+1
| | | | | | | | | | | | | | | | | | | | bug fix for daily test Description: if (fm->select_chunk) is not NULL at sequential mode and not set by the library, it shouldn't be free. Otherwise, it will cause failures in the daily test. Solution: Explicitly set (fm->select_chunk) to NULL for non-parallel case. Platforms tested: copper with parallel heping with both sequential and parallel shanti with sequential Misc. update: Hopefully only mir failed at daily test.
* [svn-r11961] Purpose:MuQun Yang2006-02-211-5/+6
| | | | | | | | | | | | | | | | | | | | Bug fix in collective IO code Description: When select none occurs in one process, fm->select_chunk hasn't been allocated the memory(not allocated until create_file_hyper); however, this needs to be checked; it was caught with cmpi at NCSA linux cluster. Solution: Relocate the place to allocate the memory space for fm->select_chunk. Platforms tested: cmpi at tungsten mpich at heping kind of minor and let daily test catch other errors. Misc. update: This won't fix the failure at mir.
* [svn-r11960] Purpose:MuQun Yang2006-02-213-20/+18
| | | | | | | | | | | | | | code clean up Description: Clean up some warnings in collective chunk IO code Solution: Platforms tested: heping Misc. update:
* [svn-r11959] Purpose:MuQun Yang2006-02-201-18/+12
| | | | | | | | | | | | | | | | | | | | bug fix Description: During the process of the combination of collective chunk IO code and the original IO code, The return value of a function call hasn't been initialized. On 32-bit mode at modi4, that value isn't set to 0 by default. So a fake error value returns. Solution: Re-arrange the code so that the return value will be set properly. Platforms tested: parallel: modi4 - 32bit heping seq: heping Misc. update:
* [svn-r11955] MuQun Yang2006-02-171-1/+1
| | | | | | | | | | | | | | Purpose: Erase one printf line accidently inserted in the code. Description: Solution: Platforms tested: No need to test. Misc. update:
* [svn-r11952] Purpose:MuQun Yang2006-02-161-0/+3
| | | | | | | | | | | | Enhance the collective chunk IO support Description: Solution: Platforms tested: Misc. update:
* [svn-r11950] Purpose:MuQun Yang2006-02-164-468/+1701
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Enhanced collective chunk IO supports Description: 1. When using collective IO with chunking storage without any tuning, performance may become worse under some circumstances. 2. Current HDF5 handles raw-data IO per chunk. So for many small chunks, many small IOs will be passed into MPI-IO. That may cause bad performance. 3. For one IO per chunk case, sometimes performance with collective is worse than performance with independent. An obvious case is when only one process is doing IO and all other process are not doing IO, the collective IO will only add overheads for communication. We want to avoid this case. Some management inside our library needs to be done. Solution: - Added managements of collective IO supports for chunking storage inside parallel HDF5 1) Implemented One IO with collective mode for all chunks in the application by building one MPI derived datatype accross all chunks. 2) Implemented the decision-making support to do collective IO inside MPI-IO per chunk. 3) Added the decision-making support to do one IO accross all chunks or to do multiple IOs with each IO per chunk. 4) Added the support to handle the case some processes won't do any IOs in collectively. 5) Some MPI-IO package(mpich 1.2.6 or lower, e.g.) cannot handle collective IO correctly for the case when some processes have no contributions to IOs, a special macro is added to change collective IO mode to independent IO mode inside HDF5 library. Platforms tested: Parallel: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 SDSC Teragrid mpich-1.2.5 Linux(Tungsten) mpich-1.2.6 Altix(NCSA cobalt) Seq: Linux(heping) Misc. update:
* [svn-r11899] Purpose:Quincey Koziol2006-01-2816-72/+683
| | | | | | | | | | | | | | | | Bug fix & new feature Description: Support variable-length datatypes in compact data storage and chunked data storage, along with attributes. Bug fix on the H5T_vlen_set_loc to allow for changing the file on a variable-length datatype on disk. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4 Can't h5committest right now, due to missing cache files.