summaryrefslogtreecommitdiffstats
path: root/src
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r6269] Purpose:Quincey Koziol2003-01-138-26/+66
| | | | | | | | | | | | | Code cleanup Description: Various code cleanups to allow the development branch to be compiled with a C++ compiler (i.e. CC=g++ ) Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir) C++
* [svn-r6268] Purpose:Quincey Koziol2003-01-111-4/+4
| | | | | | | | | | | Code improvement Description: Add extra pair of braces to API versions of FUNC_ENTER/FUNC_LEAVE macros, to make API <-> non-API mismatches obvious. Platforms tested: FreeBSD 4.7 (sleipnir)
* [svn-r6267] Snapshot version 1.5 release 45HDF Admin2003-01-112-3/+4
|
* [svn-r6266] Purpose:Quincey Koziol2003-01-1084-1526/+1505
| | | | | | | | | | | | Code cleanup/new feature. Description: Split FUNC_LEAVE into API and non-API specific versions. This allows a solution to compiling this branch with C++, as well as reducing the size of the binaries produced. Platforms tested: FreeBSD 4.7 (sleipnir) w/serial, parallel (including MPE) & thread-safe
* [svn-r6255] Purpose:Quincey Koziol2003-01-0910-179/+724
| | | | | | | | | | Code cleanup Description: Clean up a few more warnings and update dependencies. Platforms tested: Linux 2.2.18smp (eirene) serial & parallel
* [svn-r6252] Purpose:Quincey Koziol2003-01-0987-3062/+6559
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Lots of performance improvements & a couple new internal API interfaces. Description: Performance Improvements: - Cached file offset & length sizes in shared file struct, to avoid constantly looking them up in the FCPL. - Generic property improvements: - Added "revision" number to generic property classes to speed up comparisons. - Changed method of storing properties from using a hash-table to the TBBT routines in the library. - Share the propery names between classes and the lists derived from them. - Removed redundant 'def_value' buffer from each property. - Switching code to use a "copy on write" strategy for properties in each list, where the properties in each list are shared with the properties in the class, until a property's value is changed in a list. - Fixed error in layout code which was allocating too many buffers. - Redefined public macros of the form (H5open()/H5check, <variable>) internally to only be (<variable>), avoiding innumerable useless calls to H5open() and H5check_version(). - Reuse already zeroed buffers in H5F_contig_fill instead of constantly re-zeroing them. - Don't write fill values if writing entire dataset. - Use gettimeofday() system call instead of time() system when checking the modification time of a dataset. - Added reference counted string API and use it for tracking the names of objects opening in a file (for the ID->name code). - Removed redundant H5P_get() calls in B-tree routines. - Redefine H5T datatype macros internally to the library, to avoid calling H5check redundantly. - Keep dataspace information for dataset locally instead of reading from disk each time. Added new module to track open objects in a file, to allow this (which will be useful eventually for some FPH5 metadata caching issues). - Remove H5AC_find macro which was inlining metadata cache lookups, and call function instead. - Remove redundant memset() calls from H5G_namei() routine. - Remove redundant checking of object type when locating objects in metadata cache and rely on the address only. - Create default dataset object to use when default dataset creation property list is used to create datasets, bypassing querying for all the property list values. - Use default I/O vector size when performing raw data with the default dataset transfer property list, instead of querying for I/O vector size. - Remove H5P_DEFAULT internally to the library, replacing it with more specific default property list based on the type of property list needed. - Remove redundant memset() calls in object header message (H5O*) routines. - Remove redunant memset() calls in data I/O routines. - Split free-list allocation routines into malloc() and calloc()- like routines, instead of one combined routine. - Remove lots of indirection in H5O*() routines. - Simplify metadata cache entry comparison routine (used when flushing entire cache out). - Only enable metadata cache statistics when H5AC_DEBUG is turned on, instead of always tracking them. - Simplify address comparison macro (H5F_addr_eq). - Remove redundant metadata cache entry protections during dataset creation by protecting the object header once and making all the modifications necessary for the dataset creation before unprotecting it. - Reduce # of "number of element in extent" computations performed by computing and storing the value during dataspace creation. - Simplify checking for group location's file information, when file has not been involving in file-mounting operations. - Use binary encoding for modification time, instead of ASCII. - Hoist H5HL_peek calls (to get information in a local heap) out of loops in many group routine. - Use static variable for iterators of selections, instead of dynamically allocation them each time. - Lookup & insert new entries in one step, avoiding traversing group's B-tree twice. - Fixed memory leak in H5Gget_objname_idx() routine (tangential to performance improvements, but fixed along the way). - Use free-list for reference counted strings. - Don't bother copying object names into cached group entries, since they are re-created when an object is opened. The benchmark I used to measure these results created several thousand small (2K) datasets in a file and wrote out the data for them. This is Elena's "regular.c" benchmark. These changes resulted in approximately ~4.3x speedup of the development branch when compared to the previous code in the development branch and ~1.4x speedup compared to the release branch. Additionally, these changes reduce the total memory used (code and data) by the development branch by ~800KB, bringing the development branch back into the same ballpark as the release branch. I'll send out a more detailed description of the benchmark results as a followup note. New internal API routines: Added "reference counted strings" API for tracking strings that get used by multiple owners without duplicating the strings. Added "ternary search tree" API for text->object mappings. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} Other platforms/configurations tested? FreeBSD 4.7 (sleipnir) serial & parallel Solaris 2.6 (baldric) serial
* [svn-r6232] Purpose:Albert Cheng2003-01-035-5/+467
| | | | | | | | | | | | | | | | new feature Description: Added MPICH/MPE instrumentation support. All source code are bracketed by the macro H5_HAVE_MPE. Use "--enable-mpe" to configure it in. Currently only worked in Eirene because the MPE library is not installed in all machines yet. The added file, H5MPprivate.h, holds HDF5/MPE related defintions. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)}? Yep. Other platforms/configurations tested? --enable-mpe feature tested in Eirene.
* [svn-r6229] Purpose:Albert Cheng2003-01-031-1/+2
| | | | | | | | | | | Minor fix Description: By mistake, the MPI_Error handling macros were inserted outside the overall macro bracket. Moved them back inside the bracket. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)}? Yep.
* [svn-r6228] Description:Albert Cheng2003-01-031-3/+0
| | | | | | | | When I removed the option (--enable-parallel=mpich), which did not work, I failed to run autoheader to update this file. I am checking in the updated version now. Platforms tested: No need to test since it just removed a #undefine and comments.
* [svn-r6223] Purpose:Binh-Minh Ribler2002-12-222-8/+8
| | | | | | | | | | | | | | | | | | | | | | Bug fix - informed by Kent Description: Some identifiers were flagged as unresolved symbols when building with c++ on Windows. The reason is the name of these identifiers were changed by the c++ compiler, also called name mangling. Solution: Moved #ifdef __cplusplus extern "C" { #endif to include the offending identifiers so the c++ compiler will take them as is. Platforms: SunOS 5.7 (arabica) Linux 6.2 (eirene) Windows 2000
* [svn-r6221] Snapshot version 1.5 release 44HDF Admin2002-12-211-2/+2
|
* [svn-r6220] Purpose:Bill Wendling2002-12-194-156/+299
| | | | | | | | | | Update Description: A few generic changes to the FPHDF5 code. Some error messages reworked a bit. Cleaning up in case of failure improved in some cases. Added another field to the synchronization messages... Platforms tested: Linux
* [svn-r6219] Purpose:Bill Wendling2002-12-191-1/+0
| | | | | | | | | Update Description: Removed the EFL field from the FPHDF5 structure as the property list already has this info. Platforms tested: Linux
* [svn-r6218] Purpose:Bill Wendling2002-12-191-47/+17
| | | | | | | | | | Bug Fix Description: Was encoding a value as DTYPE instead of MTIME, which would cause a couple of errors. Also, got rid of the EFL field as it's encoded in the PLIST already... Platforms tested: Linux...Modest test, FPHDF5 not fully implemented just yet.
* [svn-r6206] Raymond Lu2002-12-131-2/+2
| | | | | | | | | Purpose: Improve error handling Description: make error handling better for VL string null pointer. Platform tested: arabica
* [svn-r6202] MuQun Yang2002-12-133-4/+12
| | | | | | | | | | | | | | | | Purpose: Fix bugs for windows platform. Description: 1. Update HDlseek for windows 2. Update H5Otime.c for normal time(non-daylight time) 3. Add H5_DLL in front of two functions so that windows DLL can work. Solution: Platforms tested: windows 2000, eirene(since most updates have WIN32 around it, not need to test other platforms) Misc. update: Update MANIFEST if you add or remove any file. Update release_docs/RELEASE for bug fixes, new features, etc. Update applicable document files too.
* [svn-r6199] Raymond Lu2002-12-121-2/+3
| | | | | | | Purpose: error-detection improvement Description: verify string parameter in function H5T_vlen_str_mem_getlen isn't nil.
* [svn-r6195] Raymond Lu2002-12-114-105/+249
| | | | | | | | | | Purpose: Cleanup H5Tget_native_type code Description: improve code cosmetics. Solution: Platforms tested: modi4, eirene, arabica
* [svn-r6193] Snapshot version 1.5 release 43HDF Admin2002-12-071-2/+2
|
* [svn-r6178] ./hdf5-devel/src/H5Epublic.hRobb Matzke2002-12-041-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: New Feature; Optimization; Clean-up (Merged from 1.4 branch) Description: There is no symbolic constant to pass to functions that take an optional object ID for when the caller wants to indicate no object ID. In the past the caller always passed a negative integer. GPFS performs poorly. The h5ls tool decides whether to list the file name in the output based on a compile-time choice, which isn't always optimal at run time. Solution: Added a symbolic constant H5I_INVALID_HID. Added code to tell the mmfsd of GPFS to forego byte range token prefetching. h5ls decides whether to print the file name at runtime based on the number of objects being listed. Platforms tested: SuSE Linux (arborea), gcc and mpich-1.2.4 SunOS (baldric), gcc 2002-12-03 22:51:43 Robb Matzke <matzke@arborea.spizella.com> *: Added H5E_FCNTL minor error number.
* [svn-r6177] ./hdf5-devel/src/H5E.cRobb Matzke2002-12-041-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: New Feature; Optimization; Clean-up (Merged from 1.4 branch) Description: There is no symbolic constant to pass to functions that take an optional object ID for when the caller wants to indicate no object ID. In the past the caller always passed a negative integer. GPFS performs poorly. The h5ls tool decides whether to list the file name in the output based on a compile-time choice, which isn't always optimal at run time. Solution: Added a symbolic constant H5I_INVALID_HID. Added code to tell the mmfsd of GPFS to forego byte range token prefetching. h5ls decides whether to print the file name at runtime based on the number of objects being listed. Platforms tested: SuSE Linux (arborea), gcc and mpich-1.2.4 SunOS (baldric), gcc 2002-12-03 22:50:23 Robb Matzke <matzke@arborea.spizella.com> *: Added H5E_FCNTL minor error number.
* [svn-r6176] ./hdf5-devel/src/H5.cRobb Matzke2002-12-041-7/+46
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: New Feature; Optimization; Clean-up (Merged from 1.4 branch) Description: There is no symbolic constant to pass to functions that take an optional object ID for when the caller wants to indicate no object ID. In the past the caller always passed a negative integer. GPFS performs poorly. The h5ls tool decides whether to list the file name in the output based on a compile-time choice, which isn't always optimal at run time. Solution: Added a symbolic constant H5I_INVALID_HID. Added code to tell the mmfsd of GPFS to forego byte range token prefetching. h5ls decides whether to print the file name at runtime based on the number of objects being listed. Platforms tested: SuSE Linux (arborea), gcc and mpich-1.2.4 SunOS (baldric), gcc 2002-12-03 23:23:45 Robb Matzke <matzke@arborea.spizella.com> * H5_trace: Added printing for H5S_sel_type, code "St". 2002-12-03 22:45:11 Robb Matzke <matzke@arborea.spizella.com> *: Removed a little white space. Other changes are probably due to additional API tracing statements inserted automatically.
* [svn-r6172] Purpose:Quincey Koziol2002-12-041-1/+3
| | | | | | | Bug fix Description: Correct another missing field I overlooked earlier.
* [svn-r6170] Purpose:Quincey Koziol2002-12-041-0/+1
| | | | | | | | | | Bug fix Description: Add missing 'naccess' field required for GPFS token management code. Platforms tested: FreeBSD 4.7 (sleipnir)
* [svn-r6149] ./hdf5-devel/src/H5Ipublic.hRobb Matzke2002-12-041-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: Feature; Optimization Description: Clients pass `-1' or make their own #define for HDF5 functions that take an optional object ID. Blue's GPFS is slow for typical SAF restart dumps. Solution: Added a #define for H5I_INVALID_HID Added GPFS-specific code to H5FDmpiposix.c that tells mmfsd to forego byte range token prefetching. This code can be compiled into the library by defining USE_GPFS_HINTS. The plan is to either generalize this so it's detected during configure and turned on/off at runtime, or to move it up into DSL/SAF with the new HDF5 functions to that return the low-level file handle. Platforms tested: SuSE Linux (arborea), gcc and mpich-1.2.4 SunOS (baldric), gcc 2002-09-05 12:24:28 Robb Matzke <matzke@arborea.spizella.com> *: Added #define for H5I_INVALID_HID. An invalid object handle is actually any integer that isn't currently in use as a handle, and non-positive integers are never used as a handle. The #define is -1, and is mostly so that HDF5 users can pass a symbolic name instead of a negative number to functions that take optional object ID arguments.
* [svn-r6148] ./hdf5-devel/src/H5FDmpiposix.cRobb Matzke2002-12-041-10/+58
| | | | | | | | | | | | | | | | | | | | | | | | | Purpose: Feature; Optimization Description: Clients pass `-1' or make their own #define for HDF5 functions that take an optional object ID. Blue's GPFS is slow for typical SAF restart dumps. Solution: Added a #define for H5I_INVALID_HID Added GPFS-specific code to H5FDmpiposix.c that tells mmfsd to forego byte range token prefetching. This code can be compiled into the library by defining USE_GPFS_HINTS. The plan is to either generalize this so it's detected during configure and turned on/off at runtime, or to move it up into DSL/SAF with the new HDF5 functions to that return the low-level file handle. Platforms tested: SuSE Linux (arborea), gcc and mpich-1.2.4 SunOS (baldric), gcc
* [svn-r6147] Description:Albert Cheng2002-12-031-4/+4
| | | | | | corrected a typo--H5Fget_obj_counts should be H5Fget_obj_count. Platforms tested: Eirene only since it is just a string typo.
* [svn-r6145] Raymond Lu2002-12-023-1/+30
| | | | | | | | | | Purpose: New feature to H5Dget_offset Description: If user block is set, H5Dget_offset should be able to return the absolute offset from the beginning of file. Platforms tested: eirene, arabica
* [svn-r6142] Purpose:Quincey Koziol2002-12-022-5/+8
| | | | | | | | | | Code cleanup Description: Clean up warnings with gcc 3.2.1 Platforms tested: FreeBSD 4.7 (sleipnir) w/C++, changes too small for triple check
* [svn-r6140] Purpose:Pedro Vicente Nunes2002-11-261-4/+17
| | | | | | | | | | | | code warrior fix CW does not recognize the _stati64 type, changed HDstat macro accordingly Platforms tested: windows 2000 (MSVC, Code warrior) linux
* [svn-r6136] Raymond Lu2002-11-259-37/+481
| | | | | | | | | | | Purpose: new functions Description: H5Gget_num_objs, H5Gget_objname_by_idx and H5Gget_objtype_by_idx. Platforms tested: modi4, arabica, eirene Misc. update: RELEASE.txt updated.
* [svn-r6133] Snapshot version 1.5 release 42HDF Admin2002-11-231-2/+2
|
* [svn-r6132] Purpose:Bill Wendling2002-11-211-21/+15
| | | | | | | | | | Update Description: Cleaned up the debug printing of the generic property list. It was printout NULL property values for non-existant properties and putting multiple properties into one group. Platforms tested: Eirene (too small change for full testing)
* [svn-r6131] Purpose:Quincey Koziol2002-11-212-2/+2
| | | | | | | | | | Code cleanup Description: Clean up compiler warnings from IRIX64 builds. Platforms tested: IRIX64 6.5 (modi4)
* [svn-r6123] *** empty log message ***Quincey Koziol2002-11-201-2/+2
|
* [svn-r6116] Purpose:Quincey Koziol2002-11-202-2/+2
| | | | | | | | | | | | | Code cleanup Description: Finish checkin of H5A API cleanups with header files I forgot on the first checkin pass. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir)
* [svn-r6114] Purpose:Quincey Koziol2002-11-206-115/+253
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Code Cleanup & New Feature Description: H5config.h.in: Removed H5_HAVE_COMPRESSION & H5_HAVE_FILTER_GZIP flags. Added H5_HAVE_FILTER_DEFLATE flag. H5Z.c: H5Zprivate.h: H5Zpublic.h: Switched from using H5_HAVE_COMPRESSION flag in favor of H5_HAVE_FILTER_DEFLATE. Added H5Zunregister & H5Zfilter_avail API functions. Changed a numeric constant (256) to a symbolic constant (H5Z_FILTER_RESERVED). Automatically add the shuffling filter to the list of available filters (when it is enabled). Moved prototypes for H5Z_filter_deflate & H5Z_filter_shuffle from the public header into the private header. H5Zdeflate.c: Switched from using H5_HAVE_COMPRESSION & H5_HAVE_FILTER_GZIP flags in favor of H5_HAVE_FILTER_DEFLATE. Cleaned up formatting & error reporting a bit. H5Zshuffle.c: Rewrote shuffling algorithm to be more efficient. Added error checking & reporting. Added standard Pablo information. Added standard function header comment. Added FUNC_ENTER & FUNC_LEAVE macros. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir)
* [svn-r6108] Purpose:Quincey Koziol2002-11-204-22/+14
| | | | | | | | | | | | Code cleanup. Description: Cleaned up compiler warnings & updated a few comments. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir)
* [svn-r6106] Purpose:Quincey Koziol2002-11-202-88/+78
| | | | | | | | | | | | | | | | | | | | | | | | | Code cleanup, Feature enhancement Description: Improve hashing algorithm to not generate as many clashes. Avoid using H5MD_realloc when changing the size of a chunk on disk. Instead, use H5MF_free followed by H5MF_alloc, which avoids copying the information from the space for the previous chunk to the space for the new chunk, since we are going to overwrite the chunk with new data anyway. This change should both improve I/O performance in situations where compressed chunks are being overwritten as well as reduce the space used in the file during that situation. Cleaned up error handling in a few cases. Removed old debugging printf()s. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir)
* [svn-r6104] Purpose:Quincey Koziol2002-11-201-0/+1
| | | | | | | | | | | | | | | | | Bug Fix Description: Free blocks of space in the file which were merged with a block before them were not updating the free list information correctly, allowing space in the file to over-allocated and potentially corrupted. Solution: Correct address of free block during merging. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)} FreeBSD 4.7 (sleipnir)
* [svn-r6088] MuQun Yang2002-11-131-1/+1
| | | | | | | | | | Purpose: add H5Zshuffle.c at Makefile.in Description: Solution: Platforms tested: eirene,modi4,arabica Misc. update:
* [svn-r6087] MuQun Yang2002-11-134-0/+141
| | | | | | | | | | | | | | | | | | | Purpose: Adding internal shuffle filter Description: With the combination of shuffling filter with general compression algorithm, the compression ratio may be improved without adding much encoding and decoding time for many real NASA datasets(especially floating data) and other application datasets(See techNotes). Solution: SHuffle the bytes within the data to utilize the locality. Platforms tested: arabica , eirene, modi4 Misc. update: Update MANIFEST if you add or remove any file. Update release_docs/RELEASE for bug fixes, new features, etc. Update applicable document files too.
* [svn-r6084] Purpose:Bill Wendling2002-11-123-47/+24
| | | | | | | | | | | FPHDF5 Fixups Description: - Stopped using API calls in the H5FPclient code. It now uses internal library calls. - Removed some FIXME comments because they've been fixed. - Small fix for an enum starting at 37 for no reason :-) Platforms tested: Eirene (only affects FPHDF5, so no need to test 3 platforms just yet).
* [svn-r6077] Purpose:Quincey Koziol2002-11-123-7/+15
| | | | | | | | | | Code cleanup Description: Added some comments and made some minor code cleanups Platforms tested: minor change, only testing on FreeBSD 4.7 (sleipnir) w/parallel
* [svn-r6076] Purpose:Bill Wendling2002-11-121-3/+3
| | | | | | | | | | | Update Description: Changed some of the asserts to check that a non-NULL H5F_t* is passed in. Platforms tested: Eirene PP Arabica Fortran Modi4 PP Fortran
* [svn-r6075] Purpose:Bill Wendling2002-11-121-0/+1
| | | | | | | | | | Update Description: Added EFL to the FPHDF5 structure. Platforms tested: Eirene PP Arabica Fortran Modi4 PP Fortran
* [svn-r6074] Purpose:Bill Wendling2002-11-121-0/+36
| | | | | | | | | | Update Description: Added EFL to the Object FPHDF5 structure. Platforms tested: Eirene PP Arabica Fortran Modi4 PP Fortran
* [svn-r6073] Purpose:Bill Wendling2002-11-122-43/+105
| | | | | | | | | | | Update Description: Added code which performs an update when there's a dataset creation. Commented on some FIXMEs which were in the code. Platforms tested: Eirene PP Arabica Fortran Modi4 PP Fortran
* [svn-r6072] Purpose:Bill Wendling2002-11-112-12/+10
| | | | | | | | | | Code Movement Description: Moved definition of the H5D_t data structure into the H5Dprivate.h header file. With the FPHDF5 stuff, we need access to this data structure. Platforms tested: Eirene...change small, so no need for all three tests.
* [svn-r6071] Purpose:Quincey Koziol2002-11-112-0/+6
| | | | | | | | | | | | Code cleanup Description: Start using the H5_HAVE_FILTER_GZIP macro to enable the gzip filter. Platforms tested: Tested h5committest {arabica (fortran), eirene (fortran, C++) modi4 (parallel, fortran)}? Tested FreeBSD 4.7 (sleipnir) also
generated by cgit v0.12 at 2024-08-22 04:06:04 (GMT)