summaryrefslogtreecommitdiffstats
path: root/tools
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r14913] Introduced a compression ratio = uncompressed size / ↵Pedro Vicente Nunes2008-05-011-13/+15
| | | | | | | | compressed size in the printing of the compression with 3 digits of precision per hdf-forum NASA developers suggestion tested: windows, linux
* [svn-r14905] Introduced a ratio formula compression ratio = uncompressed ↵Pedro Vicente Nunes2008-05-016-12/+12
| | | | | | | | size / compressed size in the printing of the compression with 3 digits of precision per hdf-forum NASA developers suggestion tested: windows, linux, solaris
* [svn-r14903] Undoing change committed in r14902.Scot Breitenfeld2008-04-3069-1424/+2094
|
* [svn-r14902] Merged fortran_1_8 branch changes r14505:14901 into the trunk. ↵Scot Breitenfeld2008-04-3069-2094/+1424
| | | | New fortran wrappers added.
* [svn-r14893] fix typo in commentPedro Vicente Nunes2008-04-291-1/+1
|
* [svn-r14892] RFC display compression ratio in h5dumpPedro Vicente Nunes2008-04-296-11/+82
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Here's the current behavior of h5dump regarding the printing of the dataset creation property list For example ./h5dump -H -p -d filters HDF5 "tfilters.h5" { DATASET "deflate" { DATATYPE H5T_STD_I32LE DATASPACE SIMPLE { ( 20, 10 ) / ( 20, 10 ) } STORAGE_LAYOUT { CHUNKED ( 10, 5 ) SIZE 385 } FILTERS { COMPRESSION DEFLATE { LEVEL 9 } } FILLVALUE { FILL_TIME H5D_FILL_TIME_IFSET VALUE 0 } ALLOCATION_TIME { H5D_ALLOC_TIME_INCR } } } The proposed behavior is to add this information after SIZE SIZE 385 (51.9%COMPRESSION) That percentage is obtained trough Per = (b-a) / a Where a = theoretical size obtained by multiplying datum size times number of elements b = size obtained with H5Dget_storage_size The final print would look like HDF5 "tfilters.h5" { DATASET "deflate" { DATATYPE H5T_STD_I32LE DATASPACE SIMPLE { ( 20, 10 ) / ( 20, 10 ) } STORAGE_LAYOUT { CHUNKED ( 10, 5 ) SIZE 385 (51.9%COMPRESSION) } FILTERS { COMPRESSION DEFLATE { LEVEL 9 } } FILLVALUE { FILL_TIME H5D_FILL_TIME_IFSET VALUE 0 } ALLOCATION_TIME { H5D_ALLOC_TIME_INCR } } } tested: windows, linux, solaris
* [svn-r14792] bug fix: #1106 h5dump -b will dump ASCII values for datasets ↵Pedro Vicente Nunes2008-04-034-32/+9
| | | | | | after the first one. One variable that controls the binary output was incorrectly reset to zero after a binary output was done a first time. The effect was that on cases of several datasets, the ones after the first were not binary written. Eliminated the resetting of that variable and tested a file with several datasets. Modified the test file so that it is easier to test with the tool binread, that reads the binary output of h5dump. tested: windows, linux
* [svn-r14735] make 1.8 and 1.6 code equal or similarPedro Vicente Nunes2008-03-131-19/+22
| | | | | formatted code tested: windows, linux
* [svn-r14733] make 1.8 and 1.6 code equal or similarPedro Vicente Nunes2008-03-131-134/+134
| | | | | | formatted code bug fix: the 1.6 branch did not have a test for the existence of long double type on print_type (print name of datatype) tested: windows, linux
* [svn-r14730] make 1.8 and 1.6 code equal or similarPedro Vicente Nunes2008-03-121-678/+691
| | | | Tested: windows, linux
* [svn-r14728] make 1.8 and 1.6 code look equal or similarPedro Vicente Nunes2008-03-121-92/+125
| | | | Tested: windows, linux
* [svn-r14726] Removed unused code and make 1.8 and 1.6 code look equal or similarPedro Vicente Nunes2008-03-121-28/+37
| | | | Tested: windows, linux
* [svn-r14725] Removed unused code and make 1.8 and 1.6 code look equal or similarPedro Vicente Nunes2008-03-121-43/+1
| | | | Tested: windows, linux
* [svn-r14716] remove a commented test call that was calling for an invalid ↵Pedro Vicente Nunes2008-03-101-2/+1
| | | | | | block selection tested: linux
* [svn-r14702] 1. H5HFiblock.c: fixed problem for uninitialized "u" for bug ↵Vailin Choi2008-03-043-11/+11
| | | | | | | | | | | | #1072 in H5HF_man_iblock_size(). 2. H5HFstat.c: Since H5HF_space_size() zeroed out fs_size, add "meta_size" to store free-space size before adding to "heap_size". 3. h5stat_gentest.c: increase # of groups to get "h5stat_newgrat.h5" that contains indirect block entries in fractal heap. This is for testing the recursive part of the code in H5HF_man_iblock_size(). 4. h5stat_newgrat.h5: the new .h5 file generated by h5stat_gentest.c. 5. h5stat_newgrat.ddl: expected output from new "h5stat_newgrat.h5".
* [svn-r14700] bug fix: the function equal_double that compares double type ↵Pedro Vicente Nunes2008-03-041-69/+119
| | | | | | did not had nan logic for the cases of options -d and -p tested: windows, linux
* [svn-r14690] Description:Quincey Koziol2008-02-2810-91/+460
| | | | | | | Handle comparing datasets & attributes w/variable-length strings properly. Tested on: Linux/64 2.6.9 (chicago)
* [svn-r14671] fix typo in comments and remove unused header mentionPedro Vicente Nunes2008-02-252-11/+5
| | | | tested: linux
* [svn-r14615] this one escaped the purgePedro Vicente Nunes2008-02-191-12/+0
|
* [svn-r14613] 971 (B2) h5import bug on Windows w/binary datasets. CLOSED. ↵Pedro Vicente Nunes2008-02-1939-191/+397
| | | | | | | | | | | | | | | | | | fread in windows needs a binary file to be open with "rb" instead of "r" otherwise it terminates execution if an end of file character is found on the input file. Besides that the binary file generated needs to be open with "wb" , otherwise an end of line character is read twice. DONE NOW for 1.8, already done previously for 1.6 renamed the h5import test files to have the extensions text input files = .txt binary input files = .bin configuration files = .conf hdf5 files = .h5 besides that in very test the files have the same name except extension. For example TOOLTEST txtin16.txt -c $srcdir/testfiles/txtin16.conf -o txtin16.h5 The convention for the test name is for example, for "txtin16" "txt" for text then "in16" means integer 16 size Tested: linux, solaris
* [svn-r14470] Purpose: Fixing configure problem on IRIX64.Mike McGreevy2008-01-302-4/+4
| | | | | | | | | | | | | | | Description: IRIX64 failed to build tools/h5import, as well as c++/test with szip. This is because IRIX is very picky when it comes to linking libraries, and must be done in specific order. (other UNIXes are not as such, and thus the problem wasn't present). Solution: Rearrange the order in which the libraries are linked on the compiler line by sorting the line that assigns libraries into the LDADD variable in the Makefile.am's of the two respective directories. Tested: IRIX64, kagiso, smirom
* [svn-r14437] bug fix for h5dump subsetting (deal with blocks)and new test runsPedro Vicente Nunes2008-01-167-79/+166
| | | | | | | | | | | | | | | | | | | | | | | | | add a check for block overlap after the command line parsing * Algorithm * * In a inner loop, the parameters from SSET are translated into temporary * variables so that 1 row is printed at a time (getting the coordinate indices * at each row). * We define the stride, count and block to be 1 in the row dimension to achieve * this and advance until all points are printed. * An outer loop for cases where dimensionality is greater than 2D is made. * In each iteration, the 2D block is displayed in the inner loop. The remaining * slower dimensions above the first 2 are incremented one at a time in the outer loop * * The element position is obtained from the matrix according to: * Given an index I(z,y,x) its position from the beginning of an array * of sizes A(size_z, size_y,size_x) is given by * Position of I(z,y,x) = index_z * size_y * size_x * + index_y * size_x * + index_x * tested: windows, linux
* [svn-r14420] Description:Quincey Koziol2008-01-152-2/+2
| | | | | | | | Correct the prototype for H5Sselect_elements() to take an 'hsize_t *' for the coordinates, instead of 'hsize_t **'. Tested on: Mac OS X/32 10.5.1 (amazon)
* [svn-r14414] revert the subsetting calls of h5dump to 1 size block, still a ↵Pedro Vicente Nunes2008-01-154-27/+15
| | | | | | bug with size > 1 tested: linux
* [svn-r14413] Description:Quincey Koziol2008-01-143-3/+3
| | | | | | | | | | | | | | | | | | | Change H5P[gs]et_format_bounds() => H5P[gs]et_libver_bounds() and also enumerated values H5F_FORMAT_{EARLIEST, LATEST} => H5F_LIBVER_{EARLIEST, LATEST} Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14412] more progress on the block hyperslab bug, clean code Pedro Vicente Nunes2008-01-142-18/+10
| | | | | | modified the 3D test case for subsetting with block and stride factors tested: windows, linux
* [svn-r14411] more progress on the block hyperslab bug, clean code Pedro Vicente Nunes2008-01-142-12/+10
| | | | | | | modified the 2D test case for subsetting with block and stride factors tested: windows, linux
* [svn-r14410] code cleaningPedro Vicente Nunes2008-01-141-8/+6
|
* [svn-r14409] more progress on the block hyperslab bug, clean code Pedro Vicente Nunes2008-01-143-14/+28
| | | | | | modified the 1D test case for subsetting with block and stride factors tested: windows, linux
* [svn-r14408] Pedro Vicente Nunes2008-01-141-2/+9
| | | | | | | more progress on the block hyperslab bug, clean code tested: windows, linux
* [svn-r14407] more progress on the block hyperslab bug, clean code Pedro Vicente Nunes2008-01-141-10/+6
| | | | tested: windows, linux
* [svn-r14402] Description:Quincey Koziol2008-01-1311-0/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add work-around to allow reading files that were produced with a buggy earlier version of the library, which could create objects with the wrong object header message count. There is now a configure flag "--enable-strict-format-checks" which triggers a failure on reading a file with this sort of corruption (when enabled) and allows the object to be read (when disabled). The default value for the "strict-format-checks" flag is yes when the "debug" flag is enabled and no when the "debug" flag is disabled. Note that if strict format checks are disabled (allowing objects with this particular kind of corruption to be read) and the file is opened with write access, the library will re-write the object header for the corrupt object with the correct # of object header messages. This closes bugzilla bug #1010. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14397] partial fix for the block selection subsetting bug (2D case ok)Pedro Vicente Nunes2008-01-101-3/+49
| | | | tested: windows, linux
* [svn-r14384] new file with output regarding the new binary filePedro Vicente Nunes2008-01-081-0/+2
|
* [svn-r14383] new binary file: with double dataset with NaN valuesPedro Vicente Nunes2008-01-081-0/+0
|
* [svn-r14382] bug fix: enable NaN detection for double typePedro Vicente Nunes2008-01-082-1953/+2249
| | | | | | note: RFC at http://www.hdfgroup.uiuc.edu/RFC/HDF5/NaNs_and_HDF5/ tested: windows, linux, solaris
* [svn-r14381] comment typo fixPedro Vicente Nunes2008-01-071-1/+1
|
* [svn-r14380] Eliminate old code not used and that was replaced (command line)Pedro Vicente Nunes2008-01-071-308/+73
| | | | tested: windows, linux
* [svn-r14379] add check of some values for the nbit and scale offest filters ↵Pedro Vicente Nunes2008-01-071-10/+15
| | | | | | | | on the h5repack verify function note: some sybols were made public tested: windows, linux
* [svn-r14376] moved a couple more private filter symbols to the public side, ↵Pedro Vicente Nunes2008-01-041-1/+5
| | | | | | needed by h5repack tested: windows, linux
* [svn-r14368] clean code and reshufle functions between modules, remove ↵Pedro Vicente Nunes2008-01-034-198/+141
| | | | | | unused functions tested: windows, linux
* [svn-r14366] comments grammar correctionPedro Vicente Nunes2008-01-031-6/+1
|
* [svn-r14365] Add szip filter check of client data values for has_filters.Pedro Vicente Nunes2008-01-031-11/+8
| | | | | | NOTE: szip client symbols were made public Tested: windows, linux, solaris
* [svn-r14362] Description:Quincey Koziol2008-01-033-4/+4
| | | | | | | | | | | | | | | | | | Switched from "H5P[gs]et_latest_format" to "H5P[gs]et_format_bounds". Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14361] add a warning message in case a dataset cannot be created with ↵Pedro Vicente Nunes2008-01-021-1/+7
| | | | | | modified DCPL tested: linux
* [svn-r14360] New function has_filters (replace has_filters for each object ↵Pedro Vicente Nunes2008-01-022-333/+98
| | | | | | | | | and for global filters): verify if all requested filters in the array FILTER obtained from user input are present in the property list PID obtained from the output file. All the filter comparison of client data values is done here instead of the previous filtcmp TO DO: szip, nbit and scale offset NOTE: the symbol H5Z_SHUFFLE_TOTAL_NPARMS was made public Tested: windows, teragrid with icc 8.1, linux (kagiso), solaris (linew)
* [svn-r14358] Description:Quincey Koziol2007-12-231-5/+5
| | | | | | | | | | | | | | | | | | | Tweak the constants for the shared message flags to be equal to the other flags useds for the underlying messages. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14355] uncomment previously commented code regarding nbit and ↵Pedro Vicente Nunes2007-12-202-57/+92
| | | | | | | | scale-offset filter adding changed the logic of the filter compare function to first compare filter type, then filter client data values (separate here in each individual case, since some filters return private filter values. Todo: handle the nbit and scale-offest cases) tested: windows, linux
* [svn-r14353] Description:Quincey Koziol2007-12-201-80/+80
| | | | | | | | | | | | | | | | | | | | | | | | | - Add hash value for skip list string types, to reduce # of string comparisons. - Fixed bug with metadata/small data block aggregator adding size == 0 block into file free space list. - Refactored metadata/small data block aggregator code into single set of common routines. - Changed block aggregator code to be smarter about releasing space in the 'other' block when the 'other' block has aggregated enough data. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14346] New feature: has_filters_obj function that checks if filters ↵Pedro Vicente Nunes2007-12-145-18/+134
| | | | | | | | | | | | | | | | | | | | match for each individual dataset Following the new feature of h5repack to allow multiple filters for all datasets and the new function has_filters that checks if the repacked file has all the filters requested, I added a new function has_filters_obj that does the same for each dataset. The previous function that checked this only ckecked if the user input filters were in the output dataset. This new function does this but checks if the filters are exactly the same. Currently the behavior of h5repack is to delete all filters that are present in the input file (dataset) and replace them with the requested ones, so they must match exactly. We might consider adding other logical operations, like keep the existing ones. Additionally , the function also checks if the filter parameters match. While doing this I noticed that for the shuffle filter , the values returned do not match and also the same for the N-bit and scale-offset The new function that checks for the filter values fails then, and so I commented the h5repack tests that do this for the N-bit and scale-offset filter (previously for the same bug on the shuffle filter I added special code on the compare filter function but this is temporary until I find the issue) tested: windows, linux, solaris
generated by cgit v0.12 at 2024-11-07 15:30:18 (GMT)