summaryrefslogtreecommitdiffstats
path: root/tools/h5repack/h5repack_verify.c
Commit message (Collapse)AuthorAgeFilesLines
* remove merge typoAllen Byrne2016-09-291-1/+0
|
* Merge/align from trunk(develop)Allen Byrne2016-09-281-3/+1
|
* Merge/align with trunkAllen Byrne2016-09-281-136/+111
|
* [svn-r24205] Merge HDFFV-8513/8522 from trunk (via cmake branch), h5repack ↵Allen Byrne2013-09-261-16/+29
| | | | | | | | UD plugins. Also warning session fixes. Tested: CMake local linux
* [svn-r24072] Merge trunk cmake changes to 1.8 branch. Allen Byrne2013-08-261-1/+3
| | | | | | | Also add default switch blocks to h5import. Merge h5dump any_path option from trunk. Tested: local linux
* [svn-r22013] HDFFV-7560:Allen Byrne2012-03-021-4/+5
| | | | | | | | | | Merge 1.8 and h5dump/tools and tests based on tools library from trunk. Reduced warnings. HDFFV-7949: Remove duplicated functions in h5ls Tested: local linux,h5committest
* [svn-r20007] Purpose:Jonathan Kim2011-01-261-1/+5
| | | | | | | | Clean up tool code. Remove "h5test.h" from tool code. Currently only in h5repack. Tested: jam (linux32-LE), amani (linux64-LE), heiwa (linuxppc64-BE), linew (solaris-BE), tejeda (mac32-LE)
* [svn-r19254] Description:Quincey Koziol2010-08-191-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | Bring r19252 & 19253 from trunk to 1.8 branch: Bring Coverity changes from branch to trunk: r19161: Fixed the part for matching the subset info with dataset r19189: BZ1646: h5dump does not check number of dimensions for subsetting parameters against the dataset Changed subset_t structure from holding hsize_t pointers to holding new subset_d pointers, which hold the original hsize_t pointer + len. this len is then checked against dataset ndims in the handle_dataset function of h5dump. Changed all references to use new data structure. Added tests for each subset parameter. r19190: Added new h5dump ddl files Tested on: Mac OS X/32 10.6.4 (amazon) w/debug & production (h5committested on Coverity branch)
* [svn-r18757] Enable tools lib to be built as a dll on windows. Added two ↵Allen Byrne2010-05-111-5/+4
| | | | | | | | | | get/set functions for progname and d_status. Also add windows import/export declarations to functions. Updated windows - H5pubconf.h for packed bits function Tested: Windows, linux
* [svn-r18198] Description:Quincey Koziol2010-01-301-2/+2
| | | | | | | | | Trim trailing whitespace from source code files, with following command: find . \( -name "*.[ch]" -or -name "*.cpp" -or -name "*.f90" \) -print |xargs -n 1 sed -i "" 's/[[:blank:]]*$//' Tested on: None - eyeballed only
* [svn-r17555] Description:Quincey Koziol2009-09-291-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | Bring r17553 from trunk to 1.8 branch: Bring general fixes/improvements from file_free_space branch back to trunk. Tested on: FreeBSD/32 6.3 (duty) in debug mode FreeBSD/64 6.3 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (jam) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/Intel compilers w/default API=1.6.x, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode Linux/64-amd64 2.6 (abe) w/parallel, w/FORTRAN, in production mode Mac OS X/32 10.5.8 (amazon) in debug mode Mac OS X/32 10.5.8 (amazon) w/C++ & FORTRAN, w/threadsafe, in production mode
* [svn-r17077] merge 17076 from trunkPedro Vicente Nunes2009-06-171-18/+14
| | | | | | | bug fix: h5repack was not applying a requested contiguous layout for a dataset with filters added a test to the C program test (not to the script), that verifies the layout and filters tested: linux
* [svn-r16658] merge from trunk 16656Pedro Vicente Nunes2009-04-021-27/+61
| | | | | | | | #1402 (B1) h5repack does not preserve creation order indexing. ISSUE : h5repack does not handle group creation order flags. ACTION: call H5P(g)(s)et_link_creation_order functions when handling groups, add new groups with these flags to the test generation program, and verify results in the test program. TEST: in the test program, function that compares property lists, added code to verify groups DOCS: Added the note to RELEASE.txt: "h5repack now handles group creation order. PVN - 2009/4/2 - 1402".
* [svn-r15662] Cleaned compiler warnings Pedro Vicente Nunes2008-09-191-5/+7
| | | | | | | | Bug fixes: change the options block size variable from int to hsize_t, to match the H5Pset_userblock call, do not print print compression ratio when the requested filter is NONE Tested: windows, linux
* [svn-r15629] Description:Quincey Koziol2008-09-161-103/+103
| | | | | | | | | | | | | Remove trailing whitespace from C/C++ source files, with the following script: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Tested on: Mac OS X/32 10.5.5 (amazon) No need for h5committest, just whitespace changes...
* [svn-r14379] add check of some values for the nbit and scale offest filters ↵Pedro Vicente Nunes2008-01-071-10/+15
| | | | | | | | on the h5repack verify function note: some sybols were made public tested: windows, linux
* [svn-r14376] moved a couple more private filter symbols to the public side, ↵Pedro Vicente Nunes2008-01-041-1/+5
| | | | | | needed by h5repack tested: windows, linux
* [svn-r14366] comments grammar correctionPedro Vicente Nunes2008-01-031-6/+1
|
* [svn-r14365] Add szip filter check of client data values for has_filters.Pedro Vicente Nunes2008-01-031-11/+8
| | | | | | NOTE: szip client symbols were made public Tested: windows, linux, solaris
* [svn-r14360] New function has_filters (replace has_filters for each object ↵Pedro Vicente Nunes2008-01-021-332/+97
| | | | | | | | | and for global filters): verify if all requested filters in the array FILTER obtained from user input are present in the property list PID obtained from the output file. All the filter comparison of client data values is done here instead of the previous filtcmp TO DO: szip, nbit and scale offset NOTE: the symbol H5Z_SHUFFLE_TOTAL_NPARMS was made public Tested: windows, teragrid with icc 8.1, linux (kagiso), solaris (linew)
* [svn-r14355] uncomment previously commented code regarding nbit and ↵Pedro Vicente Nunes2007-12-201-51/+90
| | | | | | | | scale-offset filter adding changed the logic of the filter compare function to first compare filter type, then filter client data values (separate here in each individual case, since some filters return private filter values. Todo: handle the nbit and scale-offest cases) tested: windows, linux
* [svn-r14346] New feature: has_filters_obj function that checks if filters ↵Pedro Vicente Nunes2007-12-141-14/+118
| | | | | | | | | | | | | | | | | | | | match for each individual dataset Following the new feature of h5repack to allow multiple filters for all datasets and the new function has_filters that checks if the repacked file has all the filters requested, I added a new function has_filters_obj that does the same for each dataset. The previous function that checked this only ckecked if the user input filters were in the output dataset. This new function does this but checks if the filters are exactly the same. Currently the behavior of h5repack is to delete all filters that are present in the input file (dataset) and replace them with the requested ones, so they must match exactly. We might consider adding other logical operations, like keep the existing ones. Additionally , the function also checks if the filter parameters match. While doing this I noticed that for the shuffle filter , the values returned do not match and also the same for the N-bit and scale-offset The new function that checks for the filter values fails then, and so I commented the h5repack tests that do this for the N-bit and scale-offset filter (previously for the same bug on the shuffle filter I added special code on the compare filter function but this is temporary until I find the issue) tested: windows, linux, solaris
* [svn-r14320] Added a function that matches the filters on the dataset's DCPL ↵Pedro Vicente Nunes2007-12-041-21/+211
| | | | | | | | and in the requested list Used to verify if the filters requested are present in the output dataset tested: windows, linux, solaris
* [svn-r14317] code maintenance: code cleaning and reorganizing of the ↵Pedro Vicente Nunes2007-12-031-362/+382
| | | | | | h5repack verify routines tested: windows, linux
* [svn-r14299] new feature: add support for h5repack to handle several global ↵Pedro Vicente Nunes2007-11-281-2/+9
| | | | | | | | filters usage is to repeat the -f option tested: windows, linux, solaris
* [svn-r14206] Description:Quincey Koziol2007-10-171-28/+9
| | | | | | | | | | | | | | | | | | | | Make H5Pget_filter API versioned and switch internal usage to H5Pget_filter2. Add regression test for H5Pget_filter1. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode
* [svn-r14193] Description:Quincey Koziol2007-10-081-66/+59
| | | | | | | | | | | | | | | | | | | Make H5Dopen versioned and change all internal usage to use H5Dopen2 Add simple regression test for H5Dopen1 Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode
* [svn-r14154] Description:Quincey Koziol2007-09-251-26/+4
| | | | | | | | | | | | | | | | | | | | Finish deprecating last H5G symbol (H5G_obj_t) - yay! Lots of misc. library fixes to remove confusion between links and objects. The tools could still use another pass, to remove h5trav_type_t type and make the correct distinction between links & objects. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode AIX/32 5.3 (copper) w/FORTRAN, w/parallel, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode
* [svn-r14115] Description:Quincey Koziol2007-08-281-2/+2
| | | | | | | | | | | | | | | | | Remove all plain calls to H5Gopen() from source, replacing them with either H5Gopen2(). Add test for H5Gopen1(). Reformatted several pieces of code, to clean them up. Tested on: FreeBSD/32 6.2 (duty) FreeBSD/64 6.2 (liberty) Linux/32 2.6 (kagiso) Linux/64 2.6 (smirom) Solaris/32 5.10 (linew) Mac OS X/32 10.4.10 (amazon)
* [svn-r13589] Pedro Vicente Nunes2007-04-041-2/+1
| | | | | | h5repack code cleaning (required reconfigure) tested: linux (32, 64, parallel), solaris
* [svn-r13253] Updated all C and C++ style source code files with the THG ↵Albert Cheng2007-02-071-2/+3
| | | | | | | | | copyright notice. Tested platform: Kagiso only since it is only a comment block change. If it works in one machine, it should work in all, I hope. Still need to check the parallel build on copper.
* [svn-r12928] code revisionPedro Vicente Nunes2006-11-161-2/+5
|
* [svn-r12720] Pedro Vicente Nunes2006-10-051-3/+5
| | | | | | added output of error messages using the tools library function error_msg, that prints the program name and error on the message tested: kagiso
* [svn-r12159] Purpose:Pedro Vicente Nunes2006-03-271-2/+2
| | | | | | | | | | | | | | | | | bug fix Description: h5repack was not dealing with family files Solution: use the toolslib function h5tools_open to open the file instead of H5Fopen in h5repack Platforms tested: linux solaris AIX Misc. update:
* [svn-r11245] Purpose:Quincey Koziol2005-08-131-77/+77
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Trim trailing whitespace, which is making 'diff'ing the two branches difficult. Solution: Ran this script in each directory: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r8904] Purpose:Pedro Vicente Nunes2004-07-201-14/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5diff and h5repack changes Description: h5diff introduced the following four modes of output: Normal mode: print the number of differences found and where they occured Report mode: print the above plus the differences Verbose mode: print the above plus a list of objects and warnings Quiet mode: do not print output (h5diff always returns an exit code of 1 when differences are found) h5repack added an extra parameter for SZIP filter (coding method) the new syntax is -f SZIP=<pixels per block,coding> (pixels per block is a even number in 2-32 and coding method is 'EC' or 'NN') Example of use: ./h5repack -i file1 -o file2 -f SZIP=8,NN -v updated usage messages, test scripts and files accordingly Solution: Platforms tested: linux AIX solaris Misc. update:
* [svn-r8869] Purpose:Pedro Vicente Nunes2004-07-131-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5repack changes Description: there were some requests to change some minor h5repack features h5repack only made a warning about a non available filter in verbose mode ( -v ) without -v it kept silent, and users sometimes missed this warning the request was that it should print this warning always. so, the new format, is e.g ./h5repack -i test_szip.h5 -o out.h5 Warning: dataset </dset_szip> cannot be read, SZIP filter is not available due to this, and to avoid a lot of these messages in the shell test script, I modified the script h5repack.sh so that it detects the presence of all filters in the environment (previously it only detected SZIP) the test files were also divided in more files , to make the script code easier to follow Solution: Platforms tested: linux AIX (no szip) solaris (no szip, no gzip ) Misc. update:
* [svn-r8781] James Laird2004-07-011-0/+11
| | | | | | | | | | | | | | | | Purpose: HDF5 now supports SZIP with no encoder. Description: SZIP can be configured to have both encoder and decoder or just to have the decoder. HDF5 can now query the configuration of any filter, and will throw errors if users try to write using a filter with encoding disabled. Solution: Added H5Zget_filter_info function, changed API for H5Pget_filter and H5P_get_filter_by_id. See SZIP RFC. Platforms tested: Copper (fortran, C++, parallel), Sleipnir (C++), Arabica (fortran, C++), Verbena (fortran, C++) Misc. update:
* [svn-r8383] Purpose:Quincey Koziol2004-04-181-9/+9
| | | | | | | | | | | | | Code cleanup Description: Clean up lots of warnings based on those reported from the SGI compilers as well as gcc. Platforms tested: SGI O3900, IRIX64 6.5 (Cheryl's SGI machine) FreeBSD 4.9 (sleipnir) w/ & w/o parallel h5committest
* [svn-r8318] Purpose:Pedro Vicente Nunes2004-04-071-6/+3
| | | | | | | | | | | | | | | | | | | | new tests for h5repack Description: added tests that do layout type to layout type conversion in a matrix of 9 between compact, contiguous and chunking Solution: Platforms tested: linux afs has problems; I could not telnet to sol and copper, arabica is really slow (meaning waiting 1 minute for a typed character) and the writing of a file gave an error arabica 181% afs: failed to store file (145) afs: failed to store file (145) Misc. update:
* [svn-r8229] Purpose:Pedro Vicente Nunes2004-03-021-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1) new function for tools library 2) new test script for h5repack Description: 1) currently all the tools (h5dump, h5diff, etc) do not check if a filter is available for reading some dataset that might have a filter not available on the current configuration (the behaviour of the tools until now was to trigger a library error, saying that the dataset cannot be read due to the lack of the filter) Solution: 1) added a new function h5tools_canreadf that checks if a dataset can be read depending on the availability of filters. this function was added in calls for h5diff and h5repack. instead of triggering the library error, a message is printed, saying that the dataset cannot be read (the print is optional, it is on on verbose mode) 2) added a shell script that tests the commannd line tool behaviour of h5repack the script does a series of runs of h5repack with several options on the same file (this file test4.h5 was added to the testfiles dir). then, it runs the h5diff tool, with the input and output files , in each run. the goal of the test is also to check item 1) . the binary file was saved with filters that might not be available on other configurations Platforms tested: linux (all filters enabled) linux (some filters disabled) solaris (some filters disabled) AIX (some filters disabled) windows (all filters on and off ) Misc. update:
* [svn-r8123] Purpose:Pedro Vicente Nunes2004-01-291-0/+9
| | | | | | | | | | | | | | | added more tests for szip and more verbose output Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8113] Purpose:Pedro Vicente Nunes2004-01-261-5/+12
| | | | | | | | | | | | | | | | | | | new library function H5Pdelete_filter deletes one or all filters from a dataset creation property list this was done for the NONE option of h5repack, added tests for this feature added a test for the new function in /test/dsets.c Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8068] Purpose:Pedro Vicente Nunes2004-01-151-2/+2
| | | | | | | | | | | | | changed the text of a error message related to the fail of H5Fopen to " unable to open file " Description: Solution: Platforms tested: linux (small change ) Misc. update:
* [svn-r8062] Purpose:Pedro Vicente Nunes2004-01-141-1/+1
| | | | | | | | | | | | | | | | bug fix Description: cases of rank 0 were not handled, now a warning is made that the dataset cannot be compressed Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8040] Purpose:Pedro Vicente Nunes2004-01-081-0/+1
| | | | | | | | | | | | | | | | | bug fix, code improvment Description: fixed a bug in the parse of chunking function added some auxiliary functions to avoid repeated parts of the code in several places Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8038] Purpose:Quincey Koziol2004-01-081-0/+1
| | | | | | | | | | | | | | | | | | | | Bug fix Description: When two property lists are compared, the H5Pequal routine was just comparing the raw information for the property values. This causes problems when the raw information contains pointers to other information. Solution: Allow a 'compare' callback to be registered for properties, so that a user application get perform the comparison itself, allowing for "deep" compares of the property value. This was exported to the H5Pregister & H5Pinsert routines in the development branch, but not the release branch. Platforms tested: FreeBSD 4.9 (sleipnir) h5committest
* [svn-r8021] Purpose:Pedro Vicente Nunes2004-01-061-5/+168
| | | | | | | | | | | | | | | | h5repack new features Description: added support/tests for multi filters Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7999] Purpose:Pedro Vicente Nunes2003-12-311-5/+15
| | | | | | | | | | | | | | | | h5repack new features Description: added support/ tests for contiguous and compact layout processing Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7997] Purpose:Pedro Vicente Nunes2003-12-301-19/+76
| | | | | | | | | | | | | | | | h5repack new features Description: added support for layout options Solution: Platforms tested: linux solaris AIX Misc. update: