summaryrefslogtreecommitdiffstats
path: root/tools/h5repack
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r15985] reorganized the code to deal with deprecated -i -o for in/out ↵Pedro Vicente Nunes2008-10-291-186/+45
| | | | | | | | files to avoid duplicated code tested: windows, linu x
* [svn-r15898] Purpose: Bug FixMike McGreevy2008-10-171-6/+1
| | | | | | | | | | | | | | | Description: Libtool wasn't working on linew because the script was not working with the Solaris Bourne shell. Libtool has built- in detection to ensure that it uses an appropriate shell, but our config/commence.am was hard coding this shell to be /bin/sh. Removing this line allows the shell to be picked up by configure, thus allowing libtool to use the correct shell on linew (bash). This was initially added to correct for a problem on an old machine (janus), so shoudn't be needed for machines we currently support. Tested: full make check install on kagiso and linew, compile only on smirom, duty, and liberty.
* [svn-r15881] Purpose: Bug Fixes, Libtool UpgradeMike McGreevy2008-10-151-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Description: 1) configure now sets LD_LIBRARY_PATH before checking for presence of SZIP encoder, so user does not need to set this. The path is then saved and sent to Makefiles, and used when "make check-install" is invoked, so user doesn't need to set this manually. 2) Upgraded libtool to version 2.2.6a 3) Rearranged tools build order as h5dump depends on existence of h5diff and h5import. Since h5dump is a sister directory as opposed to a parent of either, it doesn't know about the build rules of these tools, so setting any sort of explicit dependency confuses automake as it won't know how to build the tools. Instead, setting CONFIG = ordered forces an in-order traversal of each tools subdirectory. (without it will also traverse in order by default, but this should prevent gmake's -j option from jumping ahead as well). 'make check install' should now be able to be invoked after 'configure' without causing a dependency failure. 4) Removed H5_HAVE_LARGE_HSIZET macro from vms/src/h5pubconf.h, as this macro has now been out of the code for some time. (vms pubconf needs to be updated manually, which is why it was still hanging around). Tested: kagiso, smirom, liberty Note: h5diff looks to be causing failures in h5copy and h5dump tools tests, though these were present before any of my changes. My changes only affect build order and configuration setup, and shouldn't prevent fixes for these failures coming in after this checkin. Other than these, tests pass fine.
* [svn-r15871] Eliminate -c option and make that behavior the default and ↵Pedro Vicente Nunes2008-10-152-5/+2
| | | | | | return 2 instead of -1 on error status Tested: windows, linux
* [svn-r15791] Bug fix. When detecting the user requested filters, the "all" ↵Pedro Vicente Nunes2008-10-061-1/+5
| | | | | | option was not taken in consideration when printing the compression ratio Tested: windows, linux
* [svn-r15750] move h5repack test files to /tools/h5repack/testfilesPedro Vicente Nunes2008-10-0118-6/+8
| | | | tested: linux
* [svn-r15680] Pedro Vicente Nunes2008-09-223-42/+74
| | | | | Formatted code Tested: windows, linux
* [svn-r15663] fix commentsPedro Vicente Nunes2008-09-191-8/+15
| | | | tested: linux
* [svn-r15662] Cleaned compiler warnings Pedro Vicente Nunes2008-09-198-299/+285
| | | | | | | | Bug fixes: change the options block size variable from int to hsize_t, to match the H5Pset_userblock call, do not print print compression ratio when the requested filter is NONE Tested: windows, linux
* [svn-r15646] Cleaned compiler warnings Pedro Vicente Nunes2008-09-171-4/+4
| | | | | | Bug fix: change the options block size variable from int to hsize_t, to match the H5Pset_userblock call Tested: windows, linux
* [svn-r15642] Pedro Vicente Nunes2008-09-175-3805/+3889
| | | | | | | | Add a default user block size of 1024 when none is given add a failure condition of writing user block Tested: windows, linux
* [svn-r15629] Description:Quincey Koziol2008-09-1610-574/+574
| | | | | | | | | | | | | Remove trailing whitespace from C/C++ source files, with the following script: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Tested on: Mac OS X/32 10.5.5 (amazon) No need for h5committest, just whitespace changes...
* [svn-r15558] 1) There are 2 new command line parameters for h5repack. ↵Pedro Vicente Nunes2008-08-297-27/+188
| | | | | | | | | | | | | | Together they allow a call to H5Pset_alignment to be made -t T, --threshold=T Threshold value for H5Pset_alignment -a A, --alignment=A Alignment value for H5Pset_alignment 2) bug fix the printing of the dataset name was not done for references (verbose mode) tested: windows, linux
* [svn-r15533] #1184Pedro Vicente Nunes2008-08-266-33/+323
| | | | | | | | | | | Add a userblock to an HDF5 file during the repack. The user gives give a filename and userblock size as command line parameters to h5repack and the contents of that file are stored in the userblock for the HDF5 file created by h5repack. New flags to handle this -u and -b Tested : windows, linux
* [svn-r15463] Description:Quincey Koziol2008-08-121-0/+1
| | | | | | | | Bring revision 15462 (compiler warnings) back from trunk. Tested on: Mac OS X/32 10.5.4 (amazon) w/FORTRAN & C++ (Too minor to require h5committest)
* [svn-r15436] bug fixPedro Vicente Nunes2008-08-061-11/+11
| | | | | | | the compression ratio was being printed for cases where a layout was requested and not a filter tested: windows, linux
* [svn-r15433] http://bugzilla.hdfgroup.uiuc.edu/show_bug.cgi?id=1170Pedro Vicente Nunes2008-08-052-2/+5
| | | | | | | | | | | | | Summary: when using h5diff to compare the results of h5repack (or other tools that copy one HDF5 file to another), a new option is needed to allow h5diff to make an "absolute" comparison of the 2 files. This is the "contents" mode explained in the usage below. If this mode is present, objects in both files must match (must be exactly the same). If this does not happen, the tool returns an error code of 1 (instead of the success code of 0) Changes to the h5repack test script: the call to h5diff was changed to include -c (maintaining the previous -q). tested: windows, linux
* [svn-r15053] Add a test for the 1.6.7 -i infile -o outifle for backward ↵Pedro Vicente Nunes2008-05-211-0/+37
| | | | | | | | compability Used the function TOOLTEST from 1.6.7 Tested: linux
* [svn-r15048] bug fix regarding change from -i to -d regarding number of ↵Pedro Vicente Nunes2008-05-201-1/+1
| | | | | | links in indexed format tested: windows
* [svn-r15042] Bug fix.Albert Cheng2008-05-201-4/+4
| | | | | | | | | | | | | | | | | | | Description: The fortran Makefile.am used HDF_FORTRAN to indicate it is part of the Fortran API source so that conclude.am will give fortran api prefix in the test output. The symbox HDF_FORTRAN is also used in configure for a different purpose (indicated --enable-fortran). They conflicted. Similar problem for the symbol HDF_CXX. Solution: Changed all the involved Makefile.am to use "FORTRAN_API" instead. It is a more appropriate name. Same for CXX_API. Along the way, discovered that the Makefile.am of hl/fortran/test and hl/cxx/test did not have those symbols at all. Added them in. Platform tested: Kagiso serial and h5committested (kagisopp, smirom, linew).
* [svn-r15033] Purpose:Albert Cheng2008-05-191-0/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Improvement. Description: src/libhdf5.settings was the initial configure summary and is installed. Then configure is changed to dump a summary of the configure settings to the output and also append it to src/libhdf5.settings. That created two different output formats and duplicated information. This is the initial attempt to clean up this confusion and unify the output format. It is decided to use the src/libhdf5.settings template as the unified means. This requires more macros symbols be defined. The following symbols are all related to generating the src/libhdf5.settings file. AC_SUBST(EXTERNAL_FILTERS) AC_SUBST(MPE) MPE=no AC_SUBST(STATIC_EXEC) STATIC_EXEC=no AC_SUBST(HDF_FORTRAN) HDF_FORTRAN=no AC_SUBST(FC) HDF_FORTRAN=no AC_SUBST(HDF_CXX) HDF_CXX=no AC_SUBST(CXX) HDF_CXX=no AC_SUBST(HDF5_HL) HDF5_HL=yes AC_SUBST(GPFS) GPFS=no AC_SUBST(LINUX_LFS) LINUX_LFS=no AC_SUBST(INSTRUMENT) INSTRUMENT=no AC_SUBST(CODESTACK) CODESTACK=no AC_SUBST(HAVE_DMALLOC) HAVE_DMALLOC=no AC_SUBST(DIRECT_VFD) DIRECT_VFD=no AC_SUBST(THREADSAFE) THREADSAFE=no AC_SUBST(STATIC_SHARED) AC_SUBST(enable_shared) AC_SUBST(enable_static) AC_SUBST(UNAME_INFO) UNAME_INFO=`uname -a` The src/libhdf5.settings.in has CONDITIONAL's added to it too. The untrue conditions turned into a "#" and these lines are cleaned by the post processing script. Platform tested: h5committest on kagiso, smirom and linew. (smirom had failures not due to my changes.)
* [svn-r15024] backward compatibility for old -i infile -o outfile optionsPedro Vicente Nunes2008-05-162-18/+195
| | | | | | | | | | | | | if these are detected this syntax is used, otherwise the one in usage is used there was another -i option for -i L2, --indexed=L2 Minimum number of links in the indexed format That was changed to -d -d L2, --indexed=L2 Minimum number of links in the indexed format Tested: windows, linux
* [svn-r15006] Purpose: configure cleanupMike McGreevy2008-05-151-1/+0
| | | | | | | Description: cleaning up configure related to removal of --disable-hsizet flag, which we no longer support. Tested: kagiso
* [svn-r14915] Pedro Vicente Nunes2008-05-011-11/+15
| | | | | | | Introduced a compression ratio = uncompressed size / compressed size in the printing of the compression with 3 digits of precision per hdf-forum NASA developers suggestion tested: windows, linux
* [svn-r14824] Purpose: Updating HDF5 1.8 to use automake 1.10.1 and ↵Mike McGreevy2008-04-101-16/+20
| | | | | | | | | | | | | | | | | | libtool 2.2 Description: Updated bin/reconfigure script to reflect the new versions of libtool and automake in the /home1/packages/ directory. Rearranged configure.in script. For some reason, when using libtool 2.2, the libtool script doesn't generate until later in the configuration process, so I had to move a test that parsed through the libtool script to a point after where it was actually being generated. Ran libtoolize on the project, and ran bin/reconfigure to regenerate configure and Makefile.in's throughout. Tested: kagiso, smirom, linew, tg-login
* [svn-r14413] Description:Quincey Koziol2008-01-141-1/+1
| | | | | | | | | | | | | | | | | | | Change H5P[gs]et_format_bounds() => H5P[gs]et_libver_bounds() and also enumerated values H5F_FORMAT_{EARLIEST, LATEST} => H5F_LIBVER_{EARLIEST, LATEST} Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14402] Description:Quincey Koziol2008-01-131-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Add work-around to allow reading files that were produced with a buggy earlier version of the library, which could create objects with the wrong object header message count. There is now a configure flag "--enable-strict-format-checks" which triggers a failure on reading a file with this sort of corruption (when enabled) and allows the object to be read (when disabled). The default value for the "strict-format-checks" flag is yes when the "debug" flag is enabled and no when the "debug" flag is disabled. Note that if strict format checks are disabled (allowing objects with this particular kind of corruption to be read) and the file is opened with write access, the library will re-write the object header for the corrupt object with the correct # of object header messages. This closes bugzilla bug #1010. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14379] add check of some values for the nbit and scale offest filters ↵Pedro Vicente Nunes2008-01-071-10/+15
| | | | | | | | on the h5repack verify function note: some sybols were made public tested: windows, linux
* [svn-r14376] moved a couple more private filter symbols to the public side, ↵Pedro Vicente Nunes2008-01-041-1/+5
| | | | | | needed by h5repack tested: windows, linux
* [svn-r14368] clean code and reshufle functions between modules, remove ↵Pedro Vicente Nunes2008-01-034-198/+141
| | | | | | unused functions tested: windows, linux
* [svn-r14366] comments grammar correctionPedro Vicente Nunes2008-01-031-6/+1
|
* [svn-r14365] Add szip filter check of client data values for has_filters.Pedro Vicente Nunes2008-01-031-11/+8
| | | | | | NOTE: szip client symbols were made public Tested: windows, linux, solaris
* [svn-r14362] Description:Quincey Koziol2008-01-031-1/+1
| | | | | | | | | | | | | | | | | | Switched from "H5P[gs]et_latest_format" to "H5P[gs]et_format_bounds". Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14361] add a warning message in case a dataset cannot be created with ↵Pedro Vicente Nunes2008-01-021-1/+7
| | | | | | modified DCPL tested: linux
* [svn-r14360] New function has_filters (replace has_filters for each object ↵Pedro Vicente Nunes2008-01-022-333/+98
| | | | | | | | | and for global filters): verify if all requested filters in the array FILTER obtained from user input are present in the property list PID obtained from the output file. All the filter comparison of client data values is done here instead of the previous filtcmp TO DO: szip, nbit and scale offset NOTE: the symbol H5Z_SHUFFLE_TOTAL_NPARMS was made public Tested: windows, teragrid with icc 8.1, linux (kagiso), solaris (linew)
* [svn-r14358] Description:Quincey Koziol2007-12-231-5/+5
| | | | | | | | | | | | | | | | | | | Tweak the constants for the shared message flags to be equal to the other flags useds for the underlying messages. Tested on: FreeBSD/32 6.2 (duty) in debug mode FreeBSD/64 6.2 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/default API=1.6.x, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Mac OS X/32 10.4.10 (amazon) in debug mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode
* [svn-r14355] uncomment previously commented code regarding nbit and ↵Pedro Vicente Nunes2007-12-202-57/+92
| | | | | | | | scale-offset filter adding changed the logic of the filter compare function to first compare filter type, then filter client data values (separate here in each individual case, since some filters return private filter values. Todo: handle the nbit and scale-offest cases) tested: windows, linux
* [svn-r14346] New feature: has_filters_obj function that checks if filters ↵Pedro Vicente Nunes2007-12-145-18/+134
| | | | | | | | | | | | | | | | | | | | match for each individual dataset Following the new feature of h5repack to allow multiple filters for all datasets and the new function has_filters that checks if the repacked file has all the filters requested, I added a new function has_filters_obj that does the same for each dataset. The previous function that checked this only ckecked if the user input filters were in the output dataset. This new function does this but checks if the filters are exactly the same. Currently the behavior of h5repack is to delete all filters that are present in the input file (dataset) and replace them with the requested ones, so they must match exactly. We might consider adding other logical operations, like keep the existing ones. Additionally , the function also checks if the filter parameters match. While doing this I noticed that for the shuffle filter , the values returned do not match and also the same for the N-bit and scale-offset The new function that checks for the filter values fails then, and so I commented the h5repack tests that do this for the N-bit and scale-offset filter (previously for the same bug on the shuffle filter I added special code on the compare filter function but this is temporary until I find the issue) tested: windows, linux, solaris
* [svn-r14345] substituted the symbol CD_VALUES , number of filter client data ↵Pedro Vicente Nunes2007-12-143-6/+8
| | | | | | | | values, for H5Z_COMMON_CD_VALUES that is defined in the library tested: windows, linux, solaris
* [svn-r14320] Added a function that matches the filters on the dataset's DCPL ↵Pedro Vicente Nunes2007-12-045-70/+291
| | | | | | | | and in the requested list Used to verify if the filters requested are present in the output dataset tested: windows, linux, solaris
* [svn-r14317] code maintenance: code cleaning and reorganizing of the ↵Pedro Vicente Nunes2007-12-032-364/+382
| | | | | | h5repack verify routines tested: windows, linux
* [svn-r14311] enhancement: change the usage example for multiple filtersPedro Vicente Nunes2007-11-291-2/+2
| | | | | | to note that SHUF should be used before GZIP and that the order specified in command line is the order filters are applied tested: windows, linux
* [svn-r14310] error check in command line: check for a wrong input of the 2 ↵Pedro Vicente Nunes2007-11-291-0/+8
| | | | | | file names being the same tested: windows, linux
* [svn-r14309] bug fix: add a check for the presence of a filter in the call ↵Pedro Vicente Nunes2007-11-291-4/+15
| | | | | | | | to test of long swtich names add a test for multiple global filters tested: linux, solaris
* [svn-r14308] new feature test: add a test for the long switch namesPedro Vicente Nunes2007-11-291-1/+9
| | | | tested: linux, solaris
* [svn-r14305] updated commentsPedro Vicente Nunes2007-11-291-0/+2
| | | | tested: windows, linux
* [svn-r14304] change feature: rename compression used as %Savings Pedro Vicente Nunes2007-11-291-5/+3
| | | | | | | | | | | now the minus sign shows there was a DECREASE in compression percentage is calculated from per = (b-a)/a; where a= size of dataset before b = size after tested: windows, linux
* [svn-r14300] new feature: add a mention of multiple filters use in usagePedro Vicente Nunes2007-11-281-0/+4
| | | | tested: windows, linux
* [svn-r14299] new feature: add support for h5repack to handle several global ↵Pedro Vicente Nunes2007-11-2813-1961/+1758
| | | | | | | | filters usage is to repeat the -f option tested: windows, linux, solaris
* [svn-r14294] bug fix: in the filter percentage calculation Pedro Vicente Nunes2007-11-271-7/+14
| | | | tested: windows, linux, solaris