summaryrefslogtreecommitdiffstats
path: root/tools/h5repack/h5repack.c
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r18196] Description:Quincey Koziol2010-01-301-50/+50
| | | | | | | | | Trim trailing whitespace from source files, with the following command: find . \( -name "*.[ch]" -or -name "*.cpp" -or -name "*.f90" \) -print |xargs -n 1 sed -i "" 's/[[:blank:]]*$//' Tested on: None - just eyeballed
* [svn-r14903] Undoing change committed in r14902.Scot Breitenfeld2008-04-301-1/+1
|
* [svn-r14902] Merged fortran_1_8 branch changes r14505:14901 into the trunk. ↵Scot Breitenfeld2008-04-301-1/+1
| | | | New fortran wrappers added.
* [svn-r14671] fix typo in comments and remove unused header mentionPedro Vicente Nunes2008-02-251-1/+1
| | | | tested: linux
* [svn-r14368] clean code and reshufle functions between modules, remove ↵Pedro Vicente Nunes2008-01-031-119/+0
| | | | | | unused functions tested: windows, linux
* [svn-r14346] New feature: has_filters_obj function that checks if filters ↵Pedro Vicente Nunes2007-12-141-1/+1
| | | | | | | | | | | | | | | | | | | | match for each individual dataset Following the new feature of h5repack to allow multiple filters for all datasets and the new function has_filters that checks if the repacked file has all the filters requested, I added a new function has_filters_obj that does the same for each dataset. The previous function that checked this only ckecked if the user input filters were in the output dataset. This new function does this but checks if the filters are exactly the same. Currently the behavior of h5repack is to delete all filters that are present in the input file (dataset) and replace them with the requested ones, so they must match exactly. We might consider adding other logical operations, like keep the existing ones. Additionally , the function also checks if the filter parameters match. While doing this I noticed that for the shuffle filter , the values returned do not match and also the same for the N-bit and scale-offset The new function that checks for the filter values fails then, and so I commented the h5repack tests that do this for the N-bit and scale-offset filter (previously for the same bug on the shuffle filter I added special code on the compare filter function but this is temporary until I find the issue) tested: windows, linux, solaris
* [svn-r14345] substituted the symbol CD_VALUES , number of filter client data ↵Pedro Vicente Nunes2007-12-141-1/+1
| | | | | | | | values, for H5Z_COMMON_CD_VALUES that is defined in the library tested: windows, linux, solaris
* [svn-r14320] Added a function that matches the filters on the dataset's DCPL ↵Pedro Vicente Nunes2007-12-041-0/+1
| | | | | | | | and in the requested list Used to verify if the filters requested are present in the output dataset tested: windows, linux, solaris
* [svn-r14299] new feature: add support for h5repack to handle several global ↵Pedro Vicente Nunes2007-11-281-352/+529
| | | | | | | | filters usage is to repeat the -f option tested: windows, linux, solaris
* [svn-r13975] Add --latest, -compact=<size>, ... options to use the lastest ↵Peter Cao2007-07-131-1/+24
| | | | | | file format. Add test for the options to the daily test.
* [svn-r13810] Pedro Vicente Nunes2007-05-241-3/+23
| | | | | | | | Minor tunings to output verbose messages: 1)when there is not a filter request do not print a message saying the filter was not apllied when the dataset was too small 2) avoid printing the message that has a list of objects to modify when there is none Tested:linux
* [svn-r13589] Pedro Vicente Nunes2007-04-041-1/+1
| | | | | | h5repack code cleaning (required reconfigure) tested: linux (32, 64, parallel), solaris
* [svn-r13253] Updated all C and C++ style source code files with the THG ↵Albert Cheng2007-02-071-2/+3
| | | | | | | | | copyright notice. Tested platform: Kagiso only since it is only a comment block change. If it works in one machine, it should work in all, I hope. Still need to check the parallel build on copper.
* [svn-r12928] code revisionPedro Vicente Nunes2006-11-161-2/+3
|
* [svn-r12736] Description:Quincey Koziol2006-10-091-5/+3
| | | | | | | | | | | | | | | | | | | Add "use the latest format" support for dataspace object header encode/ decode routines and clean up format a bit for the latest format (new to 1.8.x releases) Remove storing 'perm' parameter for array datatypes in memory and the file, and add test to make certain that if any user applications are attempting to store them, we get some reports back. (Should be unlikely, since the RefMan says that the parameter is not implemented and is unsupported). Carry those changes into the tests, etc. Clean up a bunch more compiler warnings. Tested on: FreeBSD/32 4.11 (sleipnir) w/threadsafe Linux/32 2.4 (heping) w/FORTRAN & C++ Linux/64 2.4 (mir) w/enable-1.6-compat
* [svn-r12720] Pedro Vicente Nunes2006-10-051-8/+12
| | | | | | added output of error messages using the tools library function error_msg, that prints the program name and error on the message tested: kagiso
* [svn-r12440] Purpose:Quincey Koziol2006-06-271-1/+1
| | | | | | | | | | | Code cleanup Description: Trim trailing whitespace in Makefile.am and C/C++ source files to make diffing changes easier. Platforms tested: None necessary, whitespace only change
* [svn-r12159] Purpose:Pedro Vicente Nunes2006-03-271-3/+5
| | | | | | | | | | | | | | | | | bug fix Description: h5repack was not dealing with family files Solution: use the toolslib function h5tools_open to open the file instead of H5Fopen in h5repack Platforms tested: linux solaris AIX Misc. update:
* [svn-r11889] Purpose:Quincey Koziol2006-01-241-0/+1
| | | | | | | | | | Bug fix Description: Fix compile problem with C++ compiler after recent changes. Platforms tested: FreeBSD 4.11 (sleipnir) w/CC=g++
* [svn-r11245] Purpose:Quincey Koziol2005-08-131-43/+43
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Trim trailing whitespace, which is making 'diff'ing the two branches difficult. Solution: Ran this script in each directory: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r9727] Purpose:Quincey Koziol2004-12-291-2/+19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug Fix/Code Cleanup/Doc Cleanup/Optimization/Branch Sync :-) Description: Generally speaking, this is the "signed->unsigned" change to selections. However, in the process of merging code back, things got stickier and stickier until I ended up doing a big "sync the two branches up" operation. So... I brought back all the "infrastructure" fixes from the development branch to the release branch (which I think were actually making some improvement in performance) as well as fixed several bugs which had been fixed in one branch, but not the other. I've also tagged the repository before making this checkin with the label "before_signed_unsigned_changes". Platforms tested: FreeBSD 4.10 (sleipnir) w/parallel & fphdf5 FreeBSD 4.10 (sleipnir) w/threadsafe FreeBSD 4.10 (sleipnir) w/backward compatibility Solaris 2.7 (arabica) w/"purify options" Solaris 2.8 (sol) w/FORTRAN & C++ AIX 5.x (copper) w/parallel & FORTRAN IRIX64 6.5 (modi4) w/FORTRAN Linux 2.4 (heping) w/FORTRAN & C++ Misc. update:
* [svn-r9121] Purpose:Pedro Vicente Nunes2004-08-191-49/+0
| | | | | | | | | | | | | | | | | | | | new feature Description: added a check that the chunk size must be smaller than pixels per block in SZIP request prints a message and exits, if not met Solution: Platforms tested: linux aix solaris Misc. update:
* [svn-r9106] Purpose:Pedro Vicente Nunes2004-08-171-6/+16
| | | | | | | | | | | | | | | | | bug fix Description: the option CHUNK:NONE (remove chunking ) was not setting the layout to contiguous Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8904] Purpose:Pedro Vicente Nunes2004-07-201-3/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5diff and h5repack changes Description: h5diff introduced the following four modes of output: Normal mode: print the number of differences found and where they occured Report mode: print the above plus the differences Verbose mode: print the above plus a list of objects and warnings Quiet mode: do not print output (h5diff always returns an exit code of 1 when differences are found) h5repack added an extra parameter for SZIP filter (coding method) the new syntax is -f SZIP=<pixels per block,coding> (pixels per block is a even number in 2-32 and coding method is 'EC' or 'NN') Example of use: ./h5repack -i file1 -o file2 -f SZIP=8,NN -v updated usage messages, test scripts and files accordingly Solution: Platforms tested: linux AIX solaris Misc. update:
* [svn-r8882] Purpose:Pedro Vicente Nunes2004-07-151-15/+21
| | | | | | | | | | | | | | | | | | | | | | | | bug fix, new feature Description: fixed bug in the parse function: cases where we have an already inserted name but there is a new name also example: -f dset1:GZIP=1 -l dset1,dset2:CHUNK=20x20 dset1 is already inserted, but dset2 must also be (it was not) added a CHECK_SZIP symbol to enable/disable checking of library related szip parameters added the print of the filter name in verbose mode (confirms visually that the filter was applied ) Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8869] Purpose:Pedro Vicente Nunes2004-07-131-14/+15
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5repack changes Description: there were some requests to change some minor h5repack features h5repack only made a warning about a non available filter in verbose mode ( -v ) without -v it kept silent, and users sometimes missed this warning the request was that it should print this warning always. so, the new format, is e.g ./h5repack -i test_szip.h5 -o out.h5 Warning: dataset </dset_szip> cannot be read, SZIP filter is not available due to this, and to avoid a lot of these messages in the shell test script, I modified the script h5repack.sh so that it detects the presence of all filters in the environment (previously it only detected SZIP) the test files were also divided in more files , to make the script code easier to follow Solution: Platforms tested: linux AIX (no szip) solaris (no szip, no gzip ) Misc. update:
* [svn-r8781] James Laird2004-07-011-2/+1
| | | | | | | | | | | | | | | | Purpose: HDF5 now supports SZIP with no encoder. Description: SZIP can be configured to have both encoder and decoder or just to have the decoder. HDF5 can now query the configuration of any filter, and will throw errors if users try to write using a filter with encoding disabled. Solution: Added H5Zget_filter_info function, changed API for H5Pget_filter and H5P_get_filter_by_id. See SZIP RFC. Platforms tested: Copper (fortran, C++, parallel), Sleipnir (C++), Arabica (fortran, C++), Verbena (fortran, C++) Misc. update:
* [svn-r8352] Purpose:Pedro Vicente Nunes2004-04-141-6/+21
| | | | | | | | | | | | | | | | bug fix Description: the routine for reading the options from a file had the "old" parse syntax Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8320] Purpose:Pedro Vicente Nunes2004-04-081-1/+5
| | | | | | | | | | | | | | | | new tests for h5repack Description: added more tests both to the test program and shell script that test a variation of different filter converssions Solution: Platforms tested: linux Misc. update:
* [svn-r8311] Purpose:Pedro Vicente Nunes2004-04-061-1/+1
| | | | | | | | | | | | | cleaned some comments and printfs Description: Solution: Platforms tested: linux Misc. update:
* [svn-r8297] Purpose:Pedro Vicente Nunes2004-04-021-2/+2
| | | | | | | | | | | | | | | | | | | | | | bug fix Description: the synntax of the input of h5repack conatined double quotes and spaces, which were causing problems on the parsing in AIX paralell Solution: replaced the spaces by = that is, instead of -f "GZIP 6" we have now -f GZIP=6 Platforms tested: linux solaris AIX paralell Misc. update:
* [svn-r8229] Purpose:Pedro Vicente Nunes2004-03-021-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1) new function for tools library 2) new test script for h5repack Description: 1) currently all the tools (h5dump, h5diff, etc) do not check if a filter is available for reading some dataset that might have a filter not available on the current configuration (the behaviour of the tools until now was to trigger a library error, saying that the dataset cannot be read due to the lack of the filter) Solution: 1) added a new function h5tools_canreadf that checks if a dataset can be read depending on the availability of filters. this function was added in calls for h5diff and h5repack. instead of triggering the library error, a message is printed, saying that the dataset cannot be read (the print is optional, it is on on verbose mode) 2) added a shell script that tests the commannd line tool behaviour of h5repack the script does a series of runs of h5repack with several options on the same file (this file test4.h5 was added to the testfiles dir). then, it runs the h5diff tool, with the input and output files , in each run. the goal of the test is also to check item 1) . the binary file was saved with filters that might not be available on other configurations Platforms tested: linux (all filters enabled) linux (some filters disabled) solaris (some filters disabled) AIX (some filters disabled) windows (all filters on and off ) Misc. update:
* [svn-r8176] Purpose:Pedro Vicente Nunes2004-02-101-2/+2
| | | | | | | | | | | | | | | | | | | new feature, bug fix, changed function Description: 1) implemented the option that says if the dataset is too small , do not compress it 2) bug fix in the SZIP checking . only apply szip to atomic datatypes 3) made the apply_filters function more compact Solution: Platforms tested: linux AIX solaris Misc. update:
* [svn-r8122] Purpose:Pedro Vicente Nunes2004-01-281-1/+2
| | | | | | | | | | | | | | | | | | h5repack new feature Description: in the SZIP settings, when the requested pixels per block parameter does not conform to the SZIP specifications, instead of returning without applying the filter, do an attempt to set this parameter to a valid value, issuing a warning in the process Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8060] Purpose:Pedro Vicente Nunes2004-01-141-2/+2
| | | | | | | | | | | | | | | added a usage message for h5repack Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8040] Purpose:Pedro Vicente Nunes2004-01-081-1/+3
| | | | | | | | | | | | | | | | | bug fix, code improvment Description: fixed a bug in the parse of chunking function added some auxiliary functions to avoid repeated parts of the code in several places Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8021] Purpose:Pedro Vicente Nunes2004-01-061-6/+28
| | | | | | | | | | | | | | | | h5repack new features Description: added support/tests for multi filters Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7997] Purpose:Pedro Vicente Nunes2003-12-301-35/+44
| | | | | | | | | | | | | | | | h5repack new features Description: added support for layout options Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7994] Purpose:Pedro Vicente Nunes2003-12-291-74/+86
| | | | | | | | | | | | | | | | | | | h5repack new features Description: added checking routines for the filters that were applied to the output file added tests for szip filter Solution: Platforms tested: linux solaris (IRIX is not available) : Misc. update:
* [svn-r7966] Purpose:Pedro Vicente Nunes2003-12-171-0/+1
| | | | | | | | | | | | | | | | h5repack new features Description: added debugging functions and a hard link generated dataset for the test suite Solution: Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7913] Purpose:Pedro Vicente Nunes2003-12-041-36/+29
| | | | | | | | | | | | | | | | | code clean Description: separated the h5repack code in several modules Solution: Platforms tested: linux IRIX solaris Misc. update:
* [svn-r7834] Purpose:Pedro Vicente Nunes2003-11-101-2/+2
| | | | | | | | | | | | | | | | code clean Description: removed compiler warnings on IRIX Solution: Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7833] Purpose:Pedro Vicente Nunes2003-11-101-5/+11
| | | | | | | | | | | | | | | | bug fix, clean code Description: a malloced buffer was not release cleaned some compiler warnings Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7769] Purpose:Pedro Vicente Nunes2003-10-281-9/+10
| | | | | | | | | | | | | moved h5diff "public API" routines to tools/lib folder Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7717] Purpose:Pedro Vicente Nunes2003-10-231-0/+3
| | | | | | | | | | | | | | | new features of h5repack Description: added copy routine added parsing of command line arguments Platforms tested: linux, solaris, IRIX Misc. update:
* [svn-r7704] Purpose:Pedro Vicente Nunes2003-10-221-0/+2
| | | | | | | | | | | | continuation of commit message Platforms tested: linux solaris IRIX Misc. update:
* [svn-r7703] Purpose:Pedro Vicente Nunes2003-10-221-2/+405
| | | | | | | | | | | | | | | | | | | h5repack new features Description: implemented some features of h5repack , mostly borrowed from hrepack like 1) the parsing of options 2) building a list of options 3) printing formats added a test program that generates files and calls h5diff to compare the input and output files Platforms tested: Misc. update:
* [svn-r7497] Purpose:Pedro Vicente Nunes2003-09-191-0/+23
added the new tool h5repack right now it just contains source files with an empty main Platforms tested: linux (small change) Misc. update: