summaryrefslogtreecommitdiffstats
path: root/tools/h5repack/h5repack.h
Commit message (Collapse)AuthorAgeFilesLines
* HDFFV-10297 merge from developAllen Byrne2017-10-111-50/+50
| | | Also cleaned up some other non-merged changes
* HDFFV-10276 add enable-error-stack to h5diffAllen Byrne2017-08-311-4/+5
|
* Tools merge from develop-1.10Allen Byrne2017-05-171-6/+4
|
* Fix function declarationAllen Byrne2016-09-281-7/+7
|
* [svn-r24205] Merge HDFFV-8513/8522 from trunk (via cmake branch), h5repack ↵Allen Byrne2013-09-261-8/+7
| | | | | | | | UD plugins. Also warning session fixes. Tested: CMake local linux
* [svn-r22281] Purpose:Jonathan Kim2012-04-111-0/+1
| | | | | | | | | | | | | Fix for HDFFV-7993 - h5repack fails with error "chunk size must be <= maximum dimension size for fixed-sized dimensions" Description: Fixed a failure when change the chunk size of a specified chunked dataset with unlimited max dims. Also took care of converting to contiguous and compact from the dataset. Test cases were added and tagged with jira#. Merged from HDF5 trunk r22277. Tested: jam (linux32-LE), koala (linux64-LE), ostrich (linuxppc64-BE), tejeda (mac32-LE), Windows (32-LE cmake), Cmake (jam)
* [svn-r22216] Description:Quincey Koziol2012-03-311-0/+1
| | | | | | | | | | | | | Bring r22180, r22181 and r22214 from trunk to 1.8 branch: Add new "metadata block size" command line option ('-M <x>' or '--metadata_block_size=<x>') for h5repack. [With release managers blessing] Tested on: Mac OSX/64 10.7.3 (amazon) w/debug) (h5committest upcoming)
* [svn-r20104] Purpose:Jonathan Kim2011-02-141-2/+1
| | | | | | | | | | | | | Change to use HDxxx macros. Description: Merged from hdf5 trunk r20103. Originally this started for fixing incorrect pointer usage. But that got fixed through coverity merge. So this is mainly changing to use HDxxx macros and clean up some related code. Tested: jam (linux32-LE), amani (linux64-LE), heiwa (linuxppc64-BE)
* [svn-r20017] Purpose: fix compiler error on BP (AIX) from recent change for ↵Jonathan Kim2011-01-271-0/+1
| | | | h5repack svn r20007.
* [svn-r20007] Purpose:Jonathan Kim2011-01-261-0/+1
| | | | | | | | Clean up tool code. Remove "h5test.h" from tool code. Currently only in h5repack. Tested: jam (linux32-LE), amani (linux64-LE), heiwa (linuxppc64-BE), linew (solaris-BE), tejeda (mac32-LE)
* [svn-r18455] Purpose:Jonathan Kim2010-03-251-0/+16
| | | | | | | | | | | Fix for the bug1726 - NPOESS: h5repack loses attributes for datasets of type H5T_REFERENCE. Description: Merged from hdf5 trunk rXXX Tested: jam
* [svn-r18198] Description:Quincey Koziol2010-01-301-3/+3
| | | | | | | | | Trim trailing whitespace from source code files, with following command: find . \( -name "*.[ch]" -or -name "*.cpp" -or -name "*.f90" \) -print |xargs -n 1 sed -i "" 's/[[:blank:]]*$//' Tested on: None - eyeballed only
* [svn-r16658] merge from trunk 16656Pedro Vicente Nunes2009-04-021-1/+1
| | | | | | | | #1402 (B1) h5repack does not preserve creation order indexing. ISSUE : h5repack does not handle group creation order flags. ACTION: call H5P(g)(s)et_link_creation_order functions when handling groups, add new groups with these flags to the test generation program, and verify results in the test program. TEST: in the test program, function that compares property lists, added code to verify groups DOCS: Added the note to RELEASE.txt: "h5repack now handles group creation order. PVN - 2009/4/2 - 1402".
* [svn-r16115] #1375. Define a default chunk whose size is manageable. Defined ↵Pedro Vicente Nunes2008-11-211-0/+1
| | | | | | currently as the same size of hyperslab (that compares the dimension sizes against a predefined constant size and chooses the minimum between the two) Tested : linux, windows
* [svn-r15646] Cleaned compiler warnings Pedro Vicente Nunes2008-09-171-4/+4
| | | | | | Bug fix: change the options block size variable from int to hsize_t, to match the H5Pset_userblock call Tested: windows, linux
* [svn-r15629] Description:Quincey Koziol2008-09-161-3/+3
| | | | | | | | | | | | | Remove trailing whitespace from C/C++ source files, with the following script: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Tested on: Mac OS X/32 10.5.5 (amazon) No need for h5committest, just whitespace changes...
* [svn-r15558] 1) There are 2 new command line parameters for h5repack. ↵Pedro Vicente Nunes2008-08-291-2/+6
| | | | | | | | | | | | | | Together they allow a call to H5Pset_alignment to be made -t T, --threshold=T Threshold value for H5Pset_alignment -a A, --alignment=A Alignment value for H5Pset_alignment 2) bug fix the printing of the dataset name was not done for references (verbose mode) tested: windows, linux
* [svn-r15533] #1184Pedro Vicente Nunes2008-08-261-10/+6
| | | | | | | | | | | Add a userblock to an HDF5 file during the repack. The user gives give a filename and userblock size as command line parameters to h5repack and the contents of that file are stored in the userblock for the HDF5 file created by h5repack. New flags to handle this -u and -b Tested : windows, linux
* [svn-r14368] clean code and reshufle functions between modules, remove ↵Pedro Vicente Nunes2008-01-031-30/+16
| | | | | | unused functions tested: windows, linux
* [svn-r14360] New function has_filters (replace has_filters for each object ↵Pedro Vicente Nunes2008-01-021-1/+1
| | | | | | | | | and for global filters): verify if all requested filters in the array FILTER obtained from user input are present in the property list PID obtained from the output file. All the filter comparison of client data values is done here instead of the previous filtcmp TO DO: szip, nbit and scale offset NOTE: the symbol H5Z_SHUFFLE_TOTAL_NPARMS was made public Tested: windows, teragrid with icc 8.1, linux (kagiso), solaris (linew)
* [svn-r14346] New feature: has_filters_obj function that checks if filters ↵Pedro Vicente Nunes2007-12-141-2/+3
| | | | | | | | | | | | | | | | | | | | match for each individual dataset Following the new feature of h5repack to allow multiple filters for all datasets and the new function has_filters that checks if the repacked file has all the filters requested, I added a new function has_filters_obj that does the same for each dataset. The previous function that checked this only ckecked if the user input filters were in the output dataset. This new function does this but checks if the filters are exactly the same. Currently the behavior of h5repack is to delete all filters that are present in the input file (dataset) and replace them with the requested ones, so they must match exactly. We might consider adding other logical operations, like keep the existing ones. Additionally , the function also checks if the filter parameters match. While doing this I noticed that for the shuffle filter , the values returned do not match and also the same for the N-bit and scale-offset The new function that checks for the filter values fails then, and so I commented the h5repack tests that do this for the N-bit and scale-offset filter (previously for the same bug on the shuffle filter I added special code on the compare filter function but this is temporary until I find the issue) tested: windows, linux, solaris
* [svn-r14345] substituted the symbol CD_VALUES , number of filter client data ↵Pedro Vicente Nunes2007-12-141-4/+6
| | | | | | | | values, for H5Z_COMMON_CD_VALUES that is defined in the library tested: windows, linux, solaris
* [svn-r14320] Added a function that matches the filters on the dataset's DCPL ↵Pedro Vicente Nunes2007-12-041-16/+4
| | | | | | | | and in the requested list Used to verify if the filters requested are present in the output dataset tested: windows, linux, solaris
* [svn-r14317] code maintenance: code cleaning and reorganizing of the ↵Pedro Vicente Nunes2007-12-031-2/+0
| | | | | | h5repack verify routines tested: windows, linux
* [svn-r14299] new feature: add support for h5repack to handle several global ↵Pedro Vicente Nunes2007-11-281-7/+16
| | | | | | | | filters usage is to repeat the -f option tested: windows, linux, solaris
* [svn-r14115] Description:Quincey Koziol2007-08-281-4/+0
| | | | | | | | | | | | | | | | | Remove all plain calls to H5Gopen() from source, replacing them with either H5Gopen2(). Add test for H5Gopen1(). Reformatted several pieces of code, to clean them up. Tested on: FreeBSD/32 6.2 (duty) FreeBSD/64 6.2 (liberty) Linux/32 2.6 (kagiso) Linux/64 2.6 (smirom) Solaris/32 5.10 (linew) Mac OS X/32 10.4.10 (amazon)
* [svn-r13975] Add --latest, -compact=<size>, ... options to use the lastest ↵Peter Cao2007-07-131-0/+5
| | | | | | file format. Add test for the options to the daily test.
* [svn-r13810] Pedro Vicente Nunes2007-05-241-2/+5
| | | | | | | | Minor tunings to output verbose messages: 1)when there is not a filter request do not print a message saying the filter was not apllied when the dataset was too small 2) avoid printing the message that has a list of objects to modify when there is none Tested:linux
* [svn-r13589] Pedro Vicente Nunes2007-04-041-2/+1
| | | | | | h5repack code cleaning (required reconfigure) tested: linux (32, 64, parallel), solaris
* [svn-r13441] Pedro Vicente Nunes2007-03-011-11/+2
| | | | make 1.7 h5repack more similar to 1.6 h5repack
* [svn-r13253] Updated all C and C++ style source code files with the THG ↵Albert Cheng2007-02-071-2/+3
| | | | | | | | | copyright notice. Tested platform: Kagiso only since it is only a comment block change. If it works in one machine, it should work in all, I hope. Still need to check the parallel build on copper.
* [svn-r12928] code revisionPedro Vicente Nunes2006-11-161-4/+3
|
* [svn-r12884] Pedro Vicente Nunes2006-11-081-7/+1
| | | | | | | | | | | | h5repack support for H5Ocopy in the copy of objects. The old method for recreating references was dropped (references recreated in a second traversal of the file) The logic for using H5Ocopy or not is if the input DCPL has filters or non default layout OR these are requested by the user THEN use the old h5repack read / write ELSE use H5Ocopy
* [svn-r12784] Pedro Vicente Nunes2006-10-191-2/+3
| | | | | | | | | | | | | | | | | Fixes for bugs 676, 228 676: both h5repack and h5diff use H5Dread. In the case of a "big" dataset, use read/write by hyperslabs the same way h5dump uses. An arbitrary value of 1GB was defined for "big", i.e, if the dataset is greater than 1GB, then read/write by hyperslabs 228: use the file type in read/write by default. A new switch -n was introduced if the user wants to use a native type, which was the previous use by default. Added a new test for h5repack that repacks a 1GB dataset Tested: heping (serial, parallel), sol, copper
* [svn-r12736] Description:Quincey Koziol2006-10-091-9/+3
| | | | | | | | | | | | | | | | | | | Add "use the latest format" support for dataspace object header encode/ decode routines and clean up format a bit for the latest format (new to 1.8.x releases) Remove storing 'perm' parameter for array datatypes in memory and the file, and add test to make certain that if any user applications are attempting to store them, we get some reports back. (Should be unlikely, since the RefMan says that the parameter is not implemented and is unsupported). Carry those changes into the tests, etc. Clean up a bunch more compiler warnings. Tested on: FreeBSD/32 4.11 (sleipnir) w/threadsafe Linux/32 2.4 (heping) w/FORTRAN & C++ Linux/64 2.4 (mir) w/enable-1.6-compat
* [svn-r12440] Purpose:Quincey Koziol2006-06-271-4/+4
| | | | | | | | | | | Code cleanup Description: Trim trailing whitespace in Makefile.am and C/C++ source files to make diffing changes easier. Platforms tested: None necessary, whitespace only change
* [svn-r12211] Purpose:Pedro Vicente Nunes2006-04-071-2/+1
| | | | | | | | | | | | | | | | new feature Description some more check in related to the print of compression ratios: print warning messages after the print of the dataset name and compression: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12208] Purpose:Pedro Vicente Nunes2006-04-061-1/+2
| | | | | | | | | | | | | | | | new feature Description: some more formatting for the new printout of compression ratios Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12159] Purpose:Pedro Vicente Nunes2006-03-271-3/+8
| | | | | | | | | | | | | | | | | bug fix Description: h5repack was not dealing with family files Solution: use the toolslib function h5tools_open to open the file instead of H5Fopen in h5repack Platforms tested: linux solaris AIX Misc. update:
* [svn-r11886] Purpose:Quincey Koziol2006-01-231-79/+3
| | | | | | | | | | | | | Code cleanup Description: Check in some of the code cleanups from working on the external link support. (This doesn't include any of the external link features) Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX.4 (amazon) Linux 2.4
* [svn-r11577] Purpose: Maintenance/small VMS bug fixElena Pourmal2005-10-181-13/+13
| | | | | | | | | | | | Description: VMS doesn't like file names with more than one "." Some h5repacktst output file names were of the form <name>.out.h5 causing h5repacktst to choke. Solution: Renamed output files to be of the form <name>out.h5 Platforms tested: heping, unnamed VMS machine Misc. update:
* [svn-r11443] Purpose:Pedro Vicente Nunes2005-09-191-12/+8
| | | | | | | | | | | | | | | | | | | | | | new features Description: added support for the scale/offset filter there is a new filter symbol 'SOFF' -f SOFF=<scale_factor,scale_type> scale_factor = integer scale_type = 'IN' or 'DS' Solution: Platforms tested: Linux SunOS Misc. update:
* [svn-r11388] Purpose:Pedro Vicente Nunes2005-09-121-7/+7
| | | | | | | | | | | | | | | bug fix Description: during the generation of some test files, H5Fclose was not called during the #ifdef detection of the scale ofsset filter, a wrong macro symbol was used Solution: Platforms tested: linux Misc. update:
* [svn-r11245] Purpose:Quincey Koziol2005-08-131-38/+38
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Trim trailing whitespace, which is making 'diff'ing the two branches difficult. Solution: Ran this script in each directory: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r10144] Purpose:Quincey Koziol2005-03-041-0/+1
| | | | | | | | | | | | | | | | Bug fix Description: The GASS VFL driver header file was bringing in the <string.h> header file, which several other source code modules needed also, but weren't including explicitly themselves. Solution: Add includes for <string.h> to files which actually need them. Platforms tested: FreeBSD 4.11 (sleipnir) w/C++ as CC Configuration not tested by h5committest...
* [svn-r10067] Purpose:Robert E. McGrath2005-02-231-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | feature Description: h5repack support for scaleoffset compression Checking in early to help debug the filter. Solution: Added messages and command line to handle new scale offset filter. Note: TESTS ARE DISABLED FOR NOW. The filter is not complete, repack tests may fail due to know problems. PLEASE DO NOT MESS WITH THE SCALEOFFSET TESTS AT THIS TIME. They will be enabled when the filter is ready. Platforms tested: verbena,copper,shanti Misc. update: MANIFEST
* [svn-r10009] Purpose:Robert E. McGrath2005-02-151-0/+2
| | | | | | | | | | | | | | | feature Description: support for nbit compression in h5repack Solution: Platforms tested: verbena,copper,shanti Misc. update: manifest
* [svn-r9436] Purpose:Pedro Vicente Nunes2004-10-191-7/+1
| | | | | | | | | | | | | | | | | | | | | bug fix Description: Description: one case was not handled in the combination of input options (layout and filters) Solution: redo the algorythm that handles all cases Solution: Platforms tested: linux Misc. update:
* [svn-r9428] Purpose:Pedro Vicente Nunes2004-10-181-0/+1
| | | | | | | | | | | | | | | | | bug fix Description: when specifying both an input object e.g -f mydset:GZIP=1 and a defined chunk -l CHUNK=20x20 the filter used a defined default chunk instead Solution: add a check for the input chunk Platforms tested: linux (small change) Misc. update:
* [svn-r9137] Purpose:Pedro Vicente Nunes2004-08-231-0/+2
| | | | | | | | | | | | | | | | | | new test Description: added a test that generates and copies a file with a dataset with fill value (this is to test the property list function H5Pequal) Solution: Platforms tested: linux solaris aix Misc. update: