summaryrefslogtreecommitdiffstats
path: root/tools/h5repack/h5repack_copy.c
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r12793] 1. fix a compiling error in atlantiaPedro Vicente Nunes2006-10-201-17/+17
| | | | | 2. added the test library delete framework to delete output .h5 files 3. cleaned warnings
* [svn-r12784] Pedro Vicente Nunes2006-10-191-126/+226
| | | | | | | | | | | | | | | | | Fixes for bugs 676, 228 676: both h5repack and h5diff use H5Dread. In the case of a "big" dataset, use read/write by hyperslabs the same way h5dump uses. An arbitrary value of 1GB was defined for "big", i.e, if the dataset is greater than 1GB, then read/write by hyperslabs 228: use the file type in read/write by default. A new switch -n was introduced if the user wants to use a native type, which was the previous use by default. Added a new test for h5repack that repacks a 1GB dataset Tested: heping (serial, parallel), sol, copper
* [svn-r12736] Description:Quincey Koziol2006-10-091-4/+2
| | | | | | | | | | | | | | | | | | | Add "use the latest format" support for dataspace object header encode/ decode routines and clean up format a bit for the latest format (new to 1.8.x releases) Remove storing 'perm' parameter for array datatypes in memory and the file, and add test to make certain that if any user applications are attempting to store them, we get some reports back. (Should be unlikely, since the RefMan says that the parameter is not implemented and is unsupported). Carry those changes into the tests, etc. Clean up a bunch more compiler warnings. Tested on: FreeBSD/32 4.11 (sleipnir) w/threadsafe Linux/32 2.4 (heping) w/FORTRAN & C++ Linux/64 2.4 (mir) w/enable-1.6-compat
* [svn-r12720] Pedro Vicente Nunes2006-10-051-7/+10
| | | | | | added output of error messages using the tools library function error_msg, that prints the program name and error on the message tested: kagiso
* [svn-r12634] Purpose:Albert Cheng2006-08-281-1/+1
| | | | | | | | | | | | Code cleanup. Description: Removed argc and argv from the function arguments of h5tools_get_fapl() and h5tools_fopen(). They were used to call MPI_Init() which was no longer needed. Tested: heping (serial and parallel).
* [svn-r12528] Added User-Defined links to the library.James Laird2006-08-021-30/+26
| | | | | | | | | | | | | | Users can create external links using H5L_create_external(). These links point to an object in another HDF5 file. Users can alter the behavior of external links or create new kinds of links by registering callbacks using the H5L interface. Added tests, tools support, etc. Also a number of other, minor changes have been made (some restructuring of the H5L interface, for instance). Additional documentation and examples are forthcoming.
* [svn-r12440] Purpose:Quincey Koziol2006-06-271-11/+11
| | | | | | | | | | | Code cleanup Description: Trim trailing whitespace in Makefile.am and C/C++ source files to make diffing changes easier. Platforms tested: None necessary, whitespace only change
* [svn-r12254] Purpose:Quincey Koziol2006-04-141-2/+2
| | | | | | | | | | | | | | Anti-feature Description: Revert changes to H5G_stat_t struct, to make it compatible with the 1.6.x branch again. The information that was added to the H5G_stat_t struct will be reported through other API routines. Platforms tested: FreeBSD 4.11 (sleipnir) w/C++ Linux 2.4/64 (mir) w/C++ & Fortran Solaris 2.9 (shanti)
* [svn-r12211] Purpose:Pedro Vicente Nunes2006-04-071-1/+1
| | | | | | | | | | | | | | | | new feature Description some more check in related to the print of compression ratios: print warning messages after the print of the dataset name and compression: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12208] Purpose:Pedro Vicente Nunes2006-04-061-4/+6
| | | | | | | | | | | | | | | | new feature Description: some more formatting for the new printout of compression ratios Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12207] Purpose:Pedro Vicente Nunes2006-04-061-14/+27
| | | | | | | | | | | | | | | | | new feature Description: some more formatting of the output for the new compression ratio printout Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12206] Purpose:Pedro Vicente Nunes2006-04-061-8/+11
| | | | | | | | | | | | | | | | new feature Description: added some alignment for the printout of attributes, so that is formatted with the new printout of datasets compression Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12205] Purpose:Pedro Vicente Nunes2006-04-061-52/+98
| | | | | | | | | | | | | | | | new feature Description: added the printout of the compression ratio for filters in h5repack, after the filter name, obtained with H5Dget_storage_size, before and after applying the filter Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r12159] Purpose:Pedro Vicente Nunes2006-03-271-6/+8
| | | | | | | | | | | | | | | | | bug fix Description: h5repack was not dealing with family files Solution: use the toolslib function h5tools_open to open the file instead of H5Fopen in h5repack Platforms tested: linux solaris AIX Misc. update:
* [svn-r11886] Purpose:Quincey Koziol2006-01-231-1/+1
| | | | | | | | | | | | | Code cleanup Description: Check in some of the code cleanups from working on the external link support. (This doesn't include any of the external link features) Platforms tested: FreeBSD 4.11 (sleipnir) Mac OSX.4 (amazon) Linux 2.4
* [svn-r11304] Purpose:Quincey Koziol2005-08-271-2/+2
| | | | | | | | | | | | | Code cleanup (sorta) Description: Adjust H5G_stat_t to prepare for eventual "external link" information. This also puts the information for regular objects and soft links into more obviously separate places. Platforms tested: FreeBSD 4.11 (sleipnir) Linux 2.4
* [svn-r11245] Purpose:Quincey Koziol2005-08-131-134/+134
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Trim trailing whitespace, which is making 'diff'ing the two branches difficult. Solution: Ran this script in each directory: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r10067] Purpose:Robert E. McGrath2005-02-231-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | feature Description: h5repack support for scaleoffset compression Checking in early to help debug the filter. Solution: Added messages and command line to handle new scale offset filter. Note: TESTS ARE DISABLED FOR NOW. The filter is not complete, repack tests may fail due to know problems. PLEASE DO NOT MESS WITH THE SCALEOFFSET TESTS AT THIS TIME. They will be enabled when the filter is ready. Platforms tested: verbena,copper,shanti Misc. update: MANIFEST
* [svn-r10009] Purpose:Robert E. McGrath2005-02-151-0/+3
| | | | | | | | | | | | | | | feature Description: support for nbit compression in h5repack Solution: Platforms tested: verbena,copper,shanti Misc. update: manifest
* [svn-r9727] Purpose:Quincey Koziol2004-12-291-17/+12
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug Fix/Code Cleanup/Doc Cleanup/Optimization/Branch Sync :-) Description: Generally speaking, this is the "signed->unsigned" change to selections. However, in the process of merging code back, things got stickier and stickier until I ended up doing a big "sync the two branches up" operation. So... I brought back all the "infrastructure" fixes from the development branch to the release branch (which I think were actually making some improvement in performance) as well as fixed several bugs which had been fixed in one branch, but not the other. I've also tagged the repository before making this checkin with the label "before_signed_unsigned_changes". Platforms tested: FreeBSD 4.10 (sleipnir) w/parallel & fphdf5 FreeBSD 4.10 (sleipnir) w/threadsafe FreeBSD 4.10 (sleipnir) w/backward compatibility Solaris 2.7 (arabica) w/"purify options" Solaris 2.8 (sol) w/FORTRAN & C++ AIX 5.x (copper) w/parallel & FORTRAN IRIX64 6.5 (modi4) w/FORTRAN Linux 2.4 (heping) w/FORTRAN & C++ Misc. update:
* [svn-r9614] Purpose:Pedro Vicente Nunes2004-12-031-21/+34
| | | | | | | | | | | | | | | | | | new feature Description: when requesting a filter for all datasets and the filter cannot be applied for one dataset use the original dcpl withou filter and print a warning this check was done previously with buit in functions for szip that are now in the library Solution: Platforms tested: linux solaris aix Misc. update:
* [svn-r9436] Purpose:Pedro Vicente Nunes2004-10-191-20/+3
| | | | | | | | | | | | | | | | | | | | | bug fix Description: Description: one case was not handled in the combination of input options (layout and filters) Solution: redo the algorythm that handles all cases Solution: Platforms tested: linux Misc. update:
* [svn-r9428] Purpose:Pedro Vicente Nunes2004-10-181-1/+4
| | | | | | | | | | | | | | | | | bug fix Description: when specifying both an input object e.g -f mydset:GZIP=1 and a defined chunk -l CHUNK=20x20 the filter used a defined default chunk instead Solution: add a check for the input chunk Platforms tested: linux (small change) Misc. update:
* [svn-r9370] Purpose:Quincey Koziol2004-10-061-20/+4
| | | | | | | | | | | | | | | Refactor code Description: Refactor common code for determining the native type for using in the tools into separate routine. Also, reduce diffs between the two branches and bring back some fixes from the development branch to the release branch. Platforms tested: FreeBSD 4.10 (sleipnir) too minor to require h5committest
* [svn-r9364] Raymond Lu2004-10-051-4/+24
| | | | | | | | | | | | Purpose: change feature Description: Back up support bitfield and time datatypes in H5Tget_native_type.Leave it to future support. Let it return "not supported" error message for now. Platforms tested: h5committest and fuss. Misc. update: RELEASE.txt
* [svn-r8904] Purpose:Pedro Vicente Nunes2004-07-201-44/+105
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5diff and h5repack changes Description: h5diff introduced the following four modes of output: Normal mode: print the number of differences found and where they occured Report mode: print the above plus the differences Verbose mode: print the above plus a list of objects and warnings Quiet mode: do not print output (h5diff always returns an exit code of 1 when differences are found) h5repack added an extra parameter for SZIP filter (coding method) the new syntax is -f SZIP=<pixels per block,coding> (pixels per block is a even number in 2-32 and coding method is 'EC' or 'NN') Example of use: ./h5repack -i file1 -o file2 -f SZIP=8,NN -v updated usage messages, test scripts and files accordingly Solution: Platforms tested: linux AIX solaris Misc. update:
* [svn-r8882] Purpose:Pedro Vicente Nunes2004-07-151-22/+62
| | | | | | | | | | | | | | | | | | | | | | | | bug fix, new feature Description: fixed bug in the parse function: cases where we have an already inserted name but there is a new name also example: -f dset1:GZIP=1 -l dset1,dset2:CHUNK=20x20 dset1 is already inserted, but dset2 must also be (it was not) added a CHECK_SZIP symbol to enable/disable checking of library related szip parameters added the print of the filter name in verbose mode (confirms visually that the filter was applied ) Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8869] Purpose:Pedro Vicente Nunes2004-07-131-17/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | h5repack changes Description: there were some requests to change some minor h5repack features h5repack only made a warning about a non available filter in verbose mode ( -v ) without -v it kept silent, and users sometimes missed this warning the request was that it should print this warning always. so, the new format, is e.g ./h5repack -i test_szip.h5 -o out.h5 Warning: dataset </dset_szip> cannot be read, SZIP filter is not available due to this, and to avoid a lot of these messages in the shell test script, I modified the script h5repack.sh so that it detects the presence of all filters in the environment (previously it only detected SZIP) the test files were also divided in more files , to make the script code easier to follow Solution: Platforms tested: linux AIX (no szip) solaris (no szip, no gzip ) Misc. update:
* [svn-r8781] James Laird2004-07-011-0/+2
| | | | | | | | | | | | | | | | Purpose: HDF5 now supports SZIP with no encoder. Description: SZIP can be configured to have both encoder and decoder or just to have the decoder. HDF5 can now query the configuration of any filter, and will throw errors if users try to write using a filter with encoding disabled. Solution: Added H5Zget_filter_info function, changed API for H5Pget_filter and H5P_get_filter_by_id. See SZIP RFC. Platforms tested: Copper (fortran, C++, parallel), Sleipnir (C++), Arabica (fortran, C++), Verbena (fortran, C++) Misc. update:
* [svn-r8383] Purpose:Quincey Koziol2004-04-181-16/+20
| | | | | | | | | | | | | Code cleanup Description: Clean up lots of warnings based on those reported from the SGI compilers as well as gcc. Platforms tested: SGI O3900, IRIX64 6.5 (Cheryl's SGI machine) FreeBSD 4.9 (sleipnir) w/ & w/o parallel h5committest
* [svn-r8229] Purpose:Pedro Vicente Nunes2004-03-021-0/+11
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 1) new function for tools library 2) new test script for h5repack Description: 1) currently all the tools (h5dump, h5diff, etc) do not check if a filter is available for reading some dataset that might have a filter not available on the current configuration (the behaviour of the tools until now was to trigger a library error, saying that the dataset cannot be read due to the lack of the filter) Solution: 1) added a new function h5tools_canreadf that checks if a dataset can be read depending on the availability of filters. this function was added in calls for h5diff and h5repack. instead of triggering the library error, a message is printed, saying that the dataset cannot be read (the print is optional, it is on on verbose mode) 2) added a shell script that tests the commannd line tool behaviour of h5repack the script does a series of runs of h5repack with several options on the same file (this file test4.h5 was added to the testfiles dir). then, it runs the h5diff tool, with the input and output files , in each run. the goal of the test is also to check item 1) . the binary file was saved with filters that might not be available on other configurations Platforms tested: linux (all filters enabled) linux (some filters disabled) solaris (some filters disabled) AIX (some filters disabled) windows (all filters on and off ) Misc. update:
* [svn-r8176] Purpose:Pedro Vicente Nunes2004-02-101-22/+6
| | | | | | | | | | | | | | | | | | | new feature, bug fix, changed function Description: 1) implemented the option that says if the dataset is too small , do not compress it 2) bug fix in the SZIP checking . only apply szip to atomic datatypes 3) made the apply_filters function more compact Solution: Platforms tested: linux AIX solaris Misc. update:
* [svn-r8122] Purpose:Pedro Vicente Nunes2004-01-281-10/+6
| | | | | | | | | | | | | | | | | | h5repack new feature Description: in the SZIP settings, when the requested pixels per block parameter does not conform to the SZIP specifications, instead of returning without applying the filter, do an attempt to set this parameter to a valid value, issuing a warning in the process Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8120] Purpose:Pedro Vicente Nunes2004-01-281-44/+39
| | | | | | | | | | | | | | | | bug fix Description: avoid reading and writing data when one of the dimensions is 0 Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8113] Purpose:Pedro Vicente Nunes2004-01-261-1/+2
| | | | | | | | | | | | | | | | | | | new library function H5Pdelete_filter deletes one or all filters from a dataset creation property list this was done for the NONE option of h5repack, added tests for this feature added a test for the new function in /test/dsets.c Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8074] Purpose:Pedro Vicente Nunes2004-01-161-2/+3
| | | | | | | | | | | | | | | | | | | added h5repack and h5diff support for copying and differences of references to dataset regions modified the behaviour in the diff of attributes, when a difference in name is detected in the attribute cycle (number of attributes of object), instead of exiting the cycle, rather continue Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8068] Purpose:Pedro Vicente Nunes2004-01-151-1/+1
| | | | | | | | | | | | | changed the text of a error message related to the fail of H5Fopen to " unable to open file " Description: Solution: Platforms tested: linux (small change ) Misc. update:
* [svn-r8062] Purpose:Pedro Vicente Nunes2004-01-141-11/+17
| | | | | | | | | | | | | | | | bug fix Description: cases of rank 0 were not handled, now a warning is made that the dataset cannot be compressed Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8060] Purpose:Pedro Vicente Nunes2004-01-141-10/+10
| | | | | | | | | | | | | | | added a usage message for h5repack Description: Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8056] Purpose:Pedro Vicente Nunes2004-01-131-1/+1
| | | | | | | | | | | | | | | | | | h5repack change Description: changed the default size of chunks when defining a new dataset to apply a filter this size is now equal to the current dimensions. previously , it was set to half this value, and it was causing write calls to fail on some files (probably a bug) Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8040] Purpose:Pedro Vicente Nunes2004-01-081-0/+11
| | | | | | | | | | | | | | | | | bug fix, code improvment Description: fixed a bug in the parse of chunking function added some auxiliary functions to avoid repeated parts of the code in several places Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r8021] Purpose:Pedro Vicente Nunes2004-01-061-5/+5
| | | | | | | | | | | | | | | | h5repack new features Description: added support/tests for multi filters Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7999] Purpose:Pedro Vicente Nunes2003-12-311-1/+1
| | | | | | | | | | | | | | | | h5repack new features Description: added support/ tests for contiguous and compact layout processing Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7997] Purpose:Pedro Vicente Nunes2003-12-301-67/+15
| | | | | | | | | | | | | | | | h5repack new features Description: added support for layout options Solution: Platforms tested: linux solaris AIX Misc. update:
* [svn-r7994] Purpose:Pedro Vicente Nunes2003-12-291-13/+98
| | | | | | | | | | | | | | | | | | | h5repack new features Description: added checking routines for the filters that were applied to the output file added tests for szip filter Solution: Platforms tested: linux solaris (IRIX is not available) : Misc. update:
* [svn-r7969] Purpose:Pedro Vicente Nunes2003-12-181-67/+65
| | | | | | | | | | | | | | | | | | h5repack new features Description: addded the copy routines for hard links changed the traversal structure to store information about the hard links added tests Solution: Platforms tested: linux solaris IRIX Misc. update:
* [svn-r7966] Purpose:Pedro Vicente Nunes2003-12-171-0/+5
| | | | | | | | | | | | | | | | h5repack new features Description: added debugging functions and a hard link generated dataset for the test suite Solution: Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7962] Purpose:Pedro Vicente Nunes2003-12-161-87/+146
| | | | | | | | | | | | | | | | h5repack new features Description: added the copy of referenced objects Solution: Platforms tested: linux solaris 2.7 IRIX Misc. update:
* [svn-r7913] Purpose:Pedro Vicente Nunes2003-12-041-0/+516
code clean Description: separated the h5repack code in several modules Solution: Platforms tested: linux IRIX solaris Misc. update: