summaryrefslogtreecommitdiffstats
path: root/tools/h5repack
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r17703] Bug fix: (1192)Albert Cheng2009-10-214-30/+32
| | | | | | | Changed exit(1) to exit(EXIT_FAILURE) and exit(0) to exit(EXIT_SUCCESS) for better coding. Tested: jam.
* [svn-r17646] 1. tools/h5repack/h5repack_main.c: accept string for strategy ↵Vailin Choi2009-10-151-14/+30
| | | | | | | | | | | | | | | | | | instead of a number 2. tools/h5stat/h5stat.c: clean up and activate options as stated in usage 3. tools/h5stat/testfiles/*.ddl: modified according to the latest output -This line, and those below, will be ignored-- M tools/h5repack/h5repack_main.c M tools/h5stat/testfiles/h5stat_newgrat.ddl M tools/h5stat/testfiles/h5stat_filters.ddl M tools/h5stat/testfiles/h5stat_help1.ddl M tools/h5stat/testfiles/h5stat_help2.ddl M tools/h5stat/testfiles/h5stat_tsohm.ddl M tools/h5stat/testfiles/h5stat_filters-F.ddl M tools/h5stat/h5stat.c
* [svn-r17616] Purpose:Mike McGreevy2009-10-082-9/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | CFLAGS overhaul Description: Modified the way configure handles CFLAGS. (note: all changes also apply to FCFLAGS, CXXFLAGS, CPPFLAGS, and LDFLAGS). 1. The configure process will now always preserve a user's CFLAGS environment variable setup. Any additional flags necessary for compilation added at configure time will be passed into the Makefiles as AM_CFLAGS, which is an automake construct to be used in addition to CFLAGS. This will allow a user to have the final say, as CFLAGS will always appear later in the compile line than AM_CFLAGS. Additionally, setting CFLAGS during make will no longer completely erase all flags set by configure, since they're maintained in AM_CFLAGS. 2. Additionally, where possible, flags previously being assigned directly into CFLAGS (and thus propagating into h5cc) have now been redirected into H5_CFLAGS, so they're used ONLY for compiling hdf5, and not embedded into the h5cc wrapper script as well. *Note that H5_CFLAGS ultimately is assigned into AM_CFLAGS for use in the Makefiles. Complete description of changes and build process will be included in a Configure Document that Elena and I are working on. 3. Removed unsupported config files. This includes: config/dec-osf* config/hpux11.00 config/irix5.x config/powerpc-ibm-aix4.x config/rs6000-ibm-aix5.x config/unicos* 4. Modified configure summary to display additional values. Specifically, appropriate AM_* variables are being shown, as well as H5_FCFLAGS and H5_CXXFLAGS, which were for some reason not already present. Tested: - H5committest - Tested on all THG / NCSA machines, using several combinations of the more prominent configure options (c++, fortran, szip, threadsafe, parallel, et cetera). (Thanks to Quincey for rysnc testing setup!) - With regards to new automated testing, anything *necessary* for compilation will be caught by the daily tests as it stands now. (i.e., if LDFLAGS is not properly set when szip is used, linking will fail). Additionally, with regards to which flags get into h5cc, if any *necessary* flags have been improperly removed, then daily tests should fail during make installcheck. Additional machine-specific desired behaviors and/or checks may have to be set up separately within the daily tests, so this is something to work on.
* [svn-r17606] Code Cleanup:Albert Cheng2009-10-071-41/+16
| | | | | | | | TFLOPS machine has retired long ago. Removed all code specific for its support. Test: h5committested.
* [svn-r17582] Description:Quincey Koziol2009-10-026-140/+300
| | | | | | | | | | | | | | | | | | | | | Bring changes from file free space branch back to the trunk. *yay!* Tested on: FreeBSD/32 6.3 (duty) in debug mode FreeBSD/64 6.3 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (jam) w/PGI compilers, w/default API=1.8.x, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/Intel compilers, w/default API=1.6.x, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in debug mode Linux/64-amd64 2.6 (abe) w/parallel, w/FORTRAN, in production mode Mac OS X/32 10.5.8 (amazon) in debug mode Mac OS X/32 10.5.8 (amazon) w/C++ & FORTRAN, w/threadsafe, in production mode
* [svn-r17553] Description:Quincey Koziol2009-09-293-45/+44
| | | | | | | | | | | | | | | | | | | | | | Bring general fixes/improvements from file_free_space branch back to trunk. Tested on: FreeBSD/32 6.3 (duty) in debug mode FreeBSD/64 6.3 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (jam) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/Intel compilers w/default API=1.6.x, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode Linux/64-amd64 2.6 (abe) w/parallel, w/FORTRAN, in production mode Mac OS X/32 10.5.8 (amazon) in debug mode Mac OS X/32 10.5.8 (amazon) w/C++ & FORTRAN, w/threadsafe, in production mode
* [svn-r17345] Purpose:Mike McGreevy2009-08-121-54/+104
| | | | | | | | | | | | | | | | | | | | | | | | Updating autotools Description: Installed new autotools and used them to reconfigure HDF5. - Automake upgraded to 1.11 - Autoconf upgraded to 2.64 - bin/reconfigure script edited to use new versions (on jam), and run to generate new configure script and Makefile.in's. - configure.in script edited to add "_cv_" to all AC_CACHE_VAL strings (in order to comply with new autoconf standard). Tested: Tested on machines jam, smirom, liberty, linew. Tested w/ features c++, fortran, parallel. Tested w/ compilers gcc, pgcc, icc. Further testing via Daily Tests should catch any other outliers. Upon passing DT's, I'll propogate the new tools into 1.8, hdf4, et cetera.
* [svn-r17313] Description:Quincey Koziol2009-08-103-12/+4
| | | | | | | | | | | | | | | | | | | | | Bring back various minor code cleanups from the file free space branch Tested on: FreeBSD/32 6.3 (duty) in debug mode FreeBSD/64 6.3 (liberty) w/C++ & FORTRAN, in debug mode Linux/32 2.6 (kagiso) w/PGI compilers, w/C++ & FORTRAN, w/threadsafe, in debug mode Linux/64-amd64 2.6 (smirom) w/Intel compilers w/default API=1.6.x, w/C++ & FORTRAN, in production mode Solaris/32 2.10 (linew) w/deprecated symbols disabled, w/C++ & FORTRAN, w/szip filter, in production mode Linux/64-ia64 2.6 (cobalt) w/Intel compilers, w/C++ & FORTRAN, in production mode Linux/64-ia64 2.4 (tg-login3) w/parallel, w/FORTRAN, in production mode Linux/64-amd64 2.6 (abe) w/parallel, w/FORTRAN, in production mode Mac OS X/32 10.5.8 (amazon) in debug mode Mac OS X/32 10.5.8 (amazon) w/C++ & FORTRAN, w/threadsafe, in production mode
* [svn-r17268] Description:Quincey Koziol2009-07-301-1/+1
| | | | | | | | | | | Bring r17266 from 1.8 branch to trunk: Clean up various compiler warnings from IRIX64 build Tested on: Mac OS X/32 (amazon) debug & production (yes, I know it's not an IRIX64 system :-) Too minor to require h5committest
* [svn-r17228] Purpose:Mike McGreevy2009-07-232-1/+10
| | | | | | | | | | | | | | | | | | | | | | | Fix BZ #1583 Description: The --enable-static-exec flag was broken. Configure was adding the -all-static linker flag to an environment variable which was subsequently never used. (looks like it was used in 1.6 Makefile.ins, but never moved to 1.8's Makefile.ams when we added automake support). To fix, I've added this environment varibale to the link lines of all the tools. Now, when --enable-static-exec is invoked, it will correctly generate statically linked executables in the installed bin directory. Tested: I've tested manually to ensure that the generated execs are static when the flag is used and dynamic when not. I've also tested when szip is used, as this was a use case mentioned in the bug report. Also: ran full tests with make check on jam and smirom for good measure.
* [svn-r17076] bug fix: h5repack was not applying a requested contiguous ↵Pedro Vicente Nunes2009-06-173-20/+41
| | | | | | | | layout for a dataset with filters added a test to the C program test (not to the script), that verifies the layout and filters tested: windows (development and tested manually) , linux, solaris
* [svn-r17052] Add a run to the h5repack shell script to read a family filePedro Vicente Nunes2009-06-151-0/+38
| | | | | | | | The file used for input is located in the common source tools for testfiles, in tools/testfiles Modified the h5repack shell script to read files from this location (h5repack reads its input files from a dedicated testfiles location in h5repack/testfiles) Changed the h5diff open file call to use h5tools_fopen, so that it can open all file drivers Tested: windows, linux, solaris
* [svn-r16844] Description:Mike McGreevy2009-04-222-0/+6
| | | | | | | | | | | | Adding dependency to h5repack test script. h5repack.sh needs h5repacktst to run first. Tested: Problem only appeared on Glory, but tested the dependence manually on jam by trying to run only the script and checking that it first ran the h5repacktst test program.
* [svn-r16800] Purpose: Fix bug 1516Neil Fortner2009-04-204-21/+384
| | | | | | | | | | | Description: h5repack previously would not take named datatypes into consideration when copying datasets and attributes. This would cause extra anonymous datatypes in the target file at best, and cause errors halfway through the repacking at worst. h5repack should now always handle named datatypes correctly. Named datatypes are also now converted to the native type when -n is given. Tested: jam, linew, smirom (h5committest)
* [svn-r16792] Description:Mike McGreevy2009-04-201-4/+4
| | | | | | | | | | | | - Updated bin/reconfigure to use latest version of automake (1.10.2). Re-generated Makefile.in's by running bin/reconfigure. - Added libtool version numbers to c++, fortran, hl, hl c++, and hl fortran libraries. Tested: jam, liberty, smirom
* [svn-r16671] fix compiler error on a missing "static" declarationPedro Vicente Nunes2009-04-061-1/+1
| | | | tested: linux
* [svn-r16663] cleaned compiler warnings in linuxPedro Vicente Nunes2009-04-035-212/+274
| | | | tested: linux
* [svn-r16656] #1402 (B1) h5repack does not preserve creation order indexing. Pedro Vicente Nunes2009-04-024-2124/+2540
| | | | | | | | ISSUE : h5repack does not handle group creation order flags. ACTION: call H5P(g)(s)et_link_creation_order functions when handling groups, add new groups with these flags to the test generation program, and verify results in the test program. TEST: in the test program, function that compares property lists, added code to verify groups tested: windows, linux, solaris
* [svn-r16614] 3. #1501 (B1) tools bug if dataset is larger than ↵Pedro Vicente Nunes2009-03-255-5/+57
| | | | | | | | | | | | H5TOOLS_BUFSIZE limit. ISSUE : the tools use the following formula to read by hyperslabs: hyperslab_size[i] = MIN( dim_size[i], H5TOOLS_BUFSIZE / datum_size) where H5TOOLS_BUFSIZE is a constant defined of 1024K. This is OK as long as the datum_size does not exceed 1024K, otherwise we have a hyperslab size of 0 (since 1024K/(greater than 1024K) = 0). This affects h5dump. h5repack, h5diff SOLUTION: add a check for a 0 size and define as 1 if so. TEST FOR H5DUMP: Defined a case in the h5dump test generator program of such a type (an array type of doubles with a large array dimension, that was the case the user reported). Since the written file commited in svn would be around 1024K, opted for not writing the data (the part of the code where the hyperslab is defined is executed, since h5dump always reads the files). Defined a macro WRITE_ARRAY to enable such writing if needed. Added a run on the h5dump shell script. Added 2 new files to svn: tools/testfiles/tarray8.ddl, tools/testfiles/tarray8.h5. NOTE: while doing this I thought of adding this dataset case to an existing file, but that would add the large array output to those files (the ddls). The issue is that the file list is increasing. TEST FOR H5DIFF: for h5diff the check for reading by hyperslabs is H5TOOLS_MALLOCSIZE (128 * H5TOOLS_BUFSIZE) or 128 Mb. This makes it not possible to add such a file to svn, so used the same method as h5dump (only write the dataset if WRITE_ARRAY is defined). As opposed to h5dump, the hyperslab code is NOT executed when the dataset is empty (dataset is not read). Added the new dataset to existing files and shell run (tools/h5diff/testfiles/h5diff_dset1.h5 and tools/h5diff/testfiles/h5diff_dset2.h5 and output in tools/h5diff/testfiles/h5diff_80.txt). TEST FOR H5REPACK: similar issue as h5diff with the difference that the hyperslab code is run. Added a run to the shell script (with a filter, otherwise the code uses H5Ocopy). tested: linux (h5commitest failed , apparently it did not detect the code changes in /tools/lib that fix the bug: the error in an assertion in the hyperslab of 0. I am sure that making h5ccomitest --distclean will detect the new code , but don't want to wait more 3 hours :-) )
* [svn-r16561] Purpose:Mike McGreevy2009-03-101-3/+3
| | | | | | | | | | | | | | | | | | Bug Fix Description: Fixing BZ #1381. The --includedir=DIR configure option, which is used to specify the installation location of C header files, did not work correctly as the path was hard-coded in config/commence.am. I'm presuming this is because an older version of automake didn't know where to put c header files. In any case, removing this line now defaults the includedir to the same directory that it is currently hard-coded to, and also fixes the configure flag to allow customization of this value. Tested: jam, liberty
* [svn-r16560] Description:Quincey Koziol2009-03-101-0/+8
| | | | | | | | | | Remove another call to H5E_clear_stack() from within the library. Clean up lots of compiler warnings. Tested on: Mac OS X/32 10.5.6 (amazon) (followup on other platforms forthcoming)
* [svn-r16518] have 2 expected outputs for 2 h5ls runs depending if run on a ↵Pedro Vicente Nunes2009-02-261-0/+1
| | | | | | | big or little endian machine. Configure.in was modified to export a variable carrying endianess information to testh5ls.sh. This script then compares the current run with 2 expected outputs, one for a big-endian machine (linew was used to generate the output), other for little endian (jam was used to generate the output) the way h5ls prints types, it starts searching for NATIVE types first. One solution would be h5ls not to detect these native types, using for example the same print datatype function that h5dump does, that would make the output look the same on all platforms ("32-bit little-endian integer" would be printed instead). Drawback, this "native" information would not be available. Other solution is to have not one but 2 expected outputs and make the shell script detect the endianess and compare with one output or other tested: h5committest
* [svn-r16489] Fixed bug #1459 by eliminating the macro long_long and ↵Allen Byrne2009-02-181-1/+1
| | | | | | | | | | | replacing all instances with long long. Tested: h5comittest fedora 10 x64 Vista 32, VS2005, IVF101 XP32, Cygwin
* [svn-r16401] Description:Quincey Koziol2009-02-032-0/+5
| | | | | | | | | Correct error introduced in r16353 with layout version, and add test so it gets caught earlier. Tested on: FreeBSD/32 6.3 (duty) Too minor to require h5committest
* [svn-r16301] Add a mention to the usage that the default minimum size for ↵Pedro Vicente Nunes2009-01-131-1/+1
| | | | | | | | | | compression is 1024 bytes M - is an integer greater than 1, size of dataset in bytes (default is 1024) #bgz 1426 tested: windows, linux
* [svn-r16114] remove commented codePedro Vicente Nunes2008-11-211-13/+0
| | | | tested: windows, linux
* [svn-r16112] #1375. Define a default chunk whose size is manageable. Defined ↵Pedro Vicente Nunes2008-11-213-13/+55
| | | | | | currently as the same size of hyperslab (that compares the dimension sizes against a predefined constant size and chooses the minimum between the two) Tested : linux, windows
* [svn-r15993] Pedro Vicente Nunes2008-10-291-186/+45
| | | | | | Merge with 1.8 rev 15985 reorganized the code to deal with deprecated -i -o for in/out files to avoid duplicated code Tested: linux
* [svn-r15987] Merge with 1.8 rev 15871Pedro Vicente Nunes2008-10-292-5/+2
| | | | | | Eliminate -c option and make that behavior the default and return 2 instead of -1 on error status tested: linux
* [svn-r15942] Purpose: Bug Fixes and Libtool UpgradeMike McGreevy2008-10-241-6/+6
| | | | | | | | | | | | | | | | | | Description: - Remove need to set LD_LIBRARY_PATH when using shared szip library. - Libtool 2.2.6a is now used to generate libraries. - 'make check install' dependency bug is fixed, and should no longer break the build. - removed hard coding of shell in config/commence.am, as this causes problems on Solaris with the new version of libtool. - RELEASE.txt with appropriate changes. Tested: - kagiso, smirom, linew (merged from 1.8, pretty quick tests)
* [svn-r15792] Bug fix. When detecting the user requested filters, the "all" ↵Pedro Vicente Nunes2008-10-062-39/+67
| | | | | | option was not taken in consideration when printing the compression ratio Tested: windows, linux
* [svn-r15721] Added a file with user block data to be used by the h5repack ↵Pedro Vicente Nunes2008-09-291-0/+1
| | | | windows shell script only Note: for the unix shell script this file is not used
* [svn-r15678] formatted codePedro Vicente Nunes2008-09-221-4/+8
| | | | tested: windows, linux
* [svn-r15664] fix comments Pedro Vicente Nunes2008-09-191-8/+15
| | | | tested: linux
* [svn-r15653] cleaned warningsPedro Vicente Nunes2008-09-183-74/+22
| | | | tested: windows, linux
* [svn-r15652] Cleaned compiler warnings Pedro Vicente Nunes2008-09-183-26/+64
| | | | | | Bug fix: do not print print compression ratio when the requested filter is NONE Tested: windows, linux
* [svn-r15650] Cleaned compiler warnings Pedro Vicente Nunes2008-09-181-4/+4
| | | | | | Bug fix: change the options block size variable from int to hsize_t, to match the H5Pset_userblock call Tested: windows, linux
* [svn-r15643] add a failure condition of writing user blockPedro Vicente Nunes2008-09-171-161/+178
| | | | Tested: windows, linux
* [svn-r15636] formatted codePedro Vicente Nunes2008-09-161-3790/+3850
| | | | tested: windows, linux
* [svn-r15635] add info regarding user block to usagePedro Vicente Nunes2008-09-161-1/+2
| | | | tested: windows, linux
* [svn-r15634] Add a default user block size of 1024 when none is givenPedro Vicente Nunes2008-09-162-5/+11
| | | | Tested: windows, linux
* [svn-r15628] Description:Quincey Koziol2008-09-1610-574/+574
| | | | | | | | | | | | | Remove trailing whitespace from C/C++ source files, with the following script: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Tested on: Mac OS X/32 10.5.5 (amazon) No need for h5committest, just whitespace changes...
* [svn-r15557] bug fix: the -m flag add a long description of "--threshold" ↵Pedro Vicente Nunes2008-08-291-1/+1
| | | | | | that was changed to "--minimum" because "--threshold" now refers to the threshold parameter for H5Pset_alignment tested: linux
* [svn-r15556] Check options for H5Pset_alignment.Pedro Vicente Nunes2008-08-291-9/+2
| | | | | | threshold is zero default (a valid value) but zero is not a valid alignment tested: windows, linux
* [svn-r15551] 1) There are 2 new command line parameters for h5repack. ↵Pedro Vicente Nunes2008-08-287-23/+192
| | | | | | | | | | | | Together they allow a call to H5Pset_alignment to be made -t T, --threshold=T Threshold value for H5Pset_alignment -a A, --alignment=A Alignment value for H5Pset_alignment 2) bug fix the printing of the dataset name was not done for references (verbose mode) tested: windows, linux
* [svn-r15547] fix typosPedro Vicente Nunes2008-08-272-2/+2
| | | | tested: linux
* [svn-r15527] turn off a debug print flagPedro Vicente Nunes2008-08-251-1/+1
| | | | tested: windows, linux
* [svn-r15526] userblock optionsPedro Vicente Nunes2008-08-253-8/+9
| | | | | | only write the user block of a pre-existing file with user block in case there is no input user block file tested: windows, linux
* [svn-r15521] #1184Pedro Vicente Nunes2008-08-226-16/+310
| | | | | | | | | | Add a userblock to an HDF5 file during the repack. The user gives give a filename and userblock size as command line parameters to h5repack and the contents of that file are stored in the userblock for the HDF5 file created by h5repack. New flags to handle this -u and -b Tested : windows, linux
* [svn-r15462] Description:Quincey Koziol2008-08-121-0/+1
| | | | | | | | Correct compiler warnings from Visual Studio. Tested on: Mac OS X/32 10.5.4 (amazon) w/FORTRAN & C++ (Too minor to require full h5committest)
generated by cgit v0.12 at 2024-08-20 02:48:39 (GMT)