summaryrefslogtreecommitdiffstats
path: root/testpar/t_coll_chunk.c
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r12844] Description:Quincey Koziol2006-11-021-77/+77
| | | | | | | Fix parallel build failure for property list class initialization refactor. Tested on: AIX (copper) w/parallel
* [svn-r12554] New tests have been added to test the correctness of ↵MuQun Yang2006-08-091-55/+64
| | | | | | | | independent IO with file setview. To activite this test, add the command option -i. For example, at IBM AIX, type "poe testphdf5 -i" will test the library with independent IO with file setview. It simply replaces all the collective IO tests with independent IO with file setview.
* [svn-r12440] Purpose:Quincey Koziol2006-06-271-55/+55
| | | | | | | | | | | Code cleanup Description: Trim trailing whitespace in Makefile.am and C/C++ source files to make diffing changes easier. Platforms tested: None necessary, whitespace only change
* [svn-r12401] Purpose:MuQun Yang2006-06-031-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | Some collective chunk IO macro names are confusing, change them to more meaningful names. Description: H5Pset_dxpl_mpio_chunk_opt will set a flag so that the library can do one linked IO or mul ti-chunk IO with collective in chunking storage directly. That is, the library won't do an alyses to determine this. The flags for the enum type we used before are: H5FD_MPIO_OPT_ONE_IO H5FD_MPIO_OPT_MULTI_IO They are not good names because of the following two reasons: 1. It doesn't reflect chunking storage 2. OPT is kind of redundant and misleading, Solution: We change the names to H5FD_MPIO_CHUNK_ONE_IO H5FD_MPIO_CHUNK_MULTI_IO Platforms tested: Since only macro names are changed, no need to test with h5committest. Misc. update:
* [svn-r12174] Purpose:MuQun Yang2006-03-291-7/+433
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Adding parallel tests for optional collective chunk APIs Description: Three new APIs "H5Pset_dxpl_mpio_chunk_opt_ratio H5Pset_dxpl_mpio_chunk_opt_num H5Pset_dxpl_mpio_chunk_opt" for optional optimization choices from users have been added to the libraries. This check-in adds six tests to verify the funcationality and correctedness of these APIs. These tests need to be verified with 3 or more processors and with MPI-IO driver only. Solution: Using H5Pinsert, H5Pget, H5Pset to verify that the library indeed goes into the branch we hope for. Using H5_HAVE_INSTRUMENT macro to isolate these changes so that it won't affect or be misused by the application. Platforms tested: h5committest(shanti still refused to be connected) Parallel tests on heping somehow are skipped. Manually testing at heping. Have checked 1,2,3,4,5 processes. Misc. update:
* [svn-r12148] Purpose:MuQun Yang2006-03-231-1/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | | Add tests for optional APIs to support collective chunk IO Description: In order to test whether library picks up the user's options, The number of chunks need to be varied for different processes, Selection of the number of processes selected in one chunk also need to be varied. Solution: Create two cases, 1. Each chunk only selected by one unique process, this case library should use independent for collective call. 2. One-third of the processes occupies the top half of the whole domain, The rest of the processes occupies the lower half of the domain. The total number of chunk is a fixed number 8. Platforms tested: Linux 2.4 with mpich 1.2.6(only) Since I only checked in the code that handles the selection, haven't added any new tests yet. So it won't affect any platforms. Misc. update:
* [svn-r12142] Purpose:MuQun Yang2006-03-231-27/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | change the array size of collective chunking features of parallel tests. Description: Previously array size for collective optimization tests including cchunk1, cchunk2, cchunk3, cchunk4, ccontw, ccontr, cschunkw, cschunkr, ccchunkw, ccchunkr are fixed, They are only valid for some good number of processors(1,2,3,4,6,8,12,16,24,32,48 etc). Recently there are more requests for parallel tests to be valid on some odd number of processes such as 5,7,11,13 etc. Solution: I change the array size to be dynamic rather than static. Now the fastest change array size is a function of mpi_size. dim2 = constant *mpi_size. After some tunings, theoretically the above tests should be valid for any number of processors. However, other parallel tests still need to be tuned. To verify the correctness of these tests, using mpirun -np 5 ./testphdf5 -b cchunk1 at heping. Platforms tested: h5committest(shanti is refused to be connected) at heping, 5 and 7 processes are used to verify the correctness. Misc. update:
* [svn-r12044] Purpose:MuQun Yang2006-03-091-1/+1
| | | | | | | | | | | | | | | Add new tests Description: Collective IO doesn't work for some platforms/mpio packages when more than one process has no contributions to IO. Solution: 1. Add a collective IO test to verify the correctness of the library when more than one process has no contributions to IO. 2. Add the similar MPI-IO test in t_mpi to help us maintain in more platforms. Platforms tested: heping, mir, copper Misc. update:
* [svn-r11951] Purpose:MuQun Yang2006-02-161-4/+66
| | | | | | | | | | | | | | | | Enhance collective chunk IO supports Description: Add a new test to check the correctness of the HDF5 library behavior for collective IO mode when one process doesn't have any contribution for IO. Solution: Platforms tested: IBM AIX 5.2(copper) Linux (heping) mpich-1.2.6 Misc. update:
* [svn-r11572] Purpose:MuQun Yang2005-10-171-182/+294
| | | | | | | | | | | | | | | Code clean-up for collective regular chunk IO tests. Description: Add descriptions for each tests for future maintenance. Solution: Platforms tested: Mostly comments, No need to use h5committest. heping(linux 2.4) Misc. update:
* [svn-r11294] Purpose:MuQun Yang2005-08-251-52/+3
| | | | | | | | | | | | | | | bug fix Description: The previous version always tests with mpi-IO driver even when mpi-posix driver is set. Solution: Add the option to test mpi-posix driver for the first round collective chunk IO test. Platforms tested: IRIX64, AIX 5.1, Linux 2.4 Misc. update:
* [svn-r11245] Purpose:Quincey Koziol2005-08-131-24/+24
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Trim trailing whitespace, which is making 'diff'ing the two branches difficult. Solution: Ran this script in each directory: foreach f (*.[ch] *.cpp) sed 's/[[:blank:]]*$//' $f > sed.out && mv sed.out $f end Platforms tested: FreeBSD 4.11 (sleipnir) Too minor to require h5committest
* [svn-r11067] Purpose:MuQun Yang2005-07-121-1/+5
| | | | | | | | | | | | | | | | | | Updating phase 2 work of collective IO Description: The current collective IO tests cannot test for number of processors bigger than some values, this change will lift those restriction. However, the test may be slower. Solution: Platforms tested: linux 2.4, AIX 5.1, Linux 2.4 IA64 and IRIX 6.5 (I haven't tested big number of processors with the restriction of the machine) Misc. update:
* [svn-r10122] Purpose:Albert Cheng2005-03-021-1/+1
| | | | | | | | | | | | | | | | typo fix and small improvement. Description: t_coll_chunk.c: ccdataset_vrfy() was using a wrong routine name to identify itself. testphdf5.c: Add a definition of NFILENAME to be the common dimension size of FILENAME[] and filenames[][] since they must have the same first dimension size. Platforms tested: h5committested.
* [svn-r9727] Purpose:Quincey Koziol2004-12-291-27/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Bug Fix/Code Cleanup/Doc Cleanup/Optimization/Branch Sync :-) Description: Generally speaking, this is the "signed->unsigned" change to selections. However, in the process of merging code back, things got stickier and stickier until I ended up doing a big "sync the two branches up" operation. So... I brought back all the "infrastructure" fixes from the development branch to the release branch (which I think were actually making some improvement in performance) as well as fixed several bugs which had been fixed in one branch, but not the other. I've also tagged the repository before making this checkin with the label "before_signed_unsigned_changes". Platforms tested: FreeBSD 4.10 (sleipnir) w/parallel & fphdf5 FreeBSD 4.10 (sleipnir) w/threadsafe FreeBSD 4.10 (sleipnir) w/backward compatibility Solaris 2.7 (arabica) w/"purify options" Solaris 2.8 (sol) w/FORTRAN & C++ AIX 5.x (copper) w/parallel & FORTRAN IRIX64 6.5 (modi4) w/FORTRAN Linux 2.4 (heping) w/FORTRAN & C++ Misc. update:
* [svn-r9358] Purpose:Quincey Koziol2004-10-041-9/+2
| | | | | | | | | | | | | | | Bug fix Description: Relax restrictions on parallel I/O to allow compressed, chunked datasets to be read in parallel (collective access will be degraded to independent access, but will retrieve the information still). Platforms tested: FreeBSD 4.10 (sleipnir) w/parallel Solaris 2.7 (arabica) IRIX64 6.5 (modi4) h5committest
* [svn-r9071] Purpose:MuQun Yang2004-08-121-6/+19
| | | | | | | | | | | | | | | | Make collective chunk IO test more general Description: Previously collective chunk IO test is only fit for processor =4 with the dimension size to be set small; sometimes people would like to test with more than 4 processors(5,6 or more), the test therefore failed. Solution: To make the test case more general, dimensional size of the data is set to be large(right now 288 for each dimension), the disjoint hyperslab selection is re-calculated. Now the test cases should pass with 5,6 or 12 processors. Note, there is nothing wrong with the implementation of the library, it is the test case that causes the failure with the number of processor greater than 4. Platforms tested: Only at eirene, since only the test code is modified a little and it is very slow to test the parallel case. Misc. update:
* [svn-r8932] Purpose:Quincey Koziol2004-07-221-65/+72
| | | | | | | | | | | | | | | | | | | | Code cleanup Description: Clean up collective chunking code a bit. Also, add '--enable-instrument' configure flag to have a mechanism for determining that optimized operations happened correctly in the library (instead of just the "normal" way) by allowing 'flag' properties to be set outside the library and set when the "right" thing happens. This is mainly for debugging and regression checks, so we make certain we don't break optimized I/O by accident. It's enabled by default when --enable-debug is on (which is on by default in the development branch and off by default in the release branch), but can also be independently controlled with its own configure flag. Platforms tested: FreeBSD 4.10 (sleipnir) w/parallel IBM p690 (copper) w/parallel
* [svn-r8924] Purpose:MuQun Yang2004-07-211-19/+52
| | | | | | | | | | | | | | To test collective chunk IO properly. Description: See the previous message. Solution: See the previous message. Platforms tested: arabica(Sol 2.7), eirene(Linux), copper(AIX) Misc. update:
* [svn-r8907] Purpose:MuQun Yang2004-07-201-0/+449
To add collective chunk IO tests. Description: three tests are added. 1. Only one hyperslab for each process, and this hyperslab is fit in exactly one chunk. 2. non-contiguous hyperslabs in each process, these hyperslabs are fit in one chunk. 3. Single hyperslab for each process, smaller chunk is assigned. Number of chunks for every process is equal. Solution: the dataset size is set to be very small, will enlarge later. Platforms tested: AIX 5.1(copper) Misc. update: