summaryrefslogtreecommitdiffstats
path: root/src/H5FDmpio.c
Commit message (Collapse)AuthorAgeFilesLines
* Added support for vector I/O to the VFD layer, and associated test codemainzer2020-06-291-0/+2
| | | | | | | | | | in test/vfd.c. Note that this test uses only sec2 and stdio at present. Since no VFDs support vector I/O at present, the vector I/O VFD calls are translated to regular read/write calls in the VFD layer. Tested serial and parallel, debug and production on charis, parallel debug on jelly. Some seemingly un-related issues, but after consultation with Richard, I'm proceeding with the checkin.
* Normalization with hdf5_1_10Dana Robinson2020-06-011-1/+1
|
* Trim trailing whitespaceQuincey Koziol2020-04-201-15/+15
|
* Another cleanup pass as suggested by the reviewers.Richard Warren2019-10-071-1/+0
|
* At the suggestion of the PR reviewers, moved the mpio_create_large_type to ↵Richard Warren2019-10-071-1/+1
| | | | H5mpi.c and renamed the function appropriately. Also moved some support functions to set and get the vvalue where we transistion to using derived datatypes.
* No functional changes, just removed some tab charactersRichard Warren2019-10-051-4/+4
|
* Make the initial bug fixes to allow >2GB writes with Independent IORichard Warren2019-10-051-10/+28
|
* Minor tweaks to new H5P MPI code based on code review feedback.Dana Robinson2019-08-271-14/+5
|
* Added H5Pset/get_mpi_params calls and unified them with the MPI-I/ODana Robinson2019-08-261-288/+91
| | | | VFD info in H5FDmpio.c.
* Some refactoring prior to implementing new H5P MPI functions.Dana Robinson2019-08-141-321/+316
| | | | | | * Macro cleanup and obvious warning fixes in parallel code. * Moved H5FD comm and info dup/free wrapper code to a new H5mpi.c file and separated it to deal with each MPI type separately.
* Added an H5MM_memcpy call that checks for buffer overlap.Dana Robinson2019-03-161-1/+1
|
* HDFFV-10625 -- Implemented a process-0 read and then broadcast for ↵Quincey Koziol2019-01-071-6/+37
| | | | collective read of full (HS_ALL), contiguous, atomic datasets by all the processes in the file communicator.
* Clean up style issues, make function callbacks static, correct debug statements,Quincey Koziol2019-01-051-475/+319
| | | | etc. No functionality changes at all.
* Merge branch 'develop' into vfd_init_cleanupDana Robinson2019-01-011-0/+1
|\
| * Clear driver properties before returning them to application.Quincey Koziol2018-12-191-0/+1
| | | | | | | | | | Move write_tracking and page_size properties to be inside the core VFD's driver properties.
* | Cleaned up and normalized VFD init calls.Dana Robinson2018-12-181-16/+18
|/
* Fixed HDFFV-10404Binh-Minh Ribler2018-07-131-2/+2
| | | | | | | | | Description: Applied the typo fixes from user's report. The previous pull request couldn't be merged because it was too old, and it was too complicated for me to resolve conflicts. Platform tested: Linux/64 (jelly) - very minor
* Add an assert to verify that we don't write when between MPI_Barrier() callsQuincey Koziol2018-03-271-0/+3
| | | | during a flush.
* Merge branch 'develop' of https://bitbucket.hdfgroup.org/scm/hdffv/hdf5 into ↵Quincey Koziol2018-03-181-23/+74
|\ | | | | | | | | | | merge_func_enter_vol Plus initial steps toward merging API context push into FUNC_ENTER_API* macros
| * Removed commented out code from H5FDmpio.c, H5FDprivate.h and H5Fint.cmainzer2018-03-121-88/+0
| | | | | | | | Tested parallel (debug and production) and serial (production)
| * Optimized version of avoid truncate patch.M. Scot Breitenfeld2017-12-181-0/+198
| |
* | Add API context interface and use it throughout the library.Quincey Koziol2018-03-151-46/+22
|/
* Fixed HDFFV-10214:Dana Robinson2017-05-191-4/+5
| | | | | | | | | | | | * Updated comments in the library to accurately reflect the semantics of the H5FD_FEAT_POSIX_COMPAT_HANDLE flag. * Removed the check for the POSIX compatible handle feature flag when determining if a VFD supports SWMR. Partial work for HDFFV-10197: * Added a new H5FD_FEAT_DEFAULT_VFD_COMPATIBLE feature flag that is set when a VFD creates output that is compatible with the default VFD. Will be used in the testing but might also be generally useful to users.
* Merge pull request #426 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10 to ↵Larry Knox2017-04-251-6/+4
| | | | | | | | | | hdf5_1_10 * commit '54957d37f5aa73912763dbb6e308555e863c43f4': Commit copyright header change for src/H5PLpkg.c which was added after running script to make changes. Add new files in release_docs to MANIFEST. Cimmit changes to Makefile.in(s) and H5PL.c that resulted from running autogen.sh. Merge pull request #407 in HDFFV/hdf5 from ~LRKNOX/hdf5_lrk:hdf5_1_10_1 to hdf5_1_10_1 Change copyright headers to replace url referring to file to be removed and replace it with new url for COPYING file.
* Checkin of fix for CGNS bugmainzer2017-04-061-1/+36
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | (https://jira.hdfgroup.org/browse/HDFFV-10055). Briefly, in H5C_collective_write() in H5Cmpio.c, the metadata cache attempts to perform a collective write of metadata cache entries. This worked fine as long as all processes had at least one entry to write. However, when the process has no entries, the function tries to participate in the collective write by calling MPI_File_set_view(), MPI_File_write_all() and then MPI_File_set_view() again, to match the calls in H5FD_mpio_write(). After pull request 183, the CGNS test benchmark_hdf5 started failing. On investigation, I determined that the failure occurred in the first call to MPI_File_set_view() in the "no data to write" path through H5C_collective_write(). Note that pull request 183 did not create the problem, it only exposed it. The bug can be observed after pull request 182 if one executes the CGNS progam src/ptests/benchmark_hdf5 with 90 processes. The problem appears to have been that the calls to MPI_File_set_view() in H5C_collective_write() and H5FD_mpio_write() were using different values for the info parameter. I patched the problem by adding a MPI specific VFD call allowing me to get the MPI_Info used in H5FD_mpio_write() for use in MPI_File_set_view() calls in H5C_collective_write(). Tested serial & parallel, debug & production on Jelly.
* Warning and whitespace cleanup.Quincey Koziol2016-11-031-2/+2
|
* [svn-r28959] merge from trunk.Mohamad Chaarawi2016-01-221-6/+0
|\ | | | | | | renaming metadata dxpl properties.
| * [svn-r28950] - remove META_FLUSH_COLLECTIVELY property for delayed sanity ↵Mohamad Chaarawi2016-01-211-6/+0
| | | | | | | | | | | | | | | | | | | | checks from metadata dxpls - remove H5AC_ind_dxpl_id and use only H5AC_dxpl_id everywhere instead. - remove flush_me_collectively flag from cache entries - add a collective sanity check (MPI_Barrier) for every HDF5 API routine that could possibly touch the file. This is trigerred when the environment variable H5_COLL_API_SANITY_CHECK is set to a non 0 digit. tested on BB-8 with serial and parallel.
| * [svn-r28894] Description:Quincey Koziol2016-01-141-1/+2
| | | | | | | | | | | | | | | | Normalize against changes on phdf5_metadata_opt branch to trunk Tested on: MacoSX/64 10.11.2 (amazon) w/serial & parallel (h5committest forthcoming)
* | [svn-r27929] merge from trunk.Mohamad Chaarawi2015-10-011-127/+64
|\ \ | |/
| * [svn-r27811] Description:Quincey Koziol2015-09-161-118/+57
| | | | | | | | | | | | | | | | | | | | | | Refactor property list code to "deep copy" properties in the correct way, retraining the rest of the library to copy & release things correctly. This cleans up another batch of memory leaks, etc. within the library. Tested on: MacOSX/64 10.10.5 (amazon) w/serial & parallel Linux/32 2.6.x (jam) w/serial & parallel (h5committest forthcoming)
| * [svn-r27809] Minor warning fixes in the library.Dana Robinson2015-09-161-1/+1
| | | | | | | | Tested on: jam (too minor for h5committest)
| * [svn-r27768] Description:Quincey Koziol2015-09-141-8/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Complete revamp of package initialization/shutdown mechanism in the library. Each package now has a single init/term routine. This new way should avoid packages being re-initialized during library shutdown and is also be _much_ more proactive about giving feedback for resource leaks internal to the library. Introduces a new "module" header file for packages in the library (e.g src/H5Fmodule.h) which sets up some necessary package configuration macros for the FUNC_ENTER/LEAVE macros. (The VFL drivers have their own slightly modified version of this header, src/H5FDdrvr_module.h) Also cleaned up a bunch of resources leaks all across the library and tests, along with addressing many warnings, as I encountered them. Tested on: MacOSX/64 10.10.5 (amazon) w/serial & parallel Linux/64 3.10.x (kituo) w/serial & parallel Linux/64 2.6.x (ostrich) w/serial
* | [svn-r27261] apply metadata enhancement patch that was based on the mdc 3 ↵Mohamad Chaarawi2015-06-211-46/+35
|/ | | | branch.
* [svn-r27133] - Add a new attribute function characterstic for format:Mohamad Chaarawi2015-06-011-9/+9
| | | | | | | | * H5_ATTR_FORMAT(X,Y,Z) __attribute__((format(X, Y, Z))) - Rename UNUSED attribute characterstic to H5_ATTR_UNUSED. - Rename NORETURN attribute characterstic to H5_ATTR_NORETURN tested with h5committest.
* [svn-r26649] squish warnings.Mohamad Chaarawi2015-03-301-23/+25
|
* [svn-r25994] revert adding the has_mpi_atomicity feature flag and use the ↵Mohamad Chaarawi2015-01-211-1/+0
| | | | | | has_mpi flag instead.
* [svn-r25983] HDFFV-1125: Eliminate IS_H5FD_MPI() macro use in the library ↵Mohamad Chaarawi2015-01-201-0/+1
| | | | | | | | and replace with driver feature flag(s). Add an MPI atomicity feature flag and remove the macro from the library. tested Parallel on Jam.
* [svn-r25929] Description:Quincey Koziol2014-12-291-3/+13
| | | | | | | | | | Clean up EOF code within library and add 'mem_type' parameter to 'get_eof' VFD callback, to avoid various ambiguous situations, particularly with the multi VFD. (Supports changes for 'avoid_truncate' feature also) Tested on: MacOSX/64 10.10.1 (amazon) w/serial & parallel h5committest forthcoming
* [svn-r25922] mpi version check for new mpi 3 features should be >= 3 rather ↵Mohamad Chaarawi2014-12-231-6/+6
| | | | than == 3.
* [svn-r25921] - wrap MPI 3 usage with MPI_VERSION compile time check.Mohamad Chaarawi2014-12-231-4/+32
| | | | - build out unbuffered stdout/err for windows
* [svn-r25586] need to use MPI_Count and corresponding _x check routines post ↵Mohamad Chaarawi2014-09-111-20/+11
| | | | read/write to handle big counts.
* [svn-r25531] remove use of C99 PRI that failed on windows in dtypes.cMohamad Chaarawi2014-08-111-2/+8
| | | | fix bugs where hid_t were assumed to be 32 bit ints or herr_t.
* [svn-r25397] - remove configure checks for MPI_File_get_size and BigMohamad Chaarawi2014-07-071-37/+0
| | | | | MPI_File_set_size as they are supported by most MPI implementations. - fix bug in t_mpi.c (HDFFV-8856)
* [svn-r24864] Description:Quincey Koziol2014-03-211-18/+25
| | | | | | | | | | | | | | | | | | Remove all traces of MPI-POSIX VFD and GPFS detection/code. Remove remaining traces of stream VFD. Remove testpar/t_posix_compliant test (it's not actually verifying anything). Clean up H5D__mpio_opt_possible() further. Moved environment variable that disables MPI collective operations into MPI-IO VFD (instead of it being in src/H5S.c). A few other small code cleanups. Tested on: Mac OSX/64 10.9.2 (amazon) w/parallel & serial
* [svn-r23713] Description:Quincey Koziol2013-05-211-26/+26
| | | | | | | | | | Clean up warnings, switch library code to use Standard C/POSIX wrapper macros, remove internal calls to API routines, update checkapi and checkposix scripts. Tested on: Mac OSX/64 10.8.3 (amazon) w/C++ & FORTRAN Big-Endian Linux/64 (ostrich)
* [svn-r23165] HDFF-8203 Break H5FDmpi.h header into public and private componentsMohamad Chaarawi2013-01-151-0/+5
| | | | | | https://jira.hdfgroup.uiuc.edu/browse/HDFFV-8203 tested: h5committest
* [svn-r22998] Description:Quincey Koziol2012-11-011-2/+2
| | | | | | | | | | | | | | | | | | | | | | | Clean up warnings and bring changes from Coverity branch back to trunk: r20451: Fixed coverity 810 r20454: Purpose: Fix coverity issue 816 Description: Modified various file drivers to always check the return value from H5P_get_driver_info. r20455: Purpose: Cleanup fix for coverity issue 816 Description: Removed redundant check for "fa" in H5FD_core_open. Tested on: Mac OSX/64 10.8.2 (amazon) w/debug (Too minor to require h5committest)
* [svn-r22681] Description:Quincey Koziol2012-08-151-119/+79
| | | | | | | | Clean up file driver property handling, along with some misc. warnings. Tested on: Mac OSX/64 10.7.4 (amazon) w/debug, gcc 4.7.1, C++, FORTRAN & threadsafe (h5committest upcoming)
* [svn-r22676] Changes needed to make the default free-list mapping from ↵Vailin Choi2012-08-131-1/+1
| | | | H5FD_FLMAP_SINGLE to H5FD_FLMAP_DICHOTOMY.
generated by cgit v0.12 at 2024-11-18 05:05:04 (GMT)