summaryrefslogtreecommitdiffstats
path: root/src/H5FDstream.c
Commit message (Collapse)AuthorAgeFilesLines
* [svn-r5467] Purpose:Quincey Koziol2002-05-281-162/+124
| | | | | | | | | | | | | | | | | | | | | | | | Code cleanup. Description: Took Robb's recent ideas for improving the FUNC_ENTER/FUNC_LEAVE macros equivalents in the SAF library and adapted them to our library. I added an additional macro which is equivalent to FUNC_ENTER: FUNC_ENTER_NOINIT - Has the API tracing code, etc. from FUNC_ENTER but none of the library or interface initialization code. This is to be used _only_ for static functions and those which explicitly cannot have the library or interface initialization code enabled (like the API termination routines, etc.). This allowed many more of the functions in the library [but not all yet :-(] to be wrapped with FUNC_ENTER[_NOINIT]/FUNC_LEAVE pairs. It also reduced the size of the library and executables (by cutting out a bunch of code which was never executed), I'll e-mail the exact results when I've finished editing it. Platforms tested: IRIX64 6.5 (modi4)
* [svn-r5440] Purpose:Quincey Koziol2002-05-201-3/+3
| | | | | | | | | | | New feature Description: Add 'closing' parameter to H5FDflush and VFL "flush" functions, per http://hdf.ncsa.uiuc.edu/RFC/VFLFlush/VFLFlush.html Platforms tested: IRIX64 6.5 (modi4)
* [svn-r5403] Purpose:Quincey Koziol2002-05-131-3/+3
| | | | | | | | | | Back out changes. Description: Back out changes to VFL 'flush' API function, pending review. Platforms tested: IRIX64 6.5 (modi4)
* [svn-r5399] Purpose:Quincey Koziol2002-05-111-1/+1
| | | | | | | | | | Bug Fix Description: Missed adding the 'closing' parameter to one 'flush' function. Platforms tested: FreeBSD 4.5 (sleipnir)
* [svn-r5393] Purpose:Quincey Koziol2002-05-101-2/+2
| | | | | | | | | | | | | | | | | | | | | | New Feature Description: The VFL flush function is called immediately before a file is closed. This can cause duplicate syncronization actions to occur, if the VFL close function also performs them. Solution: Added 'closing' parameter to VFL 'flush' operation. This allows the VFL flush function to bypass operations that will be duplicated within the VFL close function. Additionally, use the 'closing' parameter to bypass calls to MPI_File_sync() when set. Since MPI_File_close() also syncronizes the file, this avoids the terrible performance hit taken when calling MPI_File_sync() as the file is closing. Platforms tested: IRIX64 6.5 (modi4)
* [svn-r5060] Thomas Radke2002-03-111-3/+3
| | | | | | | | | | | | | Purpose: Bugfix Description: Internally created socket wasn't closed Solution: In my last commit I only fixed the case for sending data over a socket. There was also a resource leak for the receiving side where an internally created socket wasn't closed. Same wrong logical condition, same fix. Platforms tested: Linux, SGI
* [svn-r5059] Thomas Radke2002-03-111-1/+1
| | | | | | | | | | | | | | Purpose: Bugfix Description: If the socket, used for data streaming by the Stream driver, was created by the driver itself, it did not close it after the file had been closed. A resource leak occured. Solution: This bug was just introduced due to a logical condition. Fixing the condition solved the problem. Platforms tested: Linux, SGI
* [svn-r4696] Raymond Lu2001-12-111-0/+1
| | | | | | | | | | | | | | | | | Purpose: Modify H5Fclose behavior Description: The HDF5 actual file close behaves in several ways in terms of if there are still objects(dataset, group, datatype) opened in file. Solution: Added a new file access property, file close degree. It has four values, H5F_CLOSE_DEFAULT H5F_CLOSE_WEAK H5F_CLOSE_SEMI H5F_CLOSE_STRONG The way a file is closed is decided by these values. Platforms tested: IRIX64 6.5, SunOS 5.6, FreeBSD 4.4
* [svn-r4631] Purpose:Quincey Koziol2001-11-211-1/+1
| | | | | | | | Bug fix Description: Fixed return type from FAIL to NULL. Platforms tested: Daily tests on SGI machines.
* [svn-r4620] Purpose:Quincey Koziol2001-11-201-18/+18
| | | | | | | | | Code cleanup Description: Get rid of IDs from internal function calls and some small cleanups from the old-stype => generic property list conversion. Platforms tested: FreeBSD 4.4 (hawkwind)
* [svn-r4584] Raymond Lu2001-11-021-2/+2
| | | | | | | | | Purpose: Switch from old property list to new generic property list. Description: Mainly changed H5Pcreat, H5Pclose, H5Pcopy. Platforms tested: IRIX64 6.5, FreeBSD, SunOS 5.7.
* [svn-r4572] Raymond Lu2001-10-251-0/+1
| | | | | | | Purpose: Followup file access property list changes. Platforms tested: IRIX64, SunOS 5.7, FreeBSD.
* [svn-r4473] Purpose:Quincey Koziol2001-09-251-1/+1
| | | | | | | | | | | | | | | | | | | | | Code cleanup for better compatibility with C++ compilers Description: C++ compilers are choking on our C code, for various reasons: we used our UNUSED macro incorrectly when referring to pointer types we used various C++ keywords as variables, etc. we incremented enum's with the ++ operator. Solution: Changed variables, etc.to avoid C++ keywords (new, class, typename, typeid, template) Fixed usage of UNUSED macro from this: char UNUSED *c to this: char * UNUSED c Switched the enums from x++ to x=x+1 Platforms tested: FreeBSD 4.4 (hawkwind)
* [svn-r4355] Purpose:Quincey Koziol2001-08-141-1/+1
| | | | | | | | | | | | | | | | | | | | | | Code cleanup (sorta) Description: When the first versions of the HDF5 library were designed, I remembered vividly the difficulties of porting code from a 32-bit platform to a 16-bit platform and asked that people use intn & uintn instead of int & unsigned int, respectively. However, in hindsight, this was overkill and unnecessary since we weren't going to be porting the HDF5 library to 16-bit architectures. Currently, the extra uintn & intn typedefs are causing problems for users who'd like to include both the HDF5 and HDF4 header files in one source module (like Kent's h4toh5 library). Solution: Changed the uintn & intn's to unsigned and int's respectively. Platforms tested: FreeBSD 4.4 (hawkwind)
* [svn-r4181] Purpose:Quincey Koziol2001-07-101-10/+9
| | | | | | | | | Bug Fix, Code Cleanup, Code Optimization, etc. Description: Fold in the hyperslab speedups, clean up compile warnings and change a few things from using 'unsigned' or 'hsize_t' to use 'size_t' instead. Platforms tested: FreeBSD 4.3 (hawkwind), Solaris 2.7 (arabica), Irix64 6.5 (modi4)
* [svn-r4090] Thomas Radke2001-07-021-27/+59
| | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: Implemented port hunting Really catch SIGPIPE signals Description: Port hunting allows to try and bind to a successive port number if the port number given in the filename is already used. Because of a stupid typo in the code, SIGPIPE wasn't catched which might have caused the sending side to hang. Solution: The Stream VFD's file access property list was extended by two elements: - maxhunt: how many successive ports to try if the one given in the filename is already in use Default is not to hunt for additional ports. - port: port number which is finally used to bind a socket This might be different to the port number as given in the filename if port hunting is enabled. The H5Pget_fapl_stream() can be used to obtain this port number. Platforms tested: x86 Linux, Irix 32/64 bit, Dec Alpha, Unicos on T3E, AIX on SP2 Hitachi SR8000
* [svn-r4088] Purpose:Quincey Koziol2001-06-291-6/+5
| | | | | | | | | | | | Code cleanup Description: Recent CodeWarrior patches have broken the Unix builds and moved code around in non-portable ways. Solution: Patched things back up to try to accomodate CodeWarrior and still let the Unix builds work correctly. Platforms tested: FreeBSD 4.3 (hawkwind)
* [svn-r4083] Pedro Vicente Nunes2001-06-291-5/+6
| | | | | | | | | | | | | | code warrior support and some clean up the macros file_seek and file_offset_t that were repeated over sevral files were put only in H5private.h H5private .h was updated for win32 vthe Description: Solution: Platforms tested:
* [svn-r3781] Purpose:Bill Wendling2001-04-051-7/+7
| | | | | | | | | | | | | | | | | | Update Description: Changed #include <hdf_file.h> construct to #include "hdf_file.h" so that the GNU compiler can more easily pick up the dependencies which it places in the .depend and Dependencies files. Also regenerated the Dependencies to go along with this. Platforms tested: Linux
* [svn-r3741] Purpose:Albert Cheng2001-03-311-1/+1
| | | | | | | | | | | | | | | | | | | | Improvment Description: H5config.h and H5pubconf.h are generated by configure. It does not have the #ifndef _H5config_H ... #endif guard to prevent duplicated definitions if it is included more than once. It is messy to try make configure to put in those guards. Solution: HDF5 has set an internal rule that H5public.h includes H5pubconf.h and H5private.h includes H5config.h. Source files should NOT include H5config.h or H5pubconf.h directly but include it via H5public.h or H5private.h respectively. The #ifndef ... #endif in the H5public.h and H5private.h would prevent repeated definitions from repeated include. Adjusted H5FDstream.c and H5FDstream.h to follow this rule. Platforms tested: modi4, eirene.
* [svn-r3252] Purpose:Quincey Koziol2001-01-091-16/+14
| | | | | | | | | | | | | Code cleanup. Description: Fixed _lots_ (I mean _tons_) of warnings spit out by the gcc with the extra warnings. Including a few show-stoppers for compression on IRIX machines. Solution: Changed lots of variables' types to more sensible and consistent types, more range-checking, more variable typecasts, etc. Platforms tested: FreeBSD 4.2 (hawkwind), IRIX64-64 (modi4)
* [svn-r3225] ./hdf5/src/H5FDstream.cRobb Matzke2000-12-291-7/+8
| | | | | | | 2000-12-29 08:59:03 Robb Matzke <matzke@llnl.gov> * H5FD_stream_query: The `flags' argument is advertised to be output only. Therefore I added code to zero its value before the feature bits are assigned.
* [svn-r3059] Thomas Radke2000-12-011-1/+5
| | | | | | | | | | | | | Purpose: Bugfix Description: Under SunOS 5.5 the symbol FIONBIO wasn't known. Solution: Include <sys/filio.h> which defines this symbol under Solaris. Also put the UNUSED qualifier in the right place in a function argument list (gcc 2.7.2 didn't like it before the type name). Platforms tested: SunOS 5.5 (hatteras), SunOS 5.6 t(thor.sistec.kp.dlr.de)
* [svn-r3010] Purpose:Quincey Koziol2000-11-281-1/+1
| | | | | | | | | | | | | | Bug fix Description: When the v1.2 compatibility code was turned on, internal functions in the library were getting confused. Solution: Separated guts of H5Pget_driver call into an API function (the definition of which depends on the compatibility switch) and an internal function which always behaves like the v1.3/4 function. Replaced API function calls in the library code with the internal function. Platforms tested: FreeBSD 4.2 (hawkwind)
* [svn-r2866] Purpose:Quincey Koziol2000-11-111-2/+2
| | | | | | | | Code cleanup Description: Found more "Have_foo" usage and converted them to "H5_HAVE_foo" Platforms tested: FreeBSD 4.1.1 (hawkwind)
* [svn-r2832] Thomas Radke2000-11-081-1/+1
| | | | | | | | Purpose: Bugfix. Description: Renamed the H5_HAVE_STRUCT_SOCKLEN_T into H5_HAVE_SOCKLEN_T because it isn't really a structure.
* [svn-r2817] Thomas Radke2000-11-081-4/+8
| | | | | | | | | | | | | | | | | | | Purpose: Bugfix Description: The socklen_t was hardcoded to be defined as int on architectures other than Linux and SUN (Solaris). Now it turned out that Solaris isn't consistent in this manner. Versions earlier than 2.7 do not define this type. Solution: Check at configure time whether the socklen_t type is defined by the system header includes. If not than this type is defined to be 'int'. Platforms tested: Solaris 2.6 and 2.7 Linux IRIX64 Windows NT (command line configure with both cl abd gcc)
* [svn-r2811] Dan Wells2000-11-081-1/+1
| | | | | | | | | | | | Purpose: Bug fix. Description: The names of some entries did not correspond with the names in the FUNC_ENTER macro. This would cause inaccuracies during Pablo tracing. Solution: The names were changed in FUNC_ENTER to agree with the entry names. Platforms tested: Solaris, Irix, AIX, HP Vclass
* [svn-r2803] Thomas Radke2000-11-051-2/+2
| | | | | | | | | | | Purpose: Bugfix Description: Large data files were truncated at the receiver's side. Solution: Check against EWOULDBLOCK when sending the data and retry. Platforms tested: T3E (other platforms had no such problem).
* [svn-r2746] Thomas Radke2000-10-281-88/+222
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Purpose: Port to Windows platform Bug fix Description: The Stream VFD is ported to Windows now. Also fixed a bug where an application terminated when it got a SIGPIPE due to sending/receiving on a closed socket. Solution: The socket stuff is treated different under Windows when using the MS compilers to build HDF5. They define their own socket datatype and have closesocket() instead of close(2) to close sockets. Also there are different header files for all the socket stuff. So I introduced my own socket decriptor datatype in H5FDstream.h which should be used to pass in external sockets. This datatype is mapped to either 'int' (UNIX-type sockets) or 'SOCKET' (Windows). In the code the error code checking was adapted according to the socket datatype used. Also, for Windows you have to call a routine to initialize the Socket layer before using it. As a kind of bug fix, the process signal mask is now set to ignore SIGPIPE signals which otherwise cause the application to terminate. The driver read/write routines catch this and return an error code. Platforms tested: Windows NT, both with MS Visual C++ compiler and with GNU cc It is interesting that when compiling with GNU cc under Windows it is possible to use both Windows and UNIX-type sockets (either one or the other). So I check for GNU cc and go for UNIX sockets if possible.
* [svn-r2722] Purpose:Quincey Koziol2000-10-241-1/+2
| | | | | | | | | | Feature symmetry Description: A while ago I needed to get the 'type' of data being accessed during writes to the VFL driver, so I put in code to get the information down there. Albert asked for the same information during reads, so I've added that in. Tested: FreeBSD 4.1.1 (hawkwind)
* [svn-r2679] MuQun Yang2000-10-121-0/+5
| | | | | | | | | | | | | | | | | | | Purpose: Just add a few lines so that it will not break windows platform. Description: netdb.h cannot be recognized by windows, use winsock.h in windows instead. Solution: adding the following lines at the beginning of H5FDstream.c. If you don't like, you may do it in another way, just keep it work for windows. #ifdef WIN32 > #include <winsock.h> > #else > #endif Platforms tested: I am only testing whether it will bother building objects on windows. I haven't tested whether it will affect the testing results. Hopefully not. windows 2000, eirene,arabica,gondolin,paz,opus.
* [svn-r2631] Thomas Radke2000-10-041-8/+9
| | | | | | | | | | | | Purpose: Bugfix Description: The Stream VFD was leaking memory on every opened file. Solution: In H5FD_stream_close(), finally free the file structure used to describe the closed file. Platforms tested: Linux, SGI
* [svn-r2600] Purpose:Quincey Koziol2000-09-261-1/+35
| | | | | | | | | | | Implemented new feature Description: Added data sieve buffering code to raw I/O data path. This is enabled for all the VFL drivers except the mpio & core drivers. Also added two new API functions to control the sieve buffer size: H5Pset_sieve_buf_size() and H5Pget_sieve_buf_size(). Platforms tested: Solaris 2.6 (i.e. baldric)
* [svn-r2555] Purpose:Thomas Radke2000-09-151-0/+984
Added source files for the Stream Virtual File Driver. Description: The Stream VFD allows users to stream complete HDF5 files via socket connections between different applications. Files which were created anew are flushed to any connected client on each H5Fflush() or H5Fclose() operation. Files which are opened as read-only will be read from a socket on a H5Fopen() call. The driver's H5FDset_fapl_stream() routine allows to pass in several parameters such as an external socket descriptor, some socket options, and flags for broadcasting a received file. If an external socket is provided the Stream VFD would use that for the socket calls. Otherwise it parses the filename argument in H5Fcreate()/H5Fopen() for a 'hostname::port' parameter. All files processed by the Stream VFD are kept in memory (same way as the core VFD does). Platforms: Tested so far under Linux, Irix 32/64bit, OSF1, Solaris, Cray Unicos, Hitachi SR8000, IBM AIX. Not tested under Windows yet.