Installation Instructions for HDF5 with Different Virtual File Layer * * * This file contains installation instructions for HDF5 with certain Virtual File Layer to handle file I/O. We currently have documented SRB and Globus-GASS. --- Part I. SRB --- I. Overview ----------- This part contains instructions for remote-accessing HDF5 through SRB. The SRB version 1.1.7 on Sun Solaris 2.7 platform has been tested. If you have difficulties installing the software in your system, please send mails to me (Raymond Lu) at slu@ncsa.uiuc.edu First, you must obtain and unpack the HDF5 source as described in the file INSTALL. You need the SRB library(client part) installed. You should also have access to SRB server. The Storage Resource Broker(SRB) from San Diego Supercomputer Center is client- server middleware that provides a uniform interface for connecting to heterogeneous data resources over a network and accessig replicated data sets. SRB, in conjunction with the Metadata Catalog(MCAT), provides a way to access data sets and resources based on their attributes rather than their names or physical locations. Their webpage is at http://www.npaci.edu/Research/DI/srb. HDF5 is built on the top of SRB as a client to remotely access files on SRB server through SRB. Right now, HDF-SRB only support low-level file transfer of SRB. The MCAT part is not supported yet. Low-level file transfer means files are treated just like Unix type files. Files can be read, written and appended. Partial access(read and write to a chunk of file without transferrig the whole) is also supported. II. Installation Steps ---------------------- The installation steps are similar to the ones in INSTALL file: 1. Run 'configure' file with SRB options: configure --with-srb=$SRB/include,$SRB/lib where $SRB is your SRB installed library directory. For example, below is a script file to run 'configure': #! /bin/sh # how to configure to use the SRB SRB_DIR=/afs/ncsa.uiuc.edu/projects/hdf/users/slu/srb_install configure --with-srb=$SRB_DIR/include,$SRB_DIR/lib 2. Run 'make' 3. Run 'make check' 4. Run 'make install' 5. Run testing program(Optional): Go to the testing directory(cd test) and run srb_write, srb_read, srb_append. Actually, these tests have been run in step 3. srb_write: Connect to SRB server, write an HDF5 file with an integer dataset to SRB server. srb_read: Connect to SRB server, read part of HDF5 file on the SRB server. srb_append: Connect to SRB server, append an integer dataset to an existent HDF5 file on the SRB server. 6. For using HDF-SRB, please read comments in srb_write.c, srb_read.c, srb_append.c in the hdf5/test directory. --- Part II. Globus-GASS --- I. Overview ----------- This part contains instructions for remote-accessing HDF5 through Globus-GASS. The SGI IRIX64(and IRIX) 6.5 platform have been tested. If you have difficulties installing the software in your system, please send mails to me (Raymond Lu) at slu@ncsa.uiuc.edu First, you must obtain and unpack the HDF5 source as described in the file INSTALL. You need the Globus 1.1.x and SSL(should have come with Globus) packages. HDF5 is built on the top of Globus-GASS(1.1.x) to handle remote access. Globus-GASS(1.1.x) only supports HTTP and HTTPS protocals for 'whole file read and write'. More features may be added in the future. II. Installation Steps ---------------------- The installation steps are similar to the ones in INSTALL file: 1. Run 'configure' file with SSL and GASS options: configure --with-ssl=$SSL/lib --with-gass=$GASS/include,$GASS/lib where $SSL is your SSL directory, and $GASS is your Globus directory. For example, below is a script file to run 'configure': #! /bin/sh # how to configure to use the Globus-GASS(1.1.x) GASS_DIR=/usr/local/globus-install-1.1.1/development/mips-sgi-irix6.5-64_nothreads_standard_debug SSL_LIB=/usr/local/ssl/lib configure --with-ssl=$SSL_LIB --with-gass=$GASS_DIR/include,$GASS_DIR/lib 2. Run 'make' 3. Run 'make check' 4. Run 'make install' 5. Run testing program: There is one read testing program called 'gass_read' in the 'test' directory. It does whole file read through HTTP protocal. The URL is hard coded as http://hdf.ncsa.uiuc.edu/GLOBUS/a.h5 The writing really depends on your web server. You have to set up your server in right way to accept writing in files. We have tested it using Apache Server(1.3.12) without authentication. If you need more details about our testing, please contact us. Globus suggests using their GASS server. There is another program called 'gass_append' used for experiments.