1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
|
Installation Instructions for HDF5
with Different Virtual File Layer
* * *
This file contains installation instructions for HDF5 with certain Virtual File
Layer to handle file I/O. We currently have documented SRB and Globus-GASS.
--- Part I. SRB ---
I. Overview
-----------
This part contains instructions for remote-accessing HDF5 through SRB. The
SRB version 1.1.7 on Sun Solaris 2.7 platform has been tested. If you have
difficulties installing the software in your system, please send mails to me
(Raymond Lu) at
slu@ncsa.uiuc.edu
First, you must obtain and unpack the HDF5 source as described in the file
INSTALL. You need the SRB library(client part) installed. You should also
have access to SRB server.
The Storage Resource Broker(SRB) from San Diego Supercomputer Center is client-
server middleware that provides a uniform interface for connecting to
heterogeneous data resources over a network and accessig replicated data sets.
SRB, in conjunction with the Metadata Catalog(MCAT), provides a way to access
data sets and resources based on their attributes rather than their names or
physical locations. Their webpage is at http://www.npaci.edu/Research/DI/srb.
HDF5 is built on the top of SRB as a client to remotely access files on SRB
server through SRB. Right now, HDF-SRB only support low-level file transfer of
SRB. The MCAT part is not supported yet. Low-level file transfer means files
are treated just like Unix type files. Files can be read, written and
appended. Partial access(read and write to a chunk of file without transferrig
the whole) is also supported.
II. Installation Steps
----------------------
The installation steps are similar to the ones in INSTALL file:
1. Run 'configure' file with SRB options:
configure --with-srb=$SRB/include,$SRB/lib
where $SRB is your SRB installed library directory.
For example, below is a script file to run 'configure':
#! /bin/sh
# how to configure to use the SRB
SRB_DIR=/afs/ncsa.uiuc.edu/projects/hdf/users/slu/srb_install
configure --with-srb=$SRB_DIR/include,$SRB_DIR/lib
2. Run 'make'
3. Run 'make check'
4. Run 'make install'
5. Run testing program(Optional):
Go to the testing directory(cd test) and run srb_write, srb_read,
srb_append. Actually, these tests have been run in step 3.
srb_write: Connect to SRB server, write an HDF5 file with an integer
dataset to SRB server.
srb_read: Connect to SRB server, read part of HDF5 file on the SRB server.
srb_append: Connect to SRB server, append an integer dataset to an existent
HDF5 file on the SRB server.
6. For using HDF-SRB, please read comments in srb_write.c, srb_read.c,
srb_append.c in the hdf5/test directory.
--- Part II. Globus-GASS ---
I. Overview
-----------
This part contains instructions for remote-accessing HDF5 through Globus-GASS.
The SGI IRIX64(and IRIX) 6.5 platform have been tested. If you have
difficulties installing the software in your system, please send mails to me
(Raymond Lu) at
slu@ncsa.uiuc.edu
First, you must obtain and unpack the HDF5 source as described in the file
INSTALL. You need the Globus 1.1.x and SSL(should have come with Globus)
packages.
HDF5 is built on the top of Globus-GASS(1.1.x) to handle remote access.
Globus-GASS(1.1.x) only supports HTTP and HTTPS protocals for 'whole file
read and write'. More features may be added in the future.
II. Installation Steps
----------------------
The installation steps are similar to the ones in INSTALL file:
1. Run 'configure' file with SSL and GASS options:
configure --with-ssl=$SSL/lib --with-gass=$GASS/include,$GASS/lib
where $SSL is your SSL directory, and $GASS is your Globus directory.
For example, below is a script file to run 'configure':
#! /bin/sh
# how to configure to use the Globus-GASS(1.1.x)
GASS_DIR=/usr/local/globus-install-1.1.1/development/mips-sgi-irix6.5-64_nothreads_standard_debug
SSL_LIB=/usr/local/ssl/lib
configure --with-ssl=$SSL_LIB --with-gass=$GASS_DIR/include,$GASS_DIR/lib
2. Run 'make'
3. Run 'make check'
4. Run 'make install'
5. Run testing program:
There is one read testing program called 'gass_read' in the 'test'
directory. It does whole file read through HTTP protocal. The URL is
hard coded as
http://hdf.ncsa.uiuc.edu/GLOBUS/a.h5
The writing really depends on your web server. You have to set up your
server in right way to accept writing in files. We have tested it using
Apache Server(1.3.12) without authentication. If you need more details
about our testing, please contact us. Globus suggests using their GASS
server.
There is another program called 'gass_append' used for experiments.
|
