Globus Toolkit on XC Clusters (GC)

Large Enterprise BusinessAll of HP

Before building, GT4 requires that a JDBC compliant database be present on the host system. XC Clusters come configured with the MySQL database which satisfies this requirement. However, the version of MySQL delivered on the XC is different from that which Globus used, so the ODBC connecter software they supply will not build on the XC. Instead, please obtain, build and install the following software packages on the XC before installing GT4.

iODBC version 3.52.3

    # ./configure --prefix=${INST_DIR} \
         --with-iodbc-inidir=${INST_DIR}/etc \
         --disable-gtktest --with-pthreads \
         --disable-gui
    # make
    # make install

unixODBC version 2.2.11

    # ./configure --prefix=${INST_DIR}
    # make
    # make install

MySQL ODBC Connector version 3.51.12.

    # ./configure --prefix=${INST_DIR} \
         --with-iodbc=${INST_DIR} \
         --with-unixODBC=${INST_DIR} \
         --with-odbc-ini=${INST_DIR}/etc \
         --enable-thread-safe --disable-gui
    # make
    # make install

With the database software and J2SE in place, it is time to configure and build the Globus Toolkit. Follow the instructions in the GT4 Admin Guide. On XC Clusters, we tested with the following environment variables and configuration options:

    $ GLOBUS_MYSQL_PATH=/usr
    $ export GLOBUS_MYSQL_PATH
    $ ODBCINIDIR=${INST_DIR}
    $ ./configure \
         --prefix=$GLOBUS_LOCATION \
         --enable-wsgram-lsf --enable-rls \
         --with-iodbc=${INST_DIR} \
         --with-mysql-libs=$GLOBUS_MYSQL_PATH/lib64/mysql \
         --with-mysql-includes=$GLOBUS_MYSQL_PATH/include/mysql \
         --with-odbc-ini=$ODBCINIDIR

Note that, the "--with-mysql-libs" should use the "lib64" directory on 64-bit platforms and "lib" on 32-bit systems.

With Globus built and installed, the MySQL database can be configured according to the instructions at the globus web site. For testing, we used the following MySQL commands to create a database user named "globus" with password "globusdb":

   # mysql
   mysql> use mysql;
   mysql> grant all on lrc1000.* to globus@localhost
   mysql>    identified by 'globusdb';
   mysql> grant all on rli1000.* to globus@localhost
   mysql>    identified by 'globusdb';
   mysql> SHOW GRANTS for globus@localhost;
   mysql> UPDATE mysql.user SET Password = OLD_PASSWORD('globusdb')
   mysql>    WHERE Host = 'localhost' AND User = 'globus';
   mysql> FLUSH PRIVILEGES;

Then edit "$GLOBUS_LOCATION/etc/globus-rls-server.conf" and change "db_user" to "globus", "db_pwd" to "globusdb" and "odbcini" to "${INST_DIR}/etc/odbc.ini". Finally create the "odbc.ini" file as detailed in the GT4 Admin Guide.

The last step for installing GT4 on XC Clusters is to poke holes in the XC firewall to enable the various Globus services to be accessed from the external network. Use the XC openipport(8) command to do this. For example:

   # echo "GT2 Gatekeeper"
   # openipport --port 2119 --protocol tcp --interface External
   #
   # echo "GT4 WS Core container"
   # openipport --port 8443 --protocol tcp --interface External

The GridFTP server is a little more complicated since an entire range of ports must be opened for data connections. In this case, a sequence of openipport commands may be given or, provided the administrator understands XC networking, a single iptables(8) command may be used. For example:

   # echo "GridFTP"
   # openipport --port 2811 --protocol tcp --interface External
   #
   # echo "GridFTP data"
   # openipport --port 40000 --protocol tcp --interface External
   # openipport --port 40001 --protocol tcp --interface External
   # openipport --port 40002 --protocol tcp --interface External
   # [...]
   # openipport --port 40100 --protocol tcp --interface External
   #
   # echo "GridFTP data using iptables"
   # iptables -I RH-Firewall-1-INPUT -i external_interface \
   #     -p tcp -m tcp --dport 40000:40100 --j ACCEPT

Also, be sure to set GLOBUS_TCP_PORT_RANGE=40000,40100 in "env" section of GridFTP "/etc/xinetd.d" services file so that it knows to restrict data transfers to these ports.

Globus Toolkit on XC Clusters

Large Enterprise Business

XC Clusters overview

Java™ on XC Clusters

MySQL® on XC Clusters

Getting started

Globus Toolkit feedback form

Grid computing

HP platforms

Configuring and building GT4

Configuring MySQL

Configuring the XC Firewall

Other XC notes