Compute Element and Batch Scheduler Interface

From SURAgrid
Jump to: navigation, search

Contents

Reference

OSG Documentation: CE Preparation
OSG Documentation: CE Installation

Preparation

The CE installation will install the VDT packages necessary for bringing up the GRAM2 gatekeeper and gridftp. This should be installed on a system with access to your batch system as well as the home and data directories. Choose a location for your installation. For this installation, we use /usr/local/osg.

A word about operating systems: don't stray from the RHEL5/CentOS5/SL5 path. It's just not worth it. The OSG stack works well with it. Another huge problem is that new distros are shipping with openssl-1.0.0 which has changed the certificate hash algorithm! This breaks all CA certificate distributions that use a directory of certs stored in individual files named by their hash (e.g., c8ede464.0). Hopefully this will be addressed by the Globus/VDT/OSG folks soon, because the other libraries in RHEL5 are getting quite old.

Before proceeding, disable existing services and save any old installations. Backup your /etc/grid-security/ directory. Cross your fingers.

Create a new user "rsvuser"

Installation

INSTALL BASE CE PACKAGE 

mkdir /usr/local/osg
cd /usr/local/osg
pacman [-pretend-platform RHEL-5] -get http://software.grid.iu.edu/osg-1.2:ce

[ This will take a while, so go grab a drink. ]

source setup.sh 

INSTALL AND AUTO-UPDATE CA CERTS AND CRLS

[ It is recommended that certificates and CRLs be installed in
an NFS exported directory. In this example, the directory name
will be /apps/osg. The CE will manage the CA certs under this
directory. Create symlinks from /etc/grid-security/certificates ]

vdt-ca-manage setupca --location /apps/osg --url osg 
cd /etc/grid-security
ln -s ../../apps/osg/certificates certificates
vdt-control --enable vdt-update-certs
vdt-control --enable fetch-crl

CONNECT TO BATCH SYSTEM

[ OSG supports four batch scheduling systems: Condor, PBS, SGE
and LSF. See "OSG Documentation: CE Installation" above for
Condor instructions. Replace batch-system below with either PBS,
SGE or LSF. ]

Edit $VDT_LOCATION/vdt/etc/vdt-local-setup.{csh,sh}
export GLOBUS_TCP_PORT_RANGE=30000,30100

[ only 100 connections (may be too small); make sure firewalls allow inbound connections to these ports ] 

Edit /etc/sysctl.conf and keep local ports out of GLOBUS' ports
net.ipv4.ip_local_port_range = 10240 29999
sysctl -p

[ skipping Managed Fork (condor) for now ]

cd $VDT_LOCATION
which qsub # should be in $PATH
pacman -get http://software.grid.iu.edu/osg-1.2:Globus-batch-system-Setup 

POST-INSTALL(1)

vdt-control --enable vdt-rotate-logs
vdt-post-install

Configuration

Proceed to the Compute Element Configuration

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox