spgrid status in ferrara and beyond concezio bozzi infn ferrara la biodola, may 20th 2003 on behalf...

SPGrid Status in SPGrid Status in Ferrara and beyondFerrara and beyond

Concezio BozziConcezio Bozzi

INFN FerraraINFN Ferrara

La Biodola, May 20th 2003La Biodola, May 20th 2003

On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi

People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas

Smith

La Biodola - May 20th 2003 2Concezio Bozzi - INFN Ferrara

Hardware status in Hardware status in FerraraFerrara

EDG 1.4.11 is installed on RH6.2 and RH7.3 nodes PBS queue specific for RedHat 7.3 nodes is defined BaBar VO is authorized to access the INFN RBs in

Bologna (cnaf009g.cnaf.infn.it) Resources in Ferrara are visible from the IC RB as

well (thanks to David Colling!) RH7.3 resources are accessible by using in your JDL:

Requirements=isMember(other.RunTimeEnvironment,"FERRARA")

&& other.QueueName == "wn73"; An SP5 federation is installed and available:

babarbecue.fe.infn.it::/babar/databases/SP5/BKG/bbrprod/9195/BaBar.BOOT Contains conditions + Dec2001 background collection


Integration into EDGIntegration into EDG Pack software in relocable rmps Pack software in relocable rmps Give a tag to software, will be published as Give a tag to software, will be published as

RunTimeEnvironment and used in JDL files.RunTimeEnvironment and used in JDL files. Send RPMs and tag to the EDG Integration Team, Send RPMs and tag to the EDG Integration Team,

that will test the rpms on a micro-testbed. If that will test the rpms on a micro-testbed. If everything OK, they will include them in a new EDG everything OK, they will include them in a new EDG software release. software release.

Each sitemanager will be notified of the new release, Each sitemanager will be notified of the new release, and will upgrade his testbed farm. and will upgrade his testbed farm.

Accessory parts to install software via LCFGng are Accessory parts to install software via LCFGng are also needed, and are ready since some time (we also needed, and are ready since some time (we showed them in Karlsruhe)showed them in Karlsruhe)


An RPM to run Moose has been built and installed “by An RPM to run Moose has been built and installed “by hand” on RH7.3 worker nodes:hand” on RH7.3 worker nodes:[root@grid7]# ls /opt/babar/[root@grid7]# ls /opt/babar/ 12.4.0-Roo tcl8.012.4.0-Roo tcl8.0

Contents: Contents: [root@grid7]# ls /opt/babar/12.4.0-Roo/[root@grid7]# ls /opt/babar/12.4.0-Roo/

bin etc library shlib srcbin etc library shlib src

bin: MooseApp (77MB)bin: MooseApp (77MB)etc: site.sh (setup envvar like BFROOT, OO_FD_BOOT, etc: site.sh (setup envvar like BFROOT, OO_FD_BOOT,

LD_LIBRARY_PATH)LD_LIBRARY_PATH)library: a link to init.tcl (tcl error otherwise…)library: a link to init.tcl (tcl error otherwise…)shlib: shared libraries (37MB)shlib: shared libraries (37MB)src: tcl files and flat files (16MB)src: tcl files and flat files (16MB) Total RPM:Total RPM:

136MB 136MB

Building an rpm for Building an rpm for MooseMoose

Babar release: Babar release: 1.4GB 1.4GB


Determining required Determining required partsparts

Naively, MooseApp + tcl file obtained with dump Naively, MooseApp + tcl file obtained with dump mechanismmechanism

For a number of reasons, we could not obtain the For a number of reasons, we could not obtain the latterlatter

Shared libraries are also neededShared libraries are also needed Anything else? Anything else? Use strace/lddUse strace/ldd The answer is:The answer is:

475 tcl files 475 tcl files 165 flat files165 flat files 42 shared libraries42 shared libraries


Moose was successfully run on RH7.3 worker nodes by Moose was successfully run on RH7.3 worker nodes by using both the INFN-CNAF and IC Resource Brokersusing both the INFN-CNAF and IC Resource Brokers

JDL script: JDL script: [bozzi@grid1 ~/testSPGrid]$ more Moose.jdl [bozzi@grid1 ~/testSPGrid]$ more Moose.jdl Executable = "Moose.csh";Executable = "Moose.csh";StdOutput = "Moose.out";StdOutput = "Moose.out";StdError = "Moose.err";StdError = "Moose.err";InputSandbox = {"Moose.csh", "MooseProductionOptions.tcl", InputSandbox = {"Moose.csh", "MooseProductionOptions.tcl",

"B0B0bar_generic.dec"};"B0B0bar_generic.dec"};OutputSandbox = {"Moose.out", "Moose.err"};OutputSandbox = {"Moose.out", "Moose.err"};Requirements = Requirements =

IsMember(other.RunTimeEnvironment,"FERRARA") && IsMember(other.RunTimeEnvironment,"FERRARA") && other.QueueName == "wn73";other.QueueName == "wn73";

Assuming Options, .dec and .csh files are built by Assuming Options, .dec and .csh files are built by someone elsesomeone else

Running MooseRunning Moose


Submission via GeniusSubmission via Genius

Genius under Genius under evaluation by evaluation by BaBarBaBar

Genius portal Genius portal installed in installed in Ferrara Ferrara (including (including MyProxyserverMyProxyserver))

Moose jobs Moose jobs submitted to submitted to Ferrara with Ferrara with Genius via IC Genius via IC RB:RB:


Next stepsNext steps

Include RPM in EDG release (2.0 by end of the month?)Include RPM in EDG release (2.0 by end of the month?) Upgrade from 12.4.0-Roo to 13.4.0-roo-XUpgrade from 12.4.0-Roo to 13.4.0-roo-X This allows us to use virtually any CPU with EDG This allows us to use virtually any CPU with EDG

software installed. software installed. Bottleneck: access conditionsBottleneck: access conditions Solution: at least a conditions DB per country/region/Babar siteSolution: at least a conditions DB per country/region/Babar site

Extend metodology to sites already running Babar Extend metodology to sites already running Babar software (Wahid Bhimji, Tim Barrass), or to sites using software (Wahid Bhimji, Tim Barrass), or to sites using Globus+VDT (Dirk Hufnagel)Globus+VDT (Dirk Hufnagel)

Start working on bookkeeping and production tools Start working on bookkeeping and production tools (Douglas Smith, Marc Kelly, Daniele Andreotti), (Douglas Smith, Marc Kelly, Daniele Andreotti), integration with Grid portals like Genius (Daniele, integration with Grid portals like Genius (Daniele, Concezio)Concezio)

BackupBackup


[root@print ~]# rpm -qpi Moose-0.1-1.i386.rpm [root@print ~]# rpm -qpi Moose-0.1-1.i386.rpm

Name : Moose Relocations: /opt/babar Name : Moose Relocations: /opt/babar Version : 0.1 Vendor: INFN - Ferrara Version : 0.1 Vendor: INFN - Ferrara Release : 1 Build Date: Wed 05 Mar 2003 4:25:32 PM CET Release : 1 Build Date: Wed 05 Mar 2003 4:25:32 PM CET Install date: (not installed) Build Host: print.fe.infn.it Install date: (not installed) Build Host: print.fe.infn.it Group : SPGrid/BaBar Source RPM: Moose-0.1-1.src.rpm Group : SPGrid/BaBar Source RPM: Moose-0.1-1.src.rpm Size : 2560 License: GNU General Public License (GPL) Size : 2560 License: GNU General Public License (GPL)

Packager : INFN - FerraraPackager : INFN - Ferrara URL : URL : http://www.fe.infn.it Summary : Moose Summary : Moose Description : Description : A simple Test RPM for BaBarA simple Test RPM for BaBar SPGrid SPGrid Default Installation creates: /opt/babar/bin/MooseAppFake Default Installation creates: /opt/babar/bin/MooseAppFake Installation with --prefix <dirname> creates: <dirname>/bin/MooseAppFake Installation with --prefix <dirname> creates: <dirname>/bin/MooseAppFake

Test rpm (1/3)Test rpm (1/3)



ls /opt/local/linux/6.2/RPMS/WP8/BaBar/ls /opt/local/linux/6.2/RPMS/WP8/BaBar/ Makefile Moose-0.1-1.i386.rpmMakefile Moose-0.1-1.i386.rpm

more /opt/local/linux/6.2/rpmcfg/BaBar-rpm.h more /opt/local/linux/6.2/rpmcfg/BaBar-rpm.h /* BaBar SOFTWARE RPM LIST *//* BaBar SOFTWARE RPM LIST */Moose-0.1-1Moose-0.1-1

Made some changes to the EDG standard config files on the LCFGng server : • Added the WP8/BaBar/ repository• Created the BaBar-rpm.h containing the rpm-list for BaBar software.



Added to redhat62-cfg.h a BaBar line to set the related repository for automatic updating.

RPMDIR/WP8/BaBar:\

rpm -qa |grep Moose Moose-0.3-1ls /opt/babar/bin/ MooseAppFake

On the Worker Nodes and Computing Element:

Added the following lines to WN-rpm and CE-rpm of LCFGng server config files, in order to install this rpm on the Computing Element and Worker Node:

/* BaBar software */#include "BaBar-rpm.h"

spgrid status in ferrara and beyond concezio bozzi infn ferrara la biodola, may 20th 2003 on behalf...

Documents

ferrara edg

concezio bozzi infn

tcl files

new edg software release

edg pack software

jdl files

new release

mooseapp tcl file