Jan 31, 2006

Acad

em

ic a

nd E

ducat ional Gr id Init iat ive o

f Serbia

A E G I S

SEE-GRID Nis Training Session

Hands-on V: Standard Hands-on V: Standard Grid UsageGrid Usage

Dušan VudragovićSCL and ATLAS groupInstitute of Physics, Belgrade

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Getting a proxy certificateGetting a proxy certificate Get onto a machine that understand grid

commands To create proxy

$ voms-proxy-init --voms <vo> To get information about proxy

$ voms-proxy-info To destroy proxy

$ voms-proxy-destroy To create long-term proxy

$ myproxy-init -s <host_name> -d -n To get information about a long-term

$ myproxy-info -s <host_name> –d Deleting a stored long-term proxy

$ myproxy-destroy -s <host_name> -d

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Data menagmentData menagment GUID Grid Unique Identifier

guid:bbffd56a-eff0-4b59-af7b-2a235986001c LFN Logical File Name

lfn:TestFile.dat SURL Storage URL

sfn://castorgrid.cern.ch/castor/cern.ch TURL Transport URL

gsiftp://castorgrid.cern.ch/castor/cern.ch

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Low Level Data Management ToolsChecks the existence of a file or directory on a SE$ edg-gridftp-exists URL

Lists a directory on a SE$ edg-gridftp-ls URL

Creates a directory on a SE$ edg-gridftp-mkdir URL

Renames a file on a SE$ edg-gridftp-rename sourceURL destURL

Removes a file from a SE$ edg-gridftp-rm URL

Removes a directory on a SE$ edg-gridftp-rmdir URL

Copies files between SEs$ globus-url-copy sourceURL destURL

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

LCG Data Management Client ToolsCopies a Grid file to a local destinationlcg-cp --vo <vo> <lfn> <file>

Copies a file to a SE and registers the filelcg-cr --vo <vo> -d SURL –l <lnf> <file>

Registers in the the catalog lcg-rf --vo <vo> -l <lfn> <surl>

Unregisters in the the cataloglcg-uf --vo <vo> <guid> <surl>

Gets the GUID for a given LFN or SURL.lcg-lg --vo <vo> <lfn>

Lists the replicas for a given LFN, GUID or SURL.lcg-lr --vo <vo> <lfn>

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Some JDL attributesSome JDL attributes Type

for LCG2 only “Job” type supported JobType

values: “Normal”, “MPICH”, “Interactive”… Executable

command name Arguments

command line arguments StdOutput

file where the job standard output goes StdError

file where the job standard error goes InputSandbox

files for transfer from UI to the WN OutputSandbox

files for transfer from WN to the UI

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Requirements to send a job to a particular CE Requirements = other.GlueCEUniqueID ==

“ce.phy.bg.ac.yu:2119/jobmanager-pbs-seegrid”;

job must run on a CE where a particular experiment software is installed Requirements = Member("VO-atlas-release-11.0.2",

other.GlueHostApplicationSoftwareRunTimeEnvironment);

for MPI jobRequirements = Member("MPICH", other.GlueHostApplicationSoftwareRunTimeEnvironment)

Simple JDL fileExecutable = "/bin/sh";

Arguments = "HelloWorld.sh";

Stdoutput = "stdoutput";

StdError = "stderror";

InputSandbox={"HelloWorld.c","HelloWorld.sh"};

OutputSandbox={"stdoutput","stderror"};

Requirements = other.GlueCEUniqueID ==

“ce.phy.bg.ac.yu:2119/jobmanager-pbs-seegrid”;

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Job submissionJob submission To submit a job

$ edg-job-submit <jdl_file>$ edg-job-submit –o <job_ID_file> <jdl_file>$ edg-job-submit –r <CE_ID> <jdl_file>

Retrieving status of a job$ edg-job-status <job_ID>$ edg-job-status –i <job_ID_file>

Retrieving the output of a job$ edg-job-get-output <job_ID>$ edg-job-get-output –i <job_ID_file>$ edg-job-get-output –dir <path> <job_ID>

Canceling a job$ edg-job-cancel <job_ID>$ edg-job-cancel –i <job_ID_file>

Listing CE that match a job description$ edg-job-list-match <jdl_file>

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Possible job states in the LCG-2

SEE-GRID Nis Training Session

A E G I S

Jan 31, 2006

Information ServiceInformation Service Way to get information relative to the computing

resources for certain VO$ lcg-infosites --vo <vo> ce

To know the status of the storage resources$ lcg-infosites --vo <vo> se

$ lcg-infosites --vo <vo> closeSE To retrieve the tags corresponding to the

software installation of certain VO $ lcg-infosites --vo <vo> tag

To have a list of the supported attributes $ lcg-info --list-attrsto find CEs with OS SL or SLC and list RunningJobs and FreeCPUs on them

lcg-info --list-ce --query "OS=SC*" --attrs 'OS,RunningJobs,FreeCPUs'