The DataGrid Project

http://www.eu-datagrid.org/

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

http://www.dutchgrid.nl

Presentation “a quatre mains”

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

EDG and the testbed KorsJob submission (slides) JeffJob submission (hands on) David100 Atlas jobs on the Grid Stan

…… and all this in 20’

The Project status

at 2/3 of its lifetime

second EU review February 4 and 5 2003

writing started on a follow-up project in the 6th FP for 2005

LHC has accepted grid technology for its computing challenge: LCG

EDG software release 1.4 on the testbed

on the testbed: CERN, CNAF, CCIn2P3, NIKHEF, RAL prime sites

currently stress tested by Atlas and CMS with their prod.programs

others, D0, Earth Observ, biologists, etc. are testing as well

EDG tutorials given everywhere, last week at NIKHEF

What we will show you

the layout of the testbed

how to submit a job on the Grid

what modules/services are involved in job submission

how to get/look at the output of your job

how to deal with in- and output- files

Security is very important, but will not be shown

We assume Authentication and Authorisation are done

Once authorised a user can access all resources on the grid

Authentication: once a year, Authorisation: once per session

Current EDG Testbed

CERNLyon

RAL

Manchester NIKHEF

Reference site CERN

Testbed1 EDG sites NorduGrid

21 sites

8 sites are in Europe

About 340 machines are available.

Some of them are dual processor.

Some machines are only used for

EDG.

They are split into:

- Production

- Development

NorduGrid is as a Grid infrastructure in the Nordic countries

CNAF

Tutorial and Core site

A 3 Tier ArchitectureA 3 Tier Architecture

Client Application Server

Data Server

Request

ResultData

Request

User Interface

Computing Element/Worker Nodes

Storage Element

On the EDG testbed:On the EDG testbed:

EDG Logical Machine Types

1. User Interface (UI)

2. Resource Broker (RB)

3. Information Service (IS)

4. Computing Element (CE) Gatekeeper

(Front-end Node)

Worker Nodes (WN)

5. Storage Element (SE)

6. Replica Catalog (RC)

Job Submission Scenario

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement CE)Element CE)

Information Service (IS)

ReplicaCatalogue(RC)

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job SubmitEvent

Input Sandbox

Job Status

submitted

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService(JSS)

StorageElement (SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

BrokerInfo

scheduled

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

scheduledInput Sandbox

running

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JSS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Job Status

submitted

waiting

ready

scheduled

Job Status

running

A Job Submission Example

UIJDL

Logging &Bookkeeping

ResourceBroker

Job SubmissionService

StorageElement

ComputeComputeElementElement

Information Service

ReplicaCatalogue

submitted

waiting

ready

scheduled

running

Job Status

done

Job Status

A Job Submission Example

UIJDL

Logging &Bookkeeping

ResourceBroker

Job SubmissionService

StorageElement

ComputeComputeElementElement

Information Service

ReplicaCatalogue

submitted

waiting

ready

scheduled

running

done

Job Status

Job Status

outputready

Output Sandbox

A Job Submission Example

UIJDL

Logging &Bookkeeping(LB)

ResourceBroker (RB)

Job SubmissionService (JS)

StorageElement(SE)

ComputeComputeElement (CE)Element (CE)

Information Service (IS)

ReplicaCatalogue(RC)

Output Sandbox

cleared

submitted

waiting

ready

scheduled

running

done

Job Status

outputready

NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

The End

Sites Used in this Demo

CERN Production test bed RB, II, CE, SE and a couple of worker nodes

CNAF Bologna CE, SE and worker nodes

Rutherford Appleton Lab (GridPP) CE, SE and worker nodes

CC IN2P3 Lyon CE and worker nodes

NIKHEF UI, CE, SE, worker nodes, Replica Catalogue

Local Application Test Bed

ui02 (a.k.a. tbn08)

ce02

node18-*.farmnet.nikhef.nl

se02edgmds.dutchgrid.nl

lxshare0382

grid-vo.nikhef.nlRC

application test bed

ui01,ce01,se01RB IS

CERN

Higgs analysis at Atlas

Example of a Higgs analysis

Search in 4-electron channel Choose decay via HZZ e+e-

e+e-

~80% of background given by qq ZZ e+e-e+e-

Fast Atlfast simulation Pythia event generation Parameterization detector response

Selection criteria on ‘Reconstructed’ Electron cluster

EM Calorimeter information All electrons pT>7 GeV 2 electrons pT>20 GeV Even number of electrons Al least 1 Z with |91.175-m(Z*)|<15 GeV Both Z’s: m(Z*)>20 GeV

Cross sections: Background: BR ~ 17

fb

Signal (mH=130-200): BR ~ 1-3 fb

Luminosity:

One grid job of 500 events corresponds to approximately 1 year of running (low luminosity, 30 fb-1) with LHC