GridPP Presentation to AstroGrid 13 December 2001

Steve LloydQueen Mary

University of London

GridPP AstroGrid 13 December 2001 Slide 2

GridPP Overview

Provide architecture and middleware

Provide testbeds using simulation data Provide testbeds

using real data

Future LHC Experiments

Running US Experiments

Build prototype Tier-1 and Tier-2s in the UK and implement middleware in experiments

GridPP AstroGrid 13 December 2001 Slide 3

Financial Breakdown

£17M

CERN

Staff

Hardware

DataGrid Staff

GridPP Staff+ Managers

UK Hardware

Displacement

£1.3M

£2.5M

£2.5M

£2.8M

£2.5M

Travel + Training etc

£0.9M

BaBar Tier-A and Prototype LHC Tier-1

15 New posts for Experimental Applications

£4.5M

15 New posts for DataGrid Middleware

Prototype CERN Tier-0

New posts in CERN IT Division

GridPP AstroGrid 13 December 2001 Slide 4

Major Deliverables

Prototype I - March 2002• Performance and scalability testing of components• Testing of the job scheduling and data replication software from

the first DataGrid release.

Prototype II - March 2003• Prototyping of the integrated local computing fabric, with

emphasis on scaling, reliability and resilience to errors. • Performance testing of LHC applications. Distributed HEP and other

science application models using the second DataGrid release.

Prototype III - March 2004• Full scale testing of the LHC computing model with fabric

management and Grid management software for Tier-0 and Tier-1 centres, with some Tier-2 components.

GridPP AstroGrid 13 December 2001 Slide 5

Middleware Deliverables

• Grid Architecture– Assess final DataGrid architecture as used in prototypes.

Compare with other related projects.• Security

– Develop authentication and authorisation scheme using certificates, management of local authorisation, standard interfaces.

• Workload Management– Develop uniform Job Description Language, integrate into

existing schedulers and optimization.• Data Management

– Metadata services to enable data replication, synchronization, data caching and optimisation.

GridPP AstroGrid 13 December 2001 Slide 6

Middleware Deliverables

• Grid Monitoring– Publication of information services, monitoring of static and

dynamic metrics to enable resource allocation algorithms.• Fabric Monitoring

– Automated installation of Grid middleware on multiple sites enabling rapid deployment of components.

• Mass Storage– Interface to various data storage solutions.

• Testbed– Prototype development and tools to enable VOs to share

resources.• Network Services

– Deployment of end to end networking tools, publication of network resource information, deployment of high rate transport solutions and tests of packet prioritisation services.

GridPP AstroGrid 13 December 2001 Slide 7

Application Deliverables

• LHC Experiments– Build Grid Application Frameworks based on DataGrid

Prototype releases. Demonstrate a significant fraction of distributed Grid required for LHC programme.

• BaBar Experiment (SLAC)– Adapt application framework to DataGrid prototype

release. Demonstrate use of Grid for production analysis.

• FermiLab Experiments– Build Grid frameworks based on the SAM Architecture

incorporating Globus components. Demonstrate production data analysis and MC production on the Grid.

• Smaller Experiments and Lattice QCD– Test Grid Technology in smaller environment implementing

modest data management system applicable across experimental domains.

GridPP AstroGrid 13 December 2001 Slide 8

EU DataGrid

Map Centre

http://ccwp7.in2p3.fr/mapcenter/

GridPP AstroGrid 13 December 2001 Slide 9

http://www.gridpp.ac.uk/

GridPP AstroGrid 13 December 2001 Slide 10

GridPP AstroGrid 13 December 2001 Slide 11

GEANT Network

Weathermap

http://www.dante.net/geant/

GridPP AstroGrid 13 December 2001 Slide 12

Project Management Board

Project Leader Tony Doyle Glasgow a.doyle@physics.gla.ac.ukDeputy Project Leader John Gordon RAL j.c.gordon@rl.ac.ukChair of Collaboration Board Steve Lloyd Queen Mary s.l.lloyd@qmul.ac.ukChair of Technical Board Peter Clarke UCL clarke@hep.ucl.ac.ukChair of Experiments Board Nick Brook Bristol n.brook@bristol.ac.ukDeputy Chair of EB Roger Barlow Manchester roger.barlow@man.ac.ukResource Manager Dave Britton IC d.britton@ic.ac.ukDataGrid UK Project Leader Robin Middleton RAL robin.middleton@rl.ac.ukCERN Liaison Les Robertson CERNe-Science Director Neil Geddes PPARC

See: www.gridpp.ac.uk

GridPP AstroGrid 13 December 2001 Slide 13

UK DataGrid Contacts

UK Co-ordinator Robin Middleton (R.P.Middleton@rl.ac.uk)Architecture Task Force Steve Fisher (s.m.fisher@rl.ac.uk)Security Dave Kelsey (d.p.kelsey@rl.ac.uk)WP1 Workload Management David Colling (d.colling@ic.ac.uk)WP2 Data Management Tony Doyle

(a.doyle@physics.gla.ac.uk)WP3 Grid Monitoring Steve Fisher (s.m.fisher@rl.ac.uk)WP4 Fabric Management Paul Anderson (paul@dcs.ed.ac.uk)WP5 Mass Storage John Gordon (j.c.gordon@rl.ac.uk)WP6 Integration Test Bed Andrew McNab (mcnab@hep.man.ac.uk)WP7 Network Services Peter Clarke (clarke@hep.ucl.ac.uk)WP8 HEP Applications

GridPP AstroGrid 13 December 2001 Slide 14

GridPP Status

• EU DataGrid started 1st January 2001 (funds 5 UK posts).• GridPP started 1st September 2001.• Management Structure up and running.• Project Manager appointed from 1st September.• PMB meets weekly by VC and monthly in person.• Already allocated ~16 new posts to work on EU DataGrid

- partly in post (mostly middleware development).• About to announce 15 new posts (mostly experimental

implementation). • About to Tender for £900k hardware for Tier-1/A Centre

at RAL and £300k for Tier-0 at CERN.• In process of allocating ~12 joint CERN/PPARC

Fellowships. • First EU DataGrid Testbed deployed - at 11 Dec consists

of CERN, CNAF (Bologna), RAL and Manchester.