s.l.lloydgrid steering committee 8 march 2002 slide 1 status of gridpp overview financial summary...
TRANSCRIPT
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 1
Status of GridPP
• Overview• Financial Summary• Recruitment Status• EU DataGrid• UK Grid Status• GridPP and the e-Science Centres
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 2
GridPP Overview
Provide architecture and middleware
Use the Grid with simulation data
Use the Grid with real data
Future LHC Experiments
Running US Experiments
Build prototype Tier-1 and Tier-2s in the UK and implement middleware in experiments
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 3
Allocation of GridPP Funds
CERN Hardware7%
CERN Staff26%
UK Managers 5%
UK DataGrid Posts15%
Misc1%UK Hardware
14%
UK GridPP Posts15%
UK Transferred Posts12%
Travel5% Tier-0
Applications
Tier-1/A
Middleware
Applications/System
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 4
Recruitment
• EU Funded Posts (Middleware/Testbed)– All 5 in post + 1 additional from 1/2/02
• EDG Unfunded Posts (Middleware/Testbed)– 13.5 out of 15 in post– (1 under offer, 0.5 starts 1/4/02 + 0.5 from CeSC)
• GridPP Posts (Applications + Tier1/A) – Allocated Dec 2001– ~7 out of 15 ~in post
• CERN Posts– First Round > 100 Applicants– 12 Offers, 1 Refusal, 1 Postponed– 3 Fellows, 5 Staff members, 2 UK University Staff– 4 in Applications, 2 Data Management, 3 Systems, 1
Management
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 5
Recruitment
Overall: • Initially problems with EU Funded posts at RAL.• Since then no real problems recruiting - mixture of
academic and software industry backgrounds.• Delays mainly caused by (University) bureaucracy.
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 6
EU DataGrid
• First EU Review of DataGrid completed last week.– Verbal feedback very positive.– Reviewers commended overall good performance.– Several areas above expectations.– All deliverables accepted as they are.– Earlier UK concerns successfully overcome.
• UK Contributions– Architectures– Testbed-1– Network Monitoring– Storage Element– Certificates & Security– R-GMA– LCFG– MDS deployment– Spitfire– …
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 7
LCFG
The LCFG Architecture
LCFG Source Files
mkxprof
Web Server
XML Profi le
ldxprofldxprof
GenericComponent
GenericComponent
rdxprofrdxprof
LCFG Components
DBM File
Server
Client
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 8
R-GMA
Consumer Servlet
RegistryAPI
Consumer Servlet
RegistryAPI
Consumer Servlet
RegistryAPI
Consumer Servlet
RegistryAPI
Sensor Code
ProducerAPI
Application Code
ConsumerAPI
ProducerServlet
RegistryAPI
Registry Servlet
SchemaAPI
Schema Servlet
“Event Dictionary”
Application Code
ArchiverAPI
DBProducer
DBProducerServlet
Archiver Servlet
ConsumerAPIConsumer
APIConsumerAPIConsumer
API
User code monitors output here.
User code here.Builds on R-GMA
Database Structures. Relational Grid Monitoring Architecture
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 9
EDG Testbed Status
• For EU Review of DataGrid on 1st March a Testbed 1.1 grid of 5 sites was constructed:– CERN, RAL, IN2P3-Lyon, CNAF-Bologna, NIKHEF.– The demos included jobs running at all sites and moving
data.– This had the required functionality working but proved
unreliable.• An attempt will be made to make it stable in Release 1.1.2
– Then it will be released to more sites • In UK we have a rollout plan that will start then.
– Most sites plan to be involved in the GridPP Grid in some way.
– Core UK sites at first will be RAL, Bristol, Manchester, IC where we have funded WP6 effort.
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 10
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 11
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 12
UK Tier1/A Status
Hardware Purchase for delivery in March156 Dual 1.4GHz 1GB RAM, 30GB disks 26 Disk servers (Dual 1.266GHz) each
with 1.9TB diskExpand the capacity of the tape robot by
about 35TB
Current setup14 Dual 1GHz PIII, 500MB
RAM 40GB disksCompute Element (CE)Storage Element (SE)User Interface (UI)Information Node (IN)
Central Facilities (Non Grid)
250 CPUs10TB Disk35TB Tape (Capacity
330 TB)
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 13
Tier-2 - ScotGrid
ScotGrid Processing nodes at Glasgow 59 IBM X Series 330 dual 1 GHz Pentium III with 2GB memory • 2 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory and dual ethernet • 3 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory and 100 + 1000 Mbit/s ethernet • 1TB disk • LTO/Ultrium Tape Library • Cisco ethernet switches
ScotGrid Storage at Edinburgh• IBM X Series 370 PIII Xeon with 512 MB memory 32 x 512 MB RAM • 70 x 73.4 GB IBM FC Hot-Swap HDD
BaBar UltraGrid System at Edinburgh• 4 UltraSparc 80 machines in a rack 450 MHz CPUs in each 4Mb cache, 1 GB memory • Fast Ethernet and MirrorNet switching
CDF equipment at Glasgow• 8 x 700 MHz Xeon IBM xSeries 370 4 GB memory 1 TB disk
Griddev testrig at Glasgow• 4 x 233 MHz Pentium II
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 14
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 15
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 16
GridPP & Core e-Science Centres
• NeSc– Close ties, hosted 2nd GridPP Collaboration
Meeting, Collaboration on EDIKT Project? Training...
• Belfast– Replied but not yet up and running.
• Cambridge– Close ties, hosted 3rd GridPP Collaboration
Meeting. Share one post with GridPP. Will collaborate on ATLAS Data Challenges.
• Cardiff– Replied - contacts through QM (Vista) and Brunel
GridPP Group.
Written formally to all e-Science centres inviting contact and collaboration with GridPP.
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 17
GridPP & Core e-Science Centres
• London– No formal reply but close contacts through IC
HEP Group. IC will host 5th GridPP Collaboration Meeting.
• Manchester– No reply. Manchester HEP Group will host 4th
GridPP Collaboration Meeting.
• Newcastle– In contact - Database projects?
• Oxford– Close ties, collaboration between Oxford HEP
Group and GridPP on establishment of central Tier-2 centre? CS/Core-GridPP-EDG links? Probably host 6th GridPP Collaboration Meeting.
• Southampton– Replied but no collaboration as yet.
S.L.Lloyd Grid Steering Committee 8 March 2002
Slide 18
Summary
OGSA
• GridPP Project up and running• EDG Middleware development well
underway– Recruitment ~ complete – 1st EU Review successful
• EDG Testbed 1 being rolled out– UK in 1st rollout– Now extend to several UK sites
• Application Development– Just starting– Recruitment underway– 1st US tests successful
• UK Grid– 1st Procurement for RAL Tier-1/A
underway– Tier-2s developing
• Core e-Science Centres– Good relationships evolving