The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

LHC Computing and Grids

Frédéric Hemmer

IT Deputy Department Head

October 10, 2006

for the Ambassadors of the Latin American

and Caribbean Countries visit

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

The accelerator generates 40 million particle collisions (events) every second at the centre of each of the four experiments’ detectors

The LHC Accelerator

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

LHC DATA

This is reduced by online computers that filter out a few hundred “good” events per sec.

Which are recorded on disk and magnetic tapeat 100-1,000 MegaBytes/sec

~15 PetaBytes per year for all four experiments

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

The LHC Data Challenge

• The accelerator will be completed in 2007 and run for 10-15 years

• Experiments will produce about15 Million Gigabytes of data each year (about 20 million CDs!)

• LHC data analysis requires a computing power equivalent to ~100,000 of today's fastest PC processors

• Requires many cooperating computer centres, as CERN can only provide ~20% of the capacity

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

Solution: the Grid

• Use the Grid to unite computing resources of particle physics institutes around the world

The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations

The Grid is an infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

The Grid used by CERN and its partners

• The EGEE and OSG projects are the basis of the Worldwide LHC Computing Grid Project

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

LCG Service Hierarchy

Tier-0 – the accelerator centre• Data acquisition & initial processing• Long-term data curation Data Distribution to Tier-1 centres

Canada – Triumf (Vancouver)France – IN2P3 (Lyon)Germany –KarlsruheItaly – CNAF (Bologna)Netherlands – NIKHEF/SARA (Amsterdam)Nordic countries – distributed Tier-1

Spain – PIC (Barcelona)Taiwan – Academia SInica (Taipei)UK – CLRC (Oxford)US – FermiLab (Illinois) – Brookhaven (NY)

Tier-1 – “online” to the data acquisition process high availability

• Managed Mass Storage – grid-enabled data service

All re-processing passes• Data-heavy analysis• National, regional support

Tier-2 – ~100 centres in ~40 countries• Simulation• End-user analysis – batch and interactive Services, including Data Archive and Delivery, from Tier-1s

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

LHC Computing Grid Project - a Collaboration

• The physicists and computing specialists from the LHC experiments

• The national and regional projects in Europe and the US that have been developing Grid middleware

• The regional and national computing centres that provide resources for LHC

• The research networks

Researchers

Computer Scientists &

Software Engineers

Service Providers

Building and operating the LHC Grid – a global collaboration between

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

• LCG has been the driving force for the European multi-science Grid EGEE (Enabling Grids for E-sciencE)

• EGEE is now a global effort, and the largest Grid infrastructure worldwide

• Co-funded by the European Commission (~130 M€ over 4 years)

• EGEE already used for >20 applications, including…

Impact of the LHC Computing Gridin Europe

Medical ImagingEducation, TrainingBio-informatics

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

The EGEE Project• Infrastructure operation

• Currently includes >200 sites across 40 countries• Continuous monitoring of grid services & automated site

configuration/managementhttp://gridportal.hep.ph.ic.ac.uk/rtm/launch_frame.html

• Middleware• Production quality middleware distributed under business

friendly open source licence

• User Support - Managed process from first contact through to production usage

• Training• Documentation • Expertise in grid-enabling applications• Online helpdesk• Networking events (User Forum, Conferences etc.)

• Interoperability• Expanding interoperability with related infrastructures

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

Applications on EGEE• More than 20 applications from 7 domains

• Astrophysics• MAGIC, Planck

• Computational Chemistry• Earth Sciences

• Earth Observation, Solid Earth Physics, Hydrology, Climate • Financial Simulation

• E-GRID• Fusion• Geophysics

• EGEODE• High Energy Physics

• 4 LHC experiments (ALICE, ATLAS, CMS, LHCb)• BaBar, CDF, DØ, ZEUS

• Life Sciences• Bioinformatics (Drug Discovery, GPS@, Xmipp_MLrefine, etc.)• Medical imaging (GATE, CDSS, gPTM3D, SiMRI 3D, etc.)

• Multimedia• Material Sciences • …

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

Example: EGEE Attacks Avian Flu

• EGEE used to analyse 300,000 possible potential drug compounds against bird flu virus, H5N1.

• 2000 computers at 60 computer centres in Europe, Russia, Taiwan, Israel ran during four weeks in April - the equivalent of 100 years on a single computer.

• Potential drug compounds now being identified and ranked

Neuraminidase, one of the two major surface proteins of influenza viruses, facilitating the release of virions from infected cells. Image Courtesy Ying-Ta Wu, AcademiaSinica.

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

EU projects related to EGEE

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department

Evolution

EGEE EGEE-IIEDG EGEE-III

European e-Infrastructure

Coordination

Testbeds Utility ServiceRoutine Usage

The LHC Computing Grid – October 2006Frédéric Hemmer, CERN, IT Department