CERN IT Department 1 / 17

Tour of CERN Computer Center and the Grid at CERN

Information Technologies Department

Tour of CERNComputer Center

and the Grid at CERN

Welcome!

CERN IT Department 2 / 17

Tour of CERN Computer Center and the Grid at CERN

IT Department

Computing at CERN

1. General Purpose Computing Environment

2. Administrative Computing Services

3. Physics and engineering computing

4. Consolidation, coordination and standardization of computing activities

5. Physics applications(e.g., for data acquisition/offline analysis)

6. Accelerator design and operations

http://cern.ch/it

CERN IT Department 3 / 17

Tour of CERN Computer Center and the Grid at CERN

LHC Data every year

• 40 million collisions per second

• After filtering, 100 collisions of interest per second

• > 1 Megabyte of data digitised per collision recording rate > 1 Gigabyte / sec

• 1010 collisions recorded each year stored data > 15 Petabytes / year

CMS

LHCb

ATLAS

ALICE

http://cern.ch/lhc

1 Megabyte (1MB)A digital photo

1 Gigabyte (1GB) = 1000MB5GB = A DVD movie

1 Terabyte (1TB)= 1000GBWorld annual book production

1 Petabyte (1PB)= 1000TBAnnual production of one LHC experiment

1 Exabyte (1EB)= 1000 PB3EB = World annual information production

CERN IT Department 4 / 17

Tour of CERN Computer Center and the Grid at CERN

LHC Data every year

LHC data correspond to about 20 million CDs each year

Balloon(30 Km)

Concorde(15 Km)

Mt. Blanc(4.8 Km)

Where will the experiments store all

of these data?

CD stack with1 year LHC data!

(~ 20 Km)

CERN IT Department 5 / 17

Tour of CERN Computer Center and the Grid at CERN

LHC Data Processing

LHC data analysis requires a computing power equivalent to~ 100,000 of today's

fastest PC processors

Where will the experiments find such a computing power?

CERN IT Department 6 / 17

Tour of CERN Computer Center and the Grid at CERN

• High-throughput computing based on reliable “commodity” technology• More than 8500 CPUs in about 3500 boxes (Linux)• 4 Petabytes on 14’000 drives (NAS Disk storage)• 10 Petabytes on 45’000 tape slots with 170 high speed drives

Nowhere near enough!

Computing power available at CERN

CERN IT Department 7 / 17

Tour of CERN Computer Center and the Grid at CERN

• Problem: even with Computer Centre upgrade, CERN can provide only a fraction of the necessary resources

Europe: 267 institutes4603 usersAilleurs: 208 institutes1632 users

Computing for LHC

• Solution: Computing centers, which were isolated in the past, will be connected, uniting the computing resources of particle physicists worldwide

CERN IT Department 8 / 17

Tour of CERN Computer Center and the Grid at CERN

• The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations

What is the Grid?

• In contrast, the Grid is an emerging infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe

CERN IT Department 9 / 17

Tour of CERN Computer Center and the Grid at CERN

•NASA Information Power Grid•DOE Science Grid•NSF National Virtual Observatory•NSF GriPhyN•DOE Particle Physics Data Grid•NSF TeraGrid•DOE ASCI Grid•DOE Earth Systems Grid•DARPA CoABS Grid•NEESGrid•DOH BIRN•NSF iVDGL

One Web but many Grids

•DataGrid (CERN, ...)•EuroGrid (Unicore)•DataTag (CERN,…)•Astrophysical Virtual Observatory•GRIP (Globus/Unicore)•GRIA (Industrial applications)•GridLab (Cactus Toolkit)•CrossGrid (Infrastructure Components)•EGSO (Solar Physics)

•UK e-Science Grid•Netherlands – VLAM, PolderGrid•Germany – UNICORE, Grid proposal•France – Grid funding approved•Italy – INFN Grid•Eire – Grid proposals•Switzerland - Network/Grid proposal•Hungary – DemoGrid, Grid proposal•Norway, Sweden - NorduGrid

Grid development has been initiated by the academic, scientific and research community, but industry is also interested.

CERN IT Department 10 / 17

Tour of CERN Computer Center and the Grid at CERN

1. Sharing resources on a global scaleMain issues are trust, different management policies, virtual organisations, 24 hour access and support.2. SecurityMain issues are well-defined yet flexible rules, authentication, authorisation, compatibility and standards3. Balancing the load This is more than just cycle scavenging, (SETI@home), need middleware to monitor and broker resources4. The death of distanceNetworks delivered 56Kb/s 10 years ago,now we have 155Mb/s,for the LHC anticipate 10 Gb/s5. Open standardsGrid standards are converging, and include Web services, the GlobusToolkit, various protocols

What are the principles behind the Grid? 5 big ideas…

CERN IT Department 11 / 17

Tour of CERN Computer Center and the Grid at CERN

• Medical/Healthcare (imaging, diagnosis and treatment )

• Bioinformatics (study of the human genome and proteome to understand genetic diseases)

• Nanotechnology (design of new materials from the molecular scale)

• Engineering (design optimization, simulation, failure analysis and remote instrument access and control)

• Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems)

Grid applications for Science

CERN IT Department 12 / 17

Tour of CERN Computer Center and the Grid at CERN

• CERN projects:LHC Computing Grid (LCG)

• EU funded projects led by CERN:Enabling Grids for E-SciencE (EGEE)+ others

• Industry funded projects:CERN openlab for DataGrid applications

Grid@CERN

CERN IT Department 13 / 17

Tour of CERN Computer Center and the Grid at CERN

•Timeline

• 2002: start project

• 2003: 2003: service opened (LCG-1 started in September with 12 sites)

• 2004 LCG-2 released • 2002 - 2005: deploy the LCG environment

• 2006 – 2008: build and operate the LCG service

http://cern.ch/lcg

As of April 2007:• biggest Grid project in the world• 177 sites in more than 30 countries• 30’000 processors• 14 millions Gigabytes storage

LCG: LHC Computing Grid

CERN IT Department 14 / 17

Tour of CERN Computer Center and the Grid at CERN

Access to a production quality GRID will change the way science and much else is done in Europe

A geneticist at a conference, inspired by a talk she hears, will be able to launch a complex biomolecular

simulation from her mobile phone.

A team of engineering students will be able to run the latest 3D rendering programs from their laptops using the Grid.

An international network of scientists will be able to model a new flood of the Danube in real time, using meteorological and geological data from several centres across Europe.

The EGEE vision

http://www.eu-egee.org

CERN IT Department 15 / 17

Tour of CERN Computer Center and the Grid at CERN

Objectives

• Build an ultrahigh performance computer cluster

• Link it to the DataGrid and test its performance

• Evaluate potential of future commodity technology for LCG

Openlab for Datagrid Applications

http://cern.ch/openlab

CERN IT Department 16 / 17

Tour of CERN Computer Center and the Grid at CERN

Computer Centre Tour

Ground Floor• OpenLab: equipment of the future• CIXP: CERN Internet Exchange Point

Basement• Storage Silos: >10 petabytes• PC farm: >3000 PC aligned

IMPORTANT – FOR YOUR OWN SAFETY

PLEASE DO NOT TOUCHEQUIPMENT AND CABLES DURING VISIT

CERN IT Department 17 / 17

Tour of CERN Computer Center and the Grid at CERN

To know more about the Grid…