the french national grid initiative guy wormser grids institute director grid workshop krakow...

The French National Grid Initiative

Guy WormserGrids Institute DirectorGrid Workshop Krakow

October 13, 2008

Guy Wormser, Krakow Grid workshopl , October 13, 2008 2

France and Grids

• France has been involved in the Grid adventure since the very beginning on five different themes:– Production grids – Supercomputer grids– Research Grid (Grid5000)– Research on grids– Peer-to-peer grids

• Key partners in many european projects– DATAGRID, EGEE-I, EGEE-II, EGEE-III– EUROGRID, DEISA I, DEISA-II– EGI– PRACE– COREGRID– EDGES– EELA2


Grids Scientific added value

• Transparent access to distributed data– Exemples : Earth sciences, Life sciences

• Manipulation of very large data volumes– Particle physics, astrophysics, human sciences

• Very large flexibility for computing resources– Catastrophic events management– Avian flu challenge, malaria


The main grid actors in France

• CNRS (National Center for Scientific Research), the largest research organism in France and in Europe, covering all research fields from human sciences to subatomic physics including computing sciences. CNRS is focused on fundamental research

• INRIA (National Institute for computing research), working mostly on grid reserach and research grids

• CEA (Atomic Energy Commission), interested for the applications High energy physics, Fusion

• Universities • Other specialized institutes (INSERM, INRA,CNES,..)• RENATER : The French NREN


The main grid nodes in France

• The biggest French grid node is Lyon, the IN2P3/CNRS computing center in Lyon (LHC Grid Tier 1)

• Three Tier 2: GRIF (Paris area), Nantes, Clermont-Ferrand + analysis facility in Lyon

• Several Tier3: Strasbourg, Marseille, Annecy, Grenoble• 5 smaller nodes devoted mainly to other sciences:

Paris, Lyon, CGG, Ecole Centrale, Montpellier• France represents ~15% of the EGEE ressources• Supercomputer nodes in Deisa/Prace world


Tier-2: LPC Tier-2: LPC

AF: CC-IN2P3AF: CC-IN2P3

Tier-2: LAPPTier-2: LAPP

Tier-3: IPHCTier-3: IPHC

LyonLyon

Clermont-FerrandClermont-Ferrand

Ile de Ile de FranceFrance

MarseilleMarseille

NantesNantes

StrasbourgStrasbourg

AnnecyAnnecy

Tier-3: IPNLTier-3: IPNL

Tier-3: CPPMTier-3: CPPM

Tier-2: SubatechTier-2: Subatech

Tier-2: GRIF•CEA/DAPNIA•LAL•LLR•LPNHE•IPNO

Tier-2: GRIF•CEA/DAPNIA•LAL•LLR•LPNHE•IPNO

Tier-1: CC-IN2P3Tier-1: CC-IN2P3 GrenobleGrenobleTier-3: LPSCTier-3: LPSC

Sites LCG-France en 2007


RENATER


Contribution LHC (EGEE accounting)

Normalised CPU time to a reference value to 1 kSI2000Source: http://www3.egee.cesga.es/gridsite/accounting/CESGA/country_view.html

France ranked number 2 for LHC VOs in 2007


France supercomputer capacities

very large boost of France supercomputer capacities in 2008/2009very large boost of France supercomputer capacities in 2008/2009

0

50

100

150

200

250

300

350

400

450

500

MPPSMP

VectorielTotal

GPU

0 19

2 21

0

139

331

7

476

1922007 2008-9


CNRS role in EGEE

• CNRS is convinced that grid computing can lead to very significant breakthroughs in many sciences

• CNRS is therefore heavily involved in the production grid world (partner in DATAGRID, EGEE –I, II, III, EGI_DS)

• CNRS leading Applications workpackage in EGEE (NA4). Very happy and proud to see the very rich coverage (>250 VOs , 12 different scientific domains, 1/3 non LHC) and SA2 (relationship with computing networks)

• Strong role in Operations. Producing central operation tools • No direct involvment in gLite• CNRS has a very active computing science department working

on many aspects of grid computing


Why a Grid Institute

• Grid programs within CNRS reached in 2007 a considerable importance in volume and in impact

• Federate all activities concerning research Grids and production Grids – Better visibility– Better efficiency– Renforce interaction between these two domains

• point for national and international contacts • Act on belhalf of CNRS for all european projects/contracts and for

discussions with French Ministry– CNRS core of the French NGI– Parternship to construct with INRIA and other reserach organisms

involved on research grids and reserach on grids – Partner of all regional initiatives

• « Evangelisation » of new scientific users communities• Animation, training, outreach• Central core of the future French NGI


What is the Grid Institute?

• The Grid Insitute has a dual nature:– A virtual institute federating grid work within CNRS– A real formal CNRS unit « Unité Propre de Service UPS3107 »,

cretaed on Septembre 1st 2007

• As such, the unit has – One director (GW), two deputy directors – 300 k€ annual budget in 2008 (15 k€ operating funds +285 k€ project

related) Operational support for production Grid, some hardware for launching new

nodes Training, outreach, scientific animations

– Personnel : 1 temporary staff

• Formal sigantory to all grid related european contracts (EGEE-III, EGI, EDGES, EELA2)

• Membership : all CNRS personnel having some grid activity!


Participating laboratories

• 30 laboratories:APC, CC_IN2P3, CPPM, CREATIS, LIP, I3S, IBCP, IN2P3_adm,

IPGP, IPHC, IPNL, IPNO, IRISA, IRIT, LABRI, LAL, LAPP, LIFL, LIG, LIP6, LLR, LORIA, LPC Clermont, LPNHE, LRI, IPSL, LPSC, LSIT, Subatech, UREC

– 13 laboratories IN2P3 linked to EGEE/LCG– 11 computing science labs– 5 users labs linkied to earth science, life science – Administrative support

• GDR Architecture Systèmes et Réseaux (ASR)

Total membership of 350 people ! The full mailing list in itself is a new and important asset!


Grid Institute governance

• Steering committee (June 27, 2008)– Chaired by CNRS President (or Director Général)– Membership: directors of all departments scientific departments

and national institutes (IN2P3 and INSU)

• Scientific Council ( September 10, 2008)– Guidance to the steering committee and Grid Institute

management– Formé de hautes personnalités scientifiques étrangères

provenant pour moitié du monde de la recherche sur les grilles et pour moitié des infrastructures de production

• Collaboration board– Formed by the directors of all CNRS labs participating to Grid

Institutes– First plenary meeting Dec 4 in Orsay, next meeting to be

organized before the end of 2008


The Production Grid MoU

• Formally signed on October 7 , 2008• Establishing for two years a National Steering

Committee• The National Steering committee role:

– Defining the French strategy on all aspects of production Grids– Selecting one partner to represent all the others in every major

grid project (CNRS Grid Institute picked up for EGEE-III leading the French JRU, and for EGI_DS)

– Monitoring the national prospective exercice , entrusted to CNRS Grid Insitute, which will lead to a « White paper » end 2008 forling the basis for Grid Production National Action Plan (multiannual human and financial investment plan)

– Coordination with Supercomputer and Research initiatives– Transition to a formal French NGI


The Production Grid national MoU

•Eight signatories :

•Research Ministry

•CNRS

•CEA

•INRIA

•INRA

•INSERM

•CPU

•RENATER


The national exercice prospective under Grid Institute leadership

• Objective : Assess the production grid usefulness in all the various scientific domains. Produce a « White paper » for a mid term investment plan

• 14 Working groups formed in thematic and transverse groups

• Very good spirit: all research organisms involved• Information gathered through reports from EGEE, polls

sent in the scientific community, colloquium held on Oct 6-7

• Colloquium was a good success, very interesting debates and material gathered


National prospective working groups

• Disiciplinary working groups– Earth and Universe– Life sciences (avec d'éventuels sous groupes vu la taille du domaine:

bioinformatique, imagerie, physiologie,...)– Human sciences– Chemistry- Engineering sciences and computing sciences– Physics– Particle and nuclear physics

• Transversal– Data grids– Regional grids, relationship with GRID5000– Relationship with supercomputers -relationship with Large Research Infrastrucures (ESFRI list)– Grid access, users – Relationship with industry


Colloquium conclusions

• More than 1000 respones to the poll representing more than 3000 scientists

• Production grids are well established and heavily used in 4 groups (Life sciences, Earth and Universe, subatomic Physics and fusion)

• Short term uptake in Chemistry, Engineering and computing, Human sciences

• Nothing yet done in Agronomy-Ecology and Physics• In most cases, knowledge of grid technology is limited• But even when knowledge is limited, a huge majority sees large

potential benefits (at the 90% level!)• In all the communities, already very active users producing

science ( usually ~5% level)• 85% of the French subatomic physics community will use Grid as

their everyday tool in 2012• DATA grids are more important than CPU grids• Missing ressources are mostly human


Survey results (I/IV)

Connaissance personnelle des grilles

0,0%

10,0%

20,0%

30,0%

40,0%

50,0%

60,0%

70,0%

80,0%

Nulle Faible Satisfaisante Etendue

Tous

Biologie

Santé

Chimioinformatique

Imagerie médicale

Professionnels de santé

Personal knowledge on grids

None Limited Satisfactory Broad

Utilisation des grilles dans les laboratoires

0,0%

10,0%

20,0%

30,0%

40,0%

50,0%

60,0%

Inexistante Anecdotique Croissante Courante

Tous

Biologie

Santé

Chimioinformatique

Imagerie médicale

Professionnels de santé

Use of grids in the laboratories

None Limited Growing routinely


Hardware needs in life sciences

Besoins de la communauté

020406080

100120140160

Faible ou nul Peuimportant

Important Trèsimportant

no

mb

re d

e ré

po

nse

s

Connection réseau

Calculs sursupercalculateurs

Calculs sur clusters et grillesde PCs

Stockage


Short term Action Plan

• Signature of the MoU on production grids, alllowing the formal establishment of EGEE-III JRU and construction of the French NGI. Leading role in establishing EGI (launch of the EGI location call for proposal)

• Preparation of the French proposal for EGI siting (two sites under consideration (Paris and Lyon)

• Signature of the research GRID MoU. Building up strategic partnership with INRIA

• Gateways between Research/production– Grid Observatory (EGEE-III )– Scientific animations– Middleware diffusion

• Development of the French production grid– New nodes: Bordeaux, Montpellier, Grenoble, Lyon-bio– New grille régional grid : Rhône-Alpes

• Cooperation, Outreach, Training, « evangelisation »


Integration of the Mesocenters into the production Grid

• Definition : mesocenter : Mini supercomputer implanted in a University , usually rather in isolation

• Grid Institute goals:– Interconnect « mesocenters » in the national production grid– Interoperate local grids based on these mesocenters with the

national production grid– Build gateways betweens grids and supercomputers using

mesocenters experience– Promote regional grids around mesocenters


The first EGEE grid node in subsaharian Africa


Conclusion

• France sees Grids as a strategic tool for boosting its scientific potential

• Grid Institute creation in 2007 and MoU signature in 2008 correspond to a boost of these activities

• CNRS Grid Insitute is the key actor at the national level for production Grids

• Good start for NGI thru the MoU. Key particpation in EGI formation. Preparation of French response to EGI siting bid

• Very strong WLCG participation• Boost gateways between the research and production

communities • National prospective exercice bery useful: preparation

of the production grid white paper and investment plan

the french national grid initiative guy wormser grids institute director grid workshop krakow...

Documents

view header

grid institute

grid reserach

grid adventure

computing research

computing sciences

malariato change

footerto change