egee: a grid infrastructure for e-science

EGEE: A Grid Infrastrcuture for e-ScienceFrédéric Hemmer
[email protected]
29-30 October 2007, Rome, Italy
Infrastructures, Services & Applications - October 2007
EGEE-II INFSO-RI-031688
eScience
Science is becoming increasingly digital, needs to deal with increasing amounts of data and computational needs
Simulations get ever more detailed
Nanotechnology – design of new materials from
the molecular scale
Decoding the human genome
measurements
Science is getting more digital world-wide – LHC as example
Accelerating and colliding particles
One of the most powerful instruments ever built to investigate matter
4 Experiments: ALICE, ATLAS, CMS, LHCb
27 km circumference tunnel
Due to start up in 2007
40 Million Particle collisions per second
Online filter reduces to a few 100’s of “good” events per second
recorded on disk and magnetic tape at 200-1,000 MegaBytes/sec and distributed worldwide
~15 PetaBytes per year for all four experiments
Data analyzed by 100s of research groups world wide
Large Hadron Collider
300,000 Chemical compounds:
Data challenge on EGEE,
In vitro
Example: Determining
earthquake mechanisms
magnitude, mechanism
Results
Different location (different part of fault line further south)
Different mechanism
Peru, June 23, 2001
Main trend
The size of data an organization owns, manages, and depends on is dramatically increasing:
Ownership cost of storage capacity goes down
Data generated and consumed goes up
Network capacity goes up
as sciences
Now in 2nd phase with 91 partners in 32 countries
*
Infrastructure operation
Continuous monitoring of grid services & automated site configuration/management
Support >200 Virtual Organisations from diverse research disciplines
Middleware
Implements a service-oriented architecture that virtualises resources
Adheres to recommendations on web service inter-operability and evolving towards emerging standards
User Support - Managed process from first contact through to production usage
Training
240 sites
45 countries
41,000 CPUs
5 PetaBytes
>5000 users
>100 VOs
>100,000 jobs/day
Active VOs
Number of “active” VOs growing steadily!
Turnover: Diff. VOs in last 6 / 12 / 24 months = 83 / 92 / 102
Total VOs: 104 registered, 258 visible
Grid Middleware
Applications access both Higher-level Grid Services and Foundation Grid Middleware
VOs complement gLite with other high-level services via the RESPECT programme
Rec. External Software Pkgs. for the EGEE Community
Identify useful, 3rd-party software that works with gLite
Make users aware of that software to avoid duplicated efforts
Foundation Grid Middleware
Accounting
Middleware Standards
25 projects have registered as of September 2007: web page
Applications
Support Actions
GIN
Worldwide Grids
Business Partners
CEA (France)
CGGVeritas (France)
CRSA (France)
CS-SI (France)
Support Large enterprises
Leads the Industry Forum and organises Industry Events
TID (Spain)
Outreach to Business
Platform Computing
Making gLite middleware better in exploiting the LSF local resources management system
Avanade
Excelian
UK-based Grid Consulting Company for Finance and Energy
Aid in adapting EGEE infrastructure to meet needs of the Finance & energy sectors
Hitachi Sophia-Antipolis Laboratory
Ensure the long-term sustainability of the European e-Infrastructure independent of short project funding cycles
Coordinate the integration and interaction between National Grid Infrastructures (NGIs)
Operate the production Grid infrastructure on a European level for a wide range of scientific disciplines
Must be no gap in the support of the production grid
Summary
EGEE provides a dependable production quality Grid infrastructure to a wide variety of scientific disciplines.
Collaboration and interoperability are key to providing the level of support required by user communities
Grids are increasingly becoming an essential part of the scientific computing infrastructure – sustainability needs to be ensured
Scientific results using grid
Application porting and deployment
EGEE/gLite Middleware
Information Service

egee: a grid infrastructure for e-science

Documents