http:// the wider context of the ngs mike mineter training outreach and education edinburgh...

http://www.ngs.ac.ukhttp://www.nesc.ac.uk/training

The Wider Context of the NGS

Mike MineterTraining Outreach and EducationEdinburgh e-Science

mjm@nesc.ac.uk

3

Contents

• More of the projects and organisations that influence the NGS– EGEE

– OMII-UK

– OMII-Europe

– NextGRID

– ICEAGE

4

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE – international e-infrastructure

• Build, deploy and operate a consistent, robust a large scale production grid service that

– Links with and build on national, regional and international initiatives

• Improve and maintain the middleware in order to deliver a reliable service to users

• Attract new users from research and industry and ensure training and support for them

Network infrastructure& Resource

centres

Op

era

tio

ns

, S

up

po

rt a

nd

tr

ain

ing

Collaboration

Pan-European Grid

7

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE-II: Expertise & Resources

• More than 90 partners • 32 countries• 12 federations Major and national

Grid projects in Europe, USA, Asia

+ 27 countries through related projects:– BalticGrid– SEE-GRID– EUMedGrid– EUChinaGrid– EELA

8

Enabling Grids for E-sciencE

INFSO-RI-508833

EGEE is running…

• … the largest multi-VO production grid in the world!

• What’s happening now?http://gridportal.hep.ph.ic.ac.uk/rtm/

• What resources are connected?http://goc.grid-support.ac.uk/gridsite/monitoring/

9

Enabling Grids for E-sciencE

INFSO-RI-508833

NGS – Some Possible Futures

NGS

EGEE

Campus grids

GridPP

Interoperability

GridPP / NGSConvergence ?

UK & IrelandLCG VO’s

Note: EU-wide progress towards European and National Grid Infrastrustures…

10

Enabling Grids for E-sciencE

INFSO-RI-508833

NGS- adopting VOMS, as used in EGEE grid

Virtual Organization Membership Service

Before VOMS

• User is authorised as a member of a single VO

• All VO members have same rights

• Gridmapfiles are updated by VO management software: map the user’s DN to a local account

• grid-proxy-init

VOMS

• User can be in multiple VOs– Potentially: aggregate rights

• VO can have groups– Different rights for each– Nested groups

• VO has roles– Assigned to specific purposes

E,g. system admin When assume this role

• Proxy certificate carries the additional attributes

• voms-proxy-init• VOMS establishes and

communicates VO credentials… how these are used is service-specific

12

Enabling Grids for E-sciencE

INFSO-RI-508833

GILDA demonstrator and testbed(https://gilda.ct.infn.it)

14

Enabling Grids for E-sciencE

INFSO-RI-508833

Related projects: infrastructure, education, application

Name Description

BalticGrid EGEE extension to Estonia, Latvia, Lithuania

EELA EGEE extension to Brazil, Chile, Cuba, Mexico, Argentina

EUChinaGRID EGEE extension to China

EUMedGRID EGEE extension to Malta, Algeria, Morocco, Egypt, Syria, Tunisia, Turkey

OMII-Europe interoperable, tested, certified middleware

ISSeG Site security

eIRGSP Policies

ETICS Repository, Testing

BELIEF Digital Library of Grid documentation, organisation of workshops, conferences

BIOINFOGRID Biomedical

Health-e-Child Biomedical – Integration of heterogeneous biomedical information for improved healthcare

ICEAGE International Collaboration to Extend and Advance Grid Education

15

OMII-UK: Open Middleware Infrastructure Institute

16

Mind the gap….

Research Pilot projects

Early adopters

Routine production

Researchers are not funded to provide production quality software for others to use

OMII-UK exists to help bridge this gap!

17

Open Middleware Infrastructure Institute

Formed University of Southampton (2004) Focus on an easy to install e-Infrastructure solution Utilise existing software & standards

Expanded with new partners in 2006 OGSA-DAI team at Edinburgh myGrid team at Manchester

To be a leading provider of reliable interoperable and open-source

Grid middleware components services and tools to support

advanced Grid enabled solutions in academia and industry.

18

Activity By providing a software repository of Grid

components and tools from e-science projects By re-engineering software, hardening it and

providing support for components sourced from the community

By a managed programme to contract the development of “missing” software components necessary in grid middleware

By providing an integrated grid middleware release of the sourced software components

What is OMII-Europe?http://wiki.nesc.ac.uk/read/omii-eu-na3?BeijingMarch2007

Mike MineterTraining Outreach Education – National e-Science Centre,

Edinburgh, UKmjm@nesc.ac.uk

21

EU project: RIO31844-OMII-EUROPE

What is OMII-Europe?

• Open Middleware Infrastructure Institute for Europe• European Union funded FP6 project (RI)

– FP: Framework Programme - all research-related EU investment – OMII-Europe is funded from the 6th FP – a ”Research Infrastructure - Integrated Infrastructure Initiative” – Starting May 2006, initial 2 year duration– 16 partners (8 European, 4 USA, 4 Chinese)

• Complimentary to existing national programmes (OMII-UK, NMI, C-OMEGA, OMII-China…)

• Goal is to provide key software components for building e-infrastructures

• Project will demonstrate “proof of concept” with expectation for a follow-on project in FP7

22

EU project: RIO31844-OMII-EUROPE

What will OMII-Europe do?

• Initial focus on providing common interfaces and integration of major Grid software infrastructures

• Common interoperable services:– Data Access, Virtual Organisation Management,

Portal, Accounting, Job Submission and Job Monitoring

– Capability to add additional services• Infrastructure integration

– Initial EGEE/UNICORE/Globus/CROWN interoperability

– Interoperable security framework

23

EU project: RIO31844-OMII-EUROPE

OMII-Europe JRA1 re-engineering activities

OGSA DAI BES VOMS RUSGrid

Sphere

Etc. Identified

Components

EGEE

(GLite)

UNICORE

Globus

Etc. OMII-UK, USA, China

24

NextGRID:Next Generation Grids

Stephen Davey, NeSC, UK

NextGRID Project 11M€ EU FP6 project; 3 years starting September 2004. 22 partners, some industrial, some academic. Developing Architecture for Next Generation Grids. Research and exploration project: A 5-10 year lookout.

www.nextgrid.org

NextGRID Project Vision

Grid offering services

Business focus Grids Applicable to Industry Inter Enterprise Grids

Service Level Agreements & Quality of Service (not

just best effort). Basis in Standards (for interoperability & stability).

Challenges & Experiments Key focus areas:

Service Level Agreements Workflows (across domains) Security Data

Challenges are manifested in NextGRID reference applications: Financial modelling (Implied Volatility, Derivatives Pricing)

Digital media production (On-demand video rendering)

Key components being developed and evaluated.

NextGRID Architecture White Paper Presents the NextGRID Vision and Technical

Challenges, plus future work of the project Architectural Principles

Dynamics, Composition, Infrastructure NextGRID Generalized Specifications and Profiles

http://www.nextgrid.org/download/publications/NextGRID_Architecture_White_Paper.pdf

Contributors & Acknowledgments. Particular thanks to: Malcolm Atkinson (NeSC), David Snelling (Fujitsu), Bryce

Mitchell (BT) NextGRID Architecture WP1 & many others

www.nextgrid.org

32

INFSO-SSA-26637

• Training– Targeted– Immediate goals– Specific skills– Building a workforce

• Education– Pervasive– Long term and sustained– Generic conceptual models– Developing a culture

• Both are needed

Society

Graduates

EducationInnovation

Invests

PreparesCreate

Enriches

Organisation

Skilled Workers

TrainingServices & Applications

Invests

PreparesDevelop

Strengthens

Malcolm Atkinson

International Collaboration to Extend and Advance Grid Education – ICEAGE

International Collaboration to Extend and Advance Grid Education – ICEAGE

33

INFSO-SSA-26637

ICEAGE

• Mission

Stimulate and support advances in grid education throughout Europe

• Goals– Achieve rapid growth in effective advanced grid

education– Make best use of worldwide capacity for advanced grid

education– Deliver a stimulating programme of educational events

Including international summer schools

– Broaden engagement in an advanced grid education both geographically and across disciplines

34

INFSO-SSA-26637

Iceage – Activities• Forum

– International panel of experts to develop curricula, policies & strategies, ontologies

• Support, Outreach, Induction & Training services

– Attracting & Training the Trainers

– Persuading Universities to adopt Grid Computing Curricula

– E-Learning, repository & course scheduling & announcement

• Summer Schools– General

– Specialised – S/W engineering Bio-informatics …

• T-Infrastructure

– A training grid - very different from a production grid• response time vs throughput

• lightweight CA

• middleware agility

• safe and effective play-ground

35

Contents

• More of the projects and organisations that influence the NGS– EGEE

– OMII-UK

– OMII-Europe

– NextGRID

– ICEAGE

• NGS Future Developments

36

NGS middleware: future

• Middleware recently deployed– Portal v2

– GridSAM – alternative job submission and monitoring

• Developed by partners:– Application Hosting Environment: AHE

– P-GRADE portal and GEMLCA

• Being deployed – VOMS support – coupled to developments of support procedures for projects

– WS-GRAM: GT4 job submission

– Resource Broker

• Under development– Shibboleth integration

37

The End

That’s All Folks…

almost!!

38

Feedback

Thanks to EGEE’s GGUS for this picture!!

NGS