www.eu-eela.eu e-science grid facility for europe and latin america bridging ourgrid-based and...
TRANSCRIPT
www.eu-eela.eu
E-science grid facility forEurope and Latin America
Bridging OurGrid-based and gLite-based Grid InfrastructuresAbmar de Barros, Adabriand Furtado, Francisco Brasileiro
Universidade Federal de Campina Grande
Laboratório de Sistemas Distribuídos
{abmar,adabriand}@lsd.ufcg.edu.br, [email protected]
www.eu-eela.eu
Motivation
• Interoperation of distinct grid e-infrastructures is regarded as an important asset when seeking a sustainable model for the operation of such systems– Interoperability increases the capacity of the e-
infrastructures – Also allows a significant reduction in the overall
costs of their operation
Choroni, 2nd EELA-2 Conference, 25.11.2009 2
www.eu-eela.eu
Motivation
• The EELA-2 e-infrastructure allows resource centres to provide both dedicated resources and shared resources in an unique organisation– The service part runs gLite– The opportunistic part runs OurGrid
• It is natural that we investigate alternatives to interoperate these two parts of thee-infrastructure
Choroni, 2nd EELA-2 Conference, 25.11.2009 3
www.eu-eela.eu
So much to say …… so little time!! :-(
• They say “a picture is worth 1,000 words” …• ... so, let me try to summarise what we did in
9,000 frames– http://www.youtube.com/watch?
v=Q1WZjONEjKk
Choroni, 2nd EELA-2 Conference, 25.11.2009 4
www.eu-eela.eu
The gateway components
Choroni, 2nd EELA-2 Conference, 25.11.2009 7
www.eu-eela.eu
Bridging from OurGrid to gLite
• A modified version of OurGrid worker represents gLite resources
• This worker is responsible for forwarding the job execution to the bridge, targeting it to gLite back-end
• It also manages all the job life-cycle using the gateway, obtaining transparency from the perspective of an OurGrid user
• The gLite plug-in submits the job to a gLite WMS and monitors its execution
Choroni, 2nd EELA-2 Conference, 25.11.2009 8
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 9
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 10
OGJob
An OurGrid Job is submitted in the Broker.
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 11
OGJob
The worker, instead of executing the job, forwards it to the gateway.
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 12
GatewayJob
The gateway DB stores the job in a canonical format in order to be executed in the destination grid.
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 13
GatewayJob
The engine retrieves new jobs from the database and routes them to their destination grid plug-in.
www.eu-eela.eu
Bridging from OurGrid to gLite
Choroni, 2nd EELA-2 Conference, 25.11.2009 14
gLiteJob
The gLite plug-in creates a gLite version of the job and submits it to a gLite WMS
www.eu-eela.eu
Bridging from gLite to OurGrid
• Transparency of job submission in this way is obtained by modifying a gLite CREAM CE (Computing Element)
• Instead of forwarding jobs to worker nodes, this CE submits jobs and manages their execution in the gateway
• The OurGrid plug-in submits the jobs to OurGrid system through the Broker as if they had been submitted by an user
Choroni, 2nd EELA-2 Conference, 25.11.2009 15
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 16
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 17
gLiteJob
A gLite user submits a job through an User Interface.
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 18
gLiteJob
This job eventually reaches the modified gLite CE that, instead of executing it in the worker nodes, forwards it to the gateway.
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 19
GatewayJob
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 20
GatewayJob
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 21
OGJobAn OurGrid Job is then created and submitted to OG system through a Broker
www.eu-eela.eu
Bridging from gLite to OurGrid
Choroni, 2nd EELA-2 Conference, 25.11.2009 22
OGJob
This job is executed in an OurGrid Worker as if an ordinary OurGrid user has submitted it.
www.eu-eela.eu
Crossing credentials
• Security is a main issue regarding grid computing
• Both OurGrid and gLite use credentials in order to:– Authenticate them against Certification Authorities– Authorize through VOMS servers
• The gateway job format provides a field indicating user credentials
• The plug-ins use these credentials on job submission, acting on behalf of the user who actually submitted the job
Choroni, 2nd EELA-2 Conference, 25.11.2009 23
www.eu-eela.eu
Summary of achievements
• A Java implementation of the 3g-bridge is currently deployed in the EELA-2 certification infrastructure– Plug-ins for both gLite and OurGrid
• Initial testing campaign is under way• A C++ implementation of the OurGrid plug-in is
currently being tested by the EDGeS team
Choroni, 2nd EELA-2 Conference, 25.11.2009 24
www.eu-eela.eu
Thanks for your attention!
• More details about this work can be found at:– http://www.eu-eela.eu/– http://www.ourgrid.org/– http://redmine.lsd.ufcg.edu.br/projects
• Contact me at:– [email protected]
Choroni, 2nd EELA-2 Conference, 25.11.2009 25