the edges project receives community research funding 1 edges bridge technology to interconnect egee...
TRANSCRIPT
The EDGeS project receives Community research funding
1
EDGeS Bridge technology to interconnect EGEE and BOINC
grids Peter Kacsuk
[email protected] SZTAKI
2
The problem we The problem we addressaddress
Desktop grids (DGs)(volunteer DGs – home computers,
organizational DGs – institutional desktops)
• Inexpensive,
• very large number of CPUs (~100K – 1M)
• Bag of task appls
Cluster based service grids (SGs)(EGEE, OSG, etc.)
• Moderately expensive,
• moderate number of sites and CPUs
• any appls
Supercomputer based SGs
(DEISA, TeraGrid)
• Very expensive,
• small number of sites and large number of CPUs
• MPI applsOGF GIN
EDGeS
3
What is EDGeS?What is EDGeS?
EDGeS: Enabling Desktop Grids for e-ScienceEDGeS: Enabling Desktop Grids for e-Science1.1. EDGeS is a 2-year FP7 project started on EDGeS is a 2-year FP7 project started on
the 1the 1stst of January 2008 of January 2008• Research on integrating (bridging) SGs and DGs• Creates infrastructure• Provides services
2.2. EDGeS is an infrastructureEDGeS is an infrastructure• EDGeS VO interconnected with various DGs• Application repository
3.3. EDGeS is a service forEDGeS is a service for• Application porting and validation
4
Project partnersProject partnersPartic. No. Participant name Participant short
nameCountry
1 Computer and Automation Research Institute of the Hungarian Academy of Sciences
MTA SZTAKI Hungary
2 Centro de Investigaciones Energéticas Medio Ambientales y Tecnológicas
CIEMAT Spain
3 Foundation for the Development of Science and Technology in Extremadura
Fundecyt Spain
4 The French National Institute for Research in Computer Science and Control
INRIA France
5 University of Westminster UoW UK
6 Cardiff University CU UK
7 Faculty of Sciences and Technology of the University of Coimbra
FCTUC Portugal
8 Stichting AlmereGrid AlmereGrid The Netherlands
9 Centre National de la Recherche Scientifique - Institut National de Physique Nucleaire et de Physique des Hautes Energies
IN2P3 France
5 v2.0
SG interoperation/interoperability: Task of OGF GIN
EDGeS
gLite(EGEE)
ARC(NorduGrid)
Boinc(Berkeley)
XtremWeb(INRIA/IN2P3)
Xgrid(Apple)
Unicore(DEISA)
VDT(OSG)
Current
Future
Integration of SG and Integration of SG and DG systemsDG systems
Solving the DG-SG Solving the DG-SG • interoperation (EDGeS)interoperation (EDGeS)• interoperability (EDGeS and PGI)interoperability (EDGeS and PGI)
Generic Grid-Grid (3G) Bridge to Generic Grid-Grid (3G) Bridge to integrate SGs and DGsintegrate SGs and DGs
Job
Han
dle
r In
terf
ace
Job sourceBOINC client
Job sourceEGEE GRAM
Job sourcegUSE submitter
Job source PGI client
Job Database
Queue Manager
Gri
dH
and
ler
Inte
rfac
e
DC
-AP
IP
lug
in
Xtr
emW
eb
Plu
gin
EG
EE
Plu
gin
BOINC
EGEE
XtremWeb
BOINC
EGEE
gUSE/WS-
PGRADE portal
3G Bridge
7
Production DGProduction DG--EGEE EGEE InfrastructureInfrastructure
voms
lb wmsbdii
gLite based service grid VO
XtremWeb-EGEEbridge
XtremWeb-based DGs
IN2P3 local DG
(200)
IN2P3 public DG
(300)
AR
UI/bridgeCore
serviceResource
SZTAKI 16 cpus CIEMAT 20 cpus
ce ce
CNRS 1554 cpus
ce ce
BOINC-EGEEbridge
BOINC-based DGs
UoW (1.700), Corr.
Systems (10) local DGs
SZDG (72.000) Almere
(1.000) IberCivis (14.000)public DGs
8
Oct. Nov. Dec. Jan. Feb.
EDGeS VO activity according to EGEE Accounting Portal
CPU > 1 Day/Week
CPU > 1 Month/Week
CPU > 1 Year/Week
9
GlobalDEG
LocalDEG
LocalDEG
LocalDEG LocalDEG
University DG
Volunteer DG
Service Grid
EGEE
EGEE User access to EGEE User access to various gridsvarious grids
EDGeS
Appl. Repository
10
GlobalDEG
LocalDEG
LocalDEG
LocalDEG LocalDEG
University DG
Volunteer DG
Service Grid
EGEE
User access to various User access to various gridsgrids
WS-PGRADE
EDGeS
Appl. Repository
gUSE
Accessing EDGeS by Accessing EDGeS by WS-PGRADE portalWS-PGRADE portal
EDGeS VO
UI machine
WMSMachine
Other EGEEservices
EDGeS CE1 machine
LCG-CE
WN
WN
WNWN
WN
WN
BOINC server
DBQM
DC
-AP
I p
lug
in
QM WS client
QM
EG
EE
plu
gin
JW C
lien
tUI machine
WS
In
terf
ace
WS-PGRADE
gU
SE
D
G
sub
mi
tter
12
Applications ported by EDGeS
ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid
Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)
Video Stream Analysis in a Grid Environment (VISAGE)
Correlation Systems Ltd - Israel
√√ √√
Digital Alias-free Signal Processing
University of Westminster √√ √√
Protein Molecule Simulation using Autodock
University of Westminster √√ √√
E-Marketplace Model Integrated with Logistics (EMMIL)
SZTAKI √√ √√
13
Applications ported by EDGeS
ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid
Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)
Anti-cancer Drug Design (CancerGrid)
SZTAKI √√ √√Cellular Automata based Laser Dynamics (CALD)
University of Seville and University of Westminster
√√ √√
Signal and Image Processing using GT4 Tray
Forschungszentrum Karlsruhe √√
Analysis of Genotype Data (Plink)
Atos Origin √√
14
Applications ported by EDGeS
ApplicationApplication OrganisationOrganisation Runs on Runs on Desktop Desktop GridGrid
Runs on Runs on EGEE EGEE (EDGes VO)(EDGes VO)
Distributed Audio Retrieval using TRIANA(DART)
Cardiff University √√ √√
Fusion Plasma Application (ISDEP)
BIFI √√3-D Video Rendering using Blender
University of Westminster √√
Profiling Hospitals in the UK based on Patient Readmission Statistics
University of Westminster √√
15RI-211727 NA3
version: 1.0IntroductionAuthor: Ad Emmen
NA1: MoUs with other NA1: MoUs with other projectsprojects
Signed MoU with EGEE IIISigned MoU with EGEE IIIJointly select EGEE applications that should be migrated to EDGeS
Collaboration in porting these appls to EDGeS
EGEE support for the establishment and operation of the EDGeS VO
Organizing joint events (summer school, user forum meetings)
Signed MoU with EELA-2Signed MoU with EELA-2
Prepared MoUs with Prepared MoUs with IberCivis DG
SEE-GRID-SCI
Univ. of Houston (Virtual Prairie DG)
15
16
SummarySummary• EDGeS connects EDGeS connects
– BOINC or XtremWeb DGs – and gLite based SGs
• EDGeS is an open infrastructure:EDGeS is an open infrastructure: – Any BOINC or XtremWeb DG can join– Any gLite based SG can join
• Any EGEE user can access EDGeSAny EGEE user can access EDGeS• Any EGEE VO can be extended with DGs Any EGEE VO can be extended with DGs
based on EDGeS bridge technologybased on EDGeS bridge technology• EDGeS helps any EGEE user community in EDGeS helps any EGEE user community in
porting their applications into EDGeSporting their applications into EDGeS
17
For more information please visit the EDGeS Website:
Join the EDGeS User & Industry Forum here!
http://www.edges-grid.eu/
Please contact us if you need support in porting your application to EDGeS!
Email: [email protected]
Thank you for your Thank you for your attention …attention …
Anyquestions?