1 idgf international desktop grid federation how can you benefit from joining idgf? hannover,...
TRANSCRIPT
1
IDGFIDGF
IInternationalnternational DDesktopesktop GGridrid FFederationederation
How can you benefit from joining IDGF?How can you benefit from joining IDGF?
Hannover, 17.08.2011Hannover, 17.08.2011
Peter Kacsuk, MTA SZTAKI, [email protected] Kacsuk, MTA SZTAKI, [email protected]
EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556.EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556.
2EDGI NA2 20/04/23 2
IDGF in a nutshellIDGF in a nutshell
Objectives– Build a community of those people who are
interested in any form of desktop grids including
• Different technology developers and users (BOINC, Condor, XtremWeb, OurGrid, etc.)
• Service grid providers who would like to extend their resources with DG resources
• Scientists who want to build campus grid
– Create forum for this community
3EDGI NA2 20/04/23 3
How to get benefit of joining IDGF?How to get benefit of joining IDGF?
Different type of communities can get different kind of benefits
In order to understand the potential benefits first we summarize the potential business models of using DG systems
4EDGI NA2 20/04/23 4
Typical current business model for Typical current business model for volunteer desktop grids volunteer desktop grids
VDG
DG project administrator defines the input data to be processed by the appl
BOINC project runs 1 appl that runs for years
5EDGI NA2 20/04/23 5
Superlink@Technion business model for Superlink@Technion business model for volunteer desktop grids volunteer desktop grids
VDG
• Many end-users can access the project via a web interface
• end-users define the input data to be processed by the appl
Portal• BOINC project runs one appl (genetics research)
• The appl runs if a user gives input data
6EDGI NA2 20/04/23 6
EDGeS, DEGISCO and EDGI business EDGeS, DEGISCO and EDGI business model for volunteer desktop grids model for volunteer desktop grids
VDG
• Many end-users can access the project via a web interface
• end-users define the input data to be processed by the appls
Portal• BOINC project runs several appls
• An appl runs if a user gives input data
7EDGI NA2 20/04/23 7
DEGISCO business model for volunteer DEGISCO business model for volunteer desktop grids desktop grids
VDG
• Many end-users can access the project via a web interface
• end-users define the input data to be processed by the appls
Portal• BOINC project runs several appls
• An appl runs if a user gives input data
DEGISCO provides SG VO resources
SG VO
8EDGI NA2 20/04/23 8
EDGI business model for volunteer EDGI business model for volunteer desktop grids desktop grids
VDG
• Many end-users can access the project via a web interface
• end-users define the input data to be processed by the appls
Portal• BOINC project runs several appls
• An appl runs if a user gives input data
EDGI provides cloud resources for QoS
Cloud
9EDGI NA2 20/04/23 9
EDGI business model for volunteer EDGI business model for volunteer desktop grids desktop grids
VDG
• Many end-users can access the project via a service grid VO UI
• end-users define the input data to be processed by the appls
• BOINC project runs several appls
• An appl runs if a user gives input data
EDGI provides cloud resources for QoS
SG VO
Cloud
10EDGI NA2 20/04/23 10
Benefits for potential Benefits for potential DG communitiesDG communities
Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg
Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg
IDGFIDGF
IInternationalnternational DDesktopesktop GGridrid FFederationederation
11EDGI NA2 20/04/23 11
Benefit for new volunteer BOINC Benefit for new volunteer BOINC systemssystems
It takes several years until a new volunteer BOINC system can collect substantial number of resources
IDGF will give access to the large set of SG VO resources that were created in the EDGeS and later in the DEGISCO project
It contains ~2000 computers
12EDGI NA2 20/04/23 12
Extending current business model of Extending current business model of volunteer desktop grids with the DEGISCO volunteer desktop grids with the DEGISCO business modelbusiness model
VDG
DG project administrator defines the input data to be processed by the appl
BOINC project runs 1 appl that runs for years
SG VO
The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support a VDG
13EDGI NA2 20/04/23 13
Supporting many volunteer desktop grids Supporting many volunteer desktop grids by the DEGISCO business modelby the DEGISCO business model
VDG
SG VO
The SG VO maintained by DEGISCO (and later by IDGF) provides ~2000 computers to support VDGs
VDG
14EDGI NA2 20/04/23 14
Desktop Grid VO Desktop Grid VO Statistics
15EDGI NA2 20/04/23 15
16EDGI NA2 20/04/23 16
17EDGI NA2 20/04/23 17
Examples of volunteer BOINC systems Examples of volunteer BOINC systems supported by the DEGISCO business supported by the DEGISCO business modelmodel
SLinCA@home (Ukraina) Yoyo@home (Germany) IberCivis (Spain and Portugal) CAS@home (China) Optima@home (Russia) Poem@home (Germany) Univ. of Westminster Campus Grid (UK)
18EDGI NA2 20/04/23 18
SLinCA@home (over 1 TFlop/s)
19EDGI NA2 20/04/23 19
Yoyo@home (over 1 TFlop/s)
20EDGI NA2 20/04/23 20
21EDGI NA2 20/04/23 21
Attracting more participants for Attracting more participants for volunteer desktop gridsvolunteer desktop grids
EDGI introduces a new architecture where desktop grids (BOINC, XtremWeb) can be extended with cloud resources for QoS
However, in order to get cloud resources the user needs credits
In order to collect credit either the user or her organization should provide resources for volunteer DGs belonging to IDGF
If you joined to IDGF those who would like to earn more credit will support your DG system
22EDGI NA2 20/04/23 22
Benefits for those who would like to Benefits for those who would like to build a campus gridbuild a campus grid
There are several technologies (BOINC, Condor, OurGrid, XtremWeb, etc.) to build a campus grid
IDGF provides forum to– discuss and compare these technologies– make them popular to the scientific communities– elaborate the interconnection methods of campus grids built
on these technologies IDGF provides support to build the campus grid
– Technology selection support– Installation, configuration and testing support– User interface (e.g. portal) provision support– Application porting support
23EDGI NA2 20/04/23 23
Benefits for those who would like to Benefits for those who would like to port applications to DG systemsport applications to DG systems
Porting applications to volunteer DG is not easy IDGF members have expertise in this field and can
provide support for newcomers– Application porting technology selection support– Providing best practice case studies of application porting– Assistance in porting an application
24EDGI NA2 20/04/23 24
Application porting experience in Application porting experience in EDGIEDGI
Application Organization Status
CORSIKA: Cosmic Ray Simulation
Karlsruhe Institute for Technology, UoW
Ported to BOINC, in AR, validated , deployed at UoW
BWA: alignment of DNA sequences
Academic Medical Center of the University of Amsterdam, UoW
Ported to BOINC, in AR, validated, deployed at AMC and UoW
AutoDock Vina: molecular docking
University of Westminster
Ported to BOINC, in AR, under validation, deployed at UoW
GATE: Hadrontherapy simulation
Creatis CNRS, SZTAKI
Ported to BOINC, in AR, under validation
25EDGI NA2 20/04/23 25
Application porting experience in Application porting experience in EDGIEDGI
Application Organisation Status
Conformer Generator (Tinker), molecular modelling
Biological Research Center (BRC) of the Hungarian Academy of Sciences, SZTAKI
Ported to BOINC, in AR, under validation
Classification: R based classification of patients
Academic Medical Center of the University of Amsterdam, UoW
Ported to BOINC, in AR, under validation, deployed at UoW
Mental Ray: commercial rendering engine
University of Westminster
Ported to BOINC, in AR, under validation, deployed at UoW
Guineapig++: simulate beam-beam interactions in high-energy colliders
CNRS/IN2P3 Ported to XW HEP, in AR, under validation, deployed at IN2P3
26EDGI NA2 20/04/23 26
Ported applications available @ EGI AppDB
27EDGI NA2 20/04/23 27
Benefits for those who would like to Benefits for those who would like to extend SG VO with DGextend SG VO with DG
The EDGI business model and architecture is a good example how to extend a SG VO with DGs
Small SG VOs can get additional resources for parameter sweep (PS) applications
IDGF members have expertise in this field IDGF provides support to extend a SG VO with DGs
– Technology selection support– Installation, configuration and testing support– User interface (e.g. portal) provision support– Application porting support
28EDGI NA2 20/04/23 28
Balanced usage of SG and DG systems Balanced usage of SG and DG systems within a countrywithin a country
With the technology provided by EDGI and DEGISCO processing load can be transferred towards the less loaded systems– Overloaded SGs can transfer jobs to DGs– Overloaded DGs can transfer WUs to SGs
29EDGI NA2 20/04/23 29
Benefit for technology and application Benefit for technology and application developer organizations of the European developer organizations of the European Chapter Chapter
IDGF will participate in FP7 and FP8 EU projects The work allocated for IDGF in these projects will be
distributed among the member organizations of the European Chapter
To take IDGF as partner in EU projects will be attractive since IDGF will represent a large community (see the HealthGrid experience)
30EDGI NA2 20/04/23 30
ConclusionsConclusions
Joining IDGF is worth for both SG and DG community members
DG community members can extend their DG with SG resources
SG community members can extend their SG VO with DG resources
Both communities can get application porting support
IDGF can significantly impact the community and can attract additional financial resources
31
http://http://
desktopgridfederation.desktopgridfederation.eueu
Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg
Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/Globe.svg
IDGFIDGF
IInternationalnternational DDesktopesktop GGridrid FFederationederation