introduction to ws-pgrade and guse tutorial akos balasko [email protected] 04/17/2012 1
TRANSCRIPT
2
P-GRADE Portal software family
P-GRADE Portal2.4
NGS P-GRADE portal
P-GRADE Portal2.5
P-GRADE Portal2.8
P-GRADE Portal2.9.1
WS-PGRADE Portal 3.1
WS-PGRADE Portal 3.2
GEMLCAGrid Legacy Code Arch.
GEMLCA, storage concepts
Basic concepts
2008
2009
2010
WS-PGRADE Portal 3.3
P-GRADE Portal2.10
Open source from 2008
stats:
2011
Recent and planned WS-PGRADE releases
• Nov 2012: v3.4 with DCI Bridge• Feb 2012: v3.4.1 with usage statistics portlet• March 2012: v3.4.2 with support for new EMI
release
• March 2012: v3.4.3 with support for Liferay 6.1• April 2012: v3.4.4 with SHIWA repository
support• May 2012: v3.4.5 with support for CloudBroker
SaaS
4
P-GRADE Portals around the globe
National Grid portals (UK, Ireland, Croatia, Turkey, Spain, Belgium, Malaysia , Kazakhstan, Switzerland, Australia, ClGrid, etc.)
HP-SEE/SEE-GRID-SCI, BalticGrid
US Open Science Grid, TeraGrid
IDGF (International Desktop Grid Federation)
SHIWA Simulation Platform
Economy-Grid, Swiss BioGrid, Bio és Biomed Virtual Organisations, MathGrid, etc.
HP-SEE
5
Motivations of creating gUSE
To overcome (most of) the limitations of P-GRADE portal:
To provide better modularity to replace any service
To improve scalability to millions of jobsTo enable advanced dataflow patternsTo interface with wider range of resourcesTo separate Application Developer view from
Application User view
WS-PGRADE (Web Services Parallel Grid Runtime and Developer Environment)
and gUSE (Grid User Support Environment) architecture
6
gUSE and WS-PGRADE architecture (v3.3.x)
Graphical User Interface: WS-PGRADEGraphical User Interface: WS-PGRADE
WorkflowEngine
WorkflowEngine
Workflowstorage
Workflowstorage File
storage
Filestorage
Applicationrepository
Applicationrepository
LoggingLogging
gUSEinformation
system
gUSEinformation
system
SubmittersSubmitters
Gridsphere LIFERAY Large set of portlets
Autonomous Services: high level
middleware service layer
Resources: middleware service layer
Local resources, service grid VOs, Desktop Grid resources, Web services, Databases
Local resources, service grid VOs, Desktop Grid resources, Web services, Databases
gUSE
Meta-brokerMeta-broker SubmittersSubmittersSubmittersSubmitters
Filestorage
Filestorage
SubmittersSubmitters
gUSE and WS-PGRADE architecture (v3.4.x)
gUSE and WS-PGRADE architecture (v3.4.x)
WFGraph editor
Liferay
WS-PGRADE
portal
Information System
WF Storage
File Storage
Application Repository
WF Interpreter
Backend
DC
I-B
ridge
Client machine
Portal Server machine
DCIs
BES interface
9
WS-PGRADE/gUSE main features
• Creating complex workflow and parameter sweeps
• Seamless access to various types of resources• clusters, • service grids, • desktop grids, • databases.
• Scalable architecture• Advanced data-flows and workflow concept• Creating complex applications using embedded
workflows, legacy codes• Comfort features
• Separated views for application developers and end-users
• Community components from workflow repositorywww.wspgrade.hu
10
WS-PGRADE in a nutshell
General purpose, workflow-oriented portal. Supports the development and execution of workflow-based applications
Based on Liferay
Services supported by the portal:
New functionalitiesWeb services
DB connectors
Embedded workflows
Job level PS
Conditional jobs
Multi-generator
Multi-collector
CROSS product PS
DOT product PS
Simultaneous use of various clusters, service and desktop Grids at workflow level
Basic Services EGEE grids
(LCG2,GLite)
Globus grids
(GT2,GT4)
Desktop
grids
clusters
Job execution
File storage
Certificate management
Information system
Brokering
Job monitoring
Workflow & job visualization
11
How to build a science gateway?
There are two basic options:1. Build from scratch
• Long time to produce a robust gateway• Requires substantial manpower and
development cost2. Adapt and customize an existing gateway
technology• Significantly reduces development time• Produces a robust and usable service• WS-PGRADE/gUSE provides the
required core gateway and customization technology
12
Main objectives of this tutorial
1. To show how to use the WS-PGRADE portal to develop and run DCI applications
2. To show how to run workflow applications on various DCIs in a seamless way
3. To show how to use the WS-PGRADE/gUSE framework as a generic-purpose gateway technology
4. To show how to create an application-specific gateway based on the WS-PGRADE/gUSE framework
13
Thank you for your attention!
Questions?
http://www.lpds.sztaki.hu/products/guseSpecial thanks to Peter Kacsuk (MTA SZTAKI)
for the slides