progress grid access environment for sun computing cluster

27
PIONIER 2003, PIONIER 2003, Poznan, 11.04.2003, Poznan, 11.04.2003, PROGRESS PROGRESS Grid Access Environment for SUN Grid Access Environment for SUN Computing Cluster Computing Cluster Poznań Supercomputing and Networking Center Poznań Supercomputing and Networking Center Cezary Mazurek Cezary Mazurek

Upload: irish

Post on 23-Jan-2016

51 views

Category:

Documents


0 download

DESCRIPTION

PROGRESS Grid Access Environment for SUN Computing Cluster. Poznań Supercomputing and Networking Center Cezary Mazurek. PROGRESS. Duration: December 2001 – May 2003 Deployment: June 2003-December 2003 Project Partners SUN Microsystems Poland PSNC IBCh Poznań Cyfronet AMM, Kraków - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSGrid Access Environment for SUN Grid Access Environment for SUN

Computing ClusterComputing Cluster

Poznań Supercomputing and Networking CenterPoznań Supercomputing and Networking Center

Cezary MazurekCezary Mazurek

Page 2: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Duration: December 2001 – May 2003 Deployment: June 2003-December 2003 Project Partners

SUN Microsystems PolandPSNC IBCh PoznańCyfronet AMM, KrakówTechnical University Łódź

Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

Page 3: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Project is testbed oriented Three bioX applications will be enabled within

the grid-portal architectureTwo of them are already available

Distributed cluster of SF6800 is a pilot testbed installationDedicated channels through PIONIER network (1 Gb/s)

will come in the 3Q2003 Tools and services for grid processing and data

management in PROGRESS grid-portal framework

Page 4: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS ArchitectureArchitecture

Page 5: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Pilot installation Poznan-Krakow3 SUN Fire 6800

• Poznań: SUN Fire Link

2 Data ServersFront-end for portal access

Distributed processing in distributed framework

Page 6: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS - ApplicationsPROGRESS - Applications

DNA Assembly BranchBound1 DNA Assembly Heuristic2 DNA Assembly Heuristic3 Prediction of protein secondary structure - module A1 Prediction of protein secondary structure - module A2 Prediction of protein secondary structure - module B Prediction of protein secondary structure - module C Prediction of protein secondary structure - module D

Logical workflow applications:• LAD – learning: A1->B->C• LAD – testing: A2->D

Page 7: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS HPC WindowPROGRESS HPC Window

GRID user interfaces are independent of the information processing layer bioX computational portalMigrating Desktop application

PROGRESS computational portalAccessing applications collected in the application

factoryForming and running jobs Accessing data stored in the Data Management SystemProviding information services

Page 8: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

Content P

rovider

Webservice

Session B

ean

Entity B

eans

SOAP

SOAP/XML

ComputingPortal

GRID Service Provider

Content ProviderData presentationUser interaction

Service ProviderRealization of

services functionsServices data storage

and access

Page 9: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

4 – tier architecture for grid-portal environment

Page 10: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS CommunicationCommunication

SGESGE

HTTP/HTTPSHTTP/HTTPS

DataManagement

GLOBUSGLOBUS

Po

rtal

GridBroker

CORBA

Web

serv

ice

FTP

HTTP/HTTPS

Service Provider

Grid F

TP

Webservice

Page 11: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Service ProviderPROGRESS Service Provider

Page 12: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Grid BrokerPROGRESS Grid Broker

Page 13: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS Grid brokerPROGRESS Grid broker

Grid Broker in Progress:Job submission, monitoring and controllingDifferent scheduling and resource

management strategiesFlexible job description language (XRSL)Heterogeneous and service based

environment

Page 14: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS Data Management SystemData Management System

INTERNET

DBFile System

Data Broker

Data Storage

Mirror & Proxy

Data Storage Data Storage

MetadataManagement

SRS

UniTree

WS

GASSFTPGrid FTP(...)

Clients

PortalPortal

Grid brokerGrid broker

Migrating desktop

Migrating desktop

Page 15: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSData Management SystemData Management System

Provides seamless access to data and information for grid computing

Uses metadata repository for describing stored data

Stores data on various media such as files, tapes and databases

Page 16: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS SecurityPROGRESS Security

Intrusion Detection and Security Management SystemReliable and dynamic information sourcesPossibility to automatically react to detected

attacksPossibility to apply different analysis methodsModular architecture

Page 17: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

PROGRESS at Supercomputing 2002, Baltimore, USAPROGRESS at Supercomputing 2002, Baltimore, USA

Page 18: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESSPortalPortal

Page 19: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job listPROGRESS – job list

Page 20: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job menuPROGRESS – job menu

Page 21: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – job tasksPROGRESS – job tasks

Page 22: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – task requirementsPROGRESS – task requirements

Page 23: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – data managementPROGRESS – data management

Page 24: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS – application PROGRESS – application factoryfactory

Page 25: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS - newsPROGRESS - news

Page 26: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESSPROGRESS

ConclusionsThe PROGRESS project has provided some

components and services for flexible grid-portal environment, which might be deployed in other projects and environments

PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security

Page 27: PROGRESS Grid Access Environment for SUN  Computing Cluster

PIONIER 2003,PIONIER 2003,Poznan, 11.04.2003,Poznan, 11.04.2003,

PROGRESS PROGRESS

http://progress.psnc.pl/

http://progress.psnc.pl/portal

[email protected]