Globus and gLitePlatforms

…

Outline

�gLite introduction

�services

�functionality

�Globus ToolKit overview

�components

�architecture

gLite - middleware

�a layer between services and resources

gLite – simple view

Security Service

Job

Management

Monitoring

and

Discovery

Data

Management

High-level

Applications and Tools

gLite - services

� Security Service

� Job Management

� Monitoring and Discovery

� Data Management

� High-level Applications and Tools

gLite - access

Two ways: CLI and API (WEB)

gLite - Security

gLite - Security

�Authentication

�identify entities

�uses:

�PKI (X.509) infrastructure with CA third party for signature

�MyProxy mechanism -> VOMS

�Authorization

�allows or denies access to specific services

�VOMS – virtual organisation membership service

gLite – information services

�critical grid service

Information & Monitoring (BDII)

�Berkeley Database Information Index (BDII)

�The information hierarchically stored via tree modeling (The LDAP implementation of GLUE)

�GRIS Stores information at resource level

�GIIS Stores information at site level

�BDII Stores information at VO level

Information & Monitoring (BDII)

GIIS

INFN sez. CT

GIIS

Merida (gilda)

GRISes GRISes

Other GIIS

(gilda)

GRISes

BDII (gilda)

Globus

MDS

VO Level

Site Level

Resource Level

gLite – Job Management

gLite - Accounting

� Accumulates information about the resource usagedone by users or groups of users (VOs).

� Information on Grid Services/Resources needs sensors(Resource Metering, Metering Abstraction Layer, Usage Records).

� Records are collected by the Accounting System(Queries: Users, Groups, Resource)

� Grid services should register themselves with a pricing service when accounting for billing purposes.

gLite - WMS

� WMS set of middleware components responsible of distribution and management of jobs across Grid resources.

� Two core components of WMS:

� WM: accepts and satisfy requests for job management.Matchmaking is the process of assigning the best available resource.

� Logging & Bookeeping : keeps track of job execution in term of events: (Submitted, Running, Done,...)

gLite – Computing Element

� Service that represents the computing resource that is responsible of the job management: (submission, control, etc.)

� The CE may be used by a Generic Client: an end-user interactingdirectly with the Computing Element, or the Workload Manager, which submits a given job to an appropriate CE found by a matchmakingprocess.

� Two job submission models (accordingly to user requests and site policies):

� PUSH (Eager Scheduling) (jobs pushed to CE),

� PULL(Lazy Scheduling) (jobs coming from WMS when CE has free slots)

� CE responsible to collect accounting information.

gLite – Data Management

gLite – Storage Element

� SE Services are at least:

� Storage back-end (Drivers and Hardware)

� SRM Interface (Storage Specific: dpm, rfio, …)

� Transfer service (Protocols: GridFTP(gsiftp), glubus-url-copy, …)

� Native POSIX like file I/O API (GFAL)

� Auxiliary Accounting and Logging services (accounting: SAGE)

Data are stored on Disk Pool Servers or Mass Storage Systems

gLite - Catalog

� OS like file access metaphor.

�LFN (Logical file name)

�GUID (Grid unique identifier)

�SimLinks

�SURL (Site URL)

�TURL (Transfer URL)

gLite - Functionality

� Grid Access� User Iinterface

� Info system

� Security

� MyProxy (Normal, Long term)

� VOMS

� Job submission� WMS

� Computing Element

� Worker Node

� Data management� Catalogs

� Storage elements

BDII

gLite – job workflow

Documentation

�gLite Home Page�www.glite.org

�gLite Architecture �https://edms.cern.ch/file/476451/1.0/architectur

e.pdf

�gLite Architecture Design v 1.5�https://edms.cern.ch/file/606574/1.0/design.pdf

Globus ToolKit - Overview

�Components

�execution management

�data management

�monitoring and discovery

�security

�user interface

�Architecture

�SOA compatible

GT – Execution Management

�GRAM (Grid Resource Allocation Management)

�job submission

�job interaction

�job status

�credential delegation

�related software and tools

�DagMAN, Condor-G, Nimrod-G, MPICH-G2

GT – Data Management

�GridFTP

�Reliable File Transfer Protocol

�Replica Location Service

�Data access and integration

GT – Monitoring and discovery

�MDS4

�Aggregators and Information Sources

�Information Sources and RegistrationBuilt-In

�Information Sources and MDS-Index Services

�Earth System Grid using MDS

�http://www.earthsystemgrid.org/

GT - Security

�Authentication and Authorization

�similarities with gLite Auth&Authz

�Credential Services

�MyProxy

�SimpleCA

�GSI-OpenSSH

GT - Architecture