20 july 2005 1 open science grid operating the open science grid doug olson, lbnl osg consortium...

20 July 2005 1

Open Science Grid

Operating the Open Science Grid

Doug Olson, LBNLOSG Consortium Meeting

Milwaukee, WI

20 July 2005

20 July 2005 2

Open Science Grid

Operating OSG, Olson, Milwaukee

Contents

• The roles• The players• The script

– Infrastructure services– Service desk functions– Engineering functions

• Examples of some key scenes• Acknowledgements • How to get your tickets

20 July 2005 3

Open Science Grid


The Roles

OSG Doc 47

LogicalView

Users (scientists, students, engineers, …) and

Applications

e.g. VDT (Globus,

Condor, …)

Compute, storage, (network in future)

Catalog, discovery, identity,

brokering, …

(see later slides)

20 July 2005 4

Open Science Grid


Roles (II)Physical

View

Real support organizations

often play multiple roles

Lines represent communication paths and, in our model, agreements.

We have not progressed very far with agreements yet.

Gray shading indicates that OSG Operations composed of effort from all the support centers.

20 July 2005 5

Open Science Grid


Roles (III)Physical

ViewHave recognized need for general open support, but no one is contracted to provide it, so a “best effort” community support activity has started and is still taking shape.See Fred Luehring & Burt Holzman.

Community Support

20 July 2005 6

Open Science Grid


The Players (I)(partial list of support centers, span labs and universities,

formed or forming as of 7/19/05)

Support Center Problem Reporting Address Community Supported

BNL/USATLAS [email protected] US ATLAS users, Tier1 & Tier2 centers

Fermilab [email protected] Virtual Organization (VO), Fermilab User VOs (non-CMS and non-SDSS), FermiGrid Sites, Fermilab OSG Services (DNS, Mailists and Web Portal)

GRASE [email protected] GRASE-CCR-ACDC, GRASE VO

iGOC [email protected] iVDGL, OSG Operations

LIGO [email protected] LIGO Scientific Collaboration

NERSC [email protected] PDSF facility and users, STAR

PROD_SLAC [email protected] SLAC facilities, BaBar, partial ATLAS & CMS VOs

UC CI [email protected] Teraport, best effort for OSG VOs

US CMS [email protected] US CMS VO,RPs: CMS farms at FNAL, UCSD, UW, Caltech, UFL, Purdue, MIT, UNL

VDT [email protected] VDT software distribution

Community Support Center

[email protected] any OSG participant

20 July 2005 7

Open Science Grid


The Players (II)(list of registered VOs as of 7/19/05)

VO User Support URL

ATLAS [email protected], https://cts.acf.bnl.gov/NoAuth/Submit_Problem_menu.html

iVDGL http://igoc.ivdgl.indiana.edu/

GRASE [email protected]

LIGO [email protected]

MIS http://igoc.ivdgl.indiana.edu/

SDSS [email protected]

STAR [email protected], http://www.star.bnl.gov/STAR/comp/Grid/

US CMS [email protected], http://www.uscms.org/SoftwareComputing/Grid/

other [email protected], http://www.uscms.org/SoftwareComputing/Grid/

20 July 2005 8

Open Science Grid


Guidance

Tables in preceeding

slides provide

guidance to people

looking for assistance

on the support web

pages.

20 July 2005 9

Open Science Grid


Infrastructure

VO Support Center

RP Support Center

Service Support Center - grid services

Service Support Center - middleware

Operations Support Center

Support ServicesEngineering

Infrastructure

trouble ticketing system and interface among systems

monitoring tools development and provisioning

accounting services provisioning

discovery services provisioning

identity services

grid information index

gridcat

VOMS

knowledgebase

mailing lists

web and information repositories

OSG Operations -Services and Providers

20 July 2005 10

Open Science Grid


Service Desk

VO Support Center

RP Support Center




Support Services

Service Desk

faciliate and support communications

coordinate and track problems and security incidents

coordinate and track requests for assistance

respond to problems, security incidents, and requests for assistance

publish status, activity, accounting, and problem management reports

maintain a repository of support, process, and policy information

schedule and coordinate grid service and middleware changes

monitor the status of grid resources

monitor policy compliance


20 July 2005 11

Open Science Grid


Engineering VO Support Center

RP Support Center




Support ServicesEngineering

maintain grid-controlled software packages and cache

provide common grid software not supported through VDT

verify software compatibility

provision releases of OSG middleware

provide site installation and configuration support

provide ease-of-installation tools

develop instructions on how to plug things together

troubleshoot grid service failures

troubleshoot application failures

provide and maintain common grid services

provide development guidance and assistance

provide specialized services for VO's and applications

create APIs to information resources

liaison middleware and application developers


20 July 2005 12

Open Science Grid


Trouble Ticket System• Used by IU Global NOC & Grid3, now in production for OSG

People from most support centers do/will have accounts and can assign tickets directly to appropriate SC.All support centers will be known to the system.

20 July 2005 13

Open Science Grid


Provisioning Activity• Leigh Grundhoefer, Dane Skow, co-chairs• Guided (pushed, trimmed, hammered, …) initial OSG software release• A major piece of work!• Future releases will be provisioned ( hopefully with less effort.)

20 July 2005 14

Open Science Grid


Problem trackingProblems, issues, open trouble tickets are discussed in a regular teleconference.The associated email list is [email protected].

20 July 2005 15

Open Science Grid


Acknowledgements

Abhishek Singh Rana

Adam Walters

Alain Roy

Alan Sill

Alex Sim

Alistair Mills

Bockjoo Kim

Bruce Gibbard

Dane Skow

Doug Olson

Doug Pearson

Frank van Lingen

Fred Luehring

Holzman, Burt

Ian Fisk

Jeff Weber

Jim Shank

John Huth

John Rosheck

Jon Bakken

Jorge Rodriguez

Keith Chadwick

Leigh Grundhoefer

Lisa Giacchetti

Lothar Bauerdick

Mark Kaletka

Markus Schulz

Paul Avery

Razvan Popescu

Rick Thies

Rob Gardner

Rob Quick

Ruth Pordes

Stan Naymola

Vicky White

Abhishek Rana

Bockjoo Kim

Booker Bense

Craig Prescott

Dan Bradley

Dan Yocum

Dane Skow

Doug Olson

Doug Pearson

Frederick Luehring

Fu-Ming Tsai

Gabriele Carcassi

Gabriele Garzoglio

GOC

Holzman, Burt

Horst Severini

Iwona Sakrejda

Jason A. Smith

Jeff Weber

John Rosheck

Karthik Arunachalam

Kyle Gross

Lawrence Sorrillo

Leigh Grundhoefer

Lisa Giacchetti

Matt Allen

Matteo Melani

Neha Sharma

Patrick McGuigan

Ping Yeh

Preston Smith

Razvan Popescu

Rob Quick

Ruth Pordes

Stephen Simms

Steven Timm

Suresh Singh

Thomas Wang

Young, Charles C.

Support Centers TG Operations Activity

chairs

20 July 2005 16

Open Science Grid


To get Your tickets:

1. Register your resource, service, VO, and/or support center.

0. (You already read How to Participate with OSG.)

2. Sign up on the appropriate email lists.3. See Rob Quick’s talk tomorrow.

20 July 2005 17

Open Science Grid


But the end of my talk

20 july 2005 1 open science grid operating the open science grid doug olson, lbnl osg consortium...

Documents