ED Report

Council MeetingMarch 11th 2010

Ruth PordesOSG Executive Director

OSG Council March 2010 2

Executive Director: Ruth Pordes,Technical Director: Miron Livny,

Project Manager: Chander Sehgal,Extensions /Applications

Torre Wenaus, Frank Würthwein

Joint Oversight TeamDOE & NSF

OSG Council Chairs: Paul Avery, Kent Blackburn,

Scalability: Frank WuerthweinWMS: Maxim PotekhinStorage: Matt CrawfordInternet2: Rich Carlson

Metrics: Brian BockelmanComm. & iSGTW: David RitchieProj Mgmt: Chander Sehgal

Security Officer: Mine Altunay; Deputy: Doug Olson

Integration : Rob Gardner : Site Coordination

Operations: Rob Quick

VOs : Abhishek Rana, Britta Daudert

Education, Training: Alina Bejan

Executive Team

E4CICI-Team Project

Engagement: John McGee; Campus Grids: Sebastien Goasguen

User Communities: VOs,Site Administrators

Software + VDT : Alain Roy, (Storage: Tanya Levshina)

Software ToolsAlain Roy, Mine Altunay

OSG PI: Miron LivnyOSG Co-PIs: Paul Avery,

Kent Blackburn, Ruth Pordes

Major Account Managers to US ATLAS, US CMS, LIGO

Feb 2009

Production Coordinator Dan Fraser, tbd?

Production Facility

OSG Project Structure August

2009

OSG Council March 2010 3

Executive Director: Ruth Pordes,Technical Director: Miron Livny,

Project Manager: Chander Sehgal,Extensions /Applications

Michael Ernst, Frank Würthwein

Joint Oversight TeamDOE & NSF

OSG Council Chairs: Paul Avery, Kent Blackburn,

Scalability:Igor SfiligoiWMS: Maxim PotekhinInternet2: Jeff Boote

Metrics: Brian BockelmanComm.,Edu & iSGTW: David RitchieProj Mgmt: Chander Sehgal

Security Officer: Mine Altunay; Deputy: Doug Olson

Integration : Rob Gardner : Site Coordination

Operations: Rob Quick

VOs : Abhishek Rana

Training Jim Weichel & Documentation: Robert Engel

Executive Team

E4CICI-Team Project

Engagement: John McGee; Campus Grids

User Communities: VOs,Site Administrators

Software + VDT : Alain Roy, & Storage: Tanya Levshina

Software ToolsAlain Roy, Mine Altunay

OSG PI: Miron LivnyOSG Co-PIs: Paul Avery,

Kent Blackburn, Ruth Pordes

Major Account Managers to US ATLAS, US CMS, LIGO

Production Coordinator Dan Fraser

Production Facility

OSG Project Structure

March 2010

Science Community

SoftwareProvider

Consortium ProjectDOE

NSF

Open Science GridServices andInfrastructure

Executive Board

$

$

..Satellite - PartnerProject

.. SatelliteProject

Resource Provider

Contributions

OSG does not own processing, storage, networking and does not develop software.

New OSG organo-gram

Support for End-to-End Distributed Research Community systems.

OSG Council March 2010

NSF

• ARRA satellite GlideinWMS• Recent SDCI solicitations resulted in 2 Executive

Director letters of commitment: Globus continued support, TG/BIRN IIS with MyOSG presentation layer.

• Condor + ?? • Software sustainability Report • SDCI/STCI PI meeting• CyberGIS• Participation in NEES – ED chair of Community

Collaboration Taskforce.

5

OSG Council March 2010

DOE

Here from ATLAS/CMS this afternoon.

Requested from ASCR phone meetings with Miron and myself.

Allocations on Magellan resources at ANL and NERSC. First detailed technical meeting tomorrow morning. ASCR will attend.

6

OSG Council March 2010

Blueprint Meetings

• October: Incremental Software Updates in OSG, Tier-3 program of work effort needs,storage accounting issues (size), review of FY11 SOWs.

• November: technology group• December: joint WLCG-EGEE-OSG meeting at

CERN. Discussions of transition to EGI/EMI, storage next generation ideas at CERN.

• February: Shared storage, NEES proof of concept.• May at BNL proposed: Configuration Management,

Middleware and Advanced Networking

7

OSG Council March 2010

Storage Appliance

• VO can use public storage without prior arrangements

• No per- VO limit is necessary: community space • It is crucial that the space is correctly advertised in

the OSG information systems • File cleanup could be done at any time (the VO

notification is desirable)

What is the priority? No effort available/allocated at present.

OSG supply h/w to site in exchange for running OSG s/w to implement the above. Possibility of Cornell being a first test here?

8

OSG Council March 2010

Network for Earthquake Engineering Simulation - NEES

• Miron, Technical Director andRudi Eigenmann, head of NEES-IT, at Purdue propose proof-of-concept archival of NEES data through OSG to tape. Stepping stone to technical support for “upload of data from 14 NEES sites to Purdue”.

• Fermilab offer tape archival resource accessible to OSG.

• NEES need tape archive by April 1 2010. • Work in progress. Besides software development,

integration and execution will prototype agreements and use of new kind of resource.

• Once proof-of-concept in place NEES looking for incremental archives weekly. Will need ongoing commitment and SLAs.

9

OSG Council March 2010

Planning for the Future

Plan to ramp up my effort with process support from Chander, Jim Weichel and others on this over the next few months. There is always a challenge to find the time with the number of immediate issues to address.

We (will) appreciate the activity and engagement from Council and VO members.

10

OSG Council March 2010

OSG Futures - Goalshttps://twiki.grid.iu.edu/twiki/pub/Council/Agenda2009Aug11/

OSG_Future_Requirements_v1.docx

• OSG will provide the LHC and LIGO communities with a common virtual facility…

 • OSG will provide a common, shared distributed computing

infrastructure which can be used, ..by all members of the Consortium...

 • OSG will continue as a grass-roots hands-on collaboratory…

• OSG will play a leadership role in the US National Cyberinfrastructure...

• OSG aims to have recognized responsibilities in partnership with the

NSF XD…

 • OSG aims to have recognized responsibilities as part of the next round

of the DOE SciDAC program….

 11

OSG Council March 2010

Are there Satellite Projects we should encourage?

Security Infrastructure enhancements/revamp? Campus Infrastructures? Storage and Data management? …

12

No progress I can report here….

OSG Council March 2010

Technology Group and Architecture Document

• Architecture document help for ED from sub-set of Technology Group to date:

• Diagram existing VO and OSG architectures. • Points to master documents if exist. • Address high level “Enterprise” aspects of the

architecture as well as technology/technical

13

OSG Council March 2010

Extend mission/scope?

Current: The Open Science Grid aims to promote discovery and collaboration in data-intensive research by providing a computing facility and services that integrate distributed, reliable and shared resources to support computation at all scales. 

Target? The Open Science Grid aims to promote discovery and collaboration in data-intensive research by providing computing services, software and support that integrate cross-domain, self-managed, nationally distributed cyber-infrastructures that bring together campus, community, national and commercial resources to meet the needs of communities at all scales.

14

OSG Council March 2010

If We are Successful More Communities Rely on us

The architecture and targets of the OSG are driven by its’ stakeholders – current and potential. The (three) major accounts that drive the OSG are the US LHC Collaborations (US ATLAS and US CMS) and LIGO.

Our future target is to increase the number of major accounts depending on the OSG.

Do we have communities at the table who would commit to this for the proposal next year?

15

OSG Council March 2010

Where can we be Innovative?

CF21?

http://www.nsf.gov/dir/index.jsp?org=oci

Cloud Computing and Microsoft?

Career Awards (satellites)?

16

OSG Council March 2010

National Cyberinfrastructure

Clearly more than OSG-TG

collaboration listed here?

17

Task Mission/Goals StageOSG & TG Joint Activity Tracking and Reporting ActiveiSGTW continuation and joint support plan; proposal for US based contributions PlanningResource Allocation Analysis and Recommendations PlanningResource Accounting Inter-operation and Convergence Recommendations PlanningExplore how campus outreach and activities can be coordinated ActiveSCEC Application to use both OSG & TG ActiveJoint Middleware Distributions (Client side) ActiveSecurity Incidence Response ActiveWorkforce Development PlanningJoint Student Activities ActiveInfrastructure Policy Group Active

OSG Council March 2010

Architectures documented – ATLAS

18

OSG Council March 2010

CMS

19

OSG Council March 2010

Engage

20

OSG Council March 2010

Hardware Architecture

21

OSG Council March 2010

Operations Services

22

OSG Council March 2010

One Proposal or Many?

• Based on Council and Executive Team guidance I am saying we plan OSG’ as a single unsolicited proposal to DOE and NSF.

• Do we still believe this?

23

OSG Council March 2010

Executive Director-ship

• I understand Council Action Item 7 as saying “ED candidates + deputy come forward in May 2010 and election is March 2011”.

• I know the OSG budget cannot currently sustain additional staff in March 2011 – ie cannot fund a Deputy as an addition.

• Management plan says ED candidates propose their full Executive Team.

• I think 3? 5? ED candidates in May 2010 without resolution before March 2011 makes preparing for OSG’ difficult.

• I have previously stated I am prepared to continue as ED through new proposal funding + 1 year. I hope that means March/September 2012 at the latest. At last August’s Council meeting I understood a Deputy was a “ED in waiting”.

24

OSG Council March 2010

Recap

25

OSG Council March 2010 26

Recap:Currently Allocated OSG

Budget

OSG Budget Profile

$-

$1,000,000

$2,000,000

$3,000,000

$4,000,000

$5,000,000

$6,000,000

$7,000,000

10/2006 -9/2007

10/2007 -9/2008

10/2008 -9/2009

10/2009 -9/2010

10/2010 -9/2011

10/2011 -Beyond

Funding YearNSF DOE Univ DOE Labs Total

OSG Council March 2010 27

RecapPlanning for the Future

OSG Funding – Key dates OSG DOE funding ends 3/15/2011 OSG NSF funding ends 8/31/2011 OSG Fiscal Year5 ends 9/30/2011

  We need a plan beyond the currently allocated budget to

maintain stakeholder confidence and continue Support for evolving needs of Stakeholders Ongoing support for US-LHC & LIGO Retention of Staff and Expertise

OSG Council March 2010 28

OSG Future Planning Schedule Update - Recap

(Planning started at 2009 Council Mtg)

 Phase 3 by Dec 2009• Analysis => outline for proposal Not Done. Decided this was

premature. Started exploring options. • Document Architecture In progress. See later slides. • Identify particpating senior personnel (and institutions) Not Done• September 2009 submitted joint satellite proposal with TG personnel.

Waiting for results of the reviews.

Phase 4 at March 2010 All Hands Meeting• Endorsement of proposal by stakeholders Not Done• Core US LHC/OSG management group met to discuss needs for OSG’

in January 2010. • US LHC response to “dependence on OSG services” sent to DOE/NSF

in February – report from them this afternoon.

OSG Council March 2010

Oversight

• JOT held at Germantown in early December, joint with TeraGrid. Miron, Paul, Ruth. Presentation from Magellan.

• Winter 2010: 3 phone meetings from Susan, Rich in ASCR with Miron, Ruth to discuss various topics

• Possible review in fall 2010??

29