open science grid (osg)

12
Miron Livny Center for High Throughput Computing Computer Sciences Department University of Wisconsin-Madison Open Science Grid (OSG)

Upload: arne

Post on 24-Feb-2016

65 views

Category:

Documents


0 download

DESCRIPTION

Open Science Grid (OSG). Big Picture. Starting year six of the ‘original’ five year project and year 12 of early ‘grid’ projects – PPDG (DOE) , GriPhyN (NSF-ITR) and iVDGL (NSF). Proposal for the next five years under joint review of DOE and NSF Over all funding 30+ FTEs - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Open Science Grid (OSG)

Miron LivnyCenter for High Throughput Computing

Computer Sciences DepartmentUniversity of Wisconsin-Madison

Open Science Grid(OSG)

Page 2: Open Science Grid (OSG)

Big Picture›Starting year six of the ‘original’ five year project and year 12 of early ‘grid’ projects – PPDG (DOE) , GriPhyN (NSF-ITR) and iVDGL (NSF).

›Proposal for the next five years under joint review of DOE and NSF

›Over all funding 30+ FTEs›10+ institutions involved

Page 3: Open Science Grid (OSG)

“The members of the OSG are united by a commitment to promote the adoption and to advance the state of the art of distributed high throughput computing (DHTC) – shared utilization of autonomous resources where all the elements are optimized for maximizing computational throughput.”

Page 4: Open Science Grid (OSG)
Page 5: Open Science Grid (OSG)

“The OSG project is organized into five technical areas−Production, Technology, Software, Security, and User Support−with each area having a lead, and a support area that includes the following activities- Education, Documentation and Training, Communication, International Outreach and Assessment.”

Page 6: Open Science Grid (OSG)

“As a focal point, Production is positioned to enhance this economy in other areas: by working toward interoperability with other CIs, and by replicating the DHTC pattern so that any interested university can benefit. We begin by helping universities build out their own local fabric of shared DHTC services to support a local community of students and faculty.”

Page 7: Open Science Grid (OSG)

Open Science Grid (OSG)

HTC at the National Level

Page 8: Open Science Grid (OSG)

www.cs.wisc.edu/~miron

Overlay Resource Managers

Ten years ago we introduced the concept of Condor glide-ins as a tool to support ‘just in time scheduling’ in a distributed computing infrastructure that consists of recourses that are managed by (heterogeneous) autonomous resource managers. By dynamically deploying a distributed resource manager on resources allocated (provisioned) by the local resource managers, the overlay resource manager can implement a unified resource allocation policy. In other words, we use remote job invocation to get resources allocated.

Page 9: Open Science Grid (OSG)

www.cs.wisc.edu/~miron

Page 10: Open Science Grid (OSG)

Subject: [Chtc-users] Daily CHTC OSG glidein usage 2011-09-05

From: [email protected]: 9/5/2011 12:15 AMTo: [email protected] Usage between 2011-09-04 and 2011-09-05Group Usage Summary User Hours Pct-- ------------------------------ ---------- ------1 Morgridge_Thomson 65735.5 87.72%2 Biochem_Attie 7496.5 10.00%3 Chemistry_Schmidt 978.7 1.31%4 Chemistry_Cui 410.3 0.55%5 ChE_dePablo 314.4 0.42%--------------------------------- ---------- -------TOTAL 74935.5 100.00%

Info: http://glidein.chtc.wisc.edu/

Page 11: Open Science Grid (OSG)
Page 12: Open Science Grid (OSG)

“The vision of the OSG partnership centers around enabling scientific research and discovery through DHTC. We aspire to be open towards the broadest possible range of stakeholders in terms of diversity of science and organizational structure.”