April 19, 2023

Quarterly Meeting 06Mar2012 – 07Mar2011Indiana University Presentations

Please cite as: Stewart, C.A., S. Marru, R. Knepper, D.Y. Hancock, J. Wernert, C. Aikman, J. Bolte, P. Brown, T. Miller. Indiana University collected XSEDE update. Presented at XSEDE (eXtreme Enviroment for Science and Engineering Discovery) Quarterly Meeting, 6-7 Mar 2012, Austin, TX. http://hdl.handle.net/2022/14444

The images on the first and last slides and the slide templates used throughout © National Center for Supercomputer Applications, University of Illinois Urbana-Champaign, and may not be reused without permission.

The contents of other slides (except where explicitly noted) are copyright 2011 by the Trustees of Indiana University, and this content is released under the Creative Commons Attribution 3.0 Unported license (http://creativecommons.org/licenses/by/3.0/)

WBS 1.1.4 XSEDE 12 Conference

• Goals• Build on quality and traditions of TGxy

conference• Take a quantum step up on technical quality

of conference and proceedings• Pull off organizing a conference in not

enough time, in a more expensive city, have a balanced budget, and have the experience for attendees be exceptionally good

3

WBS 1.1.4 XSEDE 12 ConferenceDecisions and steps taken to date

• New structure • XSEDE12 key leads committee• Logistics and Local Arrangements über committee• Technical program übercommittee

• Call for participation out• We’re going to expect quality and act as if we are a top-tier

conference in terms of technical content• Process is VERY different for tutorials• Strong encouragement to submit full papers (any full paper

submission will get priority in acceptance over any abstract-only submission)

• Contracts – Hotel, Helms Briscoe signed. A/V and networking close• Unsolicited proposal for student / campus champion support submitted to

NSF {Tillotson (IU) PI; Cartwright (Wis), Blood (PSC) Co-Pis}• Proposal to ACM SIGHPC for ‘affiliation’ submitted

4

WBS 1.1.4 XSEDE 12 ConferenceCurrent activities and requests for help

• Firing up requests for sponsors – will be asking many people for help

• Need ideas on plenary speadkers

• Need your help in writing and soliciting papers

• Be the first on your block to submit a paper!

• Need EOT papers – real papers about real projects

• Need Science papers – solicitation designed specifically to let scientists discuss high points of outcomes, focus in papers on methods, so that they can contribute papers without loosing ability to publish their basic work in top-tier venues within their fields

• Can each Level 1 SP take initiative to get at least one really good science track paper from one of your favorite users?

•It would be a heck of a condemnation if none of our science users is willing to submit and present a real paper when we are giving away millions of dollars in value in computer time

• Papers from other HPC or grid projects from which we can learn lessons are ESPECIALLY welcome

5

• We are responding to suggestions on what to change from past conferences – key suggestion to be in the center of the city, which makes a total of three big budget challenges (more expensive venue, loss of ‘we blew it’ discount from hotel, guidance from PI to break even).

• Budget – have decided to make tour event Tuesday night a “pay yourself” activity

• Combining Viz showcase, poster session Weds night with food stations like SCxy opening night.

• Single day registrations not yet advertised – designed to help budget out (idea copied from ISC)

• We continue to be successful in shooting the lead elephant…. Thanks to exceptional work by the program committee

• Every reason to believe we will succeed in achieving the goals we set

6

WBS 1.1.4 XSEDE 12 ConferenceRisk Status

WBS 1.2 Level 2 Update

• Level 2 highlights:– Migration to new VM hosting environment begun

at IU. Service Level document in draft form.– Backup operations center action items progressing

• Extra-Level 2 issues:– Significant VM hosting outage required restore

from backup of many VMs hosted at IU. New procedures are being implemented.

7

WBS 1.2.2 Operations Program

• New/Changed Activities:– Albedo Administrator at IU as part of operations

rebudget– Support for Distributed Lustre WAN Workflows

requested (note: request ultimately not fulfilled)

• Discontinued Activities:– None

8

WBS 1.2.6 Systems Operational Support Update (1)

• Schedule/Deliverables (required)– Migration to new VM hosting system at IU will be

completed next quarter.– Service levels for VM hosting has not been well

defined. IU and Operations management are developing a Service Level Expectations document.

– VM hosting environment is well utilized by both the Science Gateways & Software Development areas.

9

WBS 1.2.6 Systems Operational Support Update (2)

• Risks Status (required)– Backup schedule for VM hosting transition was not

adequate. New backup software is being implemented for nightly incremental backups.

• Resources/Staff (optional)– Modest storage expansion requested for VM

hosting environment, will support 24-32 additional VMs. Current environment is IU funded.

10

WBS 1.2.6 Program Plan Systems Operational Support

• New Activities:– Expansion of VM storage capacity & additional

servers to support more VMs at IU (24-32 VMs). Current environment is IU funded.

• Discontinued Activities:– N/A

11

WBS 1.2.6 Program Plan Systems Operational Support

• Unfinished projects from Yr 1– N/A

• Items for consideration that exceed budget– VM hosting expansion budget request is for

$46,926 for Yr 2. IU invested $62,748 of non-XSEDE funding in new servers and networking during Yr 1. Current storage arrays are from 2009 and in need of replacement.

12

WBS 1.2.6 Program Plan (1)

• New Activities:– Expansion of VM storage capacity & additional

servers to support more VMs at IU (24-32 VMs). Current environment is IU funded.

• Discontinued Activities:– N/A

13

WBS 1.3.2 Level 2 Update

• Level 2 highlights:– Total docs in XSEDE KB now over 400 and

averaging over 20K hits per month– Plan to document Campus Bridging Use Cases– Meeting the challenge of identifying the right

content to include is a collaborative effort

14

WBS 1.3.2 Online Information and Interfaces - Knowledgebase Update (1)• Schedule/Deliverables

– Total number of documents available in the XSEDE KB at the end of the 4th quarter = 405

– 25 new documents created this quarter – 55 new documents updated this quarter – 64,679 documents served this quarter– Plan to continuing to mine content for KB inclusion– Plan to document Campus Bridging use cases

15

WBS 1.3.2 Knowledge Base Update (2)

• Risks Status– Success in growing content that people need is

dependent on engagement from others

• Resources/Staff– Need to cross train to reduce key person

dependency

16

WBS 1.5.2 Extended Support for Science Gateways (ESSGW) Update

• Schedule/Deliverables – Current ESSGW projects = 10 (plus 4 TG project support winding down)

• Successes– Continuously engaging gateway community with bi-weekly talks resulting

in good discussions.– Gateway staffers embedded into long term gateways have started to take

on new projects.– Gateway group has huddled together for comprehensive requirements

gathering.

• Concerns– Gateway developers are getting enthusiastic to be early adopters of XSEDE

Architecture. They are not yet knowledgeable about architecture changes.

17

Status of ESSGW requests last three quarters

18

Requests Not justified Workplans completed

In process

Sept XRAC 2 0 1 1

Sep-Dec Startups 3 1 1 1

Dec XRAC 2 0 1 1

Jan-Feb Startups (as of 2/22)

2 0 1 1

Not justified - one of not recommended, precautionary request, or unresponsiveIn process – anywhere from contacting PI to workplan in review

WBS 1.5.2 ESSGW Update

• Risks Status– Balancing new gateways vs sustaining existing ones through

XSEDE evolution is important.– Existing gateways integrated are tightly coupled with current

middleware. Transition might be tricky and has to be smooth without loosing community.

– Losing momentum on important tasks like gateway community credentials and use of information services as their future of these services is unknown.

• Resources/Staff – Gateway staff need training on middleware and API

development aspects

19

20

WBS 1.5.2 ESSGW Update (3) – Requirements & Testing

WBS 1.5.2 ESSGW Update (3) – Requirements & TestingFocus Area Functional Leads Team Gateways on board Notes

XSEDE Arch. Implications for Gateways Portals/Desktop Front-ends

Tom Uram, Yan Liu Marlon Pierce, Raminder Singh, Chris Thompson

GISolve, CyberGIS SIDGrid, Ultrascan, QuakeSim, CIPRES

Workflow & Job Management

Stu Martin, Marlon Pierce

Jay Alameda, Chathura Herath, Ye Fan, Sudhakar Pamidighantam, Tom Uram

Ultrascan, VLAB, DES-SimWG, GridChem, ParamChem, CESM, ODI, SCEC, CIPRES

Planning to contact Pegasus, Kepler, Taverna, SAGA, SWIFT teams to see if there are gateways that we have missed.

Metascheduling, OnDemand submissions, and gateway level fair share scheduling

Sudhakar Pamidighantam

Terri Schwartz GridChem, CIPRES, Ultrascan

Others gateways have expressed interest before, will contact them after the initial draft.

Gateway Data Movement

Don Middleton, Stu Martin

Tom Uram, Ye Fan, Raminder Singh

Ultrascan, CIPRES, GISolve (OSG), Vlab

Gateways Using Campus Bridging

Raminder Singh, Yan Liu

Marlon Pierce (Rich Knepper)

Ultrascan, CIPRES, GISolve (OSG), Vlab

21

Yet to focus: Gateway Security, Parallel File System, Centralized Data Archives, Information Service Integration, Gateway Application Registry …

WBS 1.6.5 Program Plan – Campus Bridging• New/Changed Activities:

– Much more interest in campus bridging than any of us would have predicted a year ago (or at least more than I predicted)

– Much more need for information and materials for the community, to understand and take action on campus bridging activities by XSEDE

– Clear need for bundling software packages for campus bridging specific activities in ways that are not part of the XSEDE distributions produced by Operations

– Pilot Program {This is a one-off in some ways but we expect to be involved in the A&D <-> SD&I <-> Operations linkages in the future}

– You can’t row a boat with 0.46 FTE of hands on oars (even at two hands per FTE, this is still less than one hand)

22

WBS 1.6.5 Program Plan Campus Bridging • Unfinished projects from Yr 1

• none• Items for consideration that exceed budget

– 1.25 FTE (15 person-months) additional support requested (0.25 FTE to IU for day-in, day-out management, 1.0 FTE to Cornell to provide one dedicated person with hands on oars – particularly software bundling and distribution for use on campus outside XSEDE Level 1-2-3)

– We will use FutureGrid Note when we need hardware platforms for Campus Bridging work.

– We are NOT proposing to duplicate work done for XSEDE systems by A&D, SD&I, or Operations. We plan to pursue providing tools that will be used on campuses – outside XSEDE Level 1, 2, or 3 systems and downstream of Operations, to fulfill Campus Bridging use cases / needs.

23

XSEDE User Survey

24

Problem Statement

• Opportunity to define new processes for evaluating how users perceive of/use XSEDE services, and what changes/improvements they recommend now and over time

• Previous surveys provided useful context led to successful award, helped define initial execution of project

• Previous efforts conducted before project had significant operational experience and without Institutional Review Board approval

• 2011 survey of non-XSEDE users by Stewart, et al (http://hdl.handle.net/2022/9917) indicates only 30% of respondents have sufficient CI resources on a regular basis.

• Insights from NIH and DoE: (1) What is the value of NSF CI facilities to NIH and DoE researchers? (2) What responsibility does the NIH and DoE have in contributing to funding NSF CI?

25

Key Metrics

• Are users of XSEDE happy with the services they receive?• What does XSEDE enable its users to accomplish?• What capabilities do users want? How would these services expand

capabilities and scientific impact?• Are users of XSEDE better provisioned than non-users?

26

Recommendations/Timeline

27

April 19, 2023

Quarterly Meeting 30Aug2011 – 1Sep2011Day 2 – program plans

WBS 1.2.6 Program Plan (2)

• Unfinished projects from Yr 1– N/A

• Items for consideration that exceed budget– VM hosting expansion budget request is for

$46,926 for Yr 2. IU invested $62,748 of non-XSEDE funding in new servers and networking during Yr 1. Current storage arrays are from 2009 and in need of replacement.

29