Contract Year 1 ReviewComputational Environment (CE)

Shirley Moore

University of Tennessee-Knoxville

May 16, 2002

13-17 May 2002 Contract Year 1 Review 2

CE Strategy

• Top priorities: A computational environment that is consistent, well-

documented, and easy-to-use across the SRCs Debugging and performance analysis tools that are scalable

and easy-to-use in the SRC environment

• Focus on: Enabling DoD users to determine what performance they are

getting and improve that performance on SRC platforms Parallelization strategies and programming practices that

enhance application portability across platforms Tools and strategies for efficient file management and I/O Use of COTS and/or freely available tools; interaction with

tool developers on improvements and new tool features Training on HPC architectures, tools & methodologies (Core)

13-17 May 2002 Contract Year 1 Review 3

CE Efforts for Contract Year 1

• Recruitment and hiring of CE onsite Thomas Cortese

• Establishment of and interaction with CE User Advisory Panel

• Development of comprehensive CE training curriculum and coordination of CE training

• Collaborations with tool developers• Establishment of contacts and working

relationships with SRC systems and user support staff

13-17 May 2002 Contract Year 1 Review 4

User Contacts and Assistance• Assisted EQM code developer Victor Parr with parallel I/O and with use of PAPI (ongoing email and phone contacts)

•Assisted ARL MSRC user Dale Shires with IBM and SGI architecture and MPI questions (Jan 2002)

•Assisted ARL MSRC user Marshall Cory with ScaLAPACK questions (Feb 2002)

•Assisting USNA user Reza Malek-Malani with scheduling seminar on cluster computing

•Installed Vampir-GuideView (VGV) beta version at NAVO MSRC at request of CWO onsite Tim Campbell (March 2002)

13-17 May 2002 Contract Year 1 Review 5

Tools Introduced• Repository in a Box (RIB) toolkit used for ERDC MSRC CTA repositories

•PAPI cross-platform interface to hardware performance counters

•Vampir-GuideView (VGV) combined MPI/OpenMP performance analysis tool (beta version for evaluation)

•MPE Logging/Jumpshot freely available MPI performance analysis tool (under evaluation)

•TAU for MPI and/or OpenMP program analysis (under evaluation)

•Vprof basic block profiler (under evaluation)

13-17 May 2002 Contract Year 1 Review 6

CE Training• Advanced MPI (advanced), ERDC MSRC, 26-28 Sep 2001, David Cronk (UTK)

•Introduction to MPI (beginning), ASC MSRC, 16-17 Jan 2002, David Cronk (UTK), 6 attendees, 40 CD’s distributed, Evaluation: 4.2/5.0

•MPI Tips and Tricks (intermediate), Fort Monmouth, 30 Jan – 1 Feb 2002, David Cronk (UTK), 10 attendees

•Compaq AlphaServer SC System, ERDC MSRC, 31 Jan – 1 Feb 2002, David Ennis (OSC)

•Advanced MPI (advanced), ARL MSRC, 13-14 Mar 2002, David Cronk (UTK), 13 attendees, Evaluation: 10 Excellent, 3 Good

13-17 May 2002 Contract Year 1 Review 7

CE Training (cont.)

• Cross-Platform Performance Analysis Tools (intermediate), ERDC MSRC, 19-20 Mar 2002, Shirley Moore (UTK), 7 attendees, Evaluation:

•C Programming, AEDC, 24-29 Mar 2002, David Ennis (OSC)

•Performance Optimization for Vector Processors, NAVO MSRC, 3-4 Apr 2002, James Giuliani (OSC)

•Debugging Parallel Code Using TotalView, NAVO MSRC, 7-9 May 2002, David Cronk and Thomas Cortese (UTK)

13-17 May 2002 Contract Year 1 Review 8

Conference Presentations • David Cronk, “MPI-I/O for EQM Applications”, DoD HPC UGC 2001, Biloxi, MS, June 2001

•David Cronk, “Metacomputing Support for the SARA3D Structural Acoustics Application”, DoD HPC UGC 2001, Biloxi, MS, June 2001

• Shirley Moore, David Cronk, Kevin London, and Jack Dongarra, “Review of MPI Performance Analysis Tools”, EuroPVM/MPI2001, Santorini, Greece, April 2002 (rescheduled from September 2001)

•Shirley Moore, “A Comparison of Counting and Sampling Modes of Using Performance Monitoring Hardware”, International Conference on Computational Science (ICCS 2002), Amsterdam, April 2002

13-17 May 2002 Contract Year 1 Review 9

CE009: A Consistent Well-Documented Computational Environment

• Collaborate with SRC systems and user support staff to implement, document, and support a consistent computational environment across the SRCs

• Deliverables

– Information in SRC user guides and/or OKC about all installed components of the computational environment

–Checklists for testing tool installation

–Traveling onsite support to SRCs

–Workshops to evaluate new tool technologies (ready to schedule)

–Quarterly report on status of the computational environment at the SRCs

–Explanation for yellow: change in plans from commercial to freely available tools due to budget constraints: OKC not in production mode yet

• $207,756; 1 Oct 2001 – 30 Sep 2002

• PI: Shirley Moore

13-17 May 2002 Contract Year 1 Review 10

CE010: PAPI Deployment, Evaluation, and Extensions

•Deploy and support the PAPI cross-platform interface to hardware performance counters on all SRC platforms

•Investigate accuracy of hardware counter data

•Implement memory utilization extensions

• Deliverables

– Installation, testing, and documentation of PAPI and related tools (TAU, VProf) on all MSRC platform (Compaq Alpha substrate in progress)

– Microbenchmarks for measuring accuracy of hardware performance data (analyzing data and devising additional benchmarks)

–Design of memory utilization extensions and implementation on ASC platforms (in design phase)

• $235,064 (UTK, UTEP, PSC), 1 Oct 2001-30 Sep 2002

• PI: Shirley Moore

•MSI Participation: Patricia Teller, UTEP

13-17 May 2002 Contract Year 1 Review 11

CE012: Metacomputing Support for SIP Image Processing

• Use NetSolve to improve the performance and scalability of Tannenbaum’s image segmentation algorithm.

•Previous work: SARA3D

•Also looking at XPatch

• Deliverables

– Implementation of portions of Tannenbaum’s algorithm as NetSolve services

–Implementation of coarse-grained parallelism

–Persistent storage of intermediate results

–Deployment on grid computing testbed (must satisfy security requirements)

• $70K, 1 Oct 2001-30 Sep 2002

• PI: Shirley Moore

13-17 May 2002 Contract Year 1 Review 12

CE019: SPMD Collective Communication Model

• To develop an Open Source Fortran 90 module for the most commonly used SPMD collective communication operations

•Deliverables

– An API for SPMD collective communications based on a Fortran 90 module (specification and documentation started)

–Open Source reference implementation of the module for MPI (near completion)

–Open Source reference implementation of the module for SHMEM (not started)

–Test and timing suite (near completion)

• $74,923, 1 Mar 2002-30 Jan 2003

• PI: Timothy Kaiser, Ph.D., Coherent Cognition

13-17 May 2002 Contract Year 1 Review 13

Core Financial Summary

$0.00

$50,000.00

$100,000.00

$150,000.00

$200,000.00

$250,000.00

JuneAugustOctober

DecemberFebruaryApril

Total ProjectedFunding

Planned Expendures

Actual InvoicedExpendures

13-17 May 2002 Contract Year 1 Review 14

Staffing

• Onsite CE position at NAVO MSRC filled in February 2002 – Dr. Thomas Cortese

13-17 May 2002 Contract Year 1 Review 15

Summary• Strategic priorities determined by CE user advisory panel

(ranked from 1 to 4, 1 being highest):– Performance evaluation (1.7)

– Data management and I/O (1.7)

– Application portability (1.7)

– Consistent computational environment (2.1)• Documentation and user support (1.7)

– Debugging (2.3)

– Dynamic monitoring and control of application execution (2.4)

– Grid or “meta”-computing (2.9)

• Above priorities being addressed by CE core support (incl. training and by current and planned projects)