nees cyberinfrastructure center at the san diego supercomputer center, ucsd george e. brown, jr....

NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD

George E. Brown, Jr. Network for Earthquake Engineering Simulation

NEES TeraGrid Gateways: SimPortal & Job Submission

Portlet

Lelli Van Den EindeNEESit

[email protected]

August 13, 2008

TeraGrid Science Gateways at UCSD

SDSC Summer Seminar Series



Overview What is NEES? Computational Simulation within NEES SimPortal Gateway & Job Submission Portal Current/Future Developments



The NEES Community



NEES Equipment Sites



The Role of NEESit



Applications for Earthquake Engineering

Available on TeraGrid: Abaqus Ansys OpenSees* LS-Dyna Fluent *P Mathematica

Other Applications SAP2000 LARSA Ruamoko Etc…



NEES TeraGrid Allocation NEES wide TeraGrid Allocation

Researchers can apply at: http://it.nees.org/support/supercomputing/index.php

245,000 SU Allocation Oct 1 2007 - Sept 2008 Up from 200,000 su’s the year before ~125,000 remaining (April 2008) Usage up from 2006 Allocation:

P655: 18619 32100 P690: 669 1626 Ia64: 64 25000 (first quarter 2007 2008)

Number of users 31 groups 76 users Up from 30 groups 66 users the year before



What is OpenSees?

A software framework for developing sequential, parallel and grid-enabled finite element applications in earthquake engineering.

Written primarily in the object-oriented programming language C++.

C++ wrappers are provided so that legacy and new procedures (elements, materials, numerical routines) written in other languages C, Fortran can be used.

Funding for OpenSees has been provided by: PEER (Pacific Earthquake Enginering Research Center) NEES (George E. Brown, Jr. Network for Earthquake Engineering

Simulation) through NEESit. NSF (National Science Foundation)

Open System for Earthquake Engineering Simulation



Parallel OpenSees Interpreters

OpenSeesSP: An application for large models which will parse and execute the exact same script as the sequential application. The difference being the element state determination and equation solving are done in parallel.

OpenSeesMP: An application for BOTH large models and parameter studies.



Example Usage:Humboldt Bay Bridge Model

0

50

100

150

200

250

300

350

0 2 4 6 8 10 12 14 16 18

Number of processors

To

tal e

xecu

tio

n t

ime

(min

ute

)



TeraGrid Access

Secure Shell A Protocol that allows data to be transferred

securely over the network using public key encryption

Common programs ssh for login scp or sftp for file transfer

TeraGrid Job Submission portal NEES SimPortal under development



NEES Job Submission Portlet

Simple access to HPC resources through NEES Portal environment Users can easily run standard OpenSees jobs on

TeraGrid Supports the creation, execution, sharing and

reuse of simulations Groups can share data, tools, and collaborate Provides community with a central resources for

computational simulation Can reuse simulation code and data



NEES Job Submission Portlet

Portal user can: Execute simulations on TeraGrid Monitor the status of their jobs Share his/her own results with other users Reuse existing OpenSees code Download results to leverage elsewhere



SimPortal Provides graphical computational simulation

component for NEES currently as Grid Portal for OpenSees

Compose a simulation by acquiring all necessary OpenSees scripts from: NEEScentral data repository User desktop

Edit and verify correctness of scripts For very complex simulations, the scripts are expected to be

developed off-line and uploaded to the portal to be executed on high-performance platforms provided by NEESit.

Monitor the progress of the simulations, preview the results, and download them for a detailed analysis.

Share the scripts and simulation results with other users



SimPortalRepository

Scripts and data(public and private)

Job SubmissionService

Monitoring Service

Access job status and simulation results

Edit, verify, andvisualize models

Workspace

OpenSees scriptsand data organized

into simulations

TeraGrid

LocalFile system



Example SimPortal Interface



Initial Screen



Basic Usage

Acquire Input File(s)

Submit & Monitor

Job

Submit Results to Repository

Customize & Modify Script

Preview Results

Download Results



Acquiring Files


Submit & Monitor

Job


Customize & Modify Script

Preview Results

Files come from: User scripts uploaded to portal Generated from Portlet Text editor From NEEScentral Repository (not implemented yet)

Download Results



•

Acquiring Files



Customizing Files


Submit & Monitor

Job


Customize & Modifying Script

Preview Results

Files Can Be Modified By: Editing in Portlet Editor Setting values of parameters

Download Results



•

Verifying Correctness of Syntax (Parse)



•

Visualization of Input Files



Submission and Monitoring


Submit & Monitor

Job



Preview Results

Selection of: Machine Estimated Run Time Number of Processors

Submit

Download Results



•

Submission and Monitoring



Preview Results


Submit & Monitor

Job



Preview Results

After Job has run results can be previewed in portlet (recorder and stderr results)

Job can be modified & resubmitted if error

Download Results



Download Results


Submit & Monitor

Job



Preview Results

Download Results



Preview and Download Results



Publish Results


Submit & Monitor

Job



Preview Results

Download Results

Submit Results to Repository (current work)



Before You Begin You Need



http://simportal.nees.org:8080/ecs/neesport/neesportlaunch.jsp



Current/Future Work SimPortal integration with TeraGrid

Currently SimPortal submits jobs to Rocks Cluster Requires authentication/authorization (single sign-on) with

NEES accounts

SimPortal integration with NEEScentral Data Repository So input/output files can be archived in NEEScentral Requires extension of NEEScentral Web Services

Eventually will extend SimPortal to support other earthquake engineering simulation packages



Questions?

nees cyberinfrastructure center at the san diego supercomputer center, ucsd george e. brown, jr....

Documents

san diego supercomputer

nees community slide

ucsd george

computational simulation

role of neesit slide

teragrid science gateways

su allocation

number of users