cyberinfrastructure for rapid prototyping capability tomasz haupt, anand kalyanasundaram, igor zhuk,...

18
Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces Institute

Post on 24-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Cyberinfrastructure for Rapid Prototyping Capability

Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi GoliMississippi State University

GeoResouces Institute

Page 2: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Rapid Prototyping Capabilities*

• The overall goal of the NASA Rapid Prototyping Capability is to speed the evaluation of potential uses of NASA research products and technologies to improve future operational systems by reducing the time to access, configure, and assess the effectiveness of NASA products and technologies.

• The infrastructure to support the RPC is thus expected to provide the capability to rapidly evaluate innovative methods of linking science observations.

* Robert Moorhead (MSU/GRI) – principal investigator

Computational infrastructure + collaborative environment

Page 3: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

RPC in an example of e-Science

Many, many more, in particular in biology & medicine

• System-Level Science is the broad understanding of how complex, multiphenomena physical system behave and how their constituent components interact and interrelate.

• System-level Science integrates not only different disciplines but also, typically, software systems, data, computing resources, and people. System-level science is usually a team pursuit. Data comes from different sources, different groups develop component models, team members provide specialized expertise, and the often substantial computing and data resources required for success are themselves diverse and distributed.

• Grid Computing• Virtual Organizations

Ian FosterANL and University of Chicago“father of Grid Computing”

Page 4: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

New Web Revolution

The Web0.5

DigitalEnterprise

Enterprise2.0

GridComputing

e-Sciencee-Science

2.0

The Web2.0

The Web1.0

SOA

Server hoppingDocument exchange

Dynamic Content, PublishingE-Commerce E-banking,…

Community Content, CollaborationSocial Networking, Rich Interfaces

DatabaseAccess,Search

CloudComputing,

AJAX, mashups

Architecture of participationCollective intelligenceUser-created contentConvergent, emergentUnplanned innovationFreeform simplicity

Page 5: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

RPC Experiments

Data AccessData providers (DAAC, NOAA, etc)

Derived data product (model outputs)Simulated data

Data (Geo)processingRe-sampling, re-projecting,

time series, maps & features, etc.input deck generation

Computational Models

Data Publishing

Data Analysis

Data StorageSemanticmetadata

ProcessingAbstraction

Model DataAbstraction

Model RunAbstraction

ExperimentDescription

ExperimentalProcedure

Descriptionof Results

Analysis Procedure

Conclusions from Evaluation

(Recommendation for ISS)

(Two ways of describing them)

The delivery mechanisms for the evaluation of the use

of the NASA-provided resources

PrototypingThe capability to integrate tools and data

to perform such evaluations

Rapid

Page 6: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Interactive Web Site Private Space for Collaboration TDS-based Data Explorer

Tools for Data Processing Performance Metrics Workbench Provenance

DEMONSTRATION

Page 7: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

What’s under the hood?

Apache/Tomcat server (J2EE)

GridSphere portlet container

THREDDS(Unidata)

GUI(JSP)

Local Storage

Service Bus (ServiceMix)

HEG ART TSPT

HPC2 Storage HPC2 clusters

Wiki(MediaWiki)

Glo

bus

GRAMgridFTP

Web access

Content aggregation

Portlets

SOA

Grid Computing

REST AJAX

Page 8: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Current WorkSupport for NASA LIS RPC experiment

* Valentine Anantharaj (MSU/GRI) - PI

Web Browser

REST/AJAX

Service Bus

LISpost-

processor

JobSubmission

Service

JobMonitoring

Service

FileTransferService

TDSService

LISinput deck generator

Standalone TDSclients

Createinputdeck

Requestexecution

Createexecution

environment

Stagefiles in

Listento jobstatus

changes

Post-processoutputs

Createmetadata

andprovenance

Postresultson TDS

Initialized by user Orchestrated services: workflow

Page 9: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Support for LIS experiments

Set LIS parameters

Create LIS input deck

Run LIS

Page 10: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Monitor the status

The post-processed file is automatically transferred to the TREDDS server

Page 11: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

This concludes my presentation on

Cyberinfrastructure forof the Rapid Prototyping Capability System

Tomasz Haupt

[email protected]

Cooperative Computing Group

Center for Advanced Vehicular Systems • Mississippi State University

Page 12: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Interactive Web Sitefor describing RPC experiments

Page 13: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Private space for discussions

Page 14: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

TDS-based data repository(data explorer)

Page 15: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Tools for data processing(currently HEG)

Page 16: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Performance Metrics Workbench (currently multispectral viewer)

Page 17: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Provenance

Page 18: Cyberinfrastructure for Rapid Prototyping Capability Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli Mississippi State University GeoResouces

Electronic Journals