“Cyberinfrastructure to Support Ocean Observatories"

Invited Talk to the

Oceans Studies Board

National Research Council

UCSD, La Jolla, CA

March 18, 2005

Dr. Larry Smarr

Director, California Institute for Telecommunications and Information Technology

Harry E. Gruber Professor,

Dept. of Computer Science and Engineering

Jacobs School of Engineering, UCSD

Chair, NASA Earth System Science and Applications Advisory Committee

EOSDIS Archive Holdings Are Adding Several TBs/Dayto Federated Data Repositories

0

1,000

2,000

3,000

4,000

5,000

6,000

7,000

8,00020

01

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

2012

2013

2014

Calendar Year

Cu

mu

lati

ve T

era

Byt

es

Other EOSHIRDLSMLSTESOMIAMSR-EAIRS-isGMAOMOPITTASTERMISRV0 HoldingsMODIS-TMODIS-A

Other EOS =• ACRIMSAT• Meteor 3M• Midori II• ICESat• SORCE

file name: archive holdings_122204.xlstab: all instr bar

Terra EOMDec 2005

Aqua EOMMay 2008

Aura EOMJul 2010

NOTE: Data remains in the archive pending transition to LTA

Source: Glenn Iona, EOSDIS Element Evolution Technical Working Group January 6-7, 2005

Challenge: Average Throughput of NASA Data Products to End User is Only < 50 Megabits/s

Tested from GSFC-ICESATJanuary 2005

http://ensight.eos.nasa.gov/Missions/icesat/index.shtml

Forces a Non-Interactive Data

Architecture

Cyberinfrastructure Breakthrough—NLR ProvidesDedicated Optical Paths Between User and Data

First LightSeptember 2004

“National LambdaRail” PartnershipServes Very High-End Experimental and Research Applications

4 x 10Gb Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout

Links Two Dozen

State and Regional Optical

Networks

DOE and NASAUsing NLR

US IRNC (black)–20Gb NYC—Amsterdam–10Gb LA—TokyoGEANT/I2 (orange) –30Gb London, etc.—NYCUK to US (red)–10Gb London—ChicagoSURFnet to US (light blue)–10Gb Amsterdam—NYC–10Gb Amsterdam—ChicagoCanadian CA*net4 to US (white)–30Gb Chicago-Canada-NYC–30Gb Chicago-Canada-SeattleJapan JGN II to US (grey)–10Gb Chicago—TokyoEuropean (not GEANT) (yellow)–10Gb Amsterdam—CERN –10Gb Prague—Amsterdam–2.5Gb Stockholm—Amsterdam–10Gb London—AmsterdamIEEAF lambdas (dark blue)–10Gb NYC—Amsterdam–10Gb Seattle—Tokyo CAVEwave/PacificWave (purple)–10Gb Chicago—Seattle—SD–10Gb Seattle—LA—SD

Northern Light

UKLight

PNWGP

Japan

Manhattan Landing

CERN

Optical Circuits to the Pacific Rim and EuropeAlready Exist and Link to U.S.

The OptIPuter Project – Creating a LambdaGrid “Web” for Gigabyte Data Objects

• NSF Large Information Technology Research Proposal– Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI– Partnering Campuses: USC, SDSU, NW, TA&M, UvA, SARA, NASA

• Industrial Partners– IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent

• $13.5 Million Over Five Years• Linking Global Scale Science Projects to User’s Linux ClustersNIH Biomedical Informatics NSF EarthScope

and ORION

http://ncmir.ucsd.edu/gallery.html

siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml

Research Network

Earth and Planetary Sciences are an OptIPuter Large Data Object Visualization Driver

EVL Varrier Autostereo 3D Image USGS 30 MPixel Portable Tiled Display

SIO HIVE 3 MPixel Panoram

Schwehr. K., C. Nishimura, C.L. Johnson, D. Kilb, and A. Nayak, "Visualization Tools Facilitate Geological Investigations of Mars Exploration Rover Landing Sites",

IS&T/SPIE Electronic Imaging Proceedings, in press, 2005

Enabling Scientists to Analyze Large Data Objects:UCSD Campus LambdaStore Architecture

SIO Ocean SupercomputerIBM Storage Cluster

Extreme Switch with 2 Ten Gbps Uplinks

Streaming Microscope

Source: Phil Papadopoulos, SDSC, Calit2

UCSD

StarLight Chicago

UIC EVL

NU

CENIC San Diego GigaPOP

CalREN-XD

8

8

Expanding the OptIPuter LambdaGridProviding 1-10 Gbps Bandwidth

NetherLight Amsterdam

U Amsterdam

NASA Ames

NASA GoddardNLRNLR

2

SDSU

CICESE

via CUDI

CENIC/Abilene Shared Network

1 GE Lambda

10 GE Lambda

PNWGP Seattle

CAVEwave/NLR

NASA JPL

ISI

UCI

CENIC Los Angeles

GigaPOP

22

Interactive Retrieval and Hyperwall Display of Earth Sciences Images Using NLR

Earth science data sets created by GSFC's Scientific Visualization Studio were retrieved across the NLR in real time from OptIPuter servers in Chicago and San Diego and from GSFC servers in McLean, VA, and displayed

at the SC2004 in Pittsburgh

Enables Scientists To Perform Coordinated Studies Of

Multiple Remote-Sensing Datasets

http://esdcd.gsfc.nasa.gov/LNetphoto3.html

Source: Milt Halem & Randall Jones, NASA GSFC& Maxine Brown, UIC EVL

Eric Sokolowsky

Calit2 is Partnering with the New SIOCenter for Earth Observations and Applications

• Viewing and Analyzing Earth Satellite Data Sets• High Accuracy Topographic Measurements• Project Atmospheric Brown Clouds• Climate Modeling • Coastal Zone Data Assimilation• Ocean Observatories

NSF’s Ocean Observatories Initiative (OOI)Envisions Global, Regional, and Coastal Scales

LEO15 Inset Courtesy of Rutgers University, Institute of Marine and Coastal Sciences

A Broad Collaboratory to Prototype a Future Cyberinfrastructure of Interactive Ocean Observatories

• LOOKING NSF ITR with PIs:– John Orcutt & Larry Smarr – UCSD

– Scripps Institution of Oceanography– California Institute of Telecommunications and Information Technology

– John Delaney & Ed Lazowska –UW– Neptune Project– Department of Computer Science

– Mark Abbott – OSU• Collaborators at:

– Southern California Coastal Ocean Observing System– Monterey Bay Aquarium Research Institute (MBARI) – Woods Hole Oceanographic Institute (WHOI) – CalPoly, San Luis Obispo– University of Victoria, CANARIE, NEPTUNE-Canada – Centro de Investigacion Cientifica y de Educacion Superior de Ensenada– National Center for Supercomputing Applications (NCSA)– University of Illinois @ Chicago (UIC)– Microsoft

Coupling Regional and Coastal Ocean Observatories Using OptIPuter and Web/Grid Services

LOOKING: (Laboratory

for the Ocean Observatory Knowledge Integration

Grid)

www.neptune.washington.edu www.mbari.org/mars/

www.sccoos.org/

Looking High Level System Architecture

LOOKING Service Architecture

Pilot Project ComponentsPilot Project Components

LOOKING Builds on the Multi- Institutional SCCOOS Program, OptIPuter, and CENIC-XD

• SCCOOS is Integrating:– Moorings– Ships– Autonomous Vehicles – Satellite Remote Sensing– Drifters– Long Range HF Radar – Near-Shore

Waves/Currents (CDIP)– COAMPS Wind Model– Nested ROMS Models– Data Assimilation and

Modeling– Data Systems

www.sccoos.org/

www.cocmp.org

Yellow—Initial LOOKING OptIPuter Backbone Over CENIC-XD

Use OptIPuter to Couple Data Assimilation Models to Remote Data Sources and Analysis in Near Real Time

Regional Ocean Modeling System (ROMS) http://ourocean.jpl.nasa.gov/

Goal is Real Time Local Digital Ocean Models

Long Range HF Radar

Similar Work on SoCal Coast at SIO

MARS Cable Observatory Testbed – LOOKING Living Laboratory

Tele-Operated Crawlers

Central Lander

MARS Installation Oct 2005 -Jan 2006

Source: Jim

Bellingham, MBARI OptIPuter

Goal – From Expedition to Cable Observatories with Streaming Stereo HDTV Robotic Cameras

Scenes from The Aliens of the Deep, Directed by James Cameron &

Steven Quale

http://disney.go.com/disneypictures/aliensofthedeep/alienseduguide.pdf

Proposed Experiment for iGrid 2005 –Remote Interactive HD Imaging of Deep Sea Vent

Source John Delaney & Deborah Kelley, UWash