applying photonics to user needs: the application challenge
DESCRIPTION
05.02.28 Invited Talk to the 4th Annual On*VECTOR International Photonics Workshop Sponsored by NTT Network Innovation Laboratories Title: Applying Photonics to User Needs: The Application Challenge University of California, San DiegoTRANSCRIPT
![Page 1: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/1.jpg)
“Applying Photonics to User Needs: The Application Challenge"
Invited Talk to the4th Annual ON*VECTOR International Photonics Workshop
Sponsored by NTT Network Innovation LaboratoriesUniversity of California, San Diego
La Jolla, CAFebruary 28, 2005
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technology
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
![Page 2: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/2.jpg)
The ON*VECTOR International Photonics Workshop Gives Special Thanks to the UCSD Sun God
![Page 3: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/3.jpg)
Four Classes of Applications are Driving the Optical Networked Virtual Environment for
Collaborative Trans-Oceanic Research (ON*VECTOR)
• Browsing & Analysis of Multiple Large Remote Data Objects
• Telepresence, CineGrid, and Shared Virtual Reality
• Assimilating Data—Linking Supercomputers with Data Sets
• Interacting with Remote Scientific Instruments
![Page 4: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/4.jpg)
Realizing the Dream:High Resolution Portals to Global Science Data
30 MPixel SunScreen Display Driven by a 20-node Sun Opteron Visualization Cluster
Source: Mark Ellisman, David Lee, Jason Leigh
150 Mpixel Microscopy MontageGreen: Purkinje CellsRed: GFAP in the Glial CellsBlue: DNA in Cell Nuclei
![Page 5: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/5.jpg)
Tiled Displays Allow for Both Global Context and High Levels of Detail—150 MPixel Rover Image on 40 MPixel OptIPuter Visualization Node Display
"Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee"
![Page 6: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/6.jpg)
Interactively Zooming In Using EVL’s JuxtaView on NCMIR’s Sun Microsystems Visualization Node
"Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee"
![Page 7: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/7.jpg)
Highest Resolution Zoomon NCMIR 40 MPixel OptIPuter Display Node
"Source: Data from JPL/Mica; Display UCSD NCMIR, David Lee"
![Page 8: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/8.jpg)
Cumulative EOSDIS Archive Holdings--Adding Several TBs per Day
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,00020
01
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
Calendar Year
Cu
mu
lati
ve T
era
Byt
es
Other EOSHIRDLSMLSTESOMIAMSR-EAIRS-isGMAOMOPITTASTERMISRV0 HoldingsMODIS-TMODIS-A
Other EOS =• ACRIMSAT• Meteor 3M• Midori II• ICESat• SORCE
file name: archive holdings_122204.xlstab: all instr bar
Terra EOMDec 2005
Aqua EOMMay 2008
Aura EOMJul 2010
NOTE: Data remains in the archive pending transition to LTA
Source: Glenn Iona, EOSDIS Element Evolution Technical Working Group January 6-7, 2005
![Page 9: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/9.jpg)
Challenge: Average Throughput of NASA Data Products to End User is Only < 50 Megabits/s
Tested from GSFC-ICESATJanuary 2005
http://ensight.eos.nasa.gov/Missions/icesat/index.shtml
![Page 10: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/10.jpg)
Interactive Retrieval and Hyperwall Display of Earth Sciences Images Using NLR
Earth science data sets created by GSFC's Scientific Visualization Studio were retrieved across the NLR in real time from OptIPuter servers in Chicago and San Diego and from GSFC servers in McLean, VA, and displayed
at the SC2004 in Pittsburgh
Enables Scientists To Perform Coordinated Studies Of
Multiple Remote-Sensing Datasets
http://esdcd.gsfc.nasa.gov/LNetphoto3.html
Source: Milt Halem & Randall Jones, NASA GSFC& Maxine Brown, UIC EVL
Eric Sokolowsky
![Page 11: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/11.jpg)
Landsat7 Imagery100 Foot Resolution
Draped on elevation data
High Resolution Aerial Photography Generates Images With 10,000 Times More Data than Landsat7
Shane DeGross, Telesis
USGSNew USGS Aerial ImageryAt 1-Foot Resolution
~10x10 square miles of 350 US Cities 2.5 Billion Pixel Images Per City!
![Page 12: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/12.jpg)
Multi-Gigapixel Images are Available from Film Scanners Today
The Gigapxl Projecthttp://gigapxl.org
Balboa Park, San Diego
![Page 13: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/13.jpg)
Large Image with Enormous DetailRequire Interactive LambdaVision Systems
One Square Inch Shot From 100
Yards
The OptIPuter Project is Pursuing
Obtaining some of these Images
forLambdaVision
100M Pixel Walls
http://gigapxl.org
![Page 14: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/14.jpg)
Cosmic Simulator with a Billion Zone and Gigaparticle Resolution
• 5123 AMR or 10243 Unigrid • 8-64 Times Mass Resolution• Can Simulate First Galaxies• One Gigazone Run:
– Output ~10 TeraByte – “Snapshot” is 100 GB– Must Visually Analyze
Source: Mike Norman, UCSD
SDSC Blue Horizon (2004)
10243 Unigrid
To a LambdaGrid, a Supercomputer is Just
Another High Performance Data Generator
![Page 15: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/15.jpg)
Four Classes of LambdaGrid Applications
• Browsing & Analysis of Multiple Large Remote Data Objects
• Telepresence, CineGrid, and Shared Virtual Reality
• Assimilating Data—Linking Supercomputers with Data Sets
• Interacting with Remote Scientific Instruments
![Page 16: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/16.jpg)
Telepresence Using Uncompressed HDTV Streaming Over IP on Fiber Optics
Seattle
JGN II WorkshopJanuary 2005
Osaka
Prof. OsakaProf. Aoyama
Prof. Smarr
![Page 17: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/17.jpg)
Goal—Upgrade Access Grid to HD Streams Over IP on Dedicated Lambdas
Access Grid Talk with 35 Locations on 5 Continents—SC Global Keynote Supercomputing 04
![Page 18: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/18.jpg)
Calit2 Collaboration Rooms Testbed UCI to UCSD
In 2005 Calit2 will Link Its Two Buildings
via CENIC-XD Dedicated Fiber over 75 Miles Using OptIPuter Architecture to Create a
Distributed Collaboration Laboratory
UC Irvine UC San Diego
UCI VizClass
UCSD NCMIR
Source: Falko Kuester, UCI & Mark Ellisman, UCSD
![Page 19: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/19.jpg)
Applying the OptIPuter to Digital Cinema The Calit2 CineGrid Project
• Connect a Global Community of Users and Researchers– Engineering a Camera-to-Theatre Integrated System– Create Digital CineGrid Production & Teaching Tools – Engage Artists, Producers, Scientists, Educators
• Educational & Research Testbed Using OptIPuter Architecture – Scaling to 4K SHD and Beyond!– Distributed Computing, Storage, Visualization & Collaboration– CAVEwave and Global Lambda Infrastructure Facility (GLIF)– Support CineGrid Network Operations from Calit2
• Develop Partnerships with Industry and Universities, e.g.:– USC School of Cinema-Television– DCTF in Japan– National School of Cinema in Italy
Source: Laurin Herr, Pacific-Interface
![Page 20: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/20.jpg)
Alliance 1997: Collaborative Video Production --Upgrade to OptIPuter and CineGrid
Donna Cox, Bob Patterson, Stuart Levy, Glen Whelesswww.ncsa.uiuc.edu/People/cox/
Alliance Project Linking CAVE, Immersadesk, Power Wall, and Workstation
via Tele-Immersion and Virtual Director
UIC
![Page 21: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/21.jpg)
Four Classes of LambdaGrid Applications
• Browsing & Analysis of Multiple Large Remote Data Objects
• Telepresence, CineGrid, and Shared Virtual Reality
• Assimilating Data—Linking Supercomputers with Data Sets
• Interacting with Remote Scientific Instruments
![Page 22: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/22.jpg)
Increasing Accuracy in Hurricane Forecasts Real Time Diagnostics in GSFC of Ensemble Runs on ARC Project Columbia
Operational ForecastResolution of National Weather Service
Higher Resolution Research ForecastNASA Goddard Using Ames Altix
5.75 Day Forecast of Hurricane Isidore
Resolved Eye Wall
Intense Rain-
Bands
4x Resolution
Improvement
Source: Bill Putman, Bob Atlas, GFSC
NLR will Remove the InterCenter Networking Bottleneck
Project Contacts: Ricky Rood, Bob Atlas, Horace Mitchell, GSFC; Chris Henze, ARC
![Page 23: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/23.jpg)
Next Step: OptIPuter, NLR, and Starlight EnablingCoordinated Earth Observing Program (CEOP)
Note Current Throughput 15-45 Mbps:OptIPuter 2005 Goal is ~1-10 Gbps!
http://ensight.eos.nasa.gov/Organizations/ceop/index.shtml
Accessing 300TB’s of Observational Data in Tokyo and 100TB’s of Model Assimilation Data in MPI in Hamburg -- Analyzing Remote Data Using GRaD-DODS at These Sites Using OptIPuter Technology Over the NLR and Starlight
Source: Milt Halem, NASA GSFC
SIO
![Page 24: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/24.jpg)
Use OptIPuter to Couple Data Assimilation Models to Remote Data Sources and Analysis in Near Real Time
Regional Ocean Modeling System (ROMS) http://ourocean.jpl.nasa.gov/
Goal is Real Time Local Digital Ocean Models
Long Range HF Radar
![Page 25: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/25.jpg)
Four Classes of LambdaGrid Applications
• Browsing & Analysis of Multiple Large Remote Data Objects
• Telepresence, CineGrid, and Shared Virtual Reality
• Assimilating Data—Linking Supercomputers with Data Sets
• Interacting with Remote Scientific Instruments
![Page 26: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/26.jpg)
Brain Imaging Collaboration -- UCSD & Osaka Univ. Using Real-Time Instrument Steering and HDTV
Southern California OptIPuterMost Powerful Electron Microscope in the World
-- Osaka, Japan
Source: Mark Ellisman, UCSD
UCSDHDTV
![Page 27: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/27.jpg)
LOOKING: (Laboratory for the Ocean Observatory
Knowledge Integration Grid)
New OptIPuter Application Driver: Gigabit Fibers on the Ocean Floor
• LOOKING NSF ITR with PIs:– John Orcutt & Larry Smarr - UCSD– John Delaney & Ed Lazowska –UW– Mark Abbott – OSU
• Collaborators at:– MBARI, WHOI, NCSA, UIC, CalPoly, UVic,
CANARIE, Microsoft, NEPTUNE-Canarie• Goal: Prototype Cyberinfrastructure for NSF
ORION
www.neptune.washington.edu
LOOKING--Integrate Instruments & Sensors
(Real Time Data Sources) Into a LambdaGrid
Computing Environment With Web Services Interfaces
![Page 28: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/28.jpg)
Pilot Project ComponentsPilot Project Components
LOOKING Builds on the Multi- Institutional SCCOOS Program, OptIPuter, and CENIC-XD
• SCCOOS is Integrating:– Moorings– Ships– Autonomous Vehicles – Satellite Remote Sensing– Drifters– Long Range HF Radar – Near-Shore
Waves/Currents (CDIP)– COAMPS Wind Model– Nested ROMS Models– Data Assimilation and
Modeling– Data Systems
www.sccoos.org/
www.cocmp.org
Yellow—Initial LOOKING OptIPuter Backbone Over CENIC-XD
![Page 29: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/29.jpg)
MARS New Gen Cable Observatory Testbed - Capturing Real-Time Basic Environmental Data
Tele-Operated Crawlers
Central Lander
MARS Installation Oct 2005 -Jan 2006
Source: Jim
Bellingham, MBARI
![Page 30: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/30.jpg)
Goal – From Expedition to Cable Observatories with Streaming Stereo HDTV Robotic Cameras
Scenes from The Aliens of the Deep, Directed by James Cameron &
Steven Quale
http://disney.go.com/disneypictures/aliensofthedeep/alienseduguide.pdf
![Page 31: Applying Photonics to User Needs: The Application Challenge](https://reader036.vdocuments.net/reader036/viewer/2022062319/558555d7d8b42a54608b4d9d/html5/thumbnails/31.jpg)
September 26-30, 2005University of California, San Diego
California Institute for Telecommunications and Information Technology
The Networking Double Header of the Century Will Be Driven by LambdaGrid Applications
iGrid
2oo5T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y
Maxine Brown, Tom DeFanti, Co-Organizers
www.startap.net/igrid2005/
http://sc05.supercomp.org