u.s. integrated ocean observing system data access services coastal geotools: advances in federal...

21
U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe Rae, Derrick Snowden , Becky Baltes, and Robert Ragsdale, NOAA/US April 1, 2015

Upload: cuthbert-page

Post on 17-Jan-2018

219 views

Category:

Documents


0 download

DESCRIPTION

What is DMAC? DMAC is the collection of people, process, and technology that enable the dissemination of diverse and distributed data sets using the WWW as the platform. IOOS is deploying, and in some cases building, infrastructure to enable this dissemination.

TRANSCRIPT

Page 1: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES

Coastal Geotools: Advances in Federal Data Access ServicesHassan Moustahfid, Chris Duncombe Rae, Derrick Snowden, Becky Baltes, and Robert Ragsdale, NOAA/US

April 1, 2015

Page 2: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

85

6

11

2

4

10

3

7

9

1

U.S. IOOS®: Program Overview

2

• Codified in law (P.L. No 111-11, March 2009)

• Partnership effort that leverages dispersed national investments to deliver ocean, coastal and Great Lakes data relevant to decision-makers

12

Coastal Component– 17 Federal agencies– 13 regional partners– Academia & Industry

Global Component– US contribution to GOOS– 64% of the Global Climate

Ocean Observing System completed

Page 3: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

3

What is DMAC?

2014-04-15

DMAC is the collection of people, process, and technology that enable the dissemination of diverse and distributed data sets using the WWW as the platform.

IOOS is deploying, and in some cases building, infrastructure to enable this dissemination.

Page 4: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Technical Solutions 4

A layered view of the primary roles within IOOS/DMAC

2014-04-15

Raw data

Knowledge

Page 5: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Exposing Data!

52014-04-15Implementation across the enterprise

Functional DACs complement the regional footprint

Page 6: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Anatomy of an RA DAC

Page 7: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

7

Operational Use of HF Radar Surface Currents for Search And Rescue

Surface Currents

Search And Rescue Optimal Planning

System (SAROPS)

Data Acquisition

Data Product Generation & Management

2014-04-15

Page 8: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Technical solutions 8

HFR SAROPS as an example of the layered architecture in practice.

Application or Service Provider

Brokering Systems

Interoperability Services for Data Distribution on the Web

Data, Models, Metadata, Raw information

Service, Data, Asset Catalogs

Intermediate Product Developers

THREDDS Servers

2014-04-15

Page 9: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

10

IOOS Model Data Interoperability Design

ClientsNetCDF-Java

NetCDF4-Python ERDDAP

ROMS

ADCIRC

HYCOM

SELFENCOM

FVCOM

Observed data (buoy, gauge, ADCP, glider)

Matlab PanoplyIDV ArcGIS Python Godiva2

Com

mon

D

ata

Mod

el

Apply Standardization

Distribute viaWeb Services

OPeNDAP+CF WCS

NetCDF Subset WMS

ncISO

SOS

GridUgridTimeSeriesProfileTrajectoryTimeSeriesProfile

Application or Service Provider

Brokering Systems

Interoperability Services for Data Distribution on the Web

Data, Models, Metadata, Raw information

2015-04-01Advances in a Distributed Approach for Ocean Model Data Interoperability; http://www.mdpi.com/2077-1312/2/1/194

Page 10: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Technical solutions 11

Use Case: Model Data comparison using web services

33 Tb 4D model output on a triangular mesh grid

CO-OPS offers 1019 data sets via their SOS containing water level and met parameters

Plot the time series of observed water level and model simulation sampled at the observation locations, via web services.

2014-04-15

http://tidesandcurrents.noaa.gov/map/

Page 11: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

http://nbviewer.ipython.org/urls/raw.githubusercontent.com/rsignell-usgs/notebook/fef9438303b49a923024892db1ef3115e34d8271/CSW/IOOS_inundation.ipynb

12

Model Data comparison con’t

2014-04-15

Modify in your browser; Runs in the cloud; No need to download data;

Page 13: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Multi-scale Ultra-high Resolution (MUR) SST analysis, Global, 0.011 Degree, Daily

http://coastwatch.pfeg.noaa.gov/erddap/griddap/jplMURSST.largePng?analysed_sst[(2015-03-30T09:00:00Z)][(0.00549316):(55.0031)][(-134.995):(-39.9957)]&.draw=surface&.vars=longitude|latitude|analysed_sst&.colorBar=|||||

Access MethodsTHREDDSHyraxLive Access ServerWMSWCSERDDAP

Available FormatsnetCDFImagesEsri ASCIIJsonMatlabOPeNDAP

Page 14: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Comparison of 1km Data Sets

MODIS SST (4 micron)

Courtesy NASA GSFC OBPG

JPL G1SST

Courtesy Yi Chao, UCLA

Page 15: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

A network of underwater profiling gliders

catalog.ioos.us/gliders

Page 16: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Multi-disciplinary and multi-mission capabilities

17

Climate/Ecosystem/Fisheries Management/Water Quality

Hurricane Forecasting Response to Oil Spill

The SoCal Niño IndexCalCOFI Fish Tracking

HAB

Deep Water Horizon Alaska

Hypoxia

Exercising the Network

Page 17: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Glider DAC Update

18

• National standards to ease exchange of data from regional glider operators

• Real-time distribution to non-federal and federal partners

• Share your data• Let us make it easier• Archiving

Page 18: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

Biological and Physical Data IntegrationBeta version of marine mammal health mapping tool

Page 19: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe

oceanview.pfeg.noaa.gov/ATN

Page 20: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe
Page 21: U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe