Hydrologic Information System

for the NationIlya Zaslavsky

Spatial Information Systems LabSan Diego Supercomputer Center

UCSD

BOM talk, Melbourne, March 19, 2009

http://his.cuahsi.orghttp://hiscentral.cuahsi.orghttp://hydroseek.nethttp://river.sdsc.edu/ucsddashhttp://wron.net.au/DemosII/Modules/ODMKMLGatway.aspxhttp://maxim.ucsd.edu/mattsmaps/storet.aspx

SDSC Spatial Information Systems Lab

Research and system development• Services-based spatial information

integration infrastructure, CI projects• Mediation services for spatial data, query

processing, map assembly services• Long-term spatial data preservation• Spatial data standards and technologies for

online GIS (SVG, WMS/WFS)• Support of spatial data projects at SDSC

and beyond

Mediator

LegendGenerator

MapAssembler

Ontology

…

GRID SERVICESFOR MAP INTEGRATION

Mediator

LegendGenerator

MapAssembler

Ontology

…

GRID SERVICESFOR MAP INTEGRATION

services

In Geosciences (GEON, CUAHSI, CBEO,…)

Spatial web services

FederalAgencies

Figure 1.26 The Geography Network.

ESRICounty spatial data and toxicant information

Telesis, other localNon-profits

CA state

WSDL

WSWSDL

WSWSDL

WSWSDL

WSWSDL

WSWSDL

WS

Student projects

The CHI ME Model

In regional development (NIEHS SBRP, CRN…)

In Neurosciences (BIRN, CCDB, WBC)

http://spatial.sdsc.edu/lab/

Contact: zaslavsk@sdsc.edu

Web Services for Generating SVG Tiny Maps

on Mobile Phones

J2ME device

Java + Batik

Viewers:TinyLineSquiggleAdobe’s ASV

Services for generating object textures for Torque

.Net + C#

Spatial data servers

Background

Coordinate System

Veins

Arteries

Optic nerve

Fovea

Cotton-Wool

Hemorrhages

I

II

InferiorInferiorHemisphereHemisphere

PapMac180° 0°

I

II

InferiorInferiorHemisphereHemisphere

PapMac180° 0°

Foveal Coordinate System

CUAHSI HIS: NSF support through 2012 (GEO), ~10 mil invested

Partners:Academic: 11 NSF hydrologic observatories, CEO:P projects, LTER…Government: USGS, EPA, NCDC, NWS, state and localCommercial: Microsoft, ESRI, KistersInternational: Australia, UKStandardization: OGC, WMO (Hydrology Domain WG, CHy); adopted by USGS, NCDC

An online distributed system to support the sharing of hydrologic data from multiple repositories and databases via standard water data service protocols;

software for data publication, discovery, access and integration.

What is the CUAHSI HIS?

Observation Stations

Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System

USGS National Water Information System NOAA Climate Reference Network

Map for the US

Build a common window on water data using web services

Water Data Web Sites

NWISWeb site output# agency_cd Agency Code# site_no USGS station number# dv_dt date of daily mean streamflow# dv_va daily mean streamflow value, in cubic-feet per-second# dv_cd daily mean streamflow value qualification code## Sites in this file include:# USGS 02087500 NEUSE RIVER NEAR CLAYTON, NC#agency_cd site_no dv_dt dv_va dv_cdUSGS 02087500 2003-09-01 1190USGS 02087500 2003-09-02 649USGS 02087500 2003-09-03 525USGS 02087500 2003-09-04 486USGS 02087500 2003-09-05 733USGS 02087500 2003-09-06 585USGS 02087500 2003-09-07 485USGS 02087500 2003-09-08 463USGS 02087500 2003-09-09 673USGS 02087500 2003-09-10 517USGS 02087500 2003-09-11 454

Time series of streamflow at a gaging station

Water Data Services• Set of query functions • Returns data in WaterML

NWIS Daily Values (discharge), NWIS Ground Water, NWIS Unit Values (real time), NWIS Instantaneous Irregular Data, EPA STORET, NCDC ASOS, DAYMET, MODIS, NAM12K, USGS SNOTEL, ODM (multiple sites)

Test bed HISServers

Central HIS servers

ArcGIS

Matlab

IDL, R

MapWindow

Excel

Programming (Fortran, C, VB)

Desktop clients

Customizable web interface (DASH)

HTML - XMLW

SD

L - SO

AP

Modeling (OpenMI)

Global search (Hydroseek)

Water Data Web Services, WaterML

HIS LiteServers

External data providers

Deployment to test beds

Other popular online clients

ODM DataLoader

Streaming Data Loading

Ontology tagging (Hydrotagger)

WSDL and ODM registration

Data publishing

ODMTools

Server config tools

HIS CentralRegistry & Harvester

Hydrologic Information System Service Oriented Architecture

Central HIS Data

Services

Catalog

Semantic Tagging of Harvested Variables

Hydroseekhttp://www.hydroseek.net

Supports search by location and type of data across multiple observation networks including NWIS, Storet, and academic data

Online mapping over hydrologic observation OLAP cubes

Summary• Cyberinfrastructure for managing and publishing observational data

– Supports many types of point observational data– Overcomes syntactic and semantic heterogeneity using a standard data

model and controlled vocabularies– Supports a national network of observatory test beds but can grow!

• WaterML is a standard language for consistently communicating water observations data from academic and government sources using web services – develops towards OGC standards; already adopted by several federal agencies

• National Water Metadata Catalog is the most comprehensive index of the nation’s water observations presently existing (1.75 million stations – the largest in the world)

• The system is already deployed in the US and internationally

Business Models►A software product. Hardly…►A data product:

What is the market for it; how expensive is it to maintain, what is the model (subscription?)

►A specialized search engine, with ad revenue?

►A service Setting up HIS servers; preparing data;

developing integration solutions, consulting, etc.

►A cyberinfrastructure product??

What is a cyberinfrastructure product?

► CI: mixed ownership and licensing models, hodgepodge of technologies, autonomously managed, assembled on demand for more or less common scenarios

► There should be governance and mediation to make CI work. Potential CI vantage points: Controlling standards development and adoption; object

identifiers, ontologies and controlled vocabularies Being the “first compliant software” Automatic endorsement by federal and other agencies,

international market? Controlling access to CI tools

► The value of CI grows as it grows, and more users and data contributors join in