Deployment and Evaluation of an Observations Data Model

Jeffery S HorsburghDavid G Tarboton

Ilya ZaslavskyDavid R. Maidment

David Valentine

http://www.cuahsi.org/his.htmlSupportEAR 0622374

WaterOneFlow Web Services

Data access through web

services

Data storage through web

services

Dow

nlo

ads

Upl

oa

ds

Observatory data servers

CUAHSI HIS data servers

3rd party data servers

e.g. USGS, NCDC

GIS

Matlab

IDL

Splus, R

Excel

Programming (Fortran, C, VB)

Web services interface

Data Access System for Hydrology (DASH) Website Portal and Map Viewer

Information input, display, query and output services

Preliminary data exploration and discovery. See what is available and perform exploratory analyses

HTML -XML WS

DL

- SO

AP

ODMODM

CUAHSI Observations Data Model• A relational database at the

single observation level (atomic model)

• Stores observation data made at points

• Metadata for unambiguous interpretation

• Traceable heritage from raw measurements to usable information

• Standard format for data sharing

• Cross dimension retrieval and analysis

Streamflow

Flux towerdata

Precipitation& Climate

Groundwaterlevels

Water Quality

Soil moisture

data

CUAHSI Observations Data Modelhttp://www.cuahsi.org/his/odm.html

Discharge, Stage, Concentration and Daily Average Example

Stage and Streamflow Example

ODM Implementation in WATERS Network Information System

• 11 WATERS Network test bed projects• 16 ODM networks (some test beds have more than one

network)• Data from 1246 sites, of these, 167 sites are operated by

WATERS investigators

National Hydrologic Information ServerSan Diego Supercomputer Center

Florida – Santa Fe Watershed

Nitrate Nitrogen (mg/L)

Millpond Spring

PI: Wendy Graham, ….; DM: Kathleen McKee, Mark Newman

Utah – Little Bear River and Mud Lake

Turbidity

Continuous turbidity observations at the Little Bear River at Mendon Road from two different turbidity sensors.

Managing Data Within ODM - ODM Tools

• Load – import existing data directly to ODM

• Query and export – export data series and metadata

• Visualize – plot and summarize data series

• Edit – delete, modify, adjust, interpolate, average, etc.

Methods for Data Loading

SQL Server Integration Services

Interactive Data Loader

Scheduled Data Loader

Direct analysis from your favorite analysis environment. e.g. Matlab

% create NWIS Class and an instance of the classcreateClassFromWsdl('http://water.sdsc.edu/wateroneflow/NWIS/DailyValues.asmx?WSDL');WS = NWISDailyValues;% GetValues to get the datasiteid='NWIS:02087500';bdate='2002-09-30T00:00:00';edate='2006-10-16T00:00:00';variable='NWIS:00060';valuesxml=GetValues(WS,siteid,variable,bdate,edate,'');

1920 1930 1940 1950 1960 1970 1980 1990 2000 20100

0.5

1

1.5

2

2.5x 10

4

cfs

Daily Discharge NEUSE RIVER NEAR CLAYTON, NC

Summary

• Syntactic heterogeneity (File types and formats)• Semantic heterogeneity

– Language for observation attributes– Language to encode observation attribute values

• A national network of consistent data• Enhanced data availability• Metadata to facilitate unambiguous interpretation• Enhanced analysis capability

Future Considerations

• Additional data types (grid, image etc.)

• Additional catalog sets to enhance discovery

• Unit standardization and conversion

• Ownership, security, authentication, provenance

• Improve controlled vocabulary constraints to enhance integrity

Databases: Structured data sets to facilitate data integrity and effective sharing and analysis.- Standards- Metadata- Unambiguous interpretation

Analysis: Tools to provide windows into the database to support visualization, queries, analysis, and data driven discovery.

Models: Numerical implementations of hydrologic theory to integrate process understanding, test hypotheses and provide hydrologic forecasts.

Advancement of water science is critically dependent on integration of water information

Databases Analysis

Models

ODM

Web Services

HIS Websitehttp://www.cuahsi.org/his.html

• Project Team – Introduces members of the HIS Team

• Data Access System for Hydrology – Web map interface supporting data discovery and retrieval

• Prototype Web Services – WaterOneFlow web services facilitating downlad of time series data from numerous national repositories of hydrologic data

• Observations Data Model – Relational database schema for hydrologic observations

• HIS Tools – Links to end-user applications developed to support HIS

• Documentation and Reports – Status reports, specifications, workbooks and links related to HIS

• Feedback – Let us know what you think

• Austin Workshop – Material from WATERS workshop in Austin