GIS and Hydrologic Information Systems

By David Maidment, Tyler Jantzen and Ernest To

Center for Research in Water Resources

University of Texas at Austin

GIS and Hydrologic Information Systems

• Introduction to CUAHSI HIS

• WaterOneFlow web services

• ArcGIS Weather Downloader

GIS and Hydrologic Information Systems

• Introduction to CUAHSI HIS

• WaterOneFlow web services

• ArcGIS Weather Downloader

Ocean Sciences

CUAHSI-Hydrologic Information Systems

• CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc

• Formed in 2001 as a legal entity

• Program office in Washington (5 staff)

• Supported by the National Science Foundation

Earth Sciences

AtmosphericSciences

UCAR

CUAHSI

Unidata

HISNational Science Foundation

Geosciences Directorate

CUAHSI Member Institutions

109 Universities as of July 2006

DataHypotheses

Needs

Tools

Data

Models

Exogenous DataTechnological

Advances

CommunitySupport

Multi-DisciplinaryTeams

HydrologicSynthesis

HydrologicObservatories

MeasurementTechnology

HydrologicInformation

Systems

CommunitySupport

AdditionalHypotheses

CUAHSI Program Components

Project co-PI

Collaborator

CUAHSI HIS Partner Institutions

HIS Goals

• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data

• Support for Observatories – synthesizing hydrologic data for a region

• Advancement of Hydrologic Science – data modeling and advanced analysis

• Hydrologic Education – better data in the classroom, basin-focused teaching

GIS and Hydrologic Information Systems

• Introduction to CUAHSI HIS

• WaterOneFlow web services

• Texas HIS

• ArcGIS Weather Downloader

Rainfall & SnowWater quantity

and quality

Remote sensing

Water Data

Modeling Meteorology

Soil water

Water Data Web Sites

NWISWeb site output# agency_cd Agency Code# site_no USGS station number# dv_dt date of daily mean streamflow# dv_va daily mean streamflow value, in cubic-feet per-second# dv_cd daily mean streamflow value qualification code## Sites in this file include:# USGS 02087500 NEUSE RIVER NEAR CLAYTON, NC#agency_cd site_no dv_dt dv_va dv_cdUSGS 02087500 2003-09-01 1190USGS 02087500 2003-09-02 649USGS 02087500 2003-09-03 525USGS 02087500 2003-09-04 486USGS 02087500 2003-09-05 733USGS 02087500 2003-09-06 585USGS 02087500 2003-09-07 485USGS 02087500 2003-09-08 463USGS 02087500 2003-09-09 673USGS 02087500 2003-09-10 517USGS 02087500 2003-09-11 454

Time series of streamflow at a gaging station

CUAHSI Hydrologic Data Access System

A common data window for accessing, viewing and downloading hydrologic information

USGSUSGS

NASANASANCDCNCDCEPAEPA NWSNWS

Observatory DataObservatory Data

http://river.sdsc.edu/HDAS

Observation Stations

Ameriflux Towers (NASA & DOE) NOAA Automated Surface Observing System

USGS National Water Information System NOAA Climate Reference Network

Map for the US

Water Quality Measurement Sites in EPA Storet

Substantial variation in data availability from states

Data from Bora Beran, Drexel University

Water Quality Measurement Sites from Texas Commission for Environmental Quality (TCEQ)

Geographic Integration of Storet and TCEQ Data in HIS

NWIS Station Observation Metadata

Describe what has been measured at this station

Web Page Scraping

ProgrammaticallyProgrammatically construct a construct a URL string as produced by URL string as produced by manual usemanual use of the web page of the web page

http://nwis.waterdata.usgs.gov/nwis/discharge?site_no=02087500&agency_cd=USGS&....http://nwis.waterdata.usgs.gov/nwis/discharge?site_no=02087500&agency_cd=USGS&....

ParseParse the resulting ASCII file the resulting ASCII file

CUAHSI Web Services

Web ServicesLibrary

Web Application: Data Portal

Your application• Excel, ArcGIS, Matlab• Fortran, C/C++, Visual Basic• Hydrologic model• …………….

Your operating system• Windows, Unix, Linux, Mac

Internet Simple Object Access Protocol

NWISNWIS

ArcGISArcGIS

ExcelExcel

NCARNCAR

UnidataUnidata

NASANASAStoretStoret

NCDCNCDC

AmerifluxAmeriflux

MatlabMatlab

AccessAccess JavaJava

FortranFortran

Visual BasicVisual Basic

C/C++C/C++

Some operational services

CUAHSI Web ServicesCUAHSI Web Services

Data SourcesData Sources

ApplicationsApplications

Extract

Transform

Load

http://www.cuahsi.org/his/

Operational Services

Service Ameriflux Daymet MODIS NWIS NAM

GetSites Yes

GetSiteInfo Yes Yes

GetVariables Yes Yes

GetVariableInfo Yes Yes

GetValues Yes Yes Yes Yes Yes

GetChart Yes Yes

Water OneFlow• Like Geospatial OneStop, we need a “Water

OneFlow” – a common window for water data and models

• Advancement of water science is critically dependent on integration of water information

Federal

AcademicLocal

State

GIS and Hydrologic Information Systems

• Introduction to CUAHSI HIS

• WaterOneFlow web services

• ArcGIS Weather Downloader

WeatherDownloaderThe WeatherDownloader tool ingests historical and forecastedweather data from remote data repositories …

A watershed

…into a ArcHydro TimeSeries table

Daymet• generates daily surfaces of temperature, precipitation, humidity, and

radiation over large regions of complex terrain. • developed at the University of Montana, Numerical Terradynamic

Simulation Group (NTSG), to fulfill the need for fine resolution, daily meteorological and climatological data necessary for plant growth model inputs.

• Data are published at http://www.daymet.org (period of record = 1/1/1980 to 12/31/1997).

• Data can be accessed programmatically via a web service at:http://river.sdsc.edu/DAYMETTS/DAYMET.asmx

Data sources – historical weather

Daymet interface allows data to be downloaded for any point in the conterminous US.

Lat, Long

Output

NAM12km

• stands for North American Mesoscale model (12km resolution).• predicts climate variables for the conterminous United States.• runs four times daily (0:00 UTC, 6:00 UTC, 12:00 UTC and 18:00

UTC).• predictions are made 84 hours into the future. • The spatial resolution of the model grid is 12.19 km, and the grid

dimensions are 614 x 428.• Data are published at

http://motherlode.ucar.edu:8080/thredds/catalog/model/NCEP/NAM/CONUS_12km/catalog.html

• Data can be accessed programmatically via a web service at:http://river.sdsc.edu/UnidataTS/Nam12km.asmx

Data sources – forecasted weather

Grid indices: i,j

Output

NAM12km interface allows data to be downloaded for a single cell or an array of grid cells in the conterminous US.

WeatherDownloader CUAHSI Web service

How WeatherDownloader works

obtains 1. point featureclass

of desired locations

2. climate variables3. date range from user interface.

converts standardized request to URL query.

imports VB object into the ArcHydro TimeSeries table.

converts response to a standardized XML.

DataRepository

URL query

Response

extracts lat, long coordinates from each point.

HydroObjects

converts XML to VB object

parses user inputs into standardized “GetValues” request for a CUAHSI web service.

In ArcMap

Called by ArcMap

Other sources for WeatherDownloader

• WeatherDownloader contains an advanced feature that allows ingestion of data from other web services.

• The requirement is that the web services are compliant with the CUAHSI GetValues standard.

Inputs

• HydroID and TSTypeID to identify the downloaded data in the ArcHydro TimeSeries table.

wsdl of the webservice

web service name

web method

parameters

In this example, the user is downloading data from a remote SQL database by accessing the web services that wrap the database.

Station ID

VariableCode (Water Temperature)

End Date

Start Date

Outputs

Data are ingested into the TimeSeries table of the ArcHydro Database the same way as with Daymet and NAM12km.

Summary of Demo

1. WeatherDownloader harnesses Daymet and Nam12km web services to ingest historical and forecasted weather data into ArcGIS.

2. It can also ingest data from other web services as long as they are compliant with CUAHSI’s GetValues standard.

Series and FieldsFeatures

Point, line, area, volumeDiscrete space representation

Series – ordered sequence of numbersTime series – indexed by time

Frequency series – indexed by frequency

Surfaces Fields – multidimensional arrays

Scalar fields – single value at each locationVector fields – magnitude and direction Random fields – probability distribution

Continuous space representation

mm / 3 hours

Precipitation Evaporation

North American Regional Reanalysis of Climate

Variation during the day, July 2003

NetCDF format

Conclusions

• CUAHSI Hydrologic Information System synthesizes water data and models

• WaterOneFlow web services provide a common data window on water observational data from many sources

• Observational data at points and also weather field information can be accessed