cuahsi hydrologic information systems
DESCRIPTION
CUAHSI Hydrologic Information Systems. By David R. Maidment - PowerPoint PPT PresentationTRANSCRIPT
CUAHSI Hydrologic Information Systems
By David R. Maidment
With support from many collaborators: Ilya Zaslavsky, Reza Wahadj, Chaitan Baru, Praveen Kumar, Michael Piasecki, Rick Hooper, Jon Duncan, David Tarboton, Jeff Horsburgh, Venkat Lakshmi, Chunmaio Zheng, Xu Liang, Yao Liang, Ken Reckhow, Upmanu Lall, LeRoy Poff, Dennis Lettenmaier, Barbara Minsker, ……
And many graduate students and post-docs: Venkatesh Merwade, Tim Whiteaker, Jon Goodall, Gil Strassberg, Ben Ruddell, Luis Bermudez, Bora Boran, ……
Thanks to everyone for all their help!
Ocean Sciences
CUAHSI-Hydrologic Information Systems
• CUAHSI – Consortium of Universities for the Advancement of Hydrologic Science, Inc
• Formed in 2001 as a legal entity
• Program office in Washington (5 staff)
• Rick Hooper is Executive Director
Earth Sciences
AtmosphericSciences
NSF Geosciences Directorate
UCAR
CUAHSI
Unidata
HIS
CUAHSI Member Institutions
101 Universities as of November 2005
DataHypotheses
Needs
Tools
Data
Models
Exogenous DataTechnological
Advances
CommunitySupport
Multi-DisciplinaryTeams
HydrologicSynthesis
HydrologicObservatories
MeasurementTechnology
HydrologicInformation
Systems
CommunitySupport
AdditionalHypotheses
CUAHSI HydroView Components
Environmental Cyberinfrastructure
• Part of NSF Cyberinfrastructure program
• CUAHSI Hydrologic Information Systems is one of several pilot projects – CUAHSI, CLEANER, ORION, NEON, …..
Project co-PI
Collaborator
CUAHSI HIS Partner Institutions
HIS Goals
• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data
• Support for Observatories – synthesizing hydrologic data for a region
• Advancement of Hydrologic Science – data modeling and advanced analysis
• Hydrologic Education – better data in the classroom, basin-focused teaching
HIS Goals
• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data
• Support for Observatories – synthesizing hydrologic data for a region
• Advancement of Hydrologic Science – data modeling and advanced analysis
• Hydrologic Education – better data in the classroom, basin-focused teaching
HIS User Assessment (Chapter 4 in Status Report)
Data Access
Science Observatorysupport
Education
Which of the four HIS goals is most important to you?
CUAHSI Hydrologic Data Access System(HDAS)
A common data window for accessing, viewing and downloading hydrologic information
USGS
NASANCDCEPA NWS
Observatory Data
CUAHSI Web Services
Web ServicesLibrary
Web application: Data PortalYour application• Excel, ArcGIS, Matlab• Fortran, C/C++, Visual Basic• Hydrologic model• …………….
Your operating system• Windows, Unix, Linux, Mac
Internet Simple Object Access Protocol
NWIS Station Information in HDAS
http://river.sdsc.edu/HDAS
Observation Site Files
Ameriflux Towers Automated Surface Observing System
USGS NWIS Stations Climate Reference Network
Observation Site Map for US
USGS NWISASOSClimate Research NetworkAmeriflux
+ others…….
Neuse Basin with all points
NWIS Streamflow and Water Quality
NWIS Groundwater
ASOS
NARR
Ameriflux
NWIS Streamflow and Water Quality
ASOSNARR
Ameriflux
Filtered Site Map
http://public.ornl.gov/ameriflux/
Building each web servicerequires a site map anda web services library
Ameriflux site map
Web services library
Ameriflux towers measure vertical fluxes of water, heat, CO2
NWIS
ArcGIS
Excel
NCAR
LTER
NAWQAStoret
NCDC
Ameriflux
Matlab
Access SAS
Fortran
Visual Basic
C/C++
CUAHSI Web Services
Some operational services
Direct and Indirect Web Services
• Direct web service– The data agency provides direct querying
ability into its archives through SOAP or OpenDAP (NCDC)
• Indirect web service– CUAHSI constructs a “web page mimic”
service, housed at SDSC, that programmatically mimics the manual use of an agency’s web pages (USGS, Ameriflux)
HydroObjects Library
• CUAHSI has developed a HydroObjects Library with web service wrappers that know where to access each web service and how to interpret its output
User Application(Excel, ArcGIS, …..)
HydroObjects Librarywith web service wrappers
for NWIS, Ameriflux, NCDC, …
Direct or Indirect web services
Web data
Standards are the Key• standards …
– Industry standards already exists:• SOAP = Simple Object Access Protocol• WSDL = Web Service Definition Language
– Hydrologic community must add their own to the mix:• HTSS = Hydrologic Time Series Service• HML = Hydrologic Markup Language
• software development …– If we adopt SOAP and WSDL standards, we can
utilize industry support– Hydrology standards will increase interoperability and
code reuse• Request SWAQ to set up an advisory committee for to
help develop CUAHSI standards for HML
Utah State Time Series Analyst(developed by Jeff Horsburgh)
http://water.usu.edu/nwisanalyst/ http://water.usu.edu/analyzer/
-- operates on CUAHSI web services-- operates on local data for Neuse basin
Transfer of research results• CUAHSI web services for NWIS were announced at a
cyberseminar on Friday Oct 28• On Wednesday Nov 2, Jason Love, from a private
firm, RESPEC, in Sioux Falls, South Dakota, posted on the EPA Basins list server: “Occasionally one comes across something that is worth sharing; the CUAHSI Hydrologic Information Systems - Web Services Library for NWIS is a valuable tool for those of us interested in rapidly acquiring and processing data from the USGS, e.g., calibrating models and performing watershed assessments.”
• He provided a tutorial on how to use the services from Matlab (which CUAHSI had not developed)
• Technology transfer took less than 1 week!
Impact of Web Services
• CUAHSI web data services are significantly simplifying user access to federal water observation data
• This will increase appreciation of the collective information content of these data
• Next step is to set the data in context of their environment – Digital Watershed
• Web services may turn out to be as important or even supersede web pages as a data delivery mechanism
HIS Goals
• Hydrologic Data Access System – get me the data I want quickly and painlessly
• Support for Observatories – synthesizing hydrologic data for a region
• Advancement of Hydrologic Science – data modeling and advanced analysis
• Hydrologic Education – better data in the classroom, basin-focused teaching
Digital WatershedHow can hydrologists integrate observed and
modeled data from various sources into a single description of the environment?
Digital WatershedHydrologic Observation
Data
GeospatialData
Remote SensingData
Weather and ClimateData
(NetCDF)
(GIS)(Relational database)
(EOS-HDF)
Digital Watershed
A digital watershed is a synthesis of hydrologic observation data, geospatial data, remote sensing data and weather
and climate data into a connected database for a hydrologic region
Digital Watershed:Prototype for the Neuse basin
(See Chapter 8 in the Status Report for details)
Neuse Atmospheric Water
• Daily precipitation data from NCDC gages
• Nexrad daily rainfall rasters
• Land surface – atmosphere fluxes from North American Regional Reanalysis of climate
Neuse Surface Water
• Streamflow, water quality hydrologic observational data
• GIS: River network, water bodies, watersheds, monitoring points
• Land cover, soils, • MODIS remote sensing
(Praveen Kumar and Venkat Lakshmi)
MODIS
Terrain and Land Cover
Neuse Basin: Coastal aquifer system
* From USGS, Water Resources Data Report of North Carolina for WY 2002
Section line
Beaufort Aquifer
Neuse Groundwater
Geovolumes of hydrogeologic unitsfrom US Geological survey (GMS)
GeoVolume – 3D representation of the surface and subsurface
Geovolume Geovolume with groundwater model cells
Geovolume of layered soil texture for the Neuse basin
Digital Site
• Provides the community with a systematically constructed archive of site investigations
• A means of constructive engagement with scientists on standardized databases for site scale processes
• A library of digital sites of different kinds informs digital watershed development MADE site in Mississippi
Interfacedata models
HEC-HMS
HEC-RAS
HSPF
GIS
GeoDatabase
Arc Hydrodata model
Connecting Arc Hydro and Hydrologic Models
Map2Map Workflow Model
FLOODPLAIN MAP
Flood map as output
Model for flood flow
Model for flood
depth
HMS
Nexrad rainfall map as input
DEMO
HIS Goals
• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data
• Support for Observatories – synthesizing hydrologic data for a region
• Advancement of Hydrologic Science – data modeling and advanced analysis
• Hydrologic Education – better data in the classroom, basin-focused teaching
Towards a Feasible Environmental Observatory:
A Vision and an Implementation Plan
Richard P. HooperPresident, CUAHSI
CUAHSI Community Challenge
Predict flux of water and chemicals in rivers, lakes, aquifers, and estuaries continuously in time and space throughout the United States.
Created first for the Neuse basin
Digital Watershed:An implementation of the CUAHSI Hydrologic Data
Model for a particular region
CUAHSI Hydrologic Information System
National Scale (seamless, coast to
coast data coverage,ArcHydro USA)
1:500,000 scale
Regional Scale (e.g. Neuse basin)
1:100,000 scale
Watershed Scale (e.g. Trent watershed )
1:24,000 scale
Site Scale (experimental site level)
Site scale
Mul
tisca
le d
ata
deliv
ery
Multiscale web portal delivering point water observation data, GIS data, weather and climate data and remote sensing data for user selected regions in the United States
National Hydrologic Information System
Hydrologic Information System
Hydrologic Observing
System
Hydrologic Modeling System
HydroVolumes
Take a watershed and extrude it vertically into the atmosphereand subsurface
A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”
Watershed Hydrovolumes
Geovolume is theportion of a hydrovolumethat contains solidearth materials
USGS Gaging stations
Hydrovolume
Stream channel Hydrovolumes
Hydrologic Flux Coupler
Hydrologic Fluxes and Flows
Digital Watershed(Atmospheric, surface and subsurface water)
We want to do water,mass, energy and water balances
Hydrologic Flux Coupler
Precipitation
Evaporation
Streamflow
Define the fluxes and flows associated with each hydrovolume
Groundwater recharge
See Chapter 9 of Status Report for Details
Hydrologic Flux Coupler as an ArcGIS Workflow
Hydrologic Science
Hydrologic conditions(Fluxes, flows, concentrations)
Hydrologic Process Science(Equations, simulation models, prediction)
Hydrologic Information Science(Observations, data models, visualization
Hydrologic environment(Dynamic earth)
Physical laws and principles(Mass, momentum, energy, chemistry)
It is as important to represent hydrologic environments precisely with
data as it is to represent hydrologic processes with equations
Significant progress
Shared Data Models
Hydrology(CUAHSI)
Environmental Engineering(CLEANER)
Ecology(NEON/LTER)
Atmospheric Science(NCAR/Unidata)
Geology(GEON)
Geomorphology(NCED/WSSC)
Limnology, Ocean science, …..
ArcGIS Geographic data models
www.esri.com/datamodels
About 30 ArcGIS data models for a variety of disciplines
Geosciences Network
Atmospheric science – hydrology
• Weather and climate fields are the drivers – continuous in space and time across the nation
• Local watersheds are the reactors – each behaving according to its location and characteristics
GeoTemporal Reference Frame
• A defined geospatial coordinate system for (x,y,z)
• A defined time coordinate system (UTC, Eastern Standard Time, ….)
• A set of variables, V• Data values v(x,y,z,t)
Space (x,y,z)
Time, t
Variables, V
v – data values
Data Cube
Continuous Space-Time Model – NetCDF (Unidata)
Space, L
Time, T
Variables, V
D
Coordinate dimensions
{X}
Variable dimensions{Y}
Space, FeatureID
Time, TSDateTime
Variables, TSTypeID
TSValue
Discrete Space-Time Data ModelArcHydro
Proposed new format: GeoNetCDFContinuous Space (NetCDF)Discrete Space (GIS)
ArcGIS version 9.2(in beta release) acceptsnetCDF as a native file
format
HIS Goals
• Hydrologic Data Access System – better access to a large volume of high quality hydrologic data
• Support for Observatories – synthesizing hydrologic data for a region
• Advancement of Hydrologic Science – data modeling and advanced analysis
• Hydrologic Education – better data in the classroom, basin-focused teaching
Basin-oriented teaching
http://www.ce.utexas.edu/prof/maidment/gradhydro2005/gradhydro2005.htm
• Focus class on interpretation of a single river basin
• Interdisciplinary teaching• Water balances for each
phase of hydrologic cycle• Use Unidata Integrated
Data Viewer to access weather info
Conclusions
• HIS = a geographically distributed system of web-connected data and functions
• Hydrologic Data Access System is a significant technological innovation
• Emerging understanding of digital watershed structure and functions
• Beginnings of hydrologic information science and shared data models with neighbouring sciences