pioneering gml deployment for the nsdi

© 2006 - geoLeaders LLC

Pioneering GML Deployment for the NSDI

September 22, 2005September 22, 2005

Jeff Harrison, President, The Carbon [email protected]

Tel: 703-628-8655

Barry Cross, [email protected]

Tel: 585-243-2418

Nuke Goldstein, Founder & CTO, The Carbon [email protected]

Tel: 617-584-5077

Panagiotis A. Vretanos, Senior [email protected]

Tel: 416-701-1985

2004 NSDI Cooperative Agreement Program Grant ProjectCategory 5: Establishing Framework Data Services using the OGC Web Feature Service

Specification

mailto:[email protected]





Agenda

• Quick IntroductionQuick Introduction• Demonstration-An Environmental AssessmentDemonstration-An Environmental Assessment• Project OverviewProject Overview• Demonstration-”Interactive NSDI”Demonstration-”Interactive NSDI”• Next StepsNext Steps• Q&AQ&A


Team Introduction

• Barry Cross, Project Manager, Barry Cross, Project Manager, geoLeadersgeoLeaders

• Peter Vretanos, Senior Developer, Peter Vretanos, Senior Developer, CubeWerxCubeWerx

• Nuke Goldstein, Founder & CTO, Nuke Goldstein, Founder & CTO, The Carbon ProjectThe Carbon Project

• Jeff Harrison, Co-Founder & CEO, Jeff Harrison, Co-Founder & CEO, The Carbon ProjectThe Carbon Project


Purpose of Today’s Demo

• Demonstrate the potential of accessing a new reference Demonstrate the potential of accessing a new reference implementation of the National Hydrography Dataset implementation of the National Hydrography Dataset (NHD) through a powerful Web Feature Service (WFS) (NHD) through a powerful Web Feature Service (WFS) and a new profile of Geography Markup Language and a new profile of Geography Markup Language (GML). (GML).

• Highlight multi-vendor interoperability using open-Highlight multi-vendor interoperability using open-geospatial web services from CubeWerx, CarbonArc (a geospatial web services from CubeWerx, CarbonArc (a new extension for ESRI’s ArcGIS developed with new extension for ESRI’s ArcGIS developed with CarbonTools) and Gaia, a free Open-Geospatial .NET CarbonTools) and Gaia, a free Open-Geospatial .NET viewer from The Carbon Project.viewer from The Carbon Project.

• Illustrate how this approach can enable the NSDI.Illustrate how this approach can enable the NSDI.


The “So What” Factor

• With this service, users can access up-to-date hydrographic With this service, users can access up-to-date hydrographic content and download it directly to their application through content and download it directly to their application through an open standards-based service.an open standards-based service.

• Significant milestone in realizing a services oriented Significant milestone in realizing a services oriented architecture (SOA) as part of the FEAarchitecture (SOA) as part of the FEA– This means users can download data from many different This means users can download data from many different

sources, freely exchanging maps and content and rapidly sources, freely exchanging maps and content and rapidly integrating information to support business and personal integrating information to support business and personal decision-making. decision-making.

– This type of multi-source integration capability is essential to This type of multi-source integration capability is essential to respond to dynamic events like floods, security situations as well respond to dynamic events like floods, security situations as well as supporting a wide variety of environmental assessment and as supporting a wide variety of environmental assessment and planning applications. planning applications.

• Authorized users can also update NHD data using Authorized users can also update NHD data using WFS-T, ushering in a new age of the “Interactive NSDI”WFS-T, ushering in a new age of the “Interactive NSDI”


Overview of NHD

• National Hydrography National Hydrography Dataset (NHD) is one of the Dataset (NHD) is one of the Framework Data Themes of Framework Data Themes of the National Map.the National Map.– Along with Roads is one of Along with Roads is one of

the most complex themesthe most complex themes

• Comprehensive set of digital Comprehensive set of digital spatial data that contains spatial data that contains information about surface information about surface water features such as water features such as lakes, ponds, streams, lakes, ponds, streams, rivers, reservoirs, springs rivers, reservoirs, springs and wells and other features and wells and other features such as dams.such as dams.

NHD accessed from CubeSERV Web Feature Server (WFS)


NHD/WFS Demonstration – Environmental Assessment

• A user is conducting an A user is conducting an environmental site environmental site assessment in Washington, assessment in Washington, DC near the Potomac RiverDC near the Potomac River

• Must pull access NSDI Must pull access NSDI content, including content, including Hydrography Data, to Hydrography Data, to support assessmentsupport assessment

• Step 1 - NHD Feature AccessStep 1 - NHD Feature Access• Step 2 – Save GML and Share Step 2 – Save GML and Share

GSFGSF

Photo Courtesy of USNPS


Steps 1 & 2 – NHD Feature Access, Save GML (NHD/WMS/WFS and Gaia)

Photo Courtesy of USNPS

• Access Web Feature Access Web Feature ServerServer

• User reviews NHD/WFS User reviews NHD/WFS contentcontent

• Review GML Feature Review GML Feature AttributesAttributes

• Adds additional NSDI Adds additional NSDI information (metro lines, information (metro lines, stations)stations)

• Review GMLReview GML• Save off as GSFSave off as GSF


Content and Tools

• NHD in CubeSTOR (Oracle DB)NHD in CubeSTOR (Oracle DB)• CubeSERV Web Feature ServerCubeSERV Web Feature Server• GMLSFGMLSF• Web Map ServersWeb Map Servers• Carbon Project’s Gaia Geospatial Web Browser Carbon Project’s Gaia Geospatial Web Browser

and GMLAnalyzerand GMLAnalyzer• Geospatial Session File (GSF)Geospatial Session File (GSF)• Jeff’s iPodJeff’s iPod


Project Overview

ObjectivesObjectives– Develop and deploy an online operational WFS capability Develop and deploy an online operational WFS capability

for the Hydrography Framework Data layer (NHD/WFS). for the Hydrography Framework Data layer (NHD/WFS).

– ‘‘Lower the bar’ for implementing WFS for Framework Data Lower the bar’ for implementing WFS for Framework Data Theme(s) by employing Theme(s) by employing GML Simple Features Profile GML Simple Features Profile (GMLSF).(GMLSF).

– Coordinate with ongoing efforts to define GML Application Coordinate with ongoing efforts to define GML Application Schemas for the Framework Data Themes. Schemas for the Framework Data Themes.

– Generate feedback on the proposed OGC GMLSF standard, Generate feedback on the proposed OGC GMLSF standard, provide comment and reference on the draft ANSI provide comment and reference on the draft ANSI Framework Standards, and develop input to refine the OGC Framework Standards, and develop input to refine the OGC Web Feature Service (WFS) specification. Web Feature Service (WFS) specification.


Open-Geospatial Operations(Capabilities, Map, Feature, …)

Open-Geospatial Operations(Capabilities, Map, Feature, …)

CarbonWMS CarbonWFS CarbonGML Other…

CarbonProjectionCarbonGeometries

OGC Services (WMS, WFS, GML) OGC Services (WMS, WFS, GML)

XML DescriptionsXML Descriptions

Services Services

Other Resources Other Resources

Web Service

NHDData

NHDData

Content

Tools

ArcGISDesktop

Application

GeospatialWeb

Browser

NSDI Content and ToolsNSDI Content and Tools

Defined GMLSF Schemas for Defined GMLSF Schemas for Hydro and TransportationHydro and Transportation(XML for the NSDI)(XML for the NSDI)

Developed CubeWerx Developed CubeWerx GMLSF ValidatorGMLSF Validator

Deployed NHD content Deployed NHD content

using CubeWerx WFSusing CubeWerx WFS

Tested access via Gaia Tested access via Gaia Geospatial Web Browser Geospatial Web Browser

Integrated with ESRI ArcGIS Integrated with ESRI ArcGIS through CarbonArcthrough CarbonArc


{ The Messages sent to the WFS }

Get Capabilities

Get Feature

{ Inserts, Updates, Deletes feature(s) }

Lock Feature { Locks feature }

I nterface Layer

Transaction

{ Requests features }

{ Describes “capabilities” of the WFS }

{ Requests schema information about the feature }Describe Feature

NSDI Clients

Encoding Layer

Level 0 Profile for GML

Transportation

Hydrography

Boundaries

Elevation

Cadastral

OrthoImagery

Geodetic Control

Content LayerNSDI Application Schemas

WFS Operations

ESRI CubeWerx IONIC …

Project Architecture

• Technologies we used –Technologies we used –

– Web Feature ServiceWeb Feature Service

– Geography Markup Language - Geography Markup Language - GMLSFGMLSF

– Web Map ServiceWeb Map Service

• Goal – Establish a “NHD/WFS” Goal – Establish a “NHD/WFS” will serve as an operational will serve as an operational reference implementation that reference implementation that can be reused by other can be reused by other organizations at all levels of organizations at all levels of government. government.


Key Points on GMLSF

• GMLSF defines a simplified profile of GML for encoding GMLSF defines a simplified profile of GML for encoding geographic featuresgeographic features– Similar to the way WMS uses JPEG, GIF, PNG to be Similar to the way WMS uses JPEG, GIF, PNG to be

successful (message format is well-understood)successful (message format is well-understood)– GMLSF supports simple geometric types (Points, Lines, GMLSF supports simple geometric types (Points, Lines,

Polygons)Polygons)

• NSDI content providers can now publish using GMLSFNSDI content providers can now publish using GMLSF• Provides a simple, consistent platform for NSDI contentProvides a simple, consistent platform for NSDI content• GMLSF makes it easy to use GML and WFS in multiple GMLSF makes it easy to use GML and WFS in multiple

applicationsapplications


How it was done – from UML Models to GML Schemas

Abstract Model…

GMLSF Implementation


Why GMLSF?

• Greatly simplifies development of NSDI Greatly simplifies development of NSDI applications, simple ‘façade’ in front of multiple applications, simple ‘façade’ in front of multiple data sources.data sources.

• Since GMLSF is just XML, it can also be integrated Since GMLSF is just XML, it can also be integrated into new applications on network-connected into new applications on network-connected mobile, desktop and multi-media platforms.mobile, desktop and multi-media platforms.

• Some potential applications for hydrography Some potential applications for hydrography content in GMLSF include content in GMLSF include – water quality assessmentswater quality assessments– natural resource managementnatural resource management– environmental site assessments and impact environmental site assessments and impact

statementsstatements– delineating watershed boundariesdelineating watershed boundaries– many others. many others.


NHD/WFS Demonstration – “Interactive Framework”

• A government user is interactively A government user is interactively updating NSDI content for updating NSDI content for Washington, DC near the Potomac Washington, DC near the Potomac RiverRiver

• Another user is searching for NSDI Another user is searching for NSDI contentcontent

• Step 3 – NHD/WFS Access Step 3 – NHD/WFS Access (CarbonArc)(CarbonArc)

• Step 4 – NHD/WFS Bulk Step 4 – NHD/WFS Bulk Transactions (CarbonArc)Transactions (CarbonArc)

• Step 5 – User Access (Gaia)Step 5 – User Access (Gaia)• Step 6 - Discovery (CubeWerx Step 6 - Discovery (CubeWerx

Registry Client)Registry Client)


Step 3, 4 & 5 – NHD/WFS Access (NHD/WFS, CarbonArc)

• Picks up where we left offPicks up where we left off• Quick look at CarbonArc Quick look at CarbonArc

toolstools• Add “Hydro” ElementsAdd “Hydro” Elements• Delete and add data to Delete and add data to

NHD/WFSNHD/WFS• Commit transactionsCommit transactions• Quick look at Transaction Quick look at Transaction

XMLXML• Review updates in GaiaReview updates in Gaia


Next Steps

• Near-Term Project ActivitiesNear-Term Project Activities– Finalize schemas on NHD/WFSFinalize schemas on NHD/WFS– Deploy NHD/WFS to DenverDeploy NHD/WFS to Denver– Register NHD/WFS with Geospatial One-Stop at Register NHD/WFS with Geospatial One-Stop at

www.geodata.govwww.geodata.gov – Initial Test – Initial Test

• Potential Future WorkPotential Future Work– NHD/WFS ArcMap Toolkit NHD/WFS ArcMap Toolkit – Binary XML SupportBinary XML Support– Transaction “Agreement” for NHD (in XML)Transaction “Agreement” for NHD (in XML)– NHD Line and Polygon TransactionsNHD Line and Polygon Transactions– NHD Event Modeling w/WFSNHD Event Modeling w/WFS– GMLSF Profiling for other datasetsGMLSF Profiling for other datasets– OthersOthers

http://www.geodata.gov/


NHD/WFS ArcMap Toolkit

• Potential to handle Potential to handle hydrographic functions in hydrographic functions in ArcMap, using GMLSF and ArcMap, using GMLSF and CarbonArcCarbonArc

• Tools for easy navigation, Tools for easy navigation, access and useaccess and use

• Integrated with ArcMap Integrated with ArcMap Platform, using content Platform, using content from many sourcesfrom many sources

Tools and Functions


Binary XML Support

• Provides greatly Provides greatly increased performance, increased performance, much more compactmuch more compact

• Reduces ‘conversion’ Reduces ‘conversion’ overhead (from binary overhead (from binary to text)to text)

• Integrate available Integrate available Open Source Library Open Source Library

• Java and .NET Libraries Java and .NET Libraries that do Binary XML that do Binary XML encodingencoding

• Can be integrated into Can be integrated into NHD/WFS ArcMap NHD/WFS ArcMap Toolkit and handle the Toolkit and handle the binary XML streambinary XML stream

OGC Services (WFS, GML) OGC Services (WFS, GML)

XML DescriptionsXML Descriptions

Services Services

Other Resources Other Resources

NHDData

NHDData

Content


NHD Line and Polygon Transactions

• Add capability to Add capability to update more update more complex complex geometries via geometries via GMLSF and GMLSF and NHD/WFS (lines NHD/WFS (lines and polygons) in and polygons) in “Interactive” NSDI“Interactive” NSDI


Transaction “Agreement” for NHD (in XML)

• Provides schema Provides schema for transactionsfor transactions

• Based on WFSBased on WFS• Examples available Examples available

in CarbonArc in CarbonArc

</Transaction>


Event Modeling w/WFS

• Let’s say something Let’s say something happens on Riverhappens on River

• Enhanced WFS for Enhanced WFS for NotificationsNotifications– Database updatesDatabase updates– Changes can trigger WFS Changes can trigger WFS

transactions that can be transactions that can be automatically distributed automatically distributed across the “Interactive” across the “Interactive” NSDINSDI

– Usher in Usher in – Like a Levee break…Like a Levee break…


GMLSF Profiling for other Datasets

• Geodetic ControlGeodetic Control• Cadastral (Parcels)Cadastral (Parcels)• Roads and RailsRoads and Rails• Governmental UnitsGovernmental Units• Boundary and Annex Boundary and Annex

Survey DataSurvey Data• ……

• Provides well-known Provides well-known packaging against packaging against which application can which application can be developed – Smart be developed – Smart Clients, mobile Clients, mobile applications, etc.applications, etc.


2004 NSDI Cooperative Agreement Program Grant ProjectCategory 5: Establishing Framework Data Services using the OGC Web Feature Service

Specification

September 22, 2005September 22, 2005

Jeff Harrison, President, The Carbon [email protected]

Tel: 703-628-8655

Barry Cross, [email protected]

Tel: 585-243-2418

Nuke Goldstein, Founder & CTO, The Carbon [email protected]

Tel: 781-229-6619

Panagiotis A. [email protected]

(416) 701-1985





http://www.thecarbonportal.net/

pioneering gml deployment for the nsdi

Documents

nhd data

nhd feature accessstep

opengeospatial web services

framework data services

tools nhd

access nsdi content

gml nhdwmswfs

framework data themes