pioneering gml deployment for the nsdi
DESCRIPTION
Pioneering GML Deployment for the NSDI. 2004 NSDI Cooperative Agreement Program Grant Project Category 5: Establishing Framework Data Services using the OGC Web Feature Service Specification. September 22, 2005 Jeff Harrison, President, The Carbon Project [email protected] - PowerPoint PPT PresentationTRANSCRIPT
© 2006 - geoLeaders LLC
Pioneering GML Deployment for the NSDI
September 22, 2005September 22, 2005
Jeff Harrison, President, The Carbon [email protected]
Tel: 703-628-8655
Barry Cross, [email protected]
Tel: 585-243-2418
Nuke Goldstein, Founder & CTO, The Carbon [email protected]
Tel: 617-584-5077
Panagiotis A. Vretanos, Senior [email protected]
Tel: 416-701-1985
2004 NSDI Cooperative Agreement Program Grant ProjectCategory 5: Establishing Framework Data Services using the OGC Web Feature Service
Specification
© 2006 - geoLeaders LLC
Agenda
• Quick IntroductionQuick Introduction• Demonstration-An Environmental AssessmentDemonstration-An Environmental Assessment• Project OverviewProject Overview• Demonstration-”Interactive NSDI”Demonstration-”Interactive NSDI”• Next StepsNext Steps• Q&AQ&A
© 2006 - geoLeaders LLC
Team Introduction
• Barry Cross, Project Manager, Barry Cross, Project Manager, geoLeadersgeoLeaders
• Peter Vretanos, Senior Developer, Peter Vretanos, Senior Developer, CubeWerxCubeWerx
• Nuke Goldstein, Founder & CTO, Nuke Goldstein, Founder & CTO, The Carbon ProjectThe Carbon Project
• Jeff Harrison, Co-Founder & CEO, Jeff Harrison, Co-Founder & CEO, The Carbon ProjectThe Carbon Project
© 2006 - geoLeaders LLC
Purpose of Today’s Demo
• Demonstrate the potential of accessing a new reference Demonstrate the potential of accessing a new reference implementation of the National Hydrography Dataset implementation of the National Hydrography Dataset (NHD) through a powerful Web Feature Service (WFS) (NHD) through a powerful Web Feature Service (WFS) and a new profile of Geography Markup Language and a new profile of Geography Markup Language (GML). (GML).
• Highlight multi-vendor interoperability using open-Highlight multi-vendor interoperability using open-geospatial web services from CubeWerx, CarbonArc (a geospatial web services from CubeWerx, CarbonArc (a new extension for ESRI’s ArcGIS developed with new extension for ESRI’s ArcGIS developed with CarbonTools) and Gaia, a free Open-Geospatial .NET CarbonTools) and Gaia, a free Open-Geospatial .NET viewer from The Carbon Project.viewer from The Carbon Project.
• Illustrate how this approach can enable the NSDI.Illustrate how this approach can enable the NSDI.
© 2006 - geoLeaders LLC
The “So What” Factor
• With this service, users can access up-to-date hydrographic With this service, users can access up-to-date hydrographic content and download it directly to their application through content and download it directly to their application through an open standards-based service.an open standards-based service.
• Significant milestone in realizing a services oriented Significant milestone in realizing a services oriented architecture (SOA) as part of the FEAarchitecture (SOA) as part of the FEA– This means users can download data from many different This means users can download data from many different
sources, freely exchanging maps and content and rapidly sources, freely exchanging maps and content and rapidly integrating information to support business and personal integrating information to support business and personal decision-making. decision-making.
– This type of multi-source integration capability is essential to This type of multi-source integration capability is essential to respond to dynamic events like floods, security situations as well respond to dynamic events like floods, security situations as well as supporting a wide variety of environmental assessment and as supporting a wide variety of environmental assessment and planning applications. planning applications.
• Authorized users can also update NHD data using Authorized users can also update NHD data using WFS-T, ushering in a new age of the “Interactive NSDI”WFS-T, ushering in a new age of the “Interactive NSDI”
© 2006 - geoLeaders LLC
Overview of NHD
• National Hydrography National Hydrography Dataset (NHD) is one of the Dataset (NHD) is one of the Framework Data Themes of Framework Data Themes of the National Map.the National Map.– Along with Roads is one of Along with Roads is one of
the most complex themesthe most complex themes
• Comprehensive set of digital Comprehensive set of digital spatial data that contains spatial data that contains information about surface information about surface water features such as water features such as lakes, ponds, streams, lakes, ponds, streams, rivers, reservoirs, springs rivers, reservoirs, springs and wells and other features and wells and other features such as dams.such as dams.
NHD accessed from CubeSERV Web Feature Server (WFS)
© 2006 - geoLeaders LLC
NHD/WFS Demonstration – Environmental Assessment
• A user is conducting an A user is conducting an environmental site environmental site assessment in Washington, assessment in Washington, DC near the Potomac RiverDC near the Potomac River
• Must pull access NSDI Must pull access NSDI content, including content, including Hydrography Data, to Hydrography Data, to support assessmentsupport assessment
• Step 1 - NHD Feature AccessStep 1 - NHD Feature Access• Step 2 – Save GML and Share Step 2 – Save GML and Share
GSFGSF
Photo Courtesy of USNPS
© 2006 - geoLeaders LLC
Steps 1 & 2 – NHD Feature Access, Save GML (NHD/WMS/WFS and Gaia)
Photo Courtesy of USNPS
• Access Web Feature Access Web Feature ServerServer
• User reviews NHD/WFS User reviews NHD/WFS contentcontent
• Review GML Feature Review GML Feature AttributesAttributes
• Adds additional NSDI Adds additional NSDI information (metro lines, information (metro lines, stations)stations)
• Review GMLReview GML• Save off as GSFSave off as GSF
© 2006 - geoLeaders LLC
Content and Tools
• NHD in CubeSTOR (Oracle DB)NHD in CubeSTOR (Oracle DB)• CubeSERV Web Feature ServerCubeSERV Web Feature Server• GMLSFGMLSF• Web Map ServersWeb Map Servers• Carbon Project’s Gaia Geospatial Web Browser Carbon Project’s Gaia Geospatial Web Browser
and GMLAnalyzerand GMLAnalyzer• Geospatial Session File (GSF)Geospatial Session File (GSF)• Jeff’s iPodJeff’s iPod
© 2006 - geoLeaders LLC
Project Overview
ObjectivesObjectives– Develop and deploy an online operational WFS capability Develop and deploy an online operational WFS capability
for the Hydrography Framework Data layer (NHD/WFS). for the Hydrography Framework Data layer (NHD/WFS).
– ‘‘Lower the bar’ for implementing WFS for Framework Data Lower the bar’ for implementing WFS for Framework Data Theme(s) by employing Theme(s) by employing GML Simple Features Profile GML Simple Features Profile (GMLSF).(GMLSF).
– Coordinate with ongoing efforts to define GML Application Coordinate with ongoing efforts to define GML Application Schemas for the Framework Data Themes. Schemas for the Framework Data Themes.
– Generate feedback on the proposed OGC GMLSF standard, Generate feedback on the proposed OGC GMLSF standard, provide comment and reference on the draft ANSI provide comment and reference on the draft ANSI Framework Standards, and develop input to refine the OGC Framework Standards, and develop input to refine the OGC Web Feature Service (WFS) specification. Web Feature Service (WFS) specification.
© 2006 - geoLeaders LLC
Open-Geospatial Operations(Capabilities, Map, Feature, …)
Open-Geospatial Operations(Capabilities, Map, Feature, …)
CarbonWMS CarbonWFS CarbonGML Other…
CarbonProjectionCarbonGeometries
OGC Services (WMS, WFS, GML) OGC Services (WMS, WFS, GML)
XML DescriptionsXML Descriptions
Services Services
Other Resources Other Resources
Web Service
NHDData
NHDData
Content
Tools
ArcGISDesktop
Application
GeospatialWeb
Browser
NSDI Content and ToolsNSDI Content and Tools
Defined GMLSF Schemas for Defined GMLSF Schemas for Hydro and TransportationHydro and Transportation(XML for the NSDI)(XML for the NSDI)
Developed CubeWerx Developed CubeWerx GMLSF ValidatorGMLSF Validator
Deployed NHD content Deployed NHD content
using CubeWerx WFSusing CubeWerx WFS
Tested access via Gaia Tested access via Gaia Geospatial Web Browser Geospatial Web Browser
Integrated with ESRI ArcGIS Integrated with ESRI ArcGIS through CarbonArcthrough CarbonArc
© 2006 - geoLeaders LLC
{ The Messages sent to the WFS }
Get Capabilities
Get Feature
{ Inserts, Updates, Deletes feature(s) }
Lock Feature { Locks feature }
I nterface Layer
Transaction
{ Requests features }
{ Describes “capabilities” of the WFS }
{ Requests schema information about the feature }Describe Feature
NSDI Clients
Encoding Layer
Level 0 Profile for GML
Transportation
Hydrography
Boundaries
Elevation
Cadastral
OrthoImagery
Geodetic Control
Content LayerNSDI Application Schemas
WFS Operations
ESRI CubeWerx IONIC …
Project Architecture
• Technologies we used –Technologies we used –
– Web Feature ServiceWeb Feature Service
– Geography Markup Language - Geography Markup Language - GMLSFGMLSF
– Web Map ServiceWeb Map Service
• Goal – Establish a “NHD/WFS” Goal – Establish a “NHD/WFS” will serve as an operational will serve as an operational reference implementation that reference implementation that can be reused by other can be reused by other organizations at all levels of organizations at all levels of government. government.
© 2006 - geoLeaders LLC
Key Points on GMLSF
• GMLSF defines a simplified profile of GML for encoding GMLSF defines a simplified profile of GML for encoding geographic featuresgeographic features– Similar to the way WMS uses JPEG, GIF, PNG to be Similar to the way WMS uses JPEG, GIF, PNG to be
successful (message format is well-understood)successful (message format is well-understood)– GMLSF supports simple geometric types (Points, Lines, GMLSF supports simple geometric types (Points, Lines,
Polygons)Polygons)
• NSDI content providers can now publish using GMLSFNSDI content providers can now publish using GMLSF• Provides a simple, consistent platform for NSDI contentProvides a simple, consistent platform for NSDI content• GMLSF makes it easy to use GML and WFS in multiple GMLSF makes it easy to use GML and WFS in multiple
applicationsapplications
© 2006 - geoLeaders LLC
How it was done – from UML Models to GML Schemas
Abstract Model…
GMLSF Implementation
© 2006 - geoLeaders LLC
Why GMLSF?
• Greatly simplifies development of NSDI Greatly simplifies development of NSDI applications, simple ‘façade’ in front of multiple applications, simple ‘façade’ in front of multiple data sources.data sources.
• Since GMLSF is just XML, it can also be integrated Since GMLSF is just XML, it can also be integrated into new applications on network-connected into new applications on network-connected mobile, desktop and multi-media platforms.mobile, desktop and multi-media platforms.
• Some potential applications for hydrography Some potential applications for hydrography content in GMLSF include content in GMLSF include – water quality assessmentswater quality assessments– natural resource managementnatural resource management– environmental site assessments and impact environmental site assessments and impact
statementsstatements– delineating watershed boundariesdelineating watershed boundaries– many others. many others.
© 2006 - geoLeaders LLC
NHD/WFS Demonstration – “Interactive Framework”
• A government user is interactively A government user is interactively updating NSDI content for updating NSDI content for Washington, DC near the Potomac Washington, DC near the Potomac RiverRiver
• Another user is searching for NSDI Another user is searching for NSDI contentcontent
• Step 3 – NHD/WFS Access Step 3 – NHD/WFS Access (CarbonArc)(CarbonArc)
• Step 4 – NHD/WFS Bulk Step 4 – NHD/WFS Bulk Transactions (CarbonArc)Transactions (CarbonArc)
• Step 5 – User Access (Gaia)Step 5 – User Access (Gaia)• Step 6 - Discovery (CubeWerx Step 6 - Discovery (CubeWerx
Registry Client)Registry Client)
© 2006 - geoLeaders LLC
Step 3, 4 & 5 – NHD/WFS Access (NHD/WFS, CarbonArc)
• Picks up where we left offPicks up where we left off• Quick look at CarbonArc Quick look at CarbonArc
toolstools• Add “Hydro” ElementsAdd “Hydro” Elements• Delete and add data to Delete and add data to
NHD/WFSNHD/WFS• Commit transactionsCommit transactions• Quick look at Transaction Quick look at Transaction
XMLXML• Review updates in GaiaReview updates in Gaia
© 2006 - geoLeaders LLC
Next Steps
• Near-Term Project ActivitiesNear-Term Project Activities– Finalize schemas on NHD/WFSFinalize schemas on NHD/WFS– Deploy NHD/WFS to DenverDeploy NHD/WFS to Denver– Register NHD/WFS with Geospatial One-Stop at Register NHD/WFS with Geospatial One-Stop at
www.geodata.govwww.geodata.gov – Initial Test – Initial Test
• Potential Future WorkPotential Future Work– NHD/WFS ArcMap Toolkit NHD/WFS ArcMap Toolkit – Binary XML SupportBinary XML Support– Transaction “Agreement” for NHD (in XML)Transaction “Agreement” for NHD (in XML)– NHD Line and Polygon TransactionsNHD Line and Polygon Transactions– NHD Event Modeling w/WFSNHD Event Modeling w/WFS– GMLSF Profiling for other datasetsGMLSF Profiling for other datasets– OthersOthers
© 2006 - geoLeaders LLC
NHD/WFS ArcMap Toolkit
• Potential to handle Potential to handle hydrographic functions in hydrographic functions in ArcMap, using GMLSF and ArcMap, using GMLSF and CarbonArcCarbonArc
• Tools for easy navigation, Tools for easy navigation, access and useaccess and use
• Integrated with ArcMap Integrated with ArcMap Platform, using content Platform, using content from many sourcesfrom many sources
Tools and Functions
© 2006 - geoLeaders LLC
Binary XML Support
• Provides greatly Provides greatly increased performance, increased performance, much more compactmuch more compact
• Reduces ‘conversion’ Reduces ‘conversion’ overhead (from binary overhead (from binary to text)to text)
• Integrate available Integrate available Open Source Library Open Source Library
• Java and .NET Libraries Java and .NET Libraries that do Binary XML that do Binary XML encodingencoding
• Can be integrated into Can be integrated into NHD/WFS ArcMap NHD/WFS ArcMap Toolkit and handle the Toolkit and handle the binary XML streambinary XML stream
OGC Services (WFS, GML) OGC Services (WFS, GML)
XML DescriptionsXML Descriptions
Services Services
Other Resources Other Resources
NHDData
NHDData
Content
© 2006 - geoLeaders LLC
NHD Line and Polygon Transactions
• Add capability to Add capability to update more update more complex complex geometries via geometries via GMLSF and GMLSF and NHD/WFS (lines NHD/WFS (lines and polygons) in and polygons) in “Interactive” NSDI“Interactive” NSDI
© 2006 - geoLeaders LLC
Transaction “Agreement” for NHD (in XML)
• Provides schema Provides schema for transactionsfor transactions
• Based on WFSBased on WFS• Examples available Examples available
in CarbonArc in CarbonArc
</Transaction>
© 2006 - geoLeaders LLC
Event Modeling w/WFS
• Let’s say something Let’s say something happens on Riverhappens on River
• Enhanced WFS for Enhanced WFS for NotificationsNotifications– Database updatesDatabase updates– Changes can trigger WFS Changes can trigger WFS
transactions that can be transactions that can be automatically distributed automatically distributed across the “Interactive” across the “Interactive” NSDINSDI
– Usher in Usher in – Like a Levee break…Like a Levee break…
© 2006 - geoLeaders LLC
GMLSF Profiling for other Datasets
• Geodetic ControlGeodetic Control• Cadastral (Parcels)Cadastral (Parcels)• Roads and RailsRoads and Rails• Governmental UnitsGovernmental Units• Boundary and Annex Boundary and Annex
Survey DataSurvey Data• ……
• Provides well-known Provides well-known packaging against packaging against which application can which application can be developed – Smart be developed – Smart Clients, mobile Clients, mobile applications, etc.applications, etc.
© 2006 - geoLeaders LLC
2004 NSDI Cooperative Agreement Program Grant ProjectCategory 5: Establishing Framework Data Services using the OGC Web Feature Service
Specification
September 22, 2005September 22, 2005
Jeff Harrison, President, The Carbon [email protected]
Tel: 703-628-8655
Barry Cross, [email protected]
Tel: 585-243-2418
Nuke Goldstein, Founder & CTO, The Carbon [email protected]
Tel: 781-229-6619
Panagiotis A. [email protected]
(416) 701-1985