route data cleanup - transportation.org · 6/13/2018 · route data cleanup. for roads and...
TRANSCRIPT
![Page 1: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/1.jpg)
Route Data Cleanupfor Roads and HighwaysKyle Gonterwitz KDOTJune 13, 2018
Kevin Sigwart1SpatialJune 13, 2018
with
Stuff I thought was impossible Until I learned 1Spatial and got help from experts
![Page 2: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/2.jpg)
Problem Statement
KDOT needed to quickly validate road centerlines from NG911 with conflated route-defining attributes, and enhance
the centerlines for Route Migration for migration to Roads and Highways with minimal route errors.
![Page 3: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/3.jpg)
High Level Workflow
Goalposts moveAiming for 100%
![Page 4: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/4.jpg)
Create new routes using projected shape length measures for Roads
and Highways
KDOT SourcesKDOT source 1:
w\ Measures (M) - Project StationingTemporality for temporal events
KDOT Source 2:w\ Measures (M) - Map or driven
distances
KDOT source 3:Measure Attributes (not M) - Driven
distances or shape lengths
Stat
e Hi
ghw
ays
3456
7
UR
U
R + ramps
Conflate KDOT sources
to NG911 Road
Centerline Geometry
Roads and Highways
ClassUrbanRural
All Single Carriageway Polylines & Route Defining Attributes
Dual Carriageway (No M’s)No Route defining attributesAddress Location Attributes
No temporality (current state)Overlapping Segments
105 Sources (not edge matched)Topology Rules
Alias Tables
Next Gen 911
Workflow
![Page 5: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/5.jpg)
Technology Used
![Page 6: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/6.jpg)
• Edit in ArcGIS Pro• 1Integrate for ArcGIS
• Validate• Pinpoints Issue Locations• Automate fixups
• Shared Pro Packages on ArcGIS Online
• Facilitated Editing & Validation
• Consistent Cartography & Labeling
Editing and Reviewing
![Page 7: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/7.jpg)
Automation• Python Development
• Calibrate & Update Route Measures
• Flip Lines• Update Datasets• Package and Share Docs
https://github.com/KDOTGIS/pydot/tree/master/KhubCode25
Editing and Reviewing
![Page 8: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/8.jpg)
1Integrate for ArcGIS Demonstration
• Validation• Rules Based Validation• Pin-Point Exact
Locations • Enhancement
• Automate Cleanup• Integration
• Validate Multiple Sources
• Snap Sources Together
Editing and Reviewing
![Page 9: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/9.jpg)
Results for All Source Routes*
Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 34,190 27,616 38,717 22,969 1,363
Duplicate Calibration Points – Same measures 56 20 2 - -
Detect Non-Monotonic Routes 11,561 27,452 6,643 2,473 887
Branches 503 628 460 172 179
Barbells 1 1 2 1 1
Complex Self-Intersections 1351 201 144 37 44
Duplicate Vertex 2,809 1,117 1,031 227 253
* Round 4 and 5 networks did not include local, ghost, or zombie roads
![Page 10: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/10.jpg)
Results for All Source Routes*
Validation Check 1 2 3 4* 5*Invalid Geometry 3 3 3 - -
Multipart Line 4,755 3,242 2,499 865 841
Dangles 1,486 243 256 44 37
Orphan 137 123 107 6 7
Alpha Routes 5 8 8 2 1
Single Self Intersection – 4 approaches 445 16 29 4 17
Single Self Intersections – 5 approaches - 1 - - -
* Round 4 and 5 networks did not include local, ghost, or zombie roads
![Page 11: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/11.jpg)
Results for All Source Routes*
Validation Check 1 2 3 4* 5*Infinity 5 - 1 - -
Cutbacks 246 146 204 40 39
Evaluate Polyline Length 26 13 33 2 2
Polyline or Path Closes on Self 2,535 794 892 151 179
Loops 389 180 200 9 9
Lollipops 101 80 187 1 1
TOTAL 60,604 61,884 51,418 27,003 3,860
* Round 4 and 5 networks did not include local, ghost, or zombie roads
![Page 12: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/12.jpg)
Results for All Source Routes*
* Round 4 and 5 networks did not include local, ghost, or zombie roads
![Page 13: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/13.jpg)
Results for State Highway System
Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 11,116 11584 1838 1866 0
Duplicate Calibration Points – Same measures 2 0 0 0 0
Detect Non-Monotonic Routes 684 540 468 324 142
Branches 60 60 56 13 47
Barbells 0 0 0 0 0
Complex Self-Intersections 68 29 23 1 13
Duplicate Vertex 142 97 91 15 74
![Page 14: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/14.jpg)
Results for State Highway System
Validation Check 1 2 3 4* 5*Invalid Geometry 0 0 0 0 0
Multipart Line 327 249 279 190 213
Dangles 155 18 16 6 4
Orphan 0 0 0 0 0
Alpha Routes 0 0 1 1 0
Single Self Intersection – 4 approaches 13 6 10 0 14
Single Self Intersections – 5 approaches 0 0 0 0 0
![Page 15: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/15.jpg)
Results for State Highway System
Validation Check 1 2 3 4 5Infinity 0 0 0 0 0
Cutbacks 7 4 4 0 0
Evaluate Polyline Length 4 2 1 0 0
Polyline or Path Closes on Self 108 67 63 10 54
Loops 0 0 1 0 0
Lollipops 1 2 0 0 0
TOTAL 12,687 12,658 2,851 2,426 561
![Page 16: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/16.jpg)
Results for All Source Routes*
![Page 17: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/17.jpg)
Results for Non-State HWAY –non local
Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 13,219 13,809 33,142 21,103 1,363
Duplicate Calibration Points – Same measures 32 14 0 0 0
Detect Non-Monotonic Routes 2733 3913 3784 2149 745
Branches 296 407 281 159 132
Barbells 0 0 1 1 1
Complex Self-Intersections 266 123 78 36 31
Duplicate Vertex 730 560 391 212 179
![Page 18: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/18.jpg)
Validation Check 1 2 3 4* 5*Invalid Geometry 3 0 3 0 0
Multipart Line 1191 982 921 675 628
Dangles 356 79 82 38 33
Orphan 4 2 1 6 7
Alpha Routes 2 2 2 1 1
Single Self Intersection – 4 approaches 48 9 18 4 3
Single Self Intersections – 5 approaches 0 1 0 0 0
Results for Non-State HWAY –non local
![Page 19: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/19.jpg)
Validation Check 1 2 3 4 5Infinity 0 0 0 0 0
Cutbacks 57 39 39 40 39
Evaluate Polyline Length 2 0 7 2 2
Polyline or Path Closes on Self 574 347 246 141 125
Loops 10 9 10 9 9
Lollipops 8 4 1 1 1
TOTAL 19,531 20,300 39,007 24,577 3,299
Results for Non-State HWAY –non local
![Page 20: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/20.jpg)
Results for Non-State HWAY –non local
![Page 21: Route Data Cleanup - Transportation.org · 6/13/2018 · Route Data Cleanup. for Roads and Highways. Kyle Gonterwitz . KDOT June 13, 2018. Kevin Sigwart. 1Spatial June 13, 2018](https://reader033.vdocuments.net/reader033/viewer/2022043010/5fa2671c71963e511653c2d7/html5/thumbnails/21.jpg)