improved data consistency through wmx and training...
TRANSCRIPT
![Page 1: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/1.jpg)
Improved Data Consistency through WMX and Training
Jesse Pearson | LRS Integration Portfolio Manager
Minnesota Department of Transportation
GIS-T 2017 conference, session 3.1.2
mndot.gov
![Page 2: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/2.jpg)
mndot.gov 2
![Page 3: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/3.jpg)
Goals for session
mndot.gov/ 3
1. Learn MnDOT’s method’s for improving data entry and best practices
2. Training (mainframe vs. LRS)
3. Business Process development (mainframe vs. LRS)
4. Using Workflow Manager (WMX)
5. QA/QC processes
![Page 4: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/4.jpg)
Mainframe era – (old training process)
mndot.gov/ 4
No formal training
Learned by 1 on 1 training
Past down from employees
Jump right into production environment
![Page 5: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/5.jpg)
R&H LRS - Training
mndot.gov/ 5
Developed a 3 day hands-on formal training for new employees
Created 4 VMs for testing area for new employees
Test to prove they understand concepts & business processes!
Must pass test in order to edit in Production!
![Page 6: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/6.jpg)
Mainframe era – (old business process)
mndot.gov/ 6
No formal written business processes
Tabular data and map updated in separate
systems > hard to sync!
Each user created own version; lots of room for
error!
No common template for editors
Handwritten processes
![Page 7: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/7.jpg)
R&H LRS – Basic Business Processes
Developed 9 basic business processes• Create a route • Extend a route• Realign a route• Reassign a route• Retire a route• Reversing a route• Data Reviewer• RCE viewer/editor
![Page 8: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/8.jpg)
R&H LRS – Advanced Business Processes
8
Developed 14 advance business processes• Cartographic realignment• Add to existing route and reversing mileage• Complex reassign and reverse• Fixing self-intersecting routes• Non-Monotonic reassign route• Realigning a gapped route• Reassigning the middle of a route• Retiring a route that starts with a gap• Roundabouts• Create a lollipop route• Reassign the middle of a route and reverse• Re-calibrate and reverse route
![Page 9: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/9.jpg)
9
R&H LRS – Other Business Processes
28 total business processes!
Weekly QC and Reconcile & Post process• Oracle spatial and table checks• Master Data Reviewer batch checks
General business processes for R & H and RCE environments
On-boarding process for new R&H/RCE editors
General tips and workaround procedures
![Page 10: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/10.jpg)
Workflow Manager @ MnDOT
mndot.gov/ 10
![Page 11: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/11.jpg)
Workflow Manager @ MnDOT - 2
mndot.gov/ 11
![Page 12: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/12.jpg)
Workflow Manager @ MnDOT - 3
mndot.gov/ 12
![Page 13: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/13.jpg)
Workflow Manager - Queries
mndot.gov/ 13
Groups (LRS Editors, LRS Admin, Traffic, Speed Limit, HPMS)
Privileges
![Page 14: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/14.jpg)
14mndot.gov/
Old way – QA/QC
Errors often fixed after data was made public
Time delay between table and map updates
Oracle back-end scripts
Errors sent out by email
Rare comparison of tabular and map data
![Page 15: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/15.jpg)
New Way – QA/QC
15mndot.gov/
Combination Data Reviewer & Oracle scripts
Why Data Reviewer didn’t work best for us
• DR’s Geometry on Geometry checks were not compatible with Roads and Highways LRS @ (10.3.1 patch 4)
• Timeliness - Table to table checks took several hours to run
![Page 16: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/16.jpg)
mndot.gov/ 16
New Way – What worked for us
Limited Data Reviewer
• Network Table Checks
• Simple batch job to check for null records
• Difficult set-up (each person has own .gdb and workflow)
Oracle Back-End Scripts (Oldie but goodie!)
• Event to Event comparison
• Event to Network comparison
• Validating individual event tables
![Page 17: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/17.jpg)
New Way – What worked for us
mndot.gov/ 17
Oracle Spatial Checks
• Geometric Route Length comparison
• Opposite Route Measure Direction
• Flipped Segment Measures
• Non-zero Beginning measures
• False coincident events
• Reference Posts greater than 25’ apart
• Measure errors (Negative/null measures, duplicates, etc.)
![Page 18: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/18.jpg)
Lessons Learned at MnDOT
18
WMX good for business process Takes time to create good business
process docs, but very helpful! Job Tracking Notifications Limitations Data Reviewer Limitations
Future steps: Use DR/WMX for Server Test out new DR capabilities at 10.5
mndot.gov/
![Page 19: Improved Data Consistency Through WMX and Training …proceedings.esri.com/library/userconf/proc17/papers/697_138.pdf · Improved Data Consistency through WMX and Training Jesse Pearson](https://reader030.vdocuments.net/reader030/viewer/2022011800/5abd60e57f8b9ab02d8b8558/html5/thumbnails/19.jpg)
Wrap up & Questions?
Jesse Pearson LRS Integration Portfolio Manager
651-366-3881
mndot.gov 19