the evolution of gis · uber making own maps • “if you want to be in the self-driving car game,...

66
The Evolution of GIS From Digital Mapping to Spatial IT Atanas (A.T.) Entchev GIS Specialist Franklin Township, Somerset County, New Jersey

Upload: others

Post on 08-Jul-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

The Evolution of GISFrom Digital Mapping to Spatial IT

Atanas (A.T.) EntchevGIS Specialist

Franklin Township, Somerset County, New Jersey

Page 2: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

The evolution of GIS

• GIS in the past

• GIS in the present

• GIS in the future

• GIS trends

• The Franklin experience

Page 3: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Abstract

• This presentation will look at the technical, organizational, and business aspects of GIS in local government through a case study of GIS in Franklin Township, Somerset County, New Jersey. We will examine the past, present, and future state of GIS, and will share personal experiences and lessons learned.

• Does GIS belong in IT?

– GMIS International listserve• GIS & IT June 2016

Page 4: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS – the early days

• Born in the 1960s

• CAD (Computer-Aided Design) – a drawing tool

• GIS (Geographic Information System) – combines spatial (feature) data with tabular (attribute) data – “smart” map

– Map features know about themselves and about surrounding features

– Real-world coordinates

• Planning and engineering are early adopters

Page 5: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

A GIS is like a pizza

• Base map = crust• Layers = toppings

• Must be mutually-compatible (coordinate system, format, etc.)

• Sometimes plain pizza is the best

• Too many toppings = yucky

Page 6: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Basic GIS feature types

•Point

•Line

•Polygon

Page 7: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Push a button make a map

Page 8: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Which button?

Page 9: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber
Page 10: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Topology?

Page 11: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

NOT topology

Page 12: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Topography!

Page 13: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Network topology

Page 14: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Topology – road connectivity

Page 15: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Polygon topology in GIS

Page 16: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Topology in GIS – practical implications

• Franklin election districts

– Polygons

• Must not overlap

• Must not have gaps

• “Clean” topology

Page 17: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber
Page 18: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber
Page 19: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber
Page 20: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber
Page 21: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

SUMMARY

• GIS = mapping tool + so much more

• GIS =/= CAD

• GIS is a SPATIAL ANALYSIS TOOL

–Attributes (database behind map features)

–Topology

–Real-world coordinates

Page 22: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS – the early days

• Mainframes and dumb terminals (cloud + browser today)– Command-line interface

• Unix workstations• Cumbersome file-based data formats

– Coverage – multiple files, easy to corrupt• 100s of files in a single map

– Shapefile – same but open

• ARC/INFO, PC ARC/INFO, ArcView– Proprietary, AML/SML/Avenue scripting

Page 23: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Early municipal GIS database schema –data silos (“cylinders of excellence”)

WordPerfect

Lotus 1-2-3

dBaseFoxPro

MS Word

Excel

Page 24: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS data dump

Page 25: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS data analysts at work

Page 26: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Push a button make a map

Page 27: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS today

• Modern desktop GIS software

• Modern server GIS software

• Modern data formats – geodatabases

• Interactive “GIS Light” in the browser

– Easy, inexpensive deployment to large number of users – internally or externally

– No need to license, install and manage “GIS viewers” on the desktop

Page 28: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Today’s GIS tech

• Esri ArcGIS – proprietary

• QGIS – open source– Plus: Free, many more; Minus: No “one neck to wring”

• Back end– Geodatabase – personal, file, enterprise

– MS SQL Server, Oracle, etc. – proprietary

– PostgreSQL, PostGIS – open source

• Front end– Desktop (ArcGIS, QGIS), browser (Leaflet, OpenLayers)

Page 29: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS today – Franklin, NJ

• Typical NJ municipality

– Municipal GIS (“the map”) is part of many municipal operations

• Tax assessment

• Land management

• Water system management

• Construction / code

• Planning / zoning

• Parks & recreation

Page 30: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS today – Franklin, NJ

– Integration a challenge

• Breaking down the cylinders of excellence

– Database updates a challenge

• Use unified desktop solution

• (Slowly) migrating to web

• GIS / map challenges– Continuous changes across multiple dynamic datasets

– Must keep all in sync

– ~99.6% match rate

» Plateaued around this number – as we fix issues, new ones pop up. 100% match rate elusive & unattainable.

Page 31: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS today – Franklin, NJ

• ArcGIS (Esri)

• Enterprise geodatabase (Microsoft SQL Server + ArcGIS for Server (formerly ArcSDE))

• Publish internally to staff and field crews–Desktop, web portal (iPads in the field)

• Publish externally to residents–GIS web portal

Page 32: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin GIS – decision-support tool for open space acquisition

Page 33: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin election districts map

Page 34: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin Election Districts Map(raw GeoJSON on GitHub)

Page 35: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin Election Districts Map (geojson.io)

Page 36: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin Election Districts Map (GitHub)

Page 37: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Franklin Election Districts Map (CARTO+SDL)

Page 38: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS today tomorrow

Page 39: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Tomorrow’s GIS

Page 40: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Tomorrow’s GIS

• Database-driven

• Decision-support system Decision-making system

• On the web–Spatial analysis in the browser

• No plugins

• Mobile (embedded in apps)

Page 41: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS Trends

• OPEN

• GIS in the browser

– Streaming features

– No plugins (no Flash or Silverlight)

– No Java (but lots of JavaScript)

• Self-driving cars

• Augmented reality (StreetView, PokemonGO)

• 3D GIS

• Big data

Page 42: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Tomorrow’s GIS in Esri land

• ArcGIS Pro – the future for ArcGIS on the desktop

• ArcGIS Pro works with ArcGIS online/portal

• More Web, more open data formats, and more 3D

Page 43: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS is branching

• Spatial asset management / spatial analyses– Strong back end server tech – government, business

• Data visualization– Strong front end browser tech and graphic design

• Augmented reality (goggles)– StreetView, Mapillary, PokemonGO

• Self-driving cars– Tesla, Google, Uber, Daimler/Audi/BMW

• Maps for developers– Mapbox, others

Page 44: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Open

• Open-source software– PostgreSQL, PostGIS– QGIS (extensible)– Leaflet

• Open data (formats)– Shapefile, GeoJSON, KML(?)

• Open algorithms (???)– “Black box”, “safe areas”– Safe streets – Bing Maps released, quickly pulled “safe”

pedestrian areas from map– “Interesting” areas – new (July 2016) Google Maps paints

them orange

Page 45: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

OPEN= FREE

=

Page 46: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

OPEN= FREE

=

Page 47: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

“NO FREE LUNCH” –Verizon

• MapQuest (first mass-adopted online map)• Aol. (acquired MapQuest)• Yahoo! (has Yahoo! Maps)• 141,473,000 mobile phone customers (Q1 2016 Source:

http://www.fiercewireless.com/special-reports/how-verizon-att-t-mobile-sprint-and-more-stacked-q1-2016-top-8-carriers)

– 141,473,000 mobile phone customers = 141,473,000 mobile map data sensors

– Who else has hundreds of millions of mobile map data sensors? Uber.

– Autonomous cars need ultra-accurate maps– The mapping game is changing– PERSONAL PREDICTION – Verizon will become a major

player in digital mapping for self-driving cars

Page 48: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Self-driving cars

• Google

• Tesla

• Uber

• Ford

• Baidu

– LiDAR

• Daimler-Audi-BMW

Page 49: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Uber making own maps

Page 50: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Uber making own maps

• “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber VP (formerly at Google Maps for a decade)– Mapping each lane, not just roads

– Massive undertaking

• When Uber tried to buy Nokia’s mapping software last year, it was outbid by a group of German automakers—a signal that traditional car manufacturers understand mapping as a critical component of the future of driving.

• Lays the groundwork for Uber to eventually replace its fleet of human drivers with self-driving machines.

Page 51: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Challenges

Page 52: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Why Australia moved

Page 53: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Augmented reality

Page 54: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS in the browser – Oak Ridge National Laboratory

Page 55: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS in the browser – Ventusky weather

Page 56: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS in the browser – Ventusky

Page 57: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS big data

• How “big” is Big Data?–Franklin:

• ~65,000 residents

• ~28,000 tax lots

• ~35,000 tax line items

• NOT BIG

• Trillions of records–Massive databases

Page 58: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Big GIS data

Page 59: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Really big data

Page 60: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Affordable hi-res satellite imagery

Page 61: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Open Drone Map

Page 62: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

3D GIS – Google Earth, Apple Maps –photo-realistic 3D models

Page 63: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

3D GIS – underground (oil, gas)

Page 64: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Wrap-up: The evolution of GIS

• Draw a map draw a map using a computer draw a smart map that knows stuff about itself use a computerized map to perform spatial analyses perform spatial analysis, present result(s) on a map (or not)

– Does this address have water service? 123 Main Street 08873

– A series of spatial queries locate address overlay waterline buffer YES / NO

Page 65: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

GIS – the road ahead

• GIS EVERYWHERE (in the background)

• Database-driven (spatial IT)

• More spatial, fewer maps

• Massive high-accuracy spatial datasets

• Raster / drones / image analysis

• Open and distributed

• Indoor navigation (IPS)

• Autonomous cars

Page 66: The Evolution of GIS · Uber making own maps • “If you want to be in the self-driving car game, you’re going to have to create your own maps for it.” –Brian McClendon, Uber

Thank you!

Questions?

[email protected]