online spatial analysis for spending equity mapping
DESCRIPTION
Azavea is working with OMB Watch and Esri to develop a new online software tool that supports mapping of socioeconomic need against federal stimulus spending. To perform these calculations online requires significant performance improvements over existing geoprocessing tools. Azavea has developed a high performance distributed processing system, DecisionTree, to support highly scalable raster processing on the web. Presented at the 2011 Esri Federal User Conference.TRANSCRIPT
![Page 1: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/1.jpg)
Robert Cheetham, [email protected]
Esri Federal User Conference
Online Spatial Analysis for Spending Equity Mapping
20 January 2011
![Page 2: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/2.jpg)
About Azavea
Founded in 2000 26 people Web & Mobile apps Spatial Analysis R&D B Corporation
Projects with Social Value Pro Bono Program Donate at least 2% of profits 10% Research Program
Employee-focused Culture
![Page 3: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/3.jpg)
EGAP Application
![Page 4: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/4.jpg)
What were we aiming to do?
Map Indicators Map Spending Enable users to:
– Select their own definition of need
– Weight the inputs– Calculate the results
on-the-fly
Transform maps on-the-fly
![Page 5: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/5.jpg)
EGAP
![Page 6: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/6.jpg)
EGAP
![Page 7: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/7.jpg)
EGAP
![Page 8: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/8.jpg)
EGAP
![Page 9: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/9.jpg)
EGAP
![Page 10: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/10.jpg)
EGAP
![Page 11: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/11.jpg)
EGAP
![Page 12: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/12.jpg)
EGAP
![Page 13: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/13.jpg)
EGAP
![Page 14: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/14.jpg)
EGAP
![Page 15: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/15.jpg)
EGAP
![Page 16: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/16.jpg)
ArcGIS Server
Flex, Silverlight and JS APIs
Publish tasks and models
Caching
Optimized MSD files
![Page 17: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/17.jpg)
Technical Challenge
30 sec – 60 sec calculation time
Multiple simultaneous users …
… who are impatient
![Page 18: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/18.jpg)
Where did this come from?
![Page 19: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/19.jpg)
Classic Spatial Analysis Scenario
How do you identify an area that matches your priorities?
Walk to Grocery Store Biking Distance to Work
Near Restaurants Near Library
vitalvery importantsomewhat importantnice to have
Searching for a house, for instance…
![Page 20: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/20.jpg)
Weighted Overlay
x 5 x 2x 3x 1
+ ++
=
![Page 21: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/21.jpg)
Desktop GIS
![Page 22: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/22.jpg)
![Page 23: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/23.jpg)
![Page 24: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/24.jpg)
![Page 25: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/25.jpg)
![Page 26: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/26.jpg)
How does it work?
![Page 27: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/27.jpg)
City of Philadelphia
How does it work?
![Page 28: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/28.jpg)
Broken into a grid of cells
City of Philadelphia
![Page 29: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/29.jpg)
City of Philadelphia
Broken into a grid of cells
Each cell has a value for any given layer of information
![Page 30: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/30.jpg)
City of Philadelphia
Broken into a grid of cells
Each cell has a value for any given layer of information
![Page 31: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/31.jpg)
City of Philadelphia
Broken into a grid of cells
Each cell has a value for any given layer of information
![Page 32: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/32.jpg)
City of Philadelphia
Broken into a grid of cells
Each cell has a value for any given layer of information
1
This cell based approach enables us to combine layers using a process called map algebra
![Page 33: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/33.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Business siting is about making a choice based on the composite of several location based decision
variables
![Page 34: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/34.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Map Layers
![Page 35: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/35.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Map Layers
![Page 36: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/36.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Map Layers
![Page 37: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/37.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Map Layers
![Page 38: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/38.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
Map Layers
![Page 39: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/39.jpg)
Proximity to Transit Lines
High Per Capita Income
High Density of College Grads
High Density of Home Sales
In An Economic Incentive Zone
x 2
x 4
x 5
x 2
x -2+
Output Decision Raster
Map Layers
![Page 40: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/40.jpg)
Proximity to Transit Lines x 2
High Per Capita Income x 2
Density of College Grads x 4
Density of Home Sales x 5
Economic Incentive Zone -2
Generate Output Heat Map
![Page 41: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/41.jpg)
What we did
![Page 42: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/42.jpg)
Specific Optimization Goals
Faster file format
Distribute computation across:– Threads– Cores– CPU’s– Machines
Cache data
New technology
![Page 43: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/43.jpg)
Distributed Processing
![Page 44: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/44.jpg)
Next generation calculation engine
Reduced calculation time to
~40ms
![Page 45: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/45.jpg)
Walkability: Walkshed.org
![Page 46: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/46.jpg)
Walkability: Walkshed.org
![Page 47: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/47.jpg)
+
+
+
+
+
+
+
+
=
![Page 48: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/48.jpg)
![Page 49: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/49.jpg)
Land Conservation
![Page 50: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/50.jpg)
Elections
![Page 51: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/51.jpg)
Elections
![Page 52: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/52.jpg)
Sea Level Rise
![Page 53: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/53.jpg)
GPU geoprocessing research
National Science Foundation funded
OpenCL based Cross-platform (ATI, Nvidia)
15 – 100+ times faster than CPU
But wait, there’s more…
![Page 54: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/54.jpg)
Many Thanks!© Photo used with permission from Alphafish, via Flickr.com
![Page 55: Online Spatial Analysis for Spending Equity Mapping](https://reader031.vdocuments.net/reader031/viewer/2022012916/54b3a8a24a79599c5c8b479b/html5/thumbnails/55.jpg)
Robert Cheetham, [email protected]
Online Spatial Analysis for Open Data
Esri Federal User Conference 20 January 2011