hbasecon 2012 | scaling gis in three acts
DESCRIPTION
Scaling geospatial data is hard. State of the art GIS technologies available to the general public are locked in the realm of relational databases with PostGIS as the prominent leader. Though a number of location-based startups have walked this path before, few have marked their trail along the way. Act one proveds a survey of the landscape, defining terms, and highlighting pitfalls. Act two explores the world of open source, horizontally scalable GIS and outlines the problems they solve. Act three explores implementations backed by HBase. No previous GIS knowledge is required.TRANSCRIPT
SCALING GIS IN 3 ACTS
presented by:
Nick Dimiduk
May 22, 2012
1
SCALING GIS IN 3 ACTS- Lightning Edition! -
presented by:
Nick Dimiduk
May 22, 2012
2
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
HBase in ActionManning Press, Fall 2012
0
1
2
3
4
5
6
7
8
9
10Thousands
MULTI-BAR CHART TITLE, LEFT ALIGNED
Series 1 Series 2 Series 3 Series 4
3
hbaseinaction.com
Discount code: 12hb10
Act I: What is GIS?
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
GIS: Data (on maps!)
0
1
2
3
4
5
6
7
8
9
10Thousands
MULTI-BAR CHART TITLE, LEFT ALIGNED
Series 1 Series 2 Series 3 Series 4
5
0
1
2
3
4
5
6
7
8
9
10Thousands
MULTI-BAR CHART TITLE, LEFT ALIGNED
Series 1 Series 2 Series 3 Series 4
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
HC SVNT DRAGONES
“Here are Dragons”
0
1
2
3
4
5
6
7
8
9
10Thousands
MULTI-BAR CHART TITLE, LEFT ALIGNED
Series 1 Series 2 Series 3 Series 4
6
DRAGONES!!!
Image: Psalter World Map, 1265
http://en.wikipedia.org/wiki/Here_be_dragons
Act II: What to do with GIS?
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
Geospatial Queries
8
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
Non-Euclidean Geometry
9
Image: Trigonometry on a Spehere
http://en.wikipedia.org/wiki/Non-Euclidean_geometry
“Know thy surface”
Act III: GIS on HBase
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
The devil is in the Indices
12
Image: Six iterations of the Hilbert curve
http://en.wikipedia.org/wiki/Space-filling_curve
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
Spatial Partitioning
14
Image: USA night lights
http://www.noaanews.noaa.gov/stories/s2015.htm
© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.
The devil is in the (Spatial) Indices
16
Image: German zipcodes, R*Tree
http://en.wikipedia.org/wiki/R*_tree
Thank you!