how to efficiently use satellite imagery with machine learning · 2019. 11. 21. · green density...

45
2019-10-22 / Warsaw How to efficiently use satellite imagery with Machine Learning

Upload: others

Post on 26-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

2019-10-22 / Warsaw

How to efficiently use satellite imagerywith Machine Learning

Page 2: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Damian RodziewiczVice-president of the BoardPassionate about Data Analysis and Programming

Previously worked at Accenture, UBS, Microsoft, Domino Data Lab

Technology maniac

Loves psychology

Page 3: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

What we do - selected clients

Page 4: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Contributors to R community

Page 5: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

WHY SATELLITES?

Page 6: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Regular coverage of earth

Easily available

Time-travel

WHY SATELLITES?

Page 7: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

>4500 >600 25 cmSATELLITESIN SPACE

IMAGERYSATELLITES

BESTRESOLUTION

Page 8: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

QUICK FAQ

Page 9: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Do they collide?

Page 10: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Do they collide?

Page 11: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

How do they take pictures?

Page 12: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

How do they take pictures?

Page 13: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

I want to go!

Page 14: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

I want to go!

June 2019

Page 15: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

I want to go!

The cost of a seat?

An estimated $52 million

Page 16: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

SATELLITE IMAGERY

Page 17: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Types of available data

Public

● Landsat● Sentinel● …

Commercial

● Maxar (previously DigitalGlobe)● Planet Labs● Airbus Defence & Space● ImageSat● Skywatch● ...

Page 18: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Types of available data

Source: Chivasa, et al. Application of remote sensing in estimating maize grain yield in heterogeneous African agricultural landscapes: a review

RapidEye

Page 19: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Types of available data

Source: https://learn.arcgis.com/en/arcgis-imagery-book/chapter4/#learn-more

Page 20: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

NDVI

● Green density factor

● Recommended by NASA and used in many research works

● The higher the score, the healthier the plants are

Source: https://gisgeography.com/ndvi-normalized-difference-vegetation-index/

Page 21: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Types of available data

Sumatra, Indonesia(Left: © Copernicus Sentinel data (2015), right © U.S. Geological Survey.)Source: https://blog.conservation.org/2016/03/cloud-piercing-satellites-unleash-torrent-of-new-data-new-insights-into-planet-earth/

Page 22: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

temporal and spectralcostconsistency & availabilityease of processing

Types of available data

spatial resolution

Page 23: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Current state of the art

25 cm resolution

Twicea day

Page 24: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Current state of the art?

25 cm resolution

Twicea day

Page 25: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Current state of the art?

25 cm resolution

Twicea day

Page 26: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

25 cm resolution

Twicea day

Page 27: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

25 cm resolution

Twicea day

Credit: Cees Bassahttps://twitter.com/cgbassa/status/1167578706379988992

● 2.4 m mirrors

● The sharpest images ofthe Earth's surface

● The actual resolution ofthe images is kept secret

● 10 cm ? 2.5 cm? 1.25 cm?

Hubble telescope | NASA

Page 28: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Technology is data-source agnostic

Page 29: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

USING SATELLITE IMAGES IN PRACTICE

Page 30: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

DATA PREPROCESSINGPreprocessing of large image files.

RESOURCE INTENSIVEParts of solution requiring lots of compute and memory resources.

What shouldn’t be done locally?

Page 31: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

What shouldn’t be done locally?

Page 32: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

DASHBOARDSDisplay images and insights.

Decision support systems to actually get and apply insights.

FORECASTING & ANALYSISPredictive models based on indicators calculated from spectral data.

Where R Shines?

DEEP LEARNINGDeep neural network models on satellite data.

Page 33: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Architecture of complete solution

Satellite images library / service

Images preprocessing & storage

Model training

Dashboard & insights

Batch job

On demandBatch

API

Trained model

Database

Page 34: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

APPLICATIONS

Page 35: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: Planet.com

● Precision farming ○ Estimate vegetation health (NDVI + others)○ Identify water and damage on field

● Forests○ Simulate forests spread○ Detect deforestation zones○ Detect areas for planting trees

● Simulate disasters (e.g. forests fire, flood)

● Study glacier melts and effectson sea levels

Page 36: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

● TCW (Tasseled Cap Wetness) - wetness indicator

● Find fields that are wet

● Enforce watering restrictions

Source: unsplash.com

Page 37: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: Sentinel 2

● Dynamic pricing based on the field history

● Automatic claim verification

● Portfolio impact calculation after a disaster

● Reserves preparation for future claims

Page 38: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch
Page 39: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

indicatorse.g. NDVI

Page 40: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: https://www.marinetraffic.com

● Identify ships that turn off AIS signalling

● Scan protected areas

● Identify ships that fish in protected areas

Page 41: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: Queensland Globe

● Identify key features and cleanliness of an area

● Identify car types○ A new car, SUV, an old car

● Assess the state and quality of house rooftops

● Estimate area wellness

Page 42: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: Queensland Globe

● Count cars parked at the mall

● Estimate warehouses load by counting trucks

● Estimate amount of clients visiting a shopping mall

Page 43: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Source: unsplash.com

● Establish locations worth investing in

● Simulate city growth

● Be up to date with city infrastructure

● Detect construction zones

Page 44: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

● Count crates, track ships

● Estimate warehouse load

● Predict changes in supply and prices increase

Page 45: How to efficiently use satellite imagery with Machine Learning · 2019. 11. 21. · Green density factor Recommended by NASA and used in ... Model training Dashboard & insights Batch

Thank you

[email protected]@D_Rodziewicz