Drones in the ArcGIS PlatformCody Benkelman

The ArcGIS Platform for Imagery

Professional

Imagery &

Geospatial

Analysts

Server

ArcGIS is a Comprehensive Imagery Platform, including DronesDrones Integrate into the Complete ArcGIS Platform

Share

Analyze

To extract Information

from Imagery

To share imagery products

and information to those that need it

Manage

To manage and

process all your imagery

System of

Engagement

System of

Record

System of

Insight

ArcGIS for Image Management & Processing

• Extensive content to manage your drone project planning

- Living Atlas and in ArcGIS Online:

- e.g. Elevation; Weather; Political Boundaries; FAA maps…

• Processing to create imagery products

- Drone2Map - App Optimized for single frame imagery

- FMV (Full Motion Video) add-in for drone video

- ArcGIS desktop & server – Tools for working with all forms of imagery

• Manage and serve content from multiple projects & sensors

- Data management for massive collections

- MRF format for cloud-based storage and image services

System of

Record

System of

Insight

ArcGIS for Visualization & Analysis

• Visualization

- Fast display of imagery in 2D and 3D

- Full motion video support

• Analysis Tools

- Tools to accurately measure and interpret imagery

• Scalable Analytics

- For extracting information from imagery

ArcGIS for Sharing (Drone and other) Imagery

• Access from multiple devices in mobile, web and desktop applications

• APIs for development of custom applications

• Provide appropriate access control to those that need it

System of

Engagement

Drone data ingestion & processing

Workflow for drone imagery based on camera & operational mode

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

Video

Workflow for drone imagery based on camera & operational mode

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

Video

Orthorectified

Mosaics

3D Point

Clouds &

Meshes

Smart

Inspection

Photos

Drone2Map

Workflow for drone imagery based on camera & operational mode

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

Video

Orthorectified

Mosaics

3D Point

Clouds &

Meshes

Smart

Inspection

Photos

Drone2Map

Workflow for drone imagery based on camera & operational mode

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

VideoArcMap (Pro in early 2017)

Workflow for drone imagery based on camera & operational mode

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

Video

Georeferenced

video, on map

Map feature data,

projected into video

Rapid video search by

geography or metadata

Georeferenced features

extracted from videoArcMap (Pro in late 2016)

Full Motion Video processing

FMV add-in for ArcGIS Review of the basics…

Support for MISB format video

Video on map, Map features in video

Video files or live stream

Extract metadata, Create searchable index (map or metadata)

Latest release 1.3.1

- Full support for ArcGIS Desktop 10.3.x and 10.4.x

- Improved multiplexer, specifically control over variable bit rate, & auto bit rate calculation

“Multiplexer” Geoprocessing Tool Added in FMV version 1.3

• Extend FMV and ArcGIS to simple, low cost UAS (drone) video sensors

• Integrate GPS and IMU data (if available) into stored video file for compatibility with

MISB format

- Estimated camera orientation may be used if no IMU

Metadata requirements – FMV multiplexer

• Minimum

- GPS location (latitude, longitude and height) of the camera

• Preferred

- GPS as well as camera orientation angles (pitch, roll, heading) & sensor field of view

Multiplexer, Metadata Extraction

FMV GP Tools

Imagery Management in ArcGIS

…Next level of detail, regarding effective data management…

Close range

imagery

(inspection)

Nadir imagery

Oblique

imagery

Full Motion

VideoArcMap (Pro in late 2016)

Drone2Map

Server

Automated and Scalable Image Data Management

• http://esriurl.com/ImageManagement

• 2D Imagery & Video managed in centralized data collections

- Orthomosaics, DSMs, single image frames from Drone2Map

- Video managed as GDB features based on flight metadata

Automated and Scalable Image Data Management

• http://esriurl.com/ImageManagement

• 2D Imagery & Video managed in centralized data collections

- Orthomosaics, DSMs, single image frames from Drone2Map

- Video managed as GDB features based on flight metadata

• Sessions:

- TUES 3:15 PM “Managing Imagery & Raster Data using Mosaic Datasets” Room 5 A

- THURS 9:30 AM “Best Practices for Managing and Serving UAS Frame Imagery” Demo Theater

- THURS 3:15 “Managing Imagery & Raster Data using Mosaic Datasets” Room 10

For More Information!FMV Landing Page

www.esri.com/fmv

• www.esri.com/fmv

• FMV 1.3.1 Add-In and GP Tools

• Tutorials and Sample Data

• Access our FAQ

• Blogs

Links for follow up

Drone2Map

http://www.esri.com/drone2map

Full Motion Video (FMV) Add-In

http://www.esri.com/fmv

Workflows & data products for

2D mapping with Drone2Map Joe McGlinchy

Esri Professional Services

Data Credits

3DR

TerrAvion

Workflows and Data Products

• Input Data

- Individual image frames (mandatory)

- Geolocation

- GPS/IMU Log (optional)

- Ground Control Points (optional)

• Derived Products

- Orthophoto mosaics

- Raster Digital Surface Model

- Diverse image analytics capabilities

• Multiple dates

- Supports monitoring of key variables

Drone2Map – 2D View w/ Image Capture Points & Basemap

Drone2Map – 2D View w/ Image Capture Points & Processed Orthomosaic

Drone2Map – 3D View w/ Image Capture Points & Basemap

Extracting Information from the Data

• Surfaces

- Stockpile volumes

• Multispectral Orthophoto

- Spectral indexes

• Multiple dates

- Supports monitoring of key variables

Monitoring Surfaces

- Surfaces are often changing

- Potholes deeper than X [units]

- Canopy ‘thickness’ over a season

- Stockpile volumes over a construction project

- No two collections will have the same value

- Produce a surface raster (digital surface model) for each collection

- Assess information within a polygon over multiple dates

Surface Rasters

TIME

Surface Rasters

TIME

OBJECTID … Date

1 … 1/8/2016 0:00

2 … 1/12/2016 0:00

3 … 1/19/2016 0:00

4 … 11/3/2015 0:00

5 … 11/10/2015 0:00

6 … 11/17/2015 0:00

7 … 11/24/2015 0:00

8 … 11/24/2015 0:00

9 … 12/2/2015 0:00

10 … 12/9/2015 0:00

Tracking Volume Over Time

Inputs

- Digitized Polygon

- Mosaic Dataset w/ Date Field

- Rasters are digital surface

models

Outputs

- Python Matplotlib charts

Tracking Volume Over Time – Analysis in ArcGIS Desktop

ArcMap Demo

Vegetation Index Monitoring

- Crops are often changing

- Within field variability

- Variation due to watering patterns and other environmental factors

- Change in NDVI within a small AOI

- No two collections will have the same value

- Produce a multispectral orthomosaic for each collection

- Assess information within a polygon over multiple dates

Color IR Imagery

TIME

Color IR

TIME

OBJECTID … Date

1 … 2/9/2016 0:00

2 … 4/19/2016 0:00

3 … 4/26/2016 0:00

4 … 5/2/2016 0:00

5 … 5/10/2016 0:00

7 … 5/26/2016 0:00

8 … 6/1/2016 0:00

9 … 6/6/2016 0:00

Near Infrared Imagery

• What does Near Infrared band do for us?

- Very low reflectance from water

- Very low reflectance from shadowed areas

- Very high reflectance from vegetation

- Can be used in addition to other bands, i.e., NDVI

𝑵𝑫𝑽𝑰 =𝑵𝑰𝑹 − 𝑹𝑬𝑫

𝑵𝑰𝑹 + 𝑹𝑬𝑫

Quick overview of NDVI

Normalized Difference Vegetation Index

• Measure of vegetation health

• Values between [-1.0, 1.0]

- Negative values (approaching -1.0) correspond to water

- Values close to zero (-0.1 to 0.1) correspond generally to

barren areas of rock, sand, or snow

- Low, positive values (0.2-0.4) correspond to

shrub/grassland

- High values indicative of temperate and tropical rainforests

[1]

[1] http://earthobservatory.nasa.gov/Features/MeasuringVegetation/

RED NIR

NDVI

Analyze the Color IR data – NDVI – ArcGIS Desktop

Analyze the Color IR data - NDVI

TIME

Tracking NDVI Over Time

Inputs

- Digitized Polygon

- Mosaic Dataset w/ Date Field

- Rasters have enough bands to

support NDVI calculation

- Processing template for NDVI

via Raster Functions

Outputs

- Python Matplotlib charts

Tracking NDVI Over Time

ArcMap Demo

Summary

- UAS is a system which can produce many datasets over a common area

- Esri Mosaic Dataset is an ideal container for such data

- Lots of value in the time dimension

- Key variables can be monitored to support decision making

QUESTIONS?Joe McGlinchy

jmcglinchy@esri.com

Integrating Drones into GIS

Working with 3D DataMark Romero

Drone2Map for ArcGIS

Orthomosaics

Digital Surface Models Smart Inspection

Point Clouds and Meshes

Create 2D and 3D products from raw drone imagery

Drone2MapPlan Your Flight for the Right Product Type for 3D

Side

Overlap

Forward

Overlap

2D and 3D Products

Orbit

One

Orbit

Two

Inspection and 3D Products

Step 1. Initial Calibration

Step 2. Point Cloud and Mesh

Step 3. Share Drone Imagery FastGet Imagery Products To Your Users When They Need It

3D products Scene layers

Building an open platform with 3D

• Open 3D Scene Specification (I3S)

• LERC

• KML

• WMS/WMTS