using arcgis as a scientific data platform

Copyright © Esri. All rights reserved.

Using ArcGIS as a Scient if ic Dat a Plat form

· Feroz Kadar Sudhir Raj Shrest ha


Topics· Introduction

· Ingesting and managing

· Visualizing and analyzing

· Disseminating and consuming

· The road ahead


Scient if ic Dat a

Oceanographic

• Salinity

• Sea Temperature

• Ocean current

Met eorological

• Temperature

• Humidity

• Wind speed/direction

Ter rest r ial

• Soil moisture

• NDVI

• Land cover


Challenges

variety of formats

volume & velocity

redundancy

portability

scalability

reproducibility

integration

standards

accessibility

Analyze ShareManage


Mult idim ensional Rast ers

Gridded

Multidimensional

Multivariate


Dem oUsing data & information products in a WebGIS


Ingest ing and Managing Dat a


Mult idim ensional Mosaic Dat aset

mosaic

table

raster pixels

Representing multivariate collection of multidimensional rasters in ArcGIS

m osaic dat aset

spa tia lly-indexed ca ta log

m ulti-re solu tion , m ultivaria te , m ultid im ensiona l

reduce storage redundancy & p ixe l re sam pling

defines in form ation products

on-dem and processing

HDF

GRIB

ne tCDF

d-aware raste rs


Tabular View

Tabular view of items in a multivariate multidimensional mosaic dataset

Raster Shape Variable StdTime StdZ

… … Temperature 3/22/2016 -10

… … Temperature 3/23/2016 -10

… … Temperature 3/24/2016 -10

… … Salinity 3/22/2016 -10

… … Salinity 3/23/2016 -10

… … Salinity 3/24/2016 -10

… … Temperature 3/22/2016 -20

… … Temperature 3/23/2016 -20

… … … … …


Met adat a

· Variables

· Dimensions

· Values

· Statistics

Describing the structure of a multivariate multidimensional mosaic dataset


Rast er Types

Format-agnostic direct ingestion of rasters into a mosaic dataset

rast er t ype

crawls disk

identifies rasters

extracts metadata

attaches processing

dat a on disk m osaic dat aset

netCDF

HDF

GRIB

d-aware raste rs

stores no p ixe ls

re fe rences raste rs

stores p rocessing & m etada ta


Geoprocessing

Managing a mosaic dataset

· Tools—building blocks for managing data

· Data Management ≻ Raste r ≻ Mosaic Datase t

· In tu itive UI for in te ractive workflows

· Mode lBuilde r: com posite opera tions

· Python : au tom ate or extend


Dem oMake a netCDF raster layer


Dem oMake a netCDF raster layer

Populate a mosaic dataset using a raster typeProperties of a multidimensional mosaic dataset

Attribute table of a mosaic layer


… On ArcGIS for Server

Make your mosaic dataset accessible to other users as a web-enabled dynamic image service

m osaic dat aset im age service

dynamic, on-demand

web-based access to data

rich information model


Visualizing and Analyzing


Fi l t er ing

slicing & dicing a multivariate multidimensional mosaic dataset

variables

value range(s) per dimension

SQL WHERE clause

dimension-orthogonal cutting & chopping

m ult idim ensional f i l t er


Fi l t er ing in ArcMap

net CDF rast er layer proper t ies

Select by Dim ension GP t ool

Mult idim ensional m osaic layer proper t ies


Render ing


Render ing

· Choose and customize

· Scalar or vector field

· Export and reuse

Control how original or transformed data is presented on a map


Dem oVector-field mosaic dataset

Multidimensional mosaic layer on mapDimensional slicing & animation


Tool-based Analyt ic Models

… using Geoprocessing


Transform ing Rast er Dat a

… using raster functions for on-the-fly processing

raster-valued transformation

piecewise, scale-aware

local / focal

on-demand processing

arity: unary, binary, …, n-a ry, polyadicinpu t raste rs

outpu t raste rrast er funct ion


Chaining Rast er Funct ions

… to compose a complex analytic model


Dem oApplying a simple transformation


Dim ensional Aggregat ion

Multidimensional filtering followed by aggregation using a raster function

dimensional

filtering

aggregating

function


Ext ending Analyt ic Capabil i t ies

Choose from dozens of built-in functions or implement your own algorithm using Python

Learn more at: github.com/Esri/rast er -funct ions


Rast er Models

A portable & reusable chain of raster functions

raster variables


Rast er Model: Grouping


Dem oCombining variables using a raster model


Dem oRaster models on a mosaic dataset

Aggregating temporal slicesDifference of means


Applying a Rast er Model

image service

mosaic dataset

mosaic dataset item(s)

image layer on a desktop map

choose & customize a raste r m ode l

im age se rvice layer on a web m ap

define & t ransmit a raste r m ode l

choose & customize a raste r m ode l


Dissem inat ing and Consum ing


Desk t op Web Device

Online Cont ent and

Services

Server

multivariate multidimensional m osaic dat aset

Dissem inat ing

professionalgeospatial analysts


Dissem inat ion St rat egies

· Tiled map service

· Dynamic map service

· Dynamic image service


Shar ing your dat a as an im age

· Mosaic Dataset ≻ Genera te Tile Cache

· Avoid copying source im age to ArcGIS Online

· Cache tile s gene ra ted using ArcGIS for Desktop

· Accessed via t i led m ap service

Enable access to a static representation of your data as a map service


Shar ing your m ap

· File ≻ Share As ≻ Service

· Fea tures ove rla id on raste rs

· Sta tic vs Dynam ic m ap se rvice

· Multid im ensiona l WMS


Shar ing dat a & inform at ion product s

· Mosaic Dataset ≻ Share As Im age Service

· Pixe ls & item m etada ta

· On-dem and se rve r-side p rocessing

· Raste r m ode ls: p rede fined or clien t-specified

· m ultid im ensiona l in fo , filte ring, vector fie lds

Enable access to a dynamic representation of your information product as an image service


Dem oPublishing a multidimensional mosaic dataset


Consum ing your services· In any ArcGIS application or any WMS client

· In a web map· Identify web services driven by maps or datasets· Bring service layers into a web map

· In a map-based application· Configurable apps· Story Maps· Web AppBuilder· Custom web apps using ArcGIS API for JavaScript


Maps & Apps

Office of Elect r icit y Delivery and Energy Reliabilit y, U.S. Department of EnergySea Level Rise and Storm Surge Effects on Energy Assets


Maps & Apps

Nat ional Energy Technology Laboratory, U.S. Department of EnergyStoryMap highlighting issues around induced seismicity


Maps & Apps

Chesapeake Bay Program and Region 3 of t he U.S. Environmental Protect ion Agencyhttp://gis.chesapeakebay.net/air

https://www.govloop.com/resources/story-mapping-chesapeake


Dem oUsing image service layers in ArcGIS Online map viewer


The Road Ahead· Python Raster Types: extensible data ingestion

· Raster processing models: on GitHub and out-of-the-box

· NetCDF, HDF, GRIB: as raster products, raster layer, image service

· Collection Processing: scalable transformation of large sets of rasters

· Raster Analytics: distributed analysis and processing of imagery or rasters in a Web GIS

… with ArcGIS 10.5


GIS work f lows t hat scale

Manage Analyze Share

mosaic dataset

raster types

geoprocessing tools

multidimensional filter

animation & rendering

raster functions

dynamic web services

web maps & apps

raster analytics

… built for the characteristics of multidimensional scientific data


Please t ake our SurveyYour feedback allows us to help maintain high standards and to help presenters

Find the session you want to review

Find your event in the Esr i Event s App

Scroll down to the bottom of the session

Answer survey questions and submit

using arcgis as a scientific data platform

Documents