1

Removing Barriers to Data Interoperability with Spatial ETL

Data Translation Basics 2

Agenda

•• What is Interoperability?What is Interoperability?

•• Barriers to InteroperabilityBarriers to Interoperability

••Case StudyCase Study

••DemoDemo

Data Translation Basics 3

Interoperability

and the ability to

• The exchange of information

• Without the need for background knowledge of the data structure

• Supplying data or access to the data source

Communication Data Sharing and DistributionbyTransparentlyuse that data.

Data Translation Basics 4

Example Scenario

Data Translation Basics 5

Barriers to Sharing - Data Types

Different Purposes =

Different Semantics (Meanings)

Data Translation Basics 6

Barriers to Sharing - Data Formats

Case Study

Case Study

Demo

• CAD to GIS• GIS to CAD

Thank You

Any Questions?

Data Translation Basics 11

Traditional Format Translations

•• ““ThinThin--pipepipe”” TranslationsTranslations

Data Translation Basics 12

Centralized

Semantic

Thick-Pipe

•• What is Spatial What is Spatial ETL?ETL?

•• How Does FME Work?How Does FME Work?

What is FME?

Data Translation Basics 13

ESRI and Safe Software Partnership

•• Partnership BackgroundPartnership Background

•• History of Safe SoftwareHistory of Safe Software

•• ESRI/Safe Interoperability InitiativeESRI/Safe Interoperability Initiative

•• Initiative BenefitsInitiative Benefits

•• Safe Software and ESRI Product Safe Software and ESRI Product Integration Integration

Data Translation Basics 14

ESRI/Safe Interoperability Initiative

“The goal of this initiative is to provide ESRI The goal of this initiative is to provide ESRI users with practical, usable, wideusers with practical, usable, wide--reaching reaching and real interoperability solutions by and real interoperability solutions by incorporating Safe Software technology into incorporating Safe Software technology into the ESRI product line.the ESRI product line.””

Goal:Goal:Interoperability SolutionInteroperability Solution

PracticalPracticalUsableUsableWideWide--ReachingReaching

Data Translation Basics 15

Safe Software and ESRI Product Integration

•• FME ESRI Edition FME ESRI Edition

•• ESRI ArcGIS Data InteroperabilityESRI ArcGIS Data Interoperability

•• FME ArcGIS Data Interoperability EditionFME ArcGIS Data Interoperability Edition

•• ExampleExample

Data Translation Basics 16

ArcGIS Data Interoperability

ArcGIS Data Interoperability is an extension that allows users to work with over 100 spatial data formats.

Data Translation Basics 17

Introduction to ArcGIS Data Interoperability

•• Product BackgroundProduct Background

•• Release HistoryRelease History

Data Translation Basics 18

Mapping

Analysis

Visualization

Product Background

Use interoperability data sources in all Desktop applications:

Data Translation Basics 19

Product Background

There are many ways to use ArcGIS Data Interoperability:There are many ways to use ArcGIS Data Interoperability:

Data Translation Basics 20

ArcGIS Data Interoperability Releases

Jointly developed by ESRI and Safe Software, the leaders in GIS and Spatial ETL respectively

ArcGIS 9.0 FME 2004

ArcGIS 9.1 FME 2004

ArcGIS 9.1 SP1 FME 2005

ArcGIS 9.1 SP2 FME 2005

ArcGIS 9.2 FME 2006 GB

ArcGIS 9.3 FME 2008

Data Translation Basics 21

Data Interoperability and ESRI Products

ArcGIS Server

ArcGIS EngineArcGIS Engine

ArcGIS DesktopArcGIS Desktop

Data Translation Basics 22

Key Features of ArcGIS Data Interoperability

•• Direct ReadDirect Read

•• ArcCatalog Browse Tree, Interoperability ConnectionsArcCatalog Browse Tree, Interoperability Connections

•• Data TranslationData Translation

•• Quick Import, Quick Export, Spatial ETL ToolsQuick Import, Quick Export, Spatial ETL Tools

•• Data TransformationData Transformation

•• Spatial ETL ToolSpatial ETL Tool

Data Translation Basics 23

Interoperability Data Sources in the ArcCatalog Browse Tree

•• ArcCatalog Browse TreeArcCatalog Browse Tree

•• Browse Tree Navigation Browse Tree Navigation

•• Data RepresentationData Representation

•• Index CacheIndex Cache

•• GeoMedia Access Warehouse BrowsingGeoMedia Access Warehouse Browsing

Data Translation Basics 24

Data Representation

Before RefreshBefore Refresh After RefreshAfter Refresh

Data Translation Basics 25

Index Cache

An index cache is built when you directly read interoperability An index cache is built when you directly read interoperability data data for the first time, when the data has changed, or a previous indfor the first time, when the data has changed, or a previous index ex cache has been discarded.cache has been discarded.

Data Translation Basics 26

Data Interoperability Options

•• Caching ControlCaching Control

•• Geomedia .mdb browsing Geomedia .mdb browsing controlcontrol

•• Logging ControlLogging Control

•• ExampleExample

Data Translation Basics 27

Interoperability Connections Node

Another way to directly read data in ArcCatalog is through an Interoperability Connection.

Data Translation Basics 28

Interoperability Connections Node

•• When to useWhen to use

•• Connecting to data sources not in the file system (e.g. databasConnecting to data sources not in the file system (e.g. database)e)

•• Overriding the default way data is read in the browse treeOverriding the default way data is read in the browse tree

•• Aggregating multiple datasets as one contiguous setAggregating multiple datasets as one contiguous set

•• Tag source coordinate systemTag source coordinate system

Data Translation Basics 29

Data Interoperability BasicsExercise

Exercise 1 examines how the FME Connections node can Exercise 1 examines how the FME Connections node can be used within ArcCatalog to read and merge multiple be used within ArcCatalog to read and merge multiple datasets.datasets.

In this exercise you will create an Interoperability In this exercise you will create an Interoperability connection. You will also start to become familiar with connection. You will also start to become familiar with the datasets that will be used throughout the rest of this the datasets that will be used throughout the rest of this course.course.

Data Translation Basics 1

FME 2007 Version

Data Interoperability Training

Data Interoperability Basics

Data Translation Basics 30

Q+A #1

What functionality is found in the FME ESRI EditionWhat functionality is found in the FME ESRI Editionthat is not in ArcGIS Data Interoperability?that is not in ArcGIS Data Interoperability?1) Direct read of vector based non1) Direct read of vector based non--ESRI formats.ESRI formats.2) Quick Import and Quick Export Tools.2) Quick Import and Quick Export Tools.3) Raster format support.3) Raster format support.4) A data transformation tool.4) A data transformation tool.

3)3) Raster format support.Raster format support.

The plugin datasource infrastructure used for the The plugin datasource infrastructure used for the Data Interoperability extension is vector only. Data Interoperability extension is vector only.

BackBack……

Q

A

Data Transformation 31

Example #1

BackBack……

Example 1: Switch between ArcGIS Data Interoperability and the FExample 1: Switch between ArcGIS Data Interoperability and the FME ME Extension for ArcGIS.Extension for ArcGIS.

Follow the instructions in the training material to carry out thFollow the instructions in the training material to carry out this example.is example.

Data Transformation 32

Example #2

BackBack……

Example 2: Directly read from interoperability data sources in AExample 2: Directly read from interoperability data sources in ArcCatalog.rcCatalog.

Follow the instructions in the training material to carry out thFollow the instructions in the training material to carry out this example.is example.