datamigrator data analysis with webfocus. 2 metadata data lineage data profiling data transformation...

11
DataMigrator Data Analysis with WebFOCUS

Upload: conrad-townsend

Post on 02-Jan-2016

234 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

DataMigrator

Data Analysis with WebFOCUS

Page 2: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

2

Metadata

Data Lineage

Data Profiling

Data Transformation

Administration

Connectivity

Portability

DataMigratorETL check list

Page 3: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

3

DataMigrator Data Management Console and Web Console

Page 4: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

4

DataMigrator Staging data for analysis with WebFOCUS

Graphical tool for designing

Shares server technology and metadata with WebFOCUS.

Access and join data across disparate systems

Scalable parallel processing

Data Movement

Page 5: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

5

Change Data Capture (CDC)

Large source databases, small batch window

Want to only copy the changes

Want near real-time updates

Need some way to detect what has changed…

Page 6: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

6

CDC Major benefits

Operational reporting

Real-time query processing

Increased system efficiency

Availability of data by demand

Predictive analytics

Page 7: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

7

DataMigratorCDC

Read the database log…

Proprietary formats

Every database is different

Data Adapter for database log tables

No actual staging table required

Synonym describes a view of database log for one table

Page 8: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

8

DataMigrator CDCArchitecture

Page 9: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

9

DataMigrator CDCMetadata supported

Platforms and databases supported

ORACLE on UNIX, Linux, Windows, and IBM zSeries

DB2 UDB on UNIX, Linux, and Windows

DB2 on IBM zSeries and iSeries

VSAM on IBM zSeries

MS SQL Server 2008 on Windows

Page 10: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

10

DataMigrator CDCLog records table

Page 11: DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator

11

Data Management Console

Browser

ConsoleLog

Workspace

Toolbars

Main menu