iWay Solutions - EIM

Vincent Deeney – Solutions Architect

6/25/2009

Information BuildersAgenda

Information Builders and iWay Software

Technology Overview

Demonstration Use-Case

Technical Demonstration

iWay Software

Integration of all content –data warehouse, files, queues, CMS, documents, email, ERP, CRM, SFA. Support spectrum of all integration patterns

ETL, SOA, B2B, MFT etc.Integrated data quality and master data management Enrich and feed business events and data extracts to operational data stores, data warehouses, applications, enterprise search engines Enable real-time dashboards, scoring and analytics through embedded complex event processing

Technology OverviewiWay Software Enterprise Integration

A typical problem

• Receiving data in multiple formats from external partners (csv, txt, edi, etc.)

• Data of varying quality.

• Lack of visibility into full process (end-to-end).

• Various Manual Steps

Upstream Data

Data/Information Enters from Multiple Points Manual Data Entry B2B Gateway Call Center Self-Service Portal

EIM Issues Accuracy Completeness Business Rule Validation Correlation

In-stream Data

Data is a Flowing, Dynamic thing Complex Processes Derived Data Evolving Semantics Operational BI

EIM Issues Error Detection and Correction Lost or Mismatched Information Duplication Validation as Evolves

Downstream Data

Data is collected, manipulated, and analyzed DM/DW/Cubes/Analytical BI Performance Management Compliance Auditing

EIM Issues Access Accuracy Completeness Mismatched Semantics

Enterprise Information Management Requirements

Single View Data Quality Master Data Management Operational Data Store Customer Data Integration Citizen Services Master Patient Index Product Information Management Real Time Data Warehouse

Master Data Management Defined

MDM for customer data systems are software products that: Support the global identification, linking and synchronization of customer information

across heterogeneous data sources Create and manage a central, database-based system of record Enable the delivery of a single customer view for all stakeholders

MDM architectural styles vary in: Instantiation of the customer master data — varying from the maintenance of a physical

customer profile to a more-virtual, metadata-based indexing structure The latency of customer master data maintenance — varying from real-time,

synchronous, reading and writing of the master data in a transactional context to batch, asynchronous harmonization of the master data across systems

An MDM program potentially encompasses the management of customer, product, asset, person or party, supplier and financial masters.

MDM Architecture – Coexistence

Master is Single Version of Truth

Data Quality is Ongoing

Updates occur at Sources or Master

Updates propagated to other Sources

Master

Source Source

Source Source

MDM Architecture – Consolidation

Master is Single Version of Truth

Data Quality at Master

Updates occur at Sources

Updates propagated to Master

Master

Source Source

Source Source

MDM Architecture – Registry

Multiple Versions of Truth

Data Quality is Ongoing

Updates occur at Sources

Keys and Metadata updated in Registry

Updates propagated to other Sources (Optional)

Master

Source Source

Source Source

MDM Architecture – Centralized

Master

Source Source

Source Source

Master is Single Version of Truth

Data Quality at Master

Updates occur at Master

Updates propagated to Sources

iWay Solution

SSN Full Name Phone Number

Address City State Zip Code

205-21-1923 John George Malkovich Wachovsky PhD

610-555-1423 1350 15th St Newtown PA 19073

205-11-1923 Dr Charles Becker

6105555423 GAP PA 17527

221-15-1853 Mr. Daniel Deutsch

610.555.6432 321 Broad Street Wayne PA 19087

205-11-1923 Dr C. Becker 6105555423 1173 Kennedy Blvd

17527

305-5`-3423 Gregory K Thoben

610-555-1242 223 Mallory St Kennett Squr PA 19348

“Dirty Data” issues

Problems : Missing Data

Inconsistent Formats

Incorrect Data

Duplicate Information

SSN Full Name Phone Number

Address City State Zip Code

205-21-1923 John George Malkovich Wachovsky PhD

610-555-1423 1350 15th Street Newtown PA 19073

205-11-1923 Dr Charles Becker

6105555423 GAP PA 17527

221-15-1853 Mr. Daniel Deutsch

610.555.6432 321 Broad St Wayne PA 19087

205-11-1923 Dr C. Becker 6105555423 1173 Kennedy Blvd

17527

305-5`-3423 Gregory K Thoben

610-555-1242 223 Mallory St Kennett Squr PA 19348

Data Cleansing

Correct AddressAddress City State Zipcode

1350 15th St Newton Square PA 19703

1173 Kennedy Blvd GAP PA 17527

3223 Mallory St Kennett Square PA 19348

SSN Full Name Phone Number

Address City State Zip Code

205-21-1923 John George Malkovich Wachovsky PhD

610-555-1423 1350 15th St Newtown Square PA 19073

205-11-1923 Dr Charles Becker

6105555423 GAP PA 17527

221-15-1853 Mr. Daniel Deutsch

610.555.6432 321 Broad St Wayne PA 19087

205-11-1923 Dr C. Becker 6105555423 1173 Kennedy Blvd

GAP PA 17527

305-5`-3423 Gregory K Thoben

610-555-1242 223 Mallory St Kennett Square PA 19348

Data Cleansing

Phone Number

610-555-1423

610-555-5423

610-555-6432

610-555-1242

SSN Full Name Phone Number

Address City State Zip Code

205-21-1923 John George Malkovich Wachovsky PhD

610-555-1423 1350 15th St Newtown Square PA 19073

205-11-1923 Dr Charles Becker

610-555-5423 GAP PA 17527

221-15-1853 Mr. Daniel Deutsch

610-555-6432 321 Broad St Wayne PA 19087

205-11-1923 Dr C. Becker 610-555-5423 1173 Kennedy Blvd

GAP PA 17527

305-5`-3423 Gregory K Thoben

610-555-1242 223 Mallory St Kennett Square PA 19348

Data Cleansing

Reformat NameFirst First Middle Initial Last Middle Last Title

John George Malkovich Wachovsky PhD

Charles Becker Dr

Daniel Deutsch Mr.

Gregory K Thoben

Data Cleansing

SSN Title First Name

F. Middle

Int. L.Middle Last Name Phone Addr City St. Zip

205-21-1923 Phd John George Malkovich Wachovsky 610-555-1423 1350 15th St Newtown Square

PA 19073

205-11-1923 Dr. Charles Becker 610-555-5423 GAP PA 17527

221-15-1853 Mr Daniel Deutsch 610-555-6432 321 Broad St

Wayne PA 19087

205-11-1923 Dr. C. Becker 610-555-5423 1173 Kennedy Blvd

GAP PA 17527

305-51-3423 Gregory K Thoben 610-555-1242 223 Mallory St

Kennett Square

PA 19348

DeDuplicate and Create Golden Record

SSN Title First Name

F. Middle

Int. L.Middle Last Name Phone Addr City St. Zip

205-21-1923 Phd John George Malkovich Wachovsky 610-555-1423 1350 15th St Newtown Square

PA 19073

205-11-1923 Dr. Charles Becker 610-555-5423 1173 Kennedy Blvd

GAP PA 17527

221-15-1853 Mr Daniel Deutsch 610-555-6432 321 Broad St Wayne PA 19087

305-51-3423 Gregory K Thoben 610-555-1242 223 Mallory St Kennett Square

PA 19348

Live Demonstration