c5: introduction to dataxtend ® semantic integrator (dx si) dean elliott client solutions manager

C5: Introduction to DataXtend® Semantic Integrator (DX SI)

Dean ElliottClient Solutions Manager

© 2008 Progress Software Corporation2

Agenda

Data challenges in integration solutions

DX SI enables the data layer in integration

DX SI Lifecycle

DX SI Demonstration


Traditional approaches to data integration

Message Oriented Middleware

Inventory TT

ProvisioningBillingCMR1 CRM2

CallCenter

DataW/house

TT

ProvisioningBilling

Inventory

CRM1 CRM2

CallCenter

‘Integration Spaghetti’

DataW/house


Business Challenges resulting from traditional approaches to data integration

Message Oriented Middleware

Inventory TT

ProvisioningBillingCMR1 CRM2

CallCenter

DataW/house

TT

ProvisioningBilling

Inventory

CRM1 CRM2

CallCenter

‘Integration Spaghetti’

DataW/house

Business Challenges

Agility

Managing Change

Increasing complexity

Increasing maintenance costs


A new approach to data integration

ProvisioningBilling

Inventory

CRM1

TT

CRM2

CallCenter

DataW/house

‘Integration Spaghetti’ Messaged OrientedMiddleware

Inventory TT

ProvisioningBillingCRM1 CRM2

CallCenter

DataW/house

ESB and Semantic Data Integration

Provision-ingBilling

Inventory

CRM1

TT

CRM2

CallCenter

Common Data Model

A common data model enablestransformation of all interfaces to

a single semantic meaning.


Can’t We All Just Get Along?

No central management

Costly to modify

Not easily adapted to change

The Problem

Database 2

Database 1

Application 3

Application 2

Database 3

Translation

Translation

Application 1

TranslationTranslation

Translation

Translation

Translation

Translation

Translation

Tran

slatio

n

Tran

slat

ion

Translation

Translation

Translation

Translation

Translation

Tra

nsla

tion

Tra

nsla

tion

Translation

Tran

slatio

n

Tran

slatio

n

Translation Translation

TranslationTranslation

Translation


Model Driven Integration

Database 2

Database 1

Application 3

Application 2

Application 1

Database 3

Common Model

The Solution

DistributedTransformation

Engine

Centralized management

Rapid development and deployment

Lower TCO


Data has different meanings in different systems (semantics)• “age” means something different to an insurance

company issuing a premium than to a government agency issuing a driver’s permit

Many data transformations between systems are complex • XSLT is not enough

In SOA, everybody needs to know how to talk to everybody else!

Why DataXtend Semantic Integrator?


DataXtend Semantic Integrator

Common model architecturefor semantic mediation• Visual mapping of large,

complex integrations

Robust project life cycle support• Round-trip testing and impact analysis

Flexible, distributed deployment options• Web services, ESB, app server, or Java

container

Address the accidental architecture of data

Customer Care

Products

Customers

Provisioning

Services

TM Forum SID

Invoicing


Challenges of Common Model Integration

A good Common Model should be• Comprehensive

• Abstract

• Extensible

But… a comprehensive, abstract model is• Large

• Complex for simple things

• Hard to maintain

DataXtend SI addresses these issues


Industry Standard Common Data Models

P&C Insurance (ACORD P&C) Health Care Payers and Providers (HL7) Financial Derivatives (FpML) Telecommunication (TMF SID) Horizontal (OAGIS) Retail (ARTS) Mortgage Banking (MISMO) Utilities (IEC 61968) Life Insurance (ACORD Life) Financial Services Messages (ISO20022) B2B Supply Chain (RosettaNet, GS1/EAN)


Agenda


DXSI enables the data layer in integration

DXSI in the Systems Development Lifecycle

Summary


Progress® DataXtend SI

ENTERPRISE SERVICE BUS

NMS Inventory OMS Billing CRM

System Integration Layer- Infrastructure Abstraction

Common Data Model

CustomerProduct

ResourcePartner

Common

Market

ServiceData Interoperability Layer

- Semantic Abstraction

Business Process Layer- Process Abstraction

BPM BAM

- Enables the data layer in Integration

BPM Layer

ESB/EAI Layer

Progress DataXtend SI

Utilizes a

Common Model Semantic

Brokering Model based

Mappings Visual Round-

Trip Testing 360º End-to-End

Impact Analysis Governance

Change and

Lifecycle

Management


Visual tool for designing integration

Stateless for scalability

Runs in any Java container

Connects to any bus

DataXtend SI Product Capabilities

Runs in Eclipse

DISTRIBUTEDRUNTIME

CENTRALIZEDDESIGN

GenerateDeploy

TESTING


Agenda



DXSI in the Systems Development Lifecycle

Summary


RuntimeAutomate

rules execution

Audit and Validateevery exchange

Lifecycle ManagementManage rules, aggregations

and maps over time

Design Time Import, enrich, define

rules, aggregations and maps needed to exchange valid data between enterprise systems

Change integrations of adaptive infrastructure with build-in change management facilities

The DataXtend SI Lifecycle


DataXtend Exchange Model

Import directly from a database

(default validation rules to enforce constraints)

Import directly from XML

Import directly from a WSDL

Import directly from a UML

1080 Classes5000 Classes1000 Classes1020 Classes

Your OwnModel!

Semantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map


DataXtend Common Model Navigator

ComponentViewDetail about the component in tabular form: attributes, types, classes, collections and relationships

Graph ViewShows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships

Tree ViewAllows you to navigate through the containment hierarchy of the component.


Computed AttributesSimplify Common Models for Ease of Use

Contact

Mobile

Type = Home

Type = Work

Type = Mobile

TelephoneCustomer

Centralized design

Virtual attributes simplify models

without deviating from the standard


DataXtend Mapping and Rule Designer

All assets are visually mapped to and from the common model

Even complex expressions are

designed without coding


DataXtend Tester


Deployment Options: Distributed Execution

The DXSI Runtime is stateless and each executes independently

There is no central hub to limit performance or single point of failure

Multiple deployment

options can be used simultaneously

Source Application

DXSI Runtime Influences Message Content, Not Transport Architecture

App Server

DXSI Data Services

Target System

Target System

DXSI

Adaptor

DXSI Assembly


DXSI Exchange Model Packaging

DXSI services can be wrapped with a variety of code generators to provide easily deployed, high performance packages for many platforms including:• Sonic ESB Itineraries• Websphere SCA / SDO • WebLogic 8 and 9 XMLBeans• WAR, EAR, EJB etc.

Packagers are designed to leverage the infrastructure and tools of the chosen platform


DataXtend Deployment1: Creating the DX SI service interfaces

Interface wrappers Simplify access to DX SI service interface Build-in to DX SI

IBM SDOs Sonic™ ESB BEA Beehive JMS Java™ Beans EJB Sessions

Create one or more wrappers for every data service

DX SI

Java Runtime

No wrappers. DX SI Java interface is used

Can run standalone orpackaged

build

build


DataXtend Deployment2: Packaging

Application and Service packagers

Fully deployable solution generated Build-in packagers to DX SI

Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle®

DX SI

Java Runtime

1. Define wrappers

2. Build

3rd Party IDE

Examples: Sonic Workbench IBM WID BEA Workshop

Application Server BPM Server ESB

3. Package & Deploy

3. Package


RuntimeAutomate

rules execution



and maps over time






DataXtend SI Runtime

DataXtend SI Engine runtime process:1. Input data is mapped to the Common Model

2.Common Model is enriched with extra data if required

3.Data is mapped from Common Model to Data Source (writing)

4.Results are mapped back to the Common Model and Data Services

Rules engine automates validation of the data at all stages

Runtime report is available detailing all issues


ESB Solution without DataXtend SI

Goal:• To provide an aggregated

view of a customer’s accounts

Issues• Solution assumes all data

is equivalent i.e. canonical and on the same version, for message and data

• No controls to map data types

– E,g. TVAccounts – maps Mr as ‘0’

– Wireless maps Mr as ‘A’

– To solve requires multiple transformation svcs

• Possibly 10 XForm and Enrichment steps


DataXtend SI and ESB

ESB and DX SI• Intermediate services replaced by DX SI• DX SI handles Data and Message layout impedance

– Using XML based invocation framework similar to WS

• 11 Intermediate services to 1


RuntimeAutomate

rules execution



and maps over time






DataXtend SI Lifecycle Management Features

Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of

an element's current state for future reference.

Comparison of exchange model elements: Provides an interface for comparing elements in the

same project or in different projects.

Synchronize model changes: Allows you to selectively accept changes from one

exchange model into another.


Select the DataXtend Impact Analysis tab with an entity selected

The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor

You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity

DataXtend SI Impact Analysis


Use the Compare Editor to compare: • Entities in the same or in different projects• Two files in the same projectThis example shows how to compare two files in the same project.

DataXtend SI Compare Editor

Changes are highlighted in the Compare Editor


You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).

You can also use project synchronization to create a new project based on another, exported one.

Synchronizing Model Changes


Agenda



DXSI Lifecycle

Summary


SummaryDX SI Differentiator vs. Traditional Mappers

Comparison with traditional point-to-point message mapping tools


What if…?

What if… you could accurately turn around change impact assessments in hours rather than days?

What if… you could radically increase systems agility and responsiveness to business requests through a loosely coupled architecture?

What if… you could significantly reduce maintenance costs (through re-use, consistency, reduction in custom code, end-to-end visibility of data, and leverage of open inter-operable standards)


In Summary

DataXtend SI reduces costs to create and maintain data transformation

DataXtend SI utilizes and enables a common model approach

DataXtend SI deploy as a service


For More Information, go to…

PSDN• DataXtend SI Product Center

• Documentation

Progress.com• DataXtend SI Home Page

• DataXtend SID Model Browser


Relevant PTW Sessions

C4: Common Applications of Sonic ESB

C8: Enterprise Integration Patterns in Sonic ESB

C9: SOA Management with Actional for Sonic live at work


Questions?


Thank You

c5: introduction to dataxtend ® semantic integrator (dx si) dean elliott client solutions manager

Documents

center common data model

progress software corporation

data layer

data transformations

center data whouse esb

agenda data challenges

translation slide

integration solutions