soa-13: introduction to dataxtend ® semantic integrator (dx si) abstract data management from the...

SOA-13: Introduction to DataXtend® Semantic Integrator (DX SI)

Abstract data management from the application level using a common data model

© 2008 Progress Software Corporation2 SOA-13: Introduction to DataXtend Semantic Integrator

Agenda

Data challenges in integration solutions

DX SI enables the data layer in integration

DX SI Lifecycle

DX SI Demonstration


Traditional approaches to data integration

Message Oriented Middleware

Inventory TT

ProvisioningBillingCMR1 CRM2

CallCenter

DataW/house

TT

ProvisioningBilling

Inventory

CRM1 CRM2

CallCenter

‘Integration Spaghetti’

DataW/house


A new approach to data integration

ProvisioningBilling

Inventory

CRM1

TT

CRM2

CallCenter

DataW/house

‘Integration Spaghetti’ Messaged OrientedMiddleware

Inventory TT

ProvisioningBillingCRM1 CRM2

CallCenter

DataW/house

ESB and Semantic Data Integration

Provision-ingBilling

Inventory

CRM1

TT

CRM2

CallCenter

Common Data Model

A common data model enablestransformation of all interfaces to

a single semantic meaning.


Can’t We All Just Get Along?

No central management

Costly to modify

Not easily adapted to change

The Problem

Database 2

Database 1

Application 3

Application 2

Database 3

Translation

Translation

Application 1

TranslationTranslation

Translation

Translation

Translation

Translation

Translation

Tran

slatio

n

Tran

slat

ion

Translation

Translation

Translation

Translation

Translation

Tra

nsla

tion

Tra

nsla

tion

Translation

Tran

slatio

n

Tran

slatio

n

Translation Translation

TranslationTranslation

Translation


Model Driven Integration

Database 2

Database 1

Application 3

Application 2

Application 1

Database 3

Common Model

The Solution

DistributedTransformation

Engine

Centralized management

Rapid development and deployment

Lower TCO


Challenges of Common Model Integration

A good Common Model should be• Comprehensive

• Abstract

• Extensible

But… a comprehensive, abstract model is• Large

• Complex for simple things

• Hard to maintain

DataXtend SI addresses these issues


Agenda



DX SI Lifecycle

DX SI Demonstration


Progress® DataXtend SI

ENTERPRISE SERVICE BUS

NMS Inventory OMS Billing CRM

System Integration Layer- Infrastructure Abstraction

Common Data Model

CustomerProduct

ResourcePartner

Common

Market

ServiceData Interoperability Layer

- Semantic Abstraction

Business Process Layer- Process Abstraction

BPM BAM

- Enables the data layer in Integration

BPM Layer

ESB/EAI Layer

Progress DataXtend SI

Utilizes a

Common Model Semantic

Brokering Model based

Mappings Visual Round-

Trip Testing 360º End-to-End

Impact Analysis Governance

Change and

Lifecycle

Management


Visual tool for designing integration

Stateless for scalability

Runs in any Java container

Connects to any bus

DataXtend SI Product Capabilities

Runs in Eclipse

DISTRIBUTEDRUNTIME

CENTRALIZEDDESIGN

GenerateDeploy

TESTING


Agenda



DX SI Lifecycle

DX SI Demonstration


RuntimeAutomate

rules execution

Audit and Validateevery exchange

Lifecycle ManagementManage rules, aggregations

and maps over time

Design Time Import, enrich, define

rules, aggregations and maps needed to exchange valid data between enterprise systems

Change integrations of adaptive infrastructure with build-in change management facilities

The DataXtend SI Lifecycle


DataXtend Exchange Model

Import directly from a database

(default validation rules to enforce constraints)

Import directly from XML

Import directly from a WSDL

Import directly from a UML

1080 Classes5000 Classes1000 Classes1020 Classes

Your OwnModel!

Semantic Mappings:Validate DataMatch incompatible dataFlag Data ErrorsConditionally Map


DataXtend Common Model Navigator

ComponentViewDetail about the component in tabular form: attributes, types, classes, collections and relationships

Graph ViewShows relationships as lines. Dotted lines represent inheritance while solid lines are containment relationships

Tree ViewAllows you to navigate through the containment hierarchy of the component.


Computed AttributesSimplify Common Models for Ease of Use

Contact

Mobile

Type = Home

Type = Work

Type = Mobile

TelephoneCustomer

Centralized design

Virtual attributes simplify models

without deviating from the standard


DataXtend Mapping and Rule Designer

All assets are visually mapped to and from the common model

Even complex expressions are

designed without coding


DataXtend Tester


DataXtend Deployment1: Creating the DX SI service interfaces

Interface wrappers Simplify access to DX SI service interface Build-in to DX SI

IBM SDOs Sonic™ ESB BEA Beehive JMS Java™ Beans EJB Sessions

Create one or more wrappers for every data service

DX SI

Java Runtime

No wrappers. DX SI Java interface is used

Can run standalone orpackaged

build

build


DataXtend Deployment2: Packaging

Application and Service packagers

Fully deployable solution generated Build-in packagers to DX SI

Web service, EJB, EAR Supported platforms: JBOSS, IBM, BEA, Oracle®

DX SI

Java Runtime

1. Define wrappers

2. Build

3rd Party IDE

Examples: Sonic Workbench IBM WID BEA Workshop

Application Server BPM Server ESB

3. Package & Deploy

3. Package


RuntimeAutomate

rules execution



and maps over time






DataXtend SI Runtime

DataXtend SI Engine runtime process:1. Input data is mapped to the Common Model

2.Common Model is enriched with extra data if required

3.Data is mapped from Common Model to Data Source (writing)

4.Results are mapped back to the Common Model and Data Services

Rules engine automates validation of the data at all stages

Runtime report is available detailing all issues


ESB Solution without DataXtend SI

Goal:• To provide an aggregated

view of a customer’s accounts

Issues• Solution assumes all data

is equivalent i.e. canonical and on the same version, for message and data

• No controls to map data types

– E,g. TVAccounts – maps Mr as ‘0’

– Wireless maps Mr as ‘A’

– To solve requires multiple transformation svcs

• Possibly 10 XForm and Enrichment steps


DataXtend SI and ESB

ESB and DX SI• Intermediate services replaced by DX SI• DX SI handles Data and Message layout impedance

– Using XML based invocation framework similar to WS

• 11 Intermediate services to 1


RuntimeAutomate

rules execution



and maps over time






DataXtend SI Lifecycle Management Features

Impact Analysis view and report: Identify interdependencies in a project. An Impact Analysis report provides a snapshot of

an element's current state for future reference.

Comparison of exchange model elements: Provides an interface for comparing elements in the

same project or in different projects.

Synchronize model changes: Allows you to selectively accept changes from one

exchange model into another.


Select the DataXtend Impact Analysis tab with an entity selected

The Impact Analysis view displays all entities affected by or related to the entity selected in the Exchange Model editor

You can generate an HTML Impact Analysis Report that displays all entities related to the selected entity

DataXtend SI Impact Analysis


Use the Compare Editor to compare: • Entities in the same or in different projects• Two files in the same projectThis example shows how to compare two files in the same project.

DataXtend SI Compare Editor

Changes are highlighted in the Compare Editor


You use project synchronization to merge the contents of two exchange models: The current project (the target) and an external project (the source).

You can also use project synchronization to create a new project based on another, exported one.

Synchronizing Model Changes


Agenda



DX SI Lifecycle

DX SI Demonstration


SummaryDX SI Differentiator vs. Traditional Mappers

Comparison with traditional point-to-point message mapping tools


In Summary

DataXtend SI reduces costs to create and maintain data transformation

DataXtend SI utilizes a common model

DataXtend SI deploy as a service


For More Information, go to…

PSDN• DataXtend SI Product Center

• Documentation

Progress.com• DataXtend SI Home Page

• DataXtend SID Model Browser


Relevant Exchange Sessions

SOA-18Combining the Power of Sonic, DataXtend Semantic Integrator, and Actional for SOA Operations

SOA-25 Data Distribution Solutions Using DataXtend Semantic Integrator for Sonic ESB Users

SOA-31Progress SOA Portfolio Roadmap


Questions?


Thank You

soa-13: introduction to dataxtend ® semantic integrator (dx si) abstract data management from the...

Documents