master data & biztalk

Master Data & BizTalkJohan Hedbergjohan.hedberg@enfo.seEnfo Zystems Microsoft Integration MVP, MCT, V-TSPhttp://blogical.se/blogs/johanTwitter: @JoHed

Master Data = Data Distribution?

Integration & Distribution

Best of Breed System

Subscribing System

Data

Subscribing SystemSubscribing

System

Best of Breed System

Data

Subscribing SystemSubscribing

SystemSubscribing System

Best of Breed System

Data

Subscribing SystemSubscribing

SystemSubscribing System

SQL Master Data Services

“Master Data Services (MDS) is the SQL Server solution for master data management (MDM); the efforts made by an organization to discover and define non-transactional lists of data, with the goal of compiling maintainable master lists”

What Master Data Services is

• It is a central data store• It contains data staging tables and data

export views• It does not contain any integration

capabilities in itself

Basic MDS Architecture

MDS DatabaseStaging Tables Subscription

Views

MDS Tables

What Master Data Services is not

• It is not data distribution• It is not data sync from a (another) master

system

• Datamodell• Tabeller• Vyer

• Förändringar i 2012

MDS Future and evolution

Building the foundationV1 product

Empowering IW through Excel Add-in and improved Web UI (Silverlight)Enhanced performance and scalabilityImproved quality (usability, robustness, security)Improved Integration through readability enhancements

A ServiceEnhance curationEnhanced collaboration and sharing Improved data quality (DQS)Further empowering business users through simplified, advanced modeling capabilitiesBetter productivityImproved productivity through external IP (data types and models)Sharing and reuse

SQL 2008R2

SQL2012

Post SQL2012

• Förändringar i 2012• Yttre stage tabeller för att rensa data innan man tar in det i MDS

staging

Data Architecture – Custom Data Flow

MDS DatabaseStaging Tables Subscription

Views

MDS Tables

Data Import Data Export

Staging Tables

DQS (Cleansing & Matching)

Data MERGE and Translation

Staging Tables

External Systems External Systems

Data Architecture – Basic Data Flow

MDS DatabaseStaging Tables Subscription

Views

MDS Tables

Data Import Data Export

Data Architecture – Basic Data Flow

MDS DatabaseStaging Tables Subscription

Views

MDS Tables

BizTalkAdaptability

EventingProcesses

BizTalkAdaptability

Pub/SubProcesses

• Förändringar i 2012• Yttre stage tabeller för att rensa data innan man tar in det i MDS

staging• SSIS är en integrationsplattform

SQL Server Integration Services (SSIS)

“SSIS is an Extract, Transform, Load (ETL) framework that allows you to integrate different data sources using a workflow like designer and a set of tasks.”

• Förändringar i 2012• Yttre stage tabeller för att rensa data innan man tar in det i MDS

staging• SSIS är en integrationsplattform• Data från “SAP” kommer genom export till en fil från “SAP”• Data in sker i nattliga batchar• Men events då?

MDS WCF Architecture

IIS Service

MDS Service

WCF

WEB-UI Excel Add-In

Workflow/Notifications

MDS Database

External Systems

MDS WCF Architecture

IIS Service

MDS Service

WCF

BizTalk

MDS Database

External Systems

Demo• Stage/Import data with BizTalk Server• Export/Sync data with BizTalk Server• Lookup data with BizTalk Server

MDS Architecture

IIS Service

MDS Service

WCF

WEB-UI Excel Add-In

Workflow/Notifications

Subscribing Systems MDS Database

Subscription Views Staging Tables DQS (Cleansing &

Matching)

External Systems

BizTalk/.NET

SSIS SSIS

BizTalk/.NET

BizTalk/.NET