examining master data integration using biztalk server and sql server master data services
DESCRIPTION
Examining Master Data integration using BizTalk Server and SQL Server Master Data Services, in this session will give an introduction to using BizTalk Server together with SQL Server Master Data Services. These technologies are helpful in an Enterprise Information Management scenario. It will showcase the SQL Server technology and talk about what you need to know and the patterns you can use from an integration perspective to import and export information and perform integration between SQL Server and external information sources. BizTalk Summit 2014, London March 03-04 Brought to you by BizTalk360TRANSCRIPT
![Page 1: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/1.jpg)
brought to you by
BIZTALK SUMMIT 2014, LONDON
MARCH 03-04sessions. discussions. networking and
more
Examining Master Data integration using BizTalk Server and SQL Server Master Data ServicesJOHAN HEDBERG
![Page 2: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/2.jpg)
World Champions
Olympic Champions
![Page 3: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/3.jpg)
![Page 4: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/4.jpg)
SQL Master Data Services
“Master Data Services (MDS) is the SQL Server solution for master data management (MDM)”
![Page 5: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/5.jpg)
Agenda
Master Data ServicesScoping the discussionOffice ExcelSQL Server Integration ServicesBizTalk Server
![Page 6: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/6.jpg)
Scoping the Discussion
Master Data Solution Patterns
![Page 7: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/7.jpg)
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Customer
![Page 8: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/8.jpg)
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Product
![Page 9: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/9.jpg)
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
![Page 10: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/10.jpg)
Master Data Enterprise information Management
Data Management
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Data Steward
![Page 11: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/11.jpg)
What is the “Data Steward’s” favorite tool?
Microsoft Excel
![Page 12: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/12.jpg)
Demo
• Introduction• Working with Master Data Services in SQL Server 2012• The Portal• Excel
![Page 13: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/13.jpg)
Basic MDS Architecture
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
![Page 14: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/14.jpg)
What Master Data Services is
• It is a central data store• It contains data staging tables and data
export views• It does not contain any integration
capabilities in itself
![Page 15: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/15.jpg)
What Master Data Services is not
• It is not data distribution• It is not data sync from a (another) master
system
![Page 16: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/16.jpg)
So how do we import data without Excel?
![Page 17: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/17.jpg)
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
Data Import Data Export
![Page 18: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/18.jpg)
SQL Server Integration Services (SSIS)
“SSIS is an Extract, Transform, Load (ETL) framework for data integration”
![Page 19: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/19.jpg)
Data Architecture – 2 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
Data Import Data Export
Staging Tables
DQS (Cleansing & Matching)
Data MERGE and Translation
Staging Tables
External Systems External Systems
![Page 20: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/20.jpg)
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
SSISData Import
SSISData Export
![Page 21: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/21.jpg)
Demo
• Data import• Using SSIS
![Page 22: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/22.jpg)
Is SSIS an Integration Platform?
Yes and no
![Page 23: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/23.jpg)
Is there another Integration Platform
we can use?
BizTalk
![Page 24: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/24.jpg)
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
BizTalkData Import
BizTalkData Export
![Page 25: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/25.jpg)
Demo
• Stage/Import data with BizTalk• Export/Sync data with BizTalk
![Page 26: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/26.jpg)
So it’s all about batches of data?
It depends…
![Page 27: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/27.jpg)
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
BizTalkAdaptability
EventingProcesses
…
BizTalkAdaptability
Pub/SubDelta processing
…
![Page 28: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/28.jpg)
MDS WCF Architecture
IIS Service
MDS Service
WCF
WEB-UI Excel Add-In
Workflow/Notifications
MDS Database
External Systems
![Page 29: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/29.jpg)
MDS WCF Architecture
IIS Service
MDS Service
WCF
BizTalk
MDS Database
External Systems
*
![Page 30: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/30.jpg)
Demo
• The WCF API’s• Data Lookup
![Page 31: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/31.jpg)
MDS Complete Architecture
IIS Service
MDS Service
WCF
WEB-UI Excel Add-In
Workflow/Notifications
Subscribing Systems MDS Database
Subscription Views Staging Tables DQS (Cleansing &
Matching)
External Systems
BizTalk/.NET
SSIS SSIS
BizTalk/.NET
BizTalk/.NET
![Page 32: Examining Master Data integration using BizTalk Server and SQL Server Master Data Services](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c545a94a7959b7108b474e/html5/thumbnails/32.jpg)
Recommendations
• Start small• It’s the Business’s data• BizTalk can be an enabler