sql 2012 enterprise information management with dqs and mds by karan gulati

24
Presented by Karan Gulati Sr. Support Escalation Engineer (SSAS Maestro) http://blogs.msdn.com/karang http://karanspeaks.com Twitter @karangspeaks Enterprise Information Management with DQS, MDS and SSIS

Upload: karan-gulati

Post on 18-Jun-2015

746 views

Category:

Technology


0 download

DESCRIPTION

Session talks about SQL 2012 Enterprise Informatoin Managment

TRANSCRIPT

Page 1: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Presented by Karan GulatiSr. Support Escalation Engineer (SSAS Maestro)http://blogs.msdn.com/karanghttp://karanspeaks.comTwitter @karangspeaks

Enterprise Information Management with DQS, MDS and SSIS

Page 2: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Agenda

Data Warehousing Concepts Master Data Fact Data

Enterprise Information Management (EIM) What is it and why do we need it?

Microsoft EIM, 3 technologies working together DQS

• Capabilities and Demo MDS

• Capabilities and Demo• SSIS

EIM=DQS+MDS+SSIS Questions

Page 3: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Data Warehousing

A data warehouse is a general structure for storing the data needed for good BI (Business Intelligence).

Data in a warehouse is of little use until it is converted into the information that decision makers need.

The large relational databases, typical of data warehouses, need additional help to convert the data into information.

In data warehouse we have two kinds of data and Master Data Fact Data

Page 4: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Measures or Fact Data

Measures are the key performance indicators that you want to evaluate.

To determine which of the numbers in the data might be measures, here is a rule of thumb: If a number makes sense when it is aggregated, then it is a measure.

Examples Salary Utilization Sales

Page 5: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Dimensions or Master Data

Dimensions are the categories of data analysis.

Here is the rule of thumb: When a report is requested "by" something, that something is usually a

dimension.

Examples Employee Geography Department Products

Page 6: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

What is EIM – Enterprise Information Management

The set of capabilities enabling the enterprise to get the right data to the right consumers, reliably, repeatedly, efficiently & with high confidence.

Page 7: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Why Do We Need EIM?

Page 8: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

SQL 2012 Enterprise Information ManagementDQS

MDS

SSIS

EIM

Data Quality ServicesKnowledge based Data Cleansing and Matching

Master Data ServicesMaster and reference data Management

Integration ServicesETL and Data Integration Tool

Cleanse

Manage

Integrate

Page 9: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

SQL Server Data Quality Services

A knowledge driven Data Quality Solution

Page 10: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

What is Data Quality ?

Data Quality represents the degree to which the data is suitable for business usages

Data Quality is built through People + Technology + Processes

Bad Bata Bad Business

Page 11: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

What does Data Quality Look Like?

Page 12: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

What is SQL 2012 DQS ?

Data Quality Services (DQS) is a Knowledge-Driven data quality solution,

enabling IT Pros and data stewards to easily improve the quality of their data

Page 13: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Terms

• To prepare knowledge for a data quality project, you build and maintain a knowledge base (KB) that DQS can use to identify incorrect or invalid data.

Knowledge Bases

• Knowledge in a knowledge base is maintained in domains, each of which is specific to a data field.

Knowledge Discovery• A computer-assisted process that builds knowledge into a

knowledge base by processing a data sample

Domains

Page 14: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Example of a Knowledge Base

Page 15: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

DEMO Time………………

DQS

Page 16: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

SQL Server Master Data ServicesSQL Server Master Data Services provides a central data hub that ensures the integrity of information and consistency of data is constant across different applications.

Page 17: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

MDS Definitions – Master DataMaster Data – Slowly changing reference data shared across systems

People

• Customers

• Vendors

• Sales people

• Employees

• Partners

• Patients

Things

• Products

• Organizational units

• Recipes

• Parts

• Storage bins

• Documents

Places

• Stores

• Wells

• Power lines

• Geo areas

• Warehouses

Abstract

• Contracts

• Warranties

• Time

• Metrics

• Securities

Page 18: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

MDM Challenges

Where is the real Boeing?

Purchasing DBAsset MgmtHR Doc

Boeing Boeing Inc Boeing (Renton) Aut_Boeing Boein’

Page 19: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

No single, trusted source of the truth

No dimension maintenance capability

Conflicting views of product, customer location, etc

No system to maintain attributes

Multiple stakeholders for the same record

Inability to enforce data stewardship processes

Inconsistencies cost – mistakes, incorrect reports, etc.

Why do we need MDS

Page 20: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

Benefits

Align master data across systems Get a single version of the truth Improve operational consistency Improve reporting consistency Enable users to manage master data securely Simplify the user experience with web-based access Ensure integrity of Information Manage critical hierarchies and master data attributes Be confident that data is accurate and up to date

Page 21: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

DEMO Time………………

MDS

Page 22: SQL 2012 Enterprise Information Management with DQS and  MDS by Karan Gulati

ConclusionDQS

MDS

SSIS

EIM

Enterprise Integration Management (EIM) provides an a portfolio of solutions that enable organizations to trust the credibility and consistency of their data so they can make critical business decisions.