metadata intelligence - dama ny · data governance •governance management develop the ownership,...
TRANSCRIPT
![Page 1: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/1.jpg)
At the Intersection of Data Governance and Data
Quality
Metadata Intelligence Don Soulsby
Sandhill Consultants
Thursday , May 14, 2015
![Page 2: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/2.jpg)
Who we are:
Sandhill Consultants Strengths are in our technology understanding of foundational solutions such as Modeling, Metadata, Data Quality and Data Governance as well as data operations the their supported platforms . We offer sales, services, education and support, as well as standards and best practices should clients need these services.
Don Soulsby
• Vice President Architecture Strategies, Sandhill Consultants
• Enterprise Architecture, Business Intelligence, Metadata Consultant
• Data/Process modeller • Educator • Industry Speaker
2
metaWright
![Page 3: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/3.jpg)
The New Cx Executives
CDO – Chief Data Officer
Organizations, Processes Come and Go, Data Persists
![Page 4: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/4.jpg)
The Corporate Brain Challenge
SOFTWARE Programming
Language
WETWARE Human
Language
DATABASE TAXONOMY
![Page 5: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/5.jpg)
Managing Data Process
Business Technology The Trade Language
Lingua Franca
![Page 6: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/6.jpg)
Manage Dis!
![Page 7: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/7.jpg)
The Problem?
![Page 8: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/8.jpg)
Ownership
This is a story about four People named EVERYBODY, SOMEBODY, ANYBODY and NOBODY. There was an important job to be done and EVERBODY was sure that SOMEBODY would do it. ANYBODY could have done it, but NOBODY did. SOMEBODY got angry about that, because it was EVERBODY’s job. EVERBODY thought ANYBODY Could do it, but NOBODY realized that EVERYBODY wouldn’t do it. It ended up that EVERBODY blamed SOMEBODY when NOBODY did what ANBODY could have.
![Page 9: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/9.jpg)
Data Ownership
That which is Everybody’s business is Nobody’s business
Izaak Walton
Everybody’s business is Nobody’s business, and Nobody’d business is My business
Clara Barton
![Page 10: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/10.jpg)
DAMA – Body of Knowledge
![Page 11: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/11.jpg)
The Capability Maturity Model
Process
Control
Process
Measurement
Process
Definition
Basic
Management
Control
Initial
(1) ad hoc Process
Repeatable
(2) Stable Process
Defined
(3) Standard Process
Managed
(4) Measured Process
Optimizing
(5) Improving Process
Consistent
Execution
Controlled
Environment
Quality and
Productivity
Improvement
Continuing
Improvement
Chaotic
![Page 12: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/12.jpg)
12
CMM History
• The Software Engineering Institute established 1984 at Carnegie Mellon University, Pittsburgh
• Principle customer is the Department of Defense
• U.S. Air Force Project 1987
oMethod to select software contractors
• Over 5,000 Assessments performed since 1987
![Page 13: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/13.jpg)
Process Improvement Models
• 120+ and counting
• Data MM
• Training MM
• Release MM
• Configuration MM
• Documentation MM
• Business Rules MM
• Etc… Beyond The CMM:,
Brett Champlin, 2002
![Page 14: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/14.jpg)
Data Related Maturity Models • Data Categories MM (BC Ministry of Forests) • Data MMM (MITRE) • Data MMM (Giga) • Data Resource Management MM (Champlin) • Data Warehouse Information Management MM (Ladley) • Data Warehousing MM (Marco) • Enterprise-wide Data MMM (Parker) • Information Delivery MM (Computer Associates) • Information Evolution Model (SAS) • Information Maturity Framework (BC Ministry of Transp) • Information Quality MM (English) • Total data Quality Management MM (MIT) • Stages of Growth (Nolan)
Beyond The CMM:, Brett Champlin, 2004
![Page 15: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/15.jpg)
Mitre Data management MM
By Category 34
24
19
14 13
5 5 4 3 3 2
0
5
10
15
20
25
30
35
40
45
Beyond The CMM:, Brett Champlin, 2002
![Page 16: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/16.jpg)
![Page 17: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/17.jpg)
Dr. Peter Aiken
![Page 18: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/18.jpg)
The Data Warehouse Institute
1998
![Page 19: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/19.jpg)
Beyond The CMM:, Brett Champlin, 2004
Der Reifegad des Datenmanagements
![Page 20: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/20.jpg)
Yes, even your humble presenter
Level 1 - Initial • Programmers • Extract files, no metadata • Data access tools • Data movement tools • Personal Data
Level 2 – Repeatable • Project Management, Standards • DBA’s, Modelers, Specialists • Reporting Tools • Data quality • Team Data
Level 3 – Defined • Metadata Management • Architects • Content Management • Extended Team Data
Level 4 - Managed • Measurement • Integrated Content Management • Corporate Data
Level 5 - Optimizing • Feedback System • Knowledge Management • Extended Enterprise Data
DATA ANALYTICS MM
![Page 21: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/21.jpg)
Management’s Role Executive Maturity Must Precede Process Maturity
From "Data Management Maturity Model" Burton G. Parker, et. al., MITRE Software Engineering Center, McLean, Virginia July 1995;
Parker, B., Enterprise-wide Data Management Process Maturity Framework, Handbook of Database Management, Auerbach, 1999
Continuously
Improving
Process
Predictable
Process
Standard,
Consistent
Process
Disciplined
Procedures
Optimizing
(5)
Managed
(4)
Defined
(3)
Repeatable
(2)
Initial
(1)
Need
Management
Program
Need
Executive
Oversight
Need
Consistency
Ignored
(1)
Managing
(5)
Participative
(4)
Supportive
(3)
Recognized
(2)
![Page 22: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/22.jpg)
CMMI
• CMMI Institute, powered by Carnegie Mellon
• The CMMI Institute is a Carnegie Mellon corporation, the new home of the Capability Maturity Model Integration (CMMI)
• Formerly managed by the Software Engineering Institute (SEI)
• CMMI for Development, CMMI for Services
![Page 23: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/23.jpg)
Repeatable
Defined
Managed
Optimizing
Initial 1
2
3
4
5
CMMI Maturity Model
![Page 24: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/24.jpg)
CMMI Assessment
![Page 25: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/25.jpg)
Data Management Maturity - DMM
• Data Management Strategy
• Data Governance
• Data Quality
• Data Operations
• Platform & Architecture
• Supporting Processes
The DMM model, first announced in May 2014, was developed using the principles and structure of CMMI Institute’s Capability Maturity Model Integration (CMMI®)
![Page 26: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/26.jpg)
DMM Assessment Process
• Prioritize Practice Areas
• Communicate Goals
• Respond to Core Questions
• Establish Practice Area maturity levels
o Not started, Partially complete, Complete
• Develop People, Process & Product recommendations to advance to next level
![Page 27: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/27.jpg)
Data Management Maturity Model
METADATA
OVERSIGHT
![Page 28: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/28.jpg)
DMM – Practice Areas
Data Management
Strategy
Data Management
Strategy
Communications
Data Management
Function
Business Case
Funding
Data
Governance
Governance Management
Business Glossary
Metadata Management
Data
Quality
DQ Strategy
Data Profiling
DQ Assessment
Data Cleansing
Data
Operations
Data Requirements
Definition
Data Lifecycle Management
Provider Management
Platform & Architecture
Architectural Approach
Architectural Standards
Data Management
Platform
Data Integration
Historical Data, Archiving
![Page 29: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/29.jpg)
Data Management Maturity Assessment
POWER OF 3
EDME
![Page 30: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/30.jpg)
Enterpise Data Management Expert
EDME Certification: • Fully qualified to lead a
DMM Assessment and provide high value to any organization
• Fully qualified to lead data management improvement programs
![Page 31: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/31.jpg)
Anonymous Benchmark
![Page 32: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/32.jpg)
Data Governance Capabilities
DATA GOVERNANCE
Governance Management
Business Glossary
Metadata Management
![Page 33: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/33.jpg)
Data Governance
• Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed as a critical asset and implemented in an effective and sustainable manner.
• Business Glossary Supports a common understanding of terms and definitions about structured and unstructured data supporting business processes for all stakeholders.
• Metadata Management Establish the processes and infrastructure for specifying and extending clear and organized information about the data assets under management.
![Page 34: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/34.jpg)
Transformation NOT Translation
Unambiguous Business Terminology
Conceptual Data Model
Logical Data Model
Data Delivery Model
Business Glossary
![Page 35: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/35.jpg)
Metadata
Not Data about Data, Data in Context
“Content is King, Context is the Crown”
Eric Schmidt, former CEO at Google
![Page 36: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/36.jpg)
The Burnt Stick in Context
Fish Bones
= FUEL = PENCIL
Cave Drawing
![Page 37: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/37.jpg)
The Grid
• Important to understand the relationship of artifacts to one another by proximity.
• Important to understand the precedence of artifacts by depth.
…Carnegie Museum of Natural History in Pittsburgh that researchers said was ''mixed up'' with another dinosaur skull shortly after they were discovered in Utah in 1909.
YALE BRONTOSAURUS GETS HEAD ON RIGHT AT LAST Special to the New York Times - October 26, 1981
IF NOT…
![Page 38: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/38.jpg)
META
From the Latin "meta", which means heap, pile...
Meta di Sorrento
assuming the meaning of high ground.
![Page 39: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/39.jpg)
Data Quality Capabilities
DATA QUALITY
Data Quality Strategy
Data Profiling
Data Quality Assessment
Data Cleansing
![Page 40: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/40.jpg)
Data Quality
• Data Quality Strategy
Defines an integrated, organization-wide strategy to achieve and maintain the level of data quality required to support the business goals and objectives.
• Data Profiling
Develops an understanding of the content, quality, and rules of a specified set of data under
• Data Quality Assessment
Provides a systematic approach to measure and evaluate data quality according to processes, techniques, and against data quality rules.
• Data Cleansing
Defines the mechanisms, rules, processes, and methods used to validate and correct data according to predefined business rule
![Page 41: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/41.jpg)
Data Quality Issues
SYS A SYS B SYS C
BI SYSTEM
![Page 42: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/42.jpg)
Some More Cases to Consider
• 75% of companies report significant problems due to defective data
• 92% of claims Medicare paid to community health centers over one year’s time were “improper or highly questionable”
• Wrong price data in retail databases costs consumers as much as $2.5 billion in overcharges annually
• 96,000 IRS tax refund checks were returned as undeliverable one year
![Page 43: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/43.jpg)
Data Profiling
• Accuracy – criteria related to affinity with original intent, veracity as compared to an authoritative source, and measurement precision
• Completeness –criteria related to the availability of required data attributes
• Coverage – criteria related to the availability of required data records
• Conformity – criteria related to alignment of content with required standards
• Consistency – criteria related to compliance with required patterns and uniformity rules
• Duplication – criteria related to redundancy of records or attributes • Integrity – criteria related to the accuracy of data relationships
(parent and child linkage) • Timeliness – criteria related to the currency of content and
availability to be used when needed
![Page 44: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/44.jpg)
Accurate
Time
DQ
%
![Page 45: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/45.jpg)
Complete
![Page 46: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/46.jpg)
Coverage & Integrity
![Page 47: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/47.jpg)
Conformity & Duplication
![Page 48: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/48.jpg)
Timely
C A T S
ERP % % % %
CRM % % % %
Data Quality Scorecard
![Page 49: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/49.jpg)
Data Quality Assessment
Measure = Observation Standard
"You can't manage, what you can't measure”
Sandhill Enterprise Modelling
Set of Standards
“You can’t measure, what you can’t find!”
![Page 50: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/50.jpg)
Data Management
METADATA INTELLIGENCE
![Page 51: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/51.jpg)
Information Flow
$$
$$
Business Information
IT Information
META
DATA
![Page 52: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/52.jpg)
Many to Many Problem
Many Sources Many Uses
![Page 53: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/53.jpg)
Many to Many Solution
Many Sources Many Uses
Enterprise Data
Warehouse
![Page 54: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/54.jpg)
Business Intelligence
Data Bases
Big Data
ERP
Data Warehouse
![Page 55: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/55.jpg)
Data Asset Inventory
Self Service BI
![Page 56: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/56.jpg)
Value of Metadata
UNDERSTANDIBILITY Warehouse Extract Cleanse
Program
A100
TRACEABILITY Synonyms, Homonyms, Anti-nyms
What does it mean?
Where does it come from ?
BUSINESS GLOSSARY
METADATA REPOSITORY
![Page 57: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/57.jpg)
Metadata Intelligence
Scanner Data Bases
Big Data
ERP
Data Warehouse
Models
Metadata Repository
Business Intelligence for IT
Business Glossary
![Page 58: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/58.jpg)
Business Concept to DataBase
![Page 59: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/59.jpg)
WHY ?
![Page 60: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/60.jpg)
The Issue
Compliance
ALL DATA, Great and Small
Do Executives Trust Data or Intuition in Decision-Making?
By Bob ViolinoJUN 9, 2014 3:44pm ET
“Doveryay, No Proveryay”, “Trust yes, but verify."
![Page 61: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/61.jpg)
TRUST
Firm reliance on the integrity, ability, or character of a person
or thing
Custody; Stewardship
Something committed into the care of another; charge.
![Page 62: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/62.jpg)
Meatadata Traceability
![Page 63: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/63.jpg)
THIS FISH
FROM
FIN
TO
FORK
![Page 64: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/64.jpg)
Data Quality going Forward
OBSERVATIONAL Analytics
ALGORYTMIC Analytics
DQ%
DQ%
![Page 65: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/65.jpg)
The Only Thing That Is Constant Is Change*
* Heraclitus – 500 BCE
Internal Pressure
External Pressure
![Page 66: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/66.jpg)
Model Driven Change Management
Business Domain
Technology Domain
Logical Data Model
Middle Out
Human
Oriented
Computer
Oriented
Reverse
Engineering Physical Data Model
Forward
Engineering
Conceptual Data Model
Business Glossary
DATABASE
Metadata Repository
![Page 67: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/67.jpg)
Not Just DATA
Business Process Model
System Design Model
Application Model
Application Database Change
PROCESS
Conceptual Data Model
Logical Data Model
Data Delivery Model
Business Change
DATA
![Page 68: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/68.jpg)
More than Data Metadata
Scanner
Data Bases
Big Data
ERP
Erwin Models
Applications
Metadata Repository
![Page 69: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/69.jpg)
General Systems Theory
Karl Ludwig von Bertalanffy was an Austrian-born biologist known as one of the founders of general systems theory (GST).
IDEF-0*
*ICAM Definition, Integration DEFinition
Integrated Computer-Aided Manufacturing
![Page 70: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/70.jpg)
Enterprise Feedback
Logical Data Model
Physical Data Model
DATA IN
Logical Data Model
Physical Data Model
DATA OUT MASTER DATA
PIT-POT
Business Glossary
Conceptual Data Model
Logical Data Model
Physical Data Model
![Page 71: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/71.jpg)
PIT vs POT
1. What is was When it Was 2. What it Was as if it Was Now
W I W W I W1
OR
W I W A I I W N2
POT
Point Over Time
PIT
Point In Time
![Page 72: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/72.jpg)
Hoe to get Started…
”... please which way I ought to go from here ?“
said Alice.
"That depends a good deal on where you want to get to,"
said the Cat.
"I don't much care where----"
said Alice.
"Then it doesn't matter which way you go,"
said the Cat.
![Page 73: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/73.jpg)
Data Governance Mall
You are here
Mall Taxonomy
Where am I?
Nice to know how to get there from here!
“WayFinding”
![Page 74: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/74.jpg)
Fit For Use – by the Consumer
Les Terraces – Montreal- 1976-1987
![Page 75: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/75.jpg)
Sandhill Consultants:
76
Sandhill Consultants
Is a group of people, products and processes
that help our clients:
• Build comprehensive Data Architectures
• Resulting from a persistent Data Management Process
• Founded on a robust Data Governance Practice
• With Da’tum Ver’it’as – Trusted, Verifiable Data
![Page 76: Metadata Intelligence - DAMA NY · Data Governance •Governance Management Develop the ownership, stewardship, and operational structure needed to ensure that corporate data is managed](https://reader030.vdocuments.net/reader030/viewer/2022041115/5f25876e6132946dfe756d4e/html5/thumbnails/76.jpg)
Tibetan Proverb
“ If upstream is dirty,
downstream will be muddy”
[shuǐtóu] [bù] [qīngshuǐ] [wěi] [hún]