metadata management case study date: 10/21/2008 dan mccreary president dan mccreary & associates...

Metadata ManagementCase Study

Date: 10/21/2008

Dan McCrearyPresidentDan McCreary & [email protected](952) 931-9198

M

D

Metadata Solutions

Copyright 2008 Dan McCreary & Associates

2

M

D

Overview

• The Challenge• Why XRX is an Ideal Solution• Screen Images• Results


3

M

D

Gartner on Metadata

Metadata cast into formal logics will drive interoperability, automation, cost cutting, better search capabilities and new business opportunities.

Semantic Web Drives Data Management, Automation and Knowledge and Discovery

Alexander Linder

March 2005

G00125145


4

M

D

The Challenge

• Allow the business people (not the IT department or developers) to manage all aspects of metadata– Definitions– Approval– ISO/IEC Metadata Registry– Shopping Cart– Wantlist Management– Automatic Form Generation


5

M

D

Semantic Triangle

Concept

Referent

Refers ToSymbolizes

Stands For“cat”

Physical Objects

A pattern of neural activity in our brain

Symbol

Ogden, C. K., & Richards, I. A. (1923) The Meaning of Meaning

“katze” (German)

“gato” (Spanish)


6

M

D

Semantic Web Standards Stack

URI/IRIURI/IRI UnicodeUnicode

XMLXML NamespacesNamespaces

XML QueryXML Query XML SchemaXML Schema

RDF Model & SyntaxRDF Model & Syntax

Ontology (OWL)Ontology (OWL)

Rules/QueryRules/Query

LogicLogic

ProofProof

Trusted Semantic WebTrusted Semantic Web

Sign

atur

eSi

gnat

ure

Encr

yptio

nEn

cryp

tion

Source: Tim Berners-Lee www.w3c.org

http://www.w3.org/Consortium/Offices/Presentations/SemanticWeb/34.html


7

M

D

Example of K-12 Registry


8

M

D

A (meta) Data RegistryGoal: create semantic maps to a federal & state

metadata standard, not many standards

R5

R2

R3

R4R6

R7

RN

Mapping from Minnesota's metadata registry to N other metadata registries: The O(N2) problem

R2

R3

R4

R5

R6

R7

RN

NIEM

Mapping from Minnesota'smetadata registry to counties & federalThe O(N) problem

NIEM


9

M

D

Evolving Metadata Standards

ISO standards dominate most metadata registries

ISO/IEC 11179 MDR

GJXDM

NIEM

ebXML

Public Schemas

xBRL

MinnesotaData

Standards

Federal XMLNaming and

Design Rules

Non-ISO schemas

Federal DataReference Model

(DRM)

Federal XMLDeveloper’s

Guide (xml.gov)

XML

UML

XMI

CWM

MOF

XML

Dept Stds.

Division Stds

XLink

OASIS Standards

Doc ISO commercialschemas

Future Standards (?)

UBL


10

M

D

Minnesota Enterprise Technical Architecture

• Follow established Minnesota metadata standards


11

M

D

Build an Inventory of Data ElementsSample Data Element


12

M

D

Examples of Federal Meta Data Registries

• NIEM – National Information Exchange Model• GJXDM – Global Justice XML Data Model• ebXML – Extensible Business XML• UBL – Universal Business Language• EPA – Environmental Protection Agency• DOD – Department of Defense Metadata Registry• xBRL – XML Business Reporting Language


13

M

D

Examples of Local Metadata Registries

• Minnesota Department of Education Registry

• Minnesota Department of Revenue Property Taxation Registry

• Financial Institution


14

M

D

Property Taxation Example


15

M

D

Example: NIEM.gov

Fill your shopping cart with Data elements

Easily create sub-schemas for different needs


16

M

D

Column

TableColumn

ColumnMetadataRegistry A

Registry helps track data source mapping

OLTPRDBMS

• Registry data elements can map to one or more data sources. Concepts usually map to tables and properties map to columns.

• Mappings can be used to facilitate transfers• Mapping can be stored directly in the registry• Tools are frequently used to create initial mappings• Organizations can create mappings between their internal

systems and a central metadata registry

Column

TableColumn

Column

Data Warehouse

LocalRegistry

or database

Metadata Registry Workflow Funnel

Create the Registry• Define your glossary and data elements

• Review & make changes

• Approve & publish by stakeholders

Use the Registry• Generate data schemas (XML) by selecting and organizing data elements

• Add new items to the registry as needs change

Review& Edit

ApproveGlossaryOf Terms

Draft Data Elements

Requirem

ents & data needs

The registry defines the data we exchange and

keeps our need for code changes to a minimum


18

M

D

Federated Search

• Federation: When many different sources can return search results from a single search

BusinessTerms

ACORDData

Elements

RDMSColumns

OtherStandards

WebSiteTerms

Search


19

M

D

Federated Search Results


20

M

D

Metadata Shopper


21

M

D

Why XRX?

• Metadata is complex

• Many nested structures

• Metadata needs to be quickly customized to meet the needs of different stakeholders

• Data governance is a collaborative process


22

M

D

Before XRX

• Staffing/Skills– XML Schemas

– XSLT to transform data elements into HTML

– DBAs to create RDBMS tables and indexes

– One or more Java Developers

– HTML Forms and Reports

– CSS

– Reporting tools (Crystal Reports etc)

– Limited form functionality (no AJAX)

• Six people, 9 months $250,000 to $500,000


23

M

D

After XRX

• Skills– XForms, REST and XQuery

• Steps– Import data definitions from spreadsheets and XML

sources– Create data element registry– Create shopping cart tools with XForms– Generate XML sub-schemas for importing into

document exchanges– Higher quality user experience (suggest items)

• One Person Three Months: $40,000


24

M

D

Thank You!

Please contact me for more information:• Metadata Management• Metadata Registries• Service Oriented Architectures• Business Intelligence and Data Warehouse• Semantic Web• Native XML Databases

Dan McCreary, PresidentDan McCreary & Associates

Metadata Strategy [email protected]

(952) 931-9198

metadata management case study date: 10/21/2008 dan mccreary president dan mccreary & associates...

Documents

data elementseasily

data elementsreview

data sources

metadata registriesisoiec

minnesotas metadata

data elementsadd new

minnesotasmetadata registry

business people