iso 8000 - data quality solutions -...

___________________________________________________________________________

2012/SOM2/SCSC/CON/023

ISO 8000 - Data Quality Solutions

Submitted by: PiLog

9th Conference on Standards and Conformance in the Field of Innovations

and Related Good Practices Kazan, Russia

22-23 May 2012

6/3/2012

1

Copyright © 2011 PiLog

ISO 8000 - Data Quality Solutions APEC 2012

Dr Salomon De Jager


International Organization for Standardization (ISO) •156 National standard organization members (one per economy) (AFNOR, ANSI, BSI CNIS, DIN, GOST, Standards Australia ……….)

•192 Technical Committees– 3 000 Technical bodies

– 50 000 domain experts

•Central Secretariat in Geneva

– 150 staff

•ISO TC 184 Industrial automation systems and integration

– ISO TC184 SC4 Industrial data (STEP)

•ISO 22745 (open technical dictionaries and their application to master data) •ISO 8000 Data Quality

•ISO 8000-100 Master Data Quality•ISO 8000- 110 Master Data Exchange•ISO 8000 -120 Master Data provenance

6/3/2012

2

ISO TC 184/SC 4 voting membersISO TC 184/SC 4 voting members

• Portugal, IPQ; Instituto Português da Qualidade

• Russia, GOST; Federal Agency on Technical Regulating and Metrology

• South Africa, SABS; South African Bureau of Standards

• Spain, AENOR; Asociación Española de Normalización y Certificación

• Sweden, SIS; Swedish Standards Institute

• Switzerland, SNV; Swiss Association for Standardization

• United Kingdom, BSI; British Standards Institution

• United States, ANSI; American National Standards Institute

• Australia, SAI; Standards Australia International, Ltd

• Austria, ON; Österreichisches Normungsinstitut

• Brazil, ABNT; Associação Brasileira de Normas Técnicas

• Bulgaria, BDS; State Agency for Standardization and Metrology

• China, SAC; Standardization Administration of China

• Czech Republic, CNI; Czech Standards Institute

• France, AFNOR; Association française de normalisation

• Germany, DIN; Deutsches Institut für Normung

• Italy, UNI; Italian National Standards Body

• Japan, JISC; Japanese Industrial Standards Committee

• Korea, KATS; Korean Agency for Technology and Standards

• Netherlands, NEN; Nederlands Normalisatie‐instituut

• Norway, SN; Standards Norway


3.1.1qualitydegree to which a set of inherent characteristics fulfils requirements

NOTE 1 The term “quality” can be used with adjectives such as poor, good or excellent.

NOTE 2 “Inherent”, as opposed to “assigned”, means existing in something, especially as a permanent characteristic.

ISO 9000:2005(E)

ISO 9000 Definition of “Quality”

6/3/2012

3

ISO 8000 Quality Data

Data that meets requirements

Data that is Portable


ISO 8000

General Principles

Part 1Introduction

Part 2Terminology

Master Data

Part 100 introduction

Part 110

SyntaxSemantic encoding

Meets requirements

Part 120 Provenance

Part 130 Accuracy

Part 140 Completeness

Transaction data

ISO 8000 Family of Standards

6/3/2012

4


• Plane

The Need for Semantic Encoding

Plane


The Need for Semantic Encoding

Robot

6/3/2012

5


eOTD (ECCMA Open Technical Dictionary): a registry of terminology from many sources where each concept is assigned a unique and permanent public domain identifier and where concept identifiers may be mapped to each other and ranked according to their use (ISO 22745‐20).

Semantic Encoding


Terminology

Terminology

Terminology

IndustryTerminology

SDOTerminology

SDOTerminology

SDOTerminology

Terminology

• Public domain concept identifiers

• Free identifier resolution to underlying terminology (web services)

• Hyperlink to source standards

• Multilingual

• Multiple terms, definitions and images linked to single concept identifier

ECCMA Open Technical Dictionary (eOTD)

6/3/2012

6

•ISO 22745 developed the framework for unique concept identifiers so that terminology and dictionaries could be managed for multiple uses and languages.

Just as with music notation and engineering symbols, the eOTD concept identifiers are simply used to communicate more accurately in a language independent environment.

eOTD

A unique public domain identifier is assigned to a concept.

0161‐1#01‐089388#1 table

0161‐1#01‐086445#1 chair

0161‐1#02‐018635#1 weight

0161‐1#02‐005808#1 length

0161‐1#07‐277660#1 Monday

0161‐1#05‐001122#1 kilogram

ECCMA Open Technical Dictionary (eOTD)

Music Engineering

6/3/2012

7


Property ID Value Measure ID0161-1#02-046898#1 0161-1#07-014684#10161-1#02-027375#1 32250200370161-1#02-023822#1 1.0 0161-1#05-000798#10161-1#02-010200#1 1.450 0161-1#05-000798#10161-1#02-010196#1 1.653 0161-1#05-000798#10161-1#02-004968#1 0.591 0161-1#05-000798#10161-1#02-027376#1 100161-1#02-027378#1 0.80 0161-1#08-000168#1

Property term Value Measure termeOTD CLASS NAME BOLT:MECHANICAL PRODUCT NUMBER 3225020037NOMINAL THREAD DIAMETER 1.0 INCHES WIDTH ACROSS FLATS 1.450 INCHES WIDTH ACROSS CORNERS 1.653 INCHES HEAD HEIGHT 0.591 INCHES COUNT PER PACK 10PACK PRICE 0.80 US DOLLAR

Machine Bolt; Product Number: 3225020037; Nominal thread diameter: 1.0 inches; Width across flats: 1.450 inches; Width across corners: 1.653 inches; Head height: 0.591 inches; Count per pack: 10; Pack price: $0.80 (M-Bolt;NTD1.0”;WAF1.45”;CPP10)

eOTDIdentifier

Coded

eOTDIdentifiersResolved

Rendered

Semantic Encoding Using ISO 22745


ISO 22745; a standard method for identifying and describing individuals, organizations, locations, assets, goods, services, processes, rules and regulations in a

multilingual environment

ISO 22745

6/3/2012

8


Data requirements support a business function, granting access to a computer, a website or a software program, simply asking for the data needed to deliver the right product or service, these are all data requirements.

Be careful what you ask for – data quality starts with the quality of the request for data

Data Requirement (ISO 22745‐30)

Data requirementeOTD‐i‐xmlISO 22745‐30


Clear and unambiguous requests for:

1. Reference data (part numbers, identifiers)

2. Characteristic data (descriptions)

3. The validation of reference and characteristic data,

ISO 22745‐35 is a standard format for the generation and distribution of requests for data in a simple XML format that can be automated by the sender and recipient to create an integrated data exchange system.

Request for data (ISO 22745‐35)

Request for dataeOTD‐q‐xmlISO 22745‐35

6/3/2012

9


ISO 22745‐40 is a standard format for the exchange of reference and characteristic data in a simple XML format that can be automated by the sender and recipient to create an integrated data exchange system.

Reply to a request for data (ISO 22745‐40)



Data exchange eOTD‐r‐xmlISO 22745‐40


Data requester

Data provider

Sub

A data provider may not have all the data requested so they in turn send a request through their supply chain using the same ISO 22745 standard exchanges






Automating the data supply chain using ISO 22745

6/3/2012

10


rendering guides: a specification of the representation of the characteristic data

eOTD‐d‐xml is a representation of a rendering guide in xml

Note: While data requirements are used to control the collection of data, rendering guides are used to control how descriptions are generated from structured master data.

Rendering Guides ISO 22745‐45*

Raw dataStructured master data

Rendered description

eOTD‐i‐xmlData requirement

eOTD‐d‐xmlRendering guide

* Under development

Example RussianMAT NO SN_EXX_0556494 MAT NO SN_EXX_0556494ORIGINAL ORIGINAL

CLASS NAME CLASS NAMEFLANGE, PIPE ФЛАНЕЦ,ТРУБНЫЙFFT FFTEXTRA STRONG; STANDARD ASME B16.5; SPECIFICATTRIBUTES VALUE UOMSE MAND ATTRIBUTES VALUE UOMSEQMANBORE ***** N/A 6 I ОТВЕРСТИЕ ***** N/A 6 ICOLOR CODE YELLOW/RED N/A 8 I ЦВЕТОВАЯ МАРКИРОВКА ЖЕЛТЫЙ/КРАСНЫЙ N/A 8 IFACING RF N/A 7 I БЫТЬ ОБРАЩЕННЫМ ЛИЦЕВОЙ N/A 7 IMATERIAL CS FORGED NORMN/A 4 M МАТЕРИАЛ КОВАНАЯ УГЛЕРОДИСТАЯ СN/A 4 MMATERIAL SPECIF ASTM A350 GR LF2N/A 5 I МАТЕРИАЛ СПЕЦИФИКАЦИЯASTM A350 СОРТ LF2 N/A 5 IPIPE SIZE ***** N/A 2 M РАЗМЕРЫ ТРУБ ***** N/A 2 MRATING CL300 N/A 3 M РАСЧЕТНЫЕ ЗНАЧЕНИЯ CL300 N/A 3 MTYPE WELD NECK N/A 1 M ТИП ПРИВАРНОЙ N/A 1 MSHORT SHORT

LONG LONG

FLANGE TYPE - WELD NECK RATING - CLASS 300 FACING - RAISED FACE BORE - EXTRA STRONG BORE MATERIAL - FORGED CARBON STEEL ASTM A350 GRADE LF2 NORMALIZED

, ,CL300, MATERIAL: CS FORGED NORMALIZED, MATERIAL SPECIFICATION: ASTM A350 GR LF2, FACING: RF, COLOR CODE: YELLOW/RED; EXTRA STRONG; STANDARD ASME B16.5; SPECIFICATION - SP-50-13

ТИП ФЛАНЦА - ПРИВАРНОЙ - КЛАСС 300, ЛИЦЕВОЙ-СУПЕРПРОЧНЫЙ МАТЕРИАЛ - КОВАНАЯ УГЛЕРОДИСТАЯ СТАЛЬ ASTM A350 СОРТ LF2 НОРМАЛИЗОВАННАЯ ЦВЕТОВАЯ МАРКИРОВКА - ЖЕЛТЫЙ И КРАСНЫЙ СТАНДАРТ - ASME B16.5 СПЕЦИФИКАЦИЯ - SP-50-13

ФЛАНЕЦ ТРУБНЫЙ: ТИП: ПРИВАРНОЙ; РАСЧЕТНЫЕ ЗНАЧЕНИЯ: CL300, МАТЕРИАЛ: КОВАНАЯ УГЛЕРОДИСТАЯ СТАЛЬ, НОРМАЛИЗОВАННАЯ, МАТЕРИАЛ СПЕЦИФИКАЦИЯ: ASTM A350 СОРТ LF2, БЫТЬ ОБРАЩЕННЫМ: ЛИЦЕВОЙ, ЦВЕТОВАЯ МАРКИРОВКА: ЖЕЛТЫЙ/КРАСНЫЙ; СУПЕРПРОЧНЫЙ; СТАНДАРТ ASME B16.5;

FLANGE, PIPE:WELD NECK,CL300,RF;EXTRA ФЛАНЕЦ, ТРУБЫ:ПРИВАРНОЙ,CL300,ЛИЦЕВОЙ;СУПЕРПРОЧНЫЙ

СУПЕРПРОЧНЫЙ, СТАНДАРТ ASME B16.5, СПЕЦИФИКАЦИЯ SP-50-13

6/3/2012

11


Select from eOTD

Registry

Select from ECCMA Russia

Registry

Add to Corporate Preferred Registry

PiLog™ MDOMMaster Data Ontology Manager

Dictionary Manager

6/3/2012

12


Data Requirement Manager

Select from eOTD

Registry

Select from ECCMA Russia

Registry

Add to Corporate Preferred Registry

Displayi-xml

View Data Requirement

and edit


Classification Manager

Build a Spend Analysis Classification System using eOTD, ECCMA Russia Preferred or Corporate Classes

6/3/2012

13

Language Example

ISO 8000‐120Master Data WarehousePortable master data with

provenance

Load Data Capture

provenance data

Map metadata to eOTD

Convert to ISO 22745‐40 data stream

ERP’s

ISO 22745Managed Ontology

Terminology Data requirements Classifications Description rules

Data Integration

Master Data Cleansing1. Identify reference data2. Identify or assign class3. Assign data requirement4. Map properties (attributes)5. Identify & standardize values6. Obtain missing data (enrich)7. Validate data

Create multilingualdescriptions

PiLog ISO 8000-120 Master Data Warehouse

Identify potential duplicates

6/3/2012

14

ФЦК ISO 8000 Warehouse

Dictionary eOTD (ECCMA Russia) managed)

Region 1 Region 2 Region3 ElectronicGOST

Master Data Industrial Products& Services DATA

eOTD Russia & Shared DR

Dictionary eOTD Open

ClDR

ClDR

ClDR

ClDR

Industrial Products & Services Enterprises

ECCMA RUSSIA

ECCMA.ORG(USA)

ECCMA RUSSIA Membership•Bronze (Open)•Silver (Dictionary Views)•Gold (Russian Official Dictionary•Platinum (Shared&Official Gost DR’s)

ECCMA Chapter : Russia and CIS

Data Services

Ministry of ManufacturingMinistry of Manufacturing

Rosstandart Federal AgencyRosstandart Federal Agency

Federal Centre for Cataloguing Federal Centre for Cataloguing


Thank You!Questions?

iso 8000 - data quality solutions -...

Documents