data validation concepts and techniques -...

Richard MITANCHEY, CEREMA – COVADIS secretary

Date : 03 juin 2016

Data validation concepts and techniques

KEN Validation Workshop

203 juin 2016 KEN Validation Workshop

Outline

● COVADIS (objectives, productions)● INSPIRE / COVADIS● Geo-IDE Catalogue component and tools

Templates repository server Dataset validator

● Conclusion

303 juin 2016 KEN Validation Workshop

COVADIS Validation Committee

INSPIRE

GIS convergencebetweenAgricultureand EnvironmentCOVADIS

(since 2008)

GISheterogeneous data and uses

alignment

experience of CNV records

(small one class only GIS national

standards)

produce geographical standards adapted to the

needs of the two ministers

403 juin 2016 KEN Validation Workshop

Anatomy of COVADIS geostandards

A) Perimeter

B) Concepts

C) Implementation

WHY

is it relevant to my needs ?

WHAT

data definition ?

HOW TO

exchange or store my data ?

3 parts

603 juin 2016 KEN Validation Workshop

COVADIS geostandard qualities

Réunion régionale Information Géographique Ile-de-France 6

Kernel

Consensus

Pragmatisman operational (ready to use) data structure

ExtensibilityGeostandard = kernel that can be enriched

CompatibilityData models to prepare INSPIRE compliance

SDI aSDI b

703 juin 2016 KEN Validation Workshop

INSPIRE versus COVADISRisk management case

● Existing hazard areas‒ Observations / Models

● 3 spatial features‒ Hazard area

‒ Risk area

‒ Vullnerability

● Vulnerability evaluation

COVADIS PPR (2012)● PPR document +

regulations‒ Hazard area

‒ Regulation zone

‒ Vulnerable to the risk issue

● 2 usages / themes

III.8Land Use

III.12 Natural Risk zones

803 juin 2016 KEN Validation Workshop

INSPIRE class mapping :Water and Sewer networks (2016)

(Frontoffice)

1103 juin 2016 KEN Validation Workshop

(Backoffice)

1203 juin 2016 KEN Validation Workshop

Validation ToolUse and test cases

1303 juin 2016 KEN Validation Workshop

Dataset Validator : input parameters

1. Test name (useful for history)2. Select standard

3. Add or remove directories of datasets4. Launch the validation process

1403 juin 2016 KEN Validation Workshop

Dataset Validator : passed or not ?

Test (by name) with last date and result

Show detailed resultsOr load/delete older tests

Timestamp Elementary check

(rudimentary diagnostic : FATAL - enumerated value not allowed

1703 juin 2016 KEN Validation Workshop

Lets look at the xml rules...

1803 juin 2016 KEN Validation Workshop

The same, more human readable !

1903 juin 2016 KEN Validation Workshop

Complete (manual) error resolution

2003 juin 2016 KEN Validation Workshop

Validator characteristics

✔ Central and local deployment✗ Need to contact the template repository server✔ Global an detailed but rudimentary reporting

(test run progress and results, timestamps)✔ Including history✗ No API, No workflow, No links to resolve errors✔ Java implementation, with GUI✗ Governance unclear

2103 juin 2016 KEN Validation Workshop

Conclusion

● COVADIS geostandards should by design be compatible with INSPIRE...

now starting to include explicit INSPIRE mapping !→● Focused on implementation,

if necessary(?) compliant INSPIRE GML might be →produced by reverse mapping...

● Geo-IDE Catalogue comes with interesting railing tools (templates, standard metadata guidance, datasets validator with standalone version...)

Richard MITANCHEY, CEREMA richard.mitanchey@cerema.frCOVADIS secretary

Thank you

Centre d'études et d'expertise sur les risques, l'environnement, la mobilité et l'aménagement - www.cerema.frDirection technique Territoires et ville - 2 rue Antoine Charial - 69426 LYON Cedex 03 - Tél. : +33 (0)4 72 74 58 00Siège social : Cité des mobilités - 25 avenue François Mitterrand - 69674 BRON Cedex - Tél. : +33 (0)4 72 14 30 30

http://www.geoinformations.developpement-durable.gouv.fr/la-covadis-r425.html