EMODnet Chemistry 2

Service Contract MARE/2012/10 S12.656742

Progress of the CDI service

ByDick M.A. Schaap – Technical Coordinator

Istanbul – Turkey, 15 June 2015, 2nd Plenary Progress Meeting

CDI service for discovery and unified access of data

Already 105 data centres connected and more underway

CDI Data Discovery and Access Service

Based up ISO19115 content standard and ISO 19139 XML Schema, fully INSPIRE compliantDedicated tools and facilities for generating CDI entries, format associated data sets and populating the CDI serviceShopping basket mechanism for discovery, access request, and downloading of data sets from distributed data centres Downloading in harmonised SeaDataNet formats: SDN ODV ASCII, and soonSDN NetCDF (CF) Adopted in many projects and ongoing improvements Operational governance scheme

Chemistry CDI Data Discovery and Access Service

Dedicated CDI service for EMODNet Chemistry scope Three search interfaces for human users, upgraded as part of the project:

Quick Search with dynamic drilling down of search results;

Extended Search with more flexibility for combining search options, including free search;

Variables Vs Marine Regions with an interactive Matrix of variables in specific marine regions.

Chemistry CDI Data Discovery and Access Service

Chemistry CDI Data Discovery and Access Service

Chemistry CDI Service – filter

EMODNet Chemistry 2 project has a scope of chemical substances:Pesticidides and biocides Antifoulants PharmaceuticalsHeavy metalsHydrocarbonsRadionuclidesFertilisers Organic matter(e.g. from sewers or mariculture)ChlorophyllPartial pressures of dissolved gasesAcidity (from pH, pCO2, Total Inorganic Carbon, alkalinity)Others

Mapping between new EMODNet Chemistry 2 groups and P02 Vocabulary doneSets filter for virtual subset of SeaDataNet CDI to EMODNet Chemistry CDI collection

Chemistry CDI Service – present coverage (14 June 2015)

731109 CDI records and data sets (June 2014: 661095)

European waters (N80 W-30; N20 E45)651507 CDI records and data sets (June 2014: 587538)65 Data Centres (62)32 Countries (31)291 Originators (248)1868 – 2015 years84% unrestricted (82)16% to be negotiated (18)

Discovery and harvesting of data sets for regional product groups

EMODNet Chemistry 2 project is generating chemistry products per MSFD sea region

Discovery and harvesting of data sets per MSFD region for specific chemical parameters is done in an almost full automatic method by:

using a Robot harvester via the shopping mechanism to discover and retrieve specific data sets from distributed data centres to compile and maintain specific aggregate data sets as internal central data buffers that are transferred to regional groups for further processing and products generation.

Buffer CMS + Central User Interfacing

CDI User Interfaces

CDI Robot harvester

Specific data buffers

CDI User Interface + Shopper:

Access regulated via AAA

Agreed Settings

Dynamic Maintenance

Robot CMS to configure Robot harvesting profiles

MARIS master

RSM systemextended with

administering robot transactions and via

central interfaces

API

Central User Interface with logon (AAA service) following authorisation in buffer CMS profiles

logon

Overview of authorized buffersCentral buffer UI incl direct shopping

Request Status Manager (RSM) service extended with administering of Central buffer interfaces

Logon as user/provider/master

New functions for central buffer shopping

Discovery and harvesting of data sets for regional product groups – 1st year

Robot harvester had gathered circa 440.000 CDI records and data sets for nutrients in the given regions

These sets were transferred to the EMODNet regional groups per region

Processing of the 1st harvest by the Regional Coordinators revealed a lot of shortcomings of data sets

This was handled by a feedback loop to data providers for improvement

A second harvesting and delivery of regional data sets for nutrients took place in November 2014

Robot harvester gathered now circa 480.000 CDI records and data sets for nutrients in the given regions

Delivery took place via AWI of regional ODV collections of metadata enriched ODV files

See reports of Regional Coordinators for follow-up

Discovery and harvesting of data sets for regional product groups – repeated in November 2014

New buffer initiated with buffer-6 for contaminants in April 2015

All data centres requested to cooperate in case of ‘restricted’ data sets

Discovery and harvesting of data sets for regional product groups – contaminants

14 June 2015: 24015 CDIs harvested from 27 data centres from 20 countries; ca 10.000 remaining

www.emodnet-chemistry.eu