ics data & products preservation epos-ip wp10: services and data · 2017-03-28 · epos-ip...

1
EPOS-IP WP10: services and data provision for the GNSS community GNSS Data Gateway (CNRS) GNSS data node GNSS data node EUREF Permanent Network GNSS data GNSS Products GNSS Product Gateway (UBI/C4G) GNSS Product node GNSS Product node ICS Data & Products Preservation GNSS data node GNSS Product node ABSTRACT The EPOS-IP WP10 – “GNSS Data & Products” is the Working Package of the EPOS-IP project in charge of implementing the necessary services in order that the geo-sciences community can access the existing Pan-European Geodetic Infrastructures. The WP10 is formed by representatives of the participating institutions (10) but it is also open to the entire geodetic community. In fact, WP10 also includes members from other institutions/countries that formally are not participating in the EPOS-IP. During the EPOS-IP project, the geodetic component of EPOS (WP10) is dealing essentially with Research Infrastructures focused on continuous operating GNSS (cGNSS). The option of concentrating the efforts on the presently most generalized geodetic tool supporting research on Solid Earth was decided in order to optimize the existing resources. Furthermore, although the focus is on Solid Earth applications, other research and technical applications (e.g., reference frames, meteorology, space weather) can also benefit from the efforts of WP10 towards the optimization of the geodetic resources in Europe. We present and discuss the plans for the implementation of the thematic and core services (TCS) for GNSS data within EPOS and the related business plan. We will focus on strategies towards the implementation of the best solutions that will permit to the end-users, and in particular geo-scientists, to access the geodetic data, derived solutions, and associated metadata using transparent and uniform processes. The collaboration with EUREF is also an essential component of the implementation plan. TASKS 10.1 Strategic activities and governance 10.2 Coordination and Interaction with the GNSS Community 10.3 Interoperability with EPOS ICS and testing 10.4 GNSS Data Dissemination 10.5 GNSS Data Gateway 10.6 GNSS Products 10.7 GNSS Products Gateway TASK 1 EPOS-GNSS LONG-TERM MISSION EPOS-GNSS supports Solid Earth Sciences in Europe through the European Plate Observing System (EPOS). Its goals are - to facilitate access, through the European Plate Observing System (EPOS), to relevant GNSS data, meta-data, and data products - to coordinate the archiving of relevant GNSS data, metadata and data products - to promote best practice for GNSS station operation, data quality control and data management - to maintain and distribute open source software for GNSS data and metadata discoverability - to maintain and develop GNSS data products These efforts are done in close partnership with EUREF, the IAG (International Association of Geodesy) sub-commission for the European Reference Frame. SCHEDULE FOR SETTING UP GOVERNANCE M6 (March 2016): List of DDSS (data, data products, service and software) that will be delivered + which agency will provide them M6-M12: Prepare draft Consortium Agreement (CA) and circulate it amongst the legal departments of the different partners M12 (Sept 2016): Consortium agreement ready M12-18: Circulate consortium agreement for signature M18 (March 2017): Consortium agreement signed by all partners M18-M24: Populate boards (governance, executive, advisory) and have first meeting of Governance Board M24 (Sept 2017): Governance in place (people names and board meetings held) M36: ERIC functioning M36-M??: set up of service agreements between ERIC and TCS TASK 3 METADATA catalogue WP10 API The Glass Geodetic Package Product Repository Data Repository Metadata: CERIF Definition of community, standard-based metadata APIs Definition of APIs for data discovery and for data access/retrieval Groups Near Fault Observatories Vucanology Anthropogenic Data Repository MultiDisciplinary Geo Hazards Geo Resources Modelling Numerical Analogical AAA Standard Procedures for Authentication, Authorization, Auditing API / Web Service. AAA EPOS ICS EUREF TASK 4 TASK 5 Task 4 deals with the development of a new concept of GNSS data management integrating as many as existing research infrastructures in Europe. Namely, we aim at supporting both data users and providers with an interactive station metadata inventory, an easy interactive and non- interactive site selection and corresponding file downloads, a feedback on data quality and availability. The work in the Task 4 consists in: Definition of metadata standards and data quality metrics including the design of relevant database structure and stored procedures with interfaces to data providers and users. Development of GLASS – an integrated package to be installed at all levels of a single/multi-level GNSS infrastructure. This package is constituted by several components that are being developed: A common database scheme (including data & products); Web Services (GSAC-like) for queries and data mining on the data and metadata; QC tools; Submission and Validation of metadata; Tools to guarantee synchronization and consistency of the databases; Tools to guarantee redundancy and uniqueness of data and metadata. Implementation of the dissemination prototype including the data gateway, metadata submission centre, data monitoring centre and a hierarchical structure over selected repositories. Testing and assessment of the dissemination prototype and its functionality for specified use cases. This task will coordinate activities in order to guarantee the interoperability between the GNSS services (and more specifically the data and products gateways) and the ICS. It will also work with other TCS to promote multi-disciplinary interoperability, with special focus on Seismology, Volcanology, Near Fault Observatories and Anthropogenic Seismicity. The EPOS GNSS data preservation policy and identification of technical solutions to data preservation will be carried out in this task. Finally, the task is responsible for coordinating validation and testing phases. TASK 2 TCS GNSS Partners Commercial & Research networks National & Scientific analysis centers Services Coordination Board (EPOS) Representatives from Core Services (TCS - ICS coordination) Solid Earth Community Coordination Interaction with potential data and product providers Outreach & Interaction Establishing communication channels for the interaction with the whole GNSS community and contribute in supporting EPOS communication strategy. This task is also coordinating the activities for measuring the impact of the provided services and data provision. It will also be in charge of communication among partners, interact with external organizations, coordinate the organization of presentations to the external community and identify and manage the formal interaction with additional data & product providers. The European EPOS GNSS data gateway is the gateway for accessing data and metadata of the 2000 stations from different local data centers. The GNSS data gateway is located at Geoazur/OCA, France, and maintained by CNRS. This uppermost node of the EPOS GNSS data flow architecture is running the GLASS software package developed in Task 4 without related data repository, unlike the lower nodes that are most often associated to data repositories. The GNSS data gateway also hosts the centralized T1 metadata data base. The current request estimate on this central data gateway envisions about 500 queries per day. Related to the central T1 metadata base is the T1 submission center that will be used by all data providers in Europe as a unique point to enter and update the T1 metadata. This submission center will be managed and located at ROB, Belgium. The scheme on the left shows an example of the network architecture of GLASS nodes relating EPN (Pan- European Network for EUREF), RGP and RENAG (two French networks), RENEP and SERVIR (two Portuguese networks) as examples for national intermediate nodes, the DGW and the ICS. Rectangles are the GLASS nodes, diamonds are the data bases, cylinders are the data repositories. TASK 6 TASK 7 This task is responsible for: i) development of Guidelines for processing, implementing massive processing at 2 EPOS processing centers (CNRS & INGV) to obtain European-scale solution, and harmonized distributed processing at National Analysis Centers; ii) combination of daily/weekly solutions to obtain homogeneous station time-series and velocities (FOMI) and combination of solutions at the velocity level (large-scale European solutions, EPN densification product, and solutions from National processing centers); iii) derivation of strain rate maps; iv)testing and validation of the combination products and testing of alternative combination strategies. 70˚ 60˚ 50˚ 40˚ 30˚ 20˚ 10˚ 0˚ 10˚ 20˚ 30˚ 40˚ 30˚ 40˚ 50˚ 60˚ 70˚ 80˚ 70˚ 60˚ 50˚ 40˚ 30˚ 20˚ 10˚ 0˚ 10˚ 20˚ 30˚ 40˚ 30˚ 40˚ 50˚ 60˚ 70˚ 80˚ Selected network that will be initially processed to validate procedures. The European EPOS GNSS product gateway is the gateway for the official EPOS Products (Coordinate Time-Series, Velocities and Strain Rates). The GNSS Product gateway is located at SEGAL (UBI/IDL), Portugal, and maintained by C4G. [email protected] 90 75 60 45 30 15 0 15 30 45 2006 2008 2010 2012 2014 2016 trend = 0.45 _ + 0.12 mm/yr year vertical (mm) 0 30 60 90 120 150 180 210 240 270 300 2006 2008 2010 2012 2014 2016 trend = 21.69 _ + 0.07 mm/yr year longitude (mm) 60 30 0 30 60 90 120 150 180 210 2006 2008 2010 2012 2014 2016 trend = 16.98 _ + 0.10 mm/yr year latitude (mm) Example of the analysis of a coordinate time-series to estimate the secular motion together with seasonal signals plus co-seismic displacements Site: l'Aquila Earthquake: 6 April 2009 Task 4: GNSS data dissemination GLASS node (gateway) GLASS nodes (networks) GSAC nodes (networks) GLASS nodes (networks) GNSS repositories Metadata interface GNSS repositories Metadata interface GNSS repositories GNSS data gateway (DGW) And central database of metadata Type 1 Physical repositories (existing) Local generation of metadata Type 2 and 3 Integration level (virtual) Physical level (file repositories) Metadata & interface (virtualization) Standard tools (for handling data and meta-data) Metadata interface Monitoring centre Data quality and availability, metadata consistency PARTNERS: UBI/C4G (PT), ROB (BE), CNRS (FR), INGV (IT), NOA (GR), GOP (CZ), IMO (IS), FOMI (HU), KOERI (TK), INCDP-RA (RO)

Upload: others

Post on 25-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ICS Data & Products Preservation EPOS-IP WP10: services and data · 2017-03-28 · EPOS-IP WP10: services and data provision for the GNSS community GNSS Data Gateway (CNRS) GNSS data

EPOS-IPWP10:servicesanddataprovisionfortheGNSScommunity

GNSSDataGateway(CNRS)

GNSSdatanode

GNSSdatanode

EUREFPermanentNetwork

GNSSdata

GNSSProducts

GNSSProductGateway(UBI/C4G)

GNSSProductnode

GNSSProductnode

ICS Data&ProductsPreservation

GNSSdatanode

GNSSProductnode

ABSTRACTThe EPOS-IP WP10 – “GNSS Data & Products” is the Working Package of the EPOS-IP project in charge of implementing the necessary services in order that the geo-sciences community can access the existing Pan-European Geodetic Infrastructures. The WP10is formed by representatives of the participating institutions (10) but it is also open to the entire geodetic community. In fact, WP10 also includes members from other institutions/countries that formally are not participating in the EPOS-IP.During the EPOS-IP project, the geodetic component of EPOS (WP10) is dealing essentially with Research Infrastructures focused on continuous operating GNSS (cGNSS). The option of concentrating the efforts on the presently most generalized geodetic toolsupporting research on Solid Earth was decided in order to optimize the existing resources. Furthermore, although the focus is on Solid Earth applications, other research and technical applications (e.g., reference frames, meteorology, space weather) can alsobenefit from the efforts of WP10 towards the optimization of the geodetic resources in Europe.We present and discuss the plans for the implementation of the thematic and core services (TCS) for GNSS data within EPOS and the related business plan. We will focus on strategies towards the implementation of the best solutions that will permit to theend-users, and in particular geo-scientists, to access the geodetic data, derived solutions, and associated metadata using transparent and uniform processes. The collaboration with EUREF is also an essential component of the implementation plan.

TASKS10.1Strategicactivitiesandgovernance10.2CoordinationandInteractionwiththeGNSSCommunity10.3InteroperabilitywithEPOSICSandtesting10.4GNSSDataDissemination10.5GNSSDataGateway10.6GNSSProducts10.7GNSSProductsGateway

TASK 1EPOS-GNSS LONG-TERMMISSIONEPOS-GNSS supports Solid Earth Sciences in Europe throughthe European Plate Observing System (EPOS). Its goals are

- to facilitate access, through the European Plate ObservingSystem (EPOS), to relevant GNSS data, meta-data, and dataproducts

- to coordinate the archiving of relevant GNSS data, metadataand data products

- to promote best practice for GNSS station operation, dataquality control and data management

- to maintain and distribute open source software for GNSSdata and metadata discoverability

- to maintain and develop GNSS data products

These efforts are done in close partnership with EUREF, the IAG(International Association of Geodesy) sub-commission for theEuropean Reference Frame.

SCHEDULE FOR SETTING UP GOVERNANCEM6 (March 2016): List of DDSS (data, data products, serviceand software) that will be delivered + which agency willprovide themM6-M12: Prepare draft Consortium Agreement (CA) andcirculate it amongst the legal departments of the differentpartnersM12 (Sept 2016): Consortium agreement readyM12-18: Circulate consortium agreement for signatureM18 (March 2017): Consortium agreement signed by allpartnersM18-M24: Populate boards (governance, executive, advisory)and have first meeting of Governance BoardM24 (Sept 2017): Governance in place (people names andboard meetings held)M36: ERIC functioningM36-M??: set up of service agreements between ERIC and TCS

TASK 3

METADATAcatalogue

WP10APITheGlassGeodetic

Package

ProductRepository

DataRepository

Metadata:CERIFDefinitionofcommunity,standard-based metadata

APIsDefinitionofAPIsfordatadiscoveryandfordataaccess/retrieval

Groups• NearFaultObservatories• Vucanology• Anthropogenic

DataRepository

MultiDisciplinary• GeoHazards• GeoResources

Modelling• Numerical• Analogical

AAAStandardProceduresforAuthentication,Authorization,Auditing

API/WebService.AAA

EPOSICS

EUREF

TASK 4 TASK 5Task 4 deals with the development of a new concept of GNSS datamanagement integrating as many as existing research infrastructures inEurope. Namely, we aim at supporting both data users and providers withan interactive station metadata inventory, an easy interactive and non-interactive site selection and corresponding file downloads, a feedback ondata quality and availability. The work in the Task 4 consists in:• Definition of metadata standards and data quality metrics including the

design of relevant database structure and stored procedures withinterfaces to data providers and users.

• Development of GLASS – an integrated package to be installed at alllevels of a single/multi-level GNSS infrastructure. This package isconstituted by several components that are being developed:• A common database scheme (including data & products);• Web Services (GSAC-like) for queries and data mining on the data andmetadata;

• QC tools;• Submission and Validation of metadata;• Tools to guarantee synchronization and consistency of the databases;• Tools to guarantee redundancy and uniqueness of data andmetadata.

• Implementation of the dissemination prototype including the datagateway, metadata submission centre, data monitoring centre and ahierarchical structure over selected repositories.

• Testing and assessment of the dissemination prototype and itsfunctionality for specified use cases.

This task will coordinate activitiesin order to guarantee theinteroperability between the GNSSservices (and more specifically thedata and products gateways) andthe ICS. It will also work with otherTCS to promote multi-disciplinaryinteroperability, with special focuson Seismology, Volcanology, NearFault Observatories andAnthropogenic Seismicity. TheEPOS GNSS data preservationpolicy and identification oftechnical solutions to datapreservation will be carried out inthis task. Finally, the task isresponsible for coordinatingvalidation and testing phases.

TASK 2

TCSGNSS

PartnersCommercial&

Researchnetworks

National&Scientificanalysiscenters

ServicesCoordinationBoard(EPOS)RepresentativesfromCoreServices

(TCS- ICScoordination)

SolidEarthCommunity

CoordinationInteraction with potential data and product providers

Outreach & Interaction

Establishing communicationchannels for the interaction withthe whole GNSS community andcontribute in supporting EPOScommunication strategy. Thistask is also coordinating theactivities for measuring theimpact of the provided servicesand data provision. It will also bein charge of communicationamong partners, interact withexternal organizations,coordinate the organization ofpresentations to the externalcommunity and identify andmanage the formal interactionwith additional data & productproviders.

The European EPOS GNSS data gateway is the gatewayfor accessing data and metadata of the 2000 stationsfrom different local data centers.The GNSS data gateway is located at Geoazur/OCA,France, and maintained by CNRS.This uppermost node of the EPOS GNSS data flowarchitecture is running the GLASS software packagedeveloped in Task 4 without related data repository,unlike the lower nodes that are most often associatedto data repositories. The GNSS data gateway also hoststhe centralized T1 metadata data base. The currentrequest estimate on this central data gateway envisionsabout 500 queries per day.Related to the central T1 metadata base is the T1submission center that will be used by all data providersin Europe as a unique point to enter and update the T1metadata. This submission center will be managed andlocated at ROB, Belgium.

The scheme on the left shows an example of thenetwork architecture of GLASS nodes relating EPN (Pan-European Network for EUREF), RGP and RENAG (twoFrench networks), RENEP and SERVIR (two Portuguesenetworks) as examples for national intermediate nodes,the DGW and the ICS. Rectangles are the GLASS nodes,diamonds are the data bases, cylinders are the datarepositories.

TASK 6 TASK 7This task is responsible for:i) development of Guidelines for processing, implementing

massive processing at 2 EPOS processing centers (CNRS &INGV) to obtain European-scale solution, and harmonizeddistributed processing at National Analysis Centers;

ii) combination of daily/weekly solutions to obtainhomogeneous station time-series and velocities (FOMI) andcombination of solutions at the velocity level (large-scaleEuropean solutions, EPN densification product, and solutionsfrom National processing centers);

iii) derivation of strain rate maps;iv) testing and validation of the combination products and

testing of alternative combination strategies.

−70˚ −60˚ −50˚ −40˚ −30˚ −20˚ −10˚ 0˚ 10˚ 20˚ 30˚ 40˚

30˚

40˚

50˚

60˚

70˚

80˚

−70˚ −60˚ −50˚ −40˚ −30˚ −20˚ −10˚ 0˚ 10˚ 20˚ 30˚ 40˚

30˚

40˚

50˚

60˚

70˚

80˚

Selected network that will be initially processed to validate procedures.

The European EPOS GNSS product gateway is the gateway forthe official EPOS Products (Coordinate Time-Series, Velocitiesand Strain Rates).The GNSS Product gateway is located at SEGAL (UBI/IDL),Portugal, and maintained by C4G.

[email protected]

−90−75−60−45−30−15

0153045

2006 2008 2010 2012 2014 2016

trend = −0.45 _+ 0.12 mm/yr

year

vert

ical

(mm

)

0306090

120150180210240270300

2006 2008 2010 2012 2014 2016

trend = 21.69 _+ 0.07 mm/yr

year

long

itude

(mm

)

−60−30

0306090

120150180210

2006 2008 2010 2012 2014 2016

trend = 16.98 _+ 0.10 mm/yr

year

site AQUI

latit

ude

(mm

)

Example of the analysis of acoordinate time-series to estimatethe secular motion together withseasonal signals plus co-seismicdisplacements

Site: l'AquilaEarthquake: 6 April 2009

Task 4: GNSS data dissemination

GLASS node (gateway)

GLASS nodes (networks)

GSAC nodes (networks)

GLASS nodes (networks)

GNSS repositories

Metadata interface

GNSS repositories

Metadata interface

GNSS repositories

GNSS data gateway (DGW) And central database of metadata Type 1

Physical repositories (existing) Local generation of metadata Type 2 and 3

Integration level (virtual)

Physical level (file repositories)

Metadata & interface (virtualization)

Standard tools (for handling data and meta-data)

Metadata interface

Monitoring centre Data quality and availability, metadata consistency

PARTNERS:UBI/C4G(PT),ROB(BE),CNRS(FR),INGV(IT),NOA(GR),GOP(CZ),IMO(IS),FOMI(HU),KOERI(TK),INCDP-RA(RO)