Ευρωπαϊκός κατάλογος υπηρεσιών για ηλεκτρονικές υποδομές
Γιώργος Παπαστεφανάτος, Ε.Κ. ΑΘΗΝΑ & Παν. Αθηνών[email protected]
24 Οκτωβρίου 2019Ημερίδα “Ανοικτή Επιστήμη: Από τη Θεωρία στην Πράξη”Βιβλιοθήκη «Στέλιος Ιωάννου» - Λευκωσία
2
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
What is eInfraCentral?
1
Coordination and Support Action (CSA) in Horizon 2020 Programmme
9 organisations, including 5 major e‐infrastructures (EGI, EUDAT, PRACE, GEANT, OPENAIRE)
Operations from January 2017 to June 2019
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
3
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
…the visionEuropean Open Science Cloud (EOSC)
4
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
4
Src: https://ec.europa.eu/commission/news/european-open-science-cloud-becomes-reality-2018-nov-23_en
5
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
6
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
7
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
8
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
An analogyRoom = e-Service
Trivago
BookingHotels
Expedia
Marriott Hilton Accor Intercontinental
Crown Plaza Holiday InnSofotel NovotelWaldford ConradSheraton Westin
Customerlooking for
a Room
Room to let
9
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
The Big Picture: An Open Market for Research/Scientific Resources
Researcherlooking fora Research/
ScientificService\Resource
To make this happen we need:
1. Standardised descriptions of research resources
2. Standardised APIs for the exchange of service/ resources-related information
10
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Open Science ServicesWhen we started…
Diverse vocabulary about Service Management (SM) in the community
Various standards and frameworks available for SM
Different levels of adoption of SM practices among the Service Providers (SPs)
Different processes to manage service portfolios employed at different locations
Not the same maturity in description of service offerings, listings or catalogues by SPs
Numerous ways of representing services to the users on the web
No adopted APIs for exchanging service‐related information among SPs
11
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Main contributions
The First Catalogue for the European Open Science Cloud
The Service Description Template (SDT) and Classifications
Portal for the Catalogue
Registration services for onboarding in EOSC and analytics and visualizations
APIs for enabling EOSC interoperability
A SW platform for providers to build their own EOSC‐Compliant catalogue
12
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
The first Catalogue for the European Open Science Cloud eInfraCentral Catalogue
13
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
First Common Catalogue of ServicesEGI, EUDAT, OpenAIRE, GEANT, PRACE
14
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
http://www.einfracentral.eu/
Catalogue of European Open Science Cloud
15
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Eosc Launch 23 Nov 2018
http://catalogue.eosc-portal.eu/
AAI authentication
16
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
GEANTPRACE OpenAIRE
Advance EOSC Hub
…
PhenoMeNal
READ
…
NGI1
NGI2…
DR1
DR2
HPC1
HPC2
…
SWITCH
NREN2
…
VI-SEEM
BlueBridge
AGRINFRA+
West-Life
NTNU
OpenMinTeD
ComBioMed
OpenDreamKit
NOAD1
INDIGODataCloud
EUDATEGINOAD2
Figshare
E-CAM
EoCoE
OpenRiskNet
HIRMEOS
XDC
UBORA
AARC2AENEAS
DARE
DEEP
ESiWACE
EUXDATFREYA
PROCESS
eInfraCentral
EOSC Catalogue
TSystems
Exoscale
SixSq
INFRAFRONTIER
SoBigData
SeaDataCloud
ScienceMedia
Catalogue todayRegistration status
17
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
A single Catalogue of EOSC services and assets
SearchFilter
Browse
18
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
A single Catalogue of EOSC services and resources
Compare
Access
19
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Offered Functionality
20
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Uniform representation for EOSC services Service Description Template
21
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Search for eInfraCentral+github or
https://github.com/eInfraCentral
Service Description TemplateWay to homogeneously describe the offerings
V2.00 open for consultation
22
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Description TemplateEnables Service Representation & Classification
• Building blocks– Basic Service Information (service id, name, provider,
description, url, etc)– Service Classification Information (category \ subcategory, TRL,
lifecycle status, etc.)– Service Support Information (Order url, training material,
helpdesk, etc)– Service Contractual Information (Price, SLA, TermsOfUse,etc)– Service Performance Information (Availability, Usage, etc.)
23
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Categorisation/Classification of ServicesNo. Scientific Domain No. Scientific Subdomain
1 Mathematics2 Computer sciences3 Information sciences4 Earth sciences5 Biological sciences6 Physical sciences7 Chemical sciences1 Civil engineering 2 Electrical, electronic and information engineering 3 Mechanical engineering4 Aerospace engineering5 Chemical engineering6 Materials engineering7 Bioengineering and Biomedical engineering 8 Environmental engineering9 Environmental biotechnology10 Industrial biotechnology11 Micro and Nanotechnology 1 Basic medicine2 Clinical medicine3 Health sciences4 Medical biotechnology1 Agriculture, forestry, and fisheries2 Animal and dairy sciences3 Veterinary sciences4 Agricultural biotechnology1 Psychology2 Economics, finance and business3 Educational sciences4 Sociology5 Law6 Political sciences7 Social and economic geography8 Media and communications1 History and Archaeology2 Languages and literature3 Philosophy, ethics and religion4 Arts
7 Interdisciplinary 1 Interdisciplinary8 Other 1 Other
Engineering & Technology
Humanities6
5
4Agricultural Sciences
Social Sciences
2
3
1 Natural Sciences
Medical & Health Sciences
No. Category Description No. Subcategory
1 Spectrometer2 Radiation3 Microscopy4 Laser5 Geophysical6 Chromatographer7 Cytometer8 Spectrophotometer10 Digitisation equipment11 Monument maintenance equipment12 TBC13 Other1 Warehousing2 Fulfilment3 Assembly4 Sorting5 Re‐working6 Packaging7 Quality inspecting8 Archiving9 Disposal10 Repository11 Preservation12 Other1 Direct Connect2 Virtual Network3 Load Balancer4 VPN Gateway5 Exchange6 Content Delivery Network7 Traffic Manager8 Other1 Virtual Machine Management2 Container Management3 Job Execution4 Workload Management5 Orchestration6 Serverless Applications Repository7 Other1 Data2 File3 Queue4 Disk5 Online6 Archive7 Backup8 Synchronised9 Replicated10 Recovery11 Digital preservation12 TBC13 Other
1Instrument & Equipment
Access to instruments and equipment
Compute
Access to biological, chemical, historical,
archeological, cultural, etc. storage. Includes the acquisition, preparation
and processing of samples and materials in
view of their preservation.
Material Storage2
5
High‐performance computing resources and scalable cloud
compute capacity for demanding job
processes
Reliable, secure and scalable cloud storage for scientific data, apps
and workloads
3
4
Network
Ultra‐fast connectivity and access to
eInfrastructures' resources and services
Data Storage
No. Access Mode Description
1 Excellence Driven
Users are selected based on scientific excellence evaluation, originality, quality and technical and ethical feasibility of an application evaluated through peer review conducted by internal or external experts of the activity to be supported by the service
2 Market driven Users need to pay a fee to access the service
3 Policy based
Users are granted access based on defined policies; such policies usually apply to resources being offered with “sponsored use” to meet some national or EU level objective; for instance, a country may offer resources with “sponsored use” to support national researchers involved in international collaborations.
4 Wide access Users can freely access the service provided, registration may be needed.
No. Access Type Description
1 Remote
Services and Resources are delivered remotely with the use of a physical infrastructure. The user is able to remotely work with the physical RI without the need of physical presence.
2 Physical
Services and resources require a physical presence of the user. The user can only access the RI if he is physically present in the specific location that the RI is offered.
3 VirtualThe service/resource is delivered through a virtual infrastructure that the use may access virtually through the web or an intranet.
4 Mail‐in
Samples are sent in to for e.g. analysis and the results are returned to the user without the user actually accessing the RI
5 Other
24
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Onboard to EOSC in a few stepsRegistration Services
25
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Provider Registration ProcessLogin in EOSC Portal
Academic, Social Logins
26
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Provider Registration ProcessProvide information about the organization
ValidationRegistration
27
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Provider Registration ProcessProvide information about your first Service
Validate ServiceDescribe service
Mail notifications upon approval\rejection
28
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service provider’s & Funder DashboardEOSC analytics
29
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Provider DashboardVisualizes statistics per Provider’s offerings
Usage statistics collected
Facets by organization or by service
History of service updates in EIC
30
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Funder DashboardVisualizes statistics per Funder
Organizes services by funding bodies
For each funder presents insights, such as what are the most funded
thematic categories, etc.
31
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Rest APIs for service information exchangeEnabling EOSC interoperability
32
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
http://www.einfracentral.eu/openapi
33
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
33
http://www.einfracentral.eu/openapiSwagger\OpenAPI compatible
34
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
eInfraCentral Platform
https://github.com/eInfraCentral
catalogue.eosc-portal.eu
www.einfracentral.euPortal.catris.eu
eInfraCentral SW used for Building Aggregated catalogues
35
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
eInfraCentral Platform
https://github.com/eInfraCentral
eInfraCentral SW used for Building Thematic EOSC –compliant catalogues
http://catalogue.openaire.eu
http://catalogue.geant.org (in progress)
36
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
The road ahead…
37
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Road AheadFuture Projects
Cat
alog
ue o
fRes
earc
h In
frast
ruct
ure
Serv
ices
–w
ww
.cat
ris.e
u
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n°824173.
Vision
CatRIS aims to develop an open, trusted and user‐friendly Portalto a harmonised and aggregated Catalogue
of Research Infrastructure Services and Resources offered at European and National levels,
supporting and interoperable with the European Open Science Cloud Catalogue, focusing on Physical Research Infrastructures, Core Facilities and Shared Scientific Resources.
Cat
alog
ue o
fRes
earc
h In
frast
ruct
ure
Serv
ices
–w
ww
.cat
ris.e
u
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n°824173.
About
• Horizon 2020 Project (GA No. 824173)• Title “Catalogue of Research Infrastructure Services”• Call/Topic “Policy and international cooperation measures for research infrastructures”
• Type “Coordination and Support Action”• Starting Date 1 January 2019 • Duration 30 months• Overall budget/resources: 1.5 M€ (171.5 PM)
40
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement
n°824173.
www.project.catris.eu
@project_catris
https://www.linkedin.com/company/catris
NEANIAS-Novel EOSC Services for EmergingAtmosphere, Underwater & Space ChallengesCall: INFRAEOSC-02-2019Project ID: 863448Duration: 36 monthsFrom: 1/11/2019
NEANIAS: Services –Infrastructures –Communities & Business
› Call: INFRAEOSC-06-2019-2020 (Implementing the European Open Science Cloud)
› Duration: 24 months
› From: 1/12/2019
44
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Portalshttps://www.eInfraCentral.euhttps://catalogue.eosc‐portal.eu
For Developers & APIwww.eInfraCentral.eu/developerswww.github.com/eInfraCentralwww.github.com/eInfraCentral/docs
45
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Thank you!
45This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
46
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
46
47
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
GEANTPRACEOpenAIREAdvance EOSC Hub
… …NGI1 NGI2 …DR1 DR2
HPC1
HPC2 …
NREN1
NREN2 …
NOAD1
INDIGODataCloud
EUDATEGI
NOAD2
eInfraCentral
The eIC Initial Target
48
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
GEANTPRACEOpenAIREAdvance EOSC Hub
…
PhenoMeNal
READ
…
NGI1
NGI2 …
DR1
DR2
HPC1
HPC2
…
NREN1
NREN2
…
VI-SEEM
BlueBridge
AGRINFRA+
AARC2
VRE4EIC
West-Life MuG
OpenMinTeD
MSO4SC
EarthServer-2 EVER-EST
ComBioMed
OpenDreamKitNOAD1
INDIGODataCloud
EUDATEGINOAD2 ESiWACE
BioExcel
E-CAMCOEGSS MaX
POP NoMaD EoCoE
OpenRiskNet HIRMEOS
OPERAS-D XDC
UBORA
AENEAS
ANTAREX
AENEAS
DARE
DEEP
EDISON
ESiWACEEUXDATFREYAPROCESS
eInfraCentralThe Current eIC Target
49
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
EIC Catalogue findings (1/4)% Catalogue records per Category
Aggregator15%
Analytics2%Application
2%
Compute6%
Consulting2%
Data25%
Networking5%
Operations8%
Other*4%
Security7%
Software13%
Storage2% Training
9%
‐ All categories of the SDT are used‐ Category “Other” includes combination of Storage
and Computing, Visualisation tools and APIs.
50
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
EIC Catalogue findings (2/4)% Subcategories for Aggregators
applications5%
applications‐software
5%
data9%
data‐applications‐software
4%
data‐publications4%
data‐software‐publications
22%
other4%
publications4%
services‐applications‐software
4%
services‐data4%
services‐data‐applications‐software
9%
services‐data‐publications
4%
sevices‐applications
9%
software13%
51
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
EIC Catalogue findings (3/4)Maturity
Production88%
Alpha1% Beta
11%
Life Cycle Status of Services
trl‐975%
trl‐812%
trl‐713%
TRL Level of Services
52
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
EIC Catalogue findings (4/4)% Catalogue records for Public & Private Sector
Public80%
Private20%
53
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Registration Completed
EinfraValidates maturity
Submit Service
Description Template
EinfraValidates compliance
Submit Provider’s
Info
Login with EOSC AAI
Are you a service provider?Onboarding in EOSC
54
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Service Controller
54
55
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Use APIs to register \update services
Get an activation
key from AAI
Export services to eInfraCentral
Model (JSON)
Register your organization
in eInfraCentral
Are you a service provider?Use the API to Register multiple services
56
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731049
Are you a Service Catalogue Consumer?Web API
https://www.einfracentral.eu/api/service/geant.geant_l3vpnhttps://www.einfracentral.eu/service/geant.geant_l3vpn
Cat
alog
ue o
fRes
earc
h In
frast
ruct
ure
Serv
ices
–w
ww
.cat
ris.e
u
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement n°824173.
Partnership and Expertise
• European Science Foundation (ESF)
• European Future Innovation System Centre
• JNP Strategy and Management Consulting
• National Kapodistrian University of Athens
• National Hellenic Research Foundation – National Documentation Centre
• EurOcean Foundation
• Core Technologies for Life Science Association