cessda.eu @CESSDA_Data

Monitoring Research Infrastructures - CESSDA performanceWidening meeting Skopje, MakedonijaIvana Ilijasic Versic, COO | CESSDA ERIC

05 November 2019

Exploitation

Impact

Proposal

Funding

Conduct

Results

StakeholdersM

onitoring

KPIs

Goals

Measurable

Challenges

Exce

llenc

e

Standards

Definitions

Indica

tors

Evaluation

Potential

Innovation

Impact

Socio-Econom

ic

Data

Missions

Horizon Europe

Horizon 2020

AnalysisFinance

3

Sustainability of Research Infrastructures

Evaluation systems for RIs

Socio-economic impact

Mission, Vision, Goals

Measurable indicators (KPIs)

Organisational structure

FUNDING

ESFRI long-term sustainabilityESFRI WG 35 recommendations in 7 key areas (June 17)EC Working Doc with 42 recommendations (Sep 17)

SCRIPTA Sustainability of Research Infrastructures7 main recommendations:

Excellence;Have the right people in the right place Vision for convergent operation of RIs and e-Infra’sRI's as innovation hubsDetermine economic and wider social value of RI’sEffective governance and sustainable long-term fundingFoster coordination at national and European levels

OECD on the socio-economic impact of RI'sDistinguish between performance, impact, time

Broader context

Members: national ministries (General Assembly)Designated national Service Providers Scientific Advisory BoardEuropean Commission (annual reports, EC projects)ESFRIERIC ForumEOSCScientific communitySpecific – e.g. technical evaluation

5

Evaluation

Socio-economic impact

KPIs

Business model

Funding

On national levelinfluencing policy trusted repositoriesstandardsjobs at Service Providersoutreach to new members

On EU level:Scientific community - data sharing and re-use, training, thematic data clusters Policy level - working groups, ERIC ForumEC funding – EOSC, widening, standards

International levelCollaborations: RDA IG SSH Research Data, IASSIST, with other Disciplines

6

Evaluation

Socio-economic impact

KPIs

Business model

Funding

Developed by ESFRIDeveloped by ERIC ForumMeasure of performanceMeasure of impactMeasurable over timeQualitative, quantitative

CESSDA – a distributed SSH RI

Not: patents, publications.

7

Evaluation

Socio-economic impact

KPIs

Business model

Funding

National example (DE)

https://www.ratswd.de/pressemitteilung/16102019

https://www.ratswd.de/pressemitteilung/16102019

ESFRIdevelopments

Objective KPIs

Achievingscientificexcellence

1.NumberofuserrequestsforaccessÖ2.NumberofusersservedÖ3.Numberofpublications4.Percentageoftop(10%)citedpublications

Deliveryofeducationandtraining

5.NumberofMScandPhDstudentsusingtheRIÖ6.TrainingofpeoplewhoarenotRIstaffÖ

EnhancingcollaborationinEurope

7.NumberofMembersoftheRIfromESFRIcountriesÖ8.ShareofusersandpublicationsperESFRImembercountryÖ

Facilitatingeconomicactivities

9. Share of users associated with industry and publications withindustry10.Incomefromcommercialactivitiesandthenumberofentitiespayingforservice

Outreachtothepublic 11.EngagementachievedbydirectcontactÖ12.OutreachthroughmediaÖ13.OutreachviatheRI’sownwebandsocialmediaÖ

Optimizingdatause 14.NumberofpubliclyavailabledatasetsusedexternallyÖ

Provisionofscientificadvice

15.ParticipationbyRIsinpolicyrelatedactivitiesÖ16.Citationsinpolicyrelatedpublications

Facilitatinginternationalco-operation

17. Share of users and publications per non-ESFRI membercountryÖ18.Internationaltrainees19.NumberofmembersoftheRIfromnon-ESFRIcountriesÖ

Optimisingmanagement 20.Revenues21.ExtentofresourcesmadeavailableÖ

Quantitative (number of)Trust:

certified repositoriesUsers:

data downloads, levels, registered, number of website visits, social media followers

Studies (datasets):new datasets added to collections, variables (if possible), published through CDC (or available in archive), openly available, restricted, data breaches (aiming at zero)

Funding: annual, share of project funding, staff (FTE equivalent)

Training: Organised seminars/training events/webinars, number of participants

…....

QualitativePurpose of use for downloaded data (i.e. study, teaching, BA/MA/ PhD thesis, research or other)Utilisation rate (i.e. the share of studies downloaded at least once)Institutional developments (non-quantitative description)FAIR metrics, policies…etc.

Relevant CESSDA KPIs

Combine list of KPIs with CESSDA strategic goals

Gap analysis of goals-KPI relationship

Explore experiences of other domains (i.e.

Humanities/CLARIN/Daan)

Precise definition and description of KPIs

Several iterations with SPs

Next steps

CANVAS Business ModelKey partnersKey activitiesKey resourcesValue propositionsCustomer relationshipsCommunication channelsCosts (investments, maintenance)Return (money, indicators/metrics)

CESSDA ERIC business model (in progress)

12

Evaluation

Socio-economic impact

KPIs

Business model

Funding

Membership fees

ministries, research councils

additional contributions

Project funding, esp. EU

Future:

Revenues from services

(business models)

CESSDA ERIC funding

13

Evaluation

Socio-economic impact

KPIs

Business model

Funding

cessda.eu @CESSDA_Data

Thank you for your attention!

ivana.versic@cessda.eu