ESAArchivesLong-TermStrategy

GuidoDeMarchi

12.6.18

ESACScienceArchivesStrategy

Enablemaximumscienceexploitationofdatasets

Ensureefficientlong-termpreservationofdata,software,knowledge,usingmoderntechnology

Buildcost-effectivearchives,alsothroughintegrationin,andacross,projects

2Strategydocument

Brainstormingonstrategydocument

•  Firstlong-termstrategydiscussedanddefinedin2013,timetoupdateit

•  InternalESAforumsagreevisionwith3pillarsisvalid– Wewanttoenablebestscience– Wewanttopreservedata,software,knowledge– Wewantefficientpreservation,henceintegratearchiveswithoperations(whenpossible)

•  Needtorevisethewaythesetopicsareaddressedinthe2013strategydocument,toomuchemphasisonIT,VOandmulti-missiontools,notenoughonlegacyandcommunity

3Strategydocument

1.Enablemaximumsciencereturn

•  Ensuredataqualityandcompleteness–  Ensurecomplete,calibrateddata;alsoancillarydata? –  High-levelscienceproductsfromcommunity(H2020)–  Linktorelatedgroundbaseddata

•  Improvedataaccessandeasedatasearch•  WidenESDCusersbase

4Strategydocument

1.Enablemaximumsciencereturn

•  Ensuredataqualityandcompleteness•  Improvedataaccessandeasedatasearch–  Enablefast,reliableaccesstoalldata(e.g.CDNlikeESASky)–  DevelopScienceExploitationandPreservationPlatformwithstrongcommunityinteraction

–  Developcollaborativeresearchareas(jupyternotebook)–  Search/miningtoolsbasedonsciencevalues/themes,acrossspace,time,energy

•  WidenESDCusersbase

5Strategydocument

1.Enablemaximumsciencereturn

•  Ensuredataqualityandcompleteness•  Improvedataaccessandeasedatasearch•  WidenESDCusersbase–  Engageyounggenerationsthroughresearchproposals–  Supportconferences,summerschools,townhalls–  Encourageandsupportcitizenscienceprojects–  CommunityupdatesthroughESDCNewsletter–  Feedbackthroughsurveys,promotehelpdesks,webinars– Monitorexploitationmetrics

6Strategydocument

2.Preservedataandknowledgeforthelongterm

•  Maintaindataingestioncapabilitiesinlegacyphase•  Maintainsciencesupporttousersoflegacyarchives•  Searchandincludemissinglegacydata•  Makelegacydatapartofmulti-missiontoolsThismeansthatESDCwillhaveto•  Workwithmissionteamsandcommunitytopreparelegacytransition

•  Agreewithmissionteamsonwhattokeep/ignore•  Preparealegacymanual(alsofor“off-site”archives)

7Strategydocument

3.Encouragearchivesintegrationwithin/acrossprojects

•  Goalistoavoidduplicationsandeasetransitiontolegacy,butrecallthat“onesizedoeshardlyfitall”

•  WorkearlyonwithSOCstoplanmissionarchives•  AgreeearlyonwithconsortiaonESAcoreareas•  AgreeearlyonwithPIsoncalibrateddata•  Defineminimumsetofmetadataacrossarchives?•  Regularlyreviewandassesstechnicalframework•  Fosterdialogueacrossarchivesonfunctionalities•  Interoperability:standardstaketime,newfeatures?

8Strategydocument

Internalcallforpriorities

•  Manyideascollectedinternally(scientistsandsoftwareengineers)

•  Somearereadyforimplementation•  Ideasrankedinternally,twogroups:–  Highimpact,lowcost,mostlyorganisationalwork–  Highimpact,substantialdevelopmentwork

•  InputsandcommentsbyUGssought

9Strategydocument

Group1Highimpact,lowcost,mostlyorganisationneeded(nodevelopment)

Activelyenabledataexploitation [firstchoice,31points]•  Researchproposalstofundyoungscientists(needreviewers)•  Visitorprogrammelinkedtodataexploitation•  Citizenscienceprojects(needstoolsforanalysis)Advertisement [thirdchoice,19points]•  Support/organisesummerschools(alsoatESAC)•  Newsletters,townhallmeetingsAssistandfeedback [secondchoice,20points]•  Improvedhelpdesks,withvideos,demos,chats•  Usersurveys(feedbackonwhatdoes/doesnotwork)

10Newactivities

ArchivalResearchProgramme1.  Goalistosupportearly-careerscientistspresenttheir

sciencefromarchivaldata(okifcombinedwithotherdata)2.  Postdoc/studentwritesshortapplication(2pages)outlining

scienceidea3.  Committeeselectsxmostpromisingideas,ESAallocates

funds(travel,hotel,conferenceregistration;max800euro?)4.  Whenpaperisready(draft?submitted?accepted?)

successfulproposercontactsESAfortravelauthorisation5.  ProposeraskedtomentionArchivalResearchProgrammein

her/hispresentation(oneslide)6.  Afterconference,proposersendstickets/receiptstoESAfor

reimbursement7.  Firstyearwillacceptproposalsforrecentlypublishedpapers

ifbasedonarchivaldata

13

Group2Considerabledevelopmentrequired,highercosts

Collaborativeareas(proofofconcept) [secondchoice,19points] •  Offercollaborativeresearchareas,JupyterLabexample•  Code-to-data,movestorage&toolsto“cloud”•  ScienceExploitation&PreservationPlatformAnalysistoolsintegratedinarchives [firstchoice,27points]•  Dataminingandanalysistoolsaspartofthearchives•  Cross-missiondataselectioninspace,energy,time•  Archiveinterfacesbasedonsciencethemes•  Integratemetadata,withsourcedetails/linksandqualityflags;

encourage/allowuserstodothattoo?Otherideas [thirdchoice,13points]•  DOItoimprovelinkingtopapers,identifyunuseddata•  Accesstosomehousekeepingdata,priorityforsomemissions•  Definemetricsandmonitoring(forR&Dproducts)

11Newactivities

Youropinion

1.  Arewemissingsomethingimportant?Anycommentsorideas?

2.  Arearchivalresearchproposalsuseful?Ifso,wouldyouhelporsuggestnamesforreviewingtheapplications?

3. DoyouseeascienceusefortheSEPP?OrshouldtheEuropeanOpenScienceCouldbeusedinstead?(whatdoyou/yourcolleaguessayaboutthat?)

12