beta report

BBMRI Stakeholders' Forum / Paris – 15th Dec 09 - ßeta 1

BBMRI socio-economic impact study

BETA reportLaurent Bach – Mireille Matt Julien Pénin – Sandrine Wolff

BETA – University of Strasbourg & [email protected]


outline

Objectives and current status of the study Preliminary results

First lessons for BBMRI evaluation


• Test the feasibility of using the BETA approach to evaluate some socio-economic impacts of biobank networking (BBN) projects

• Draw lessons for a possible future implementation in the case of BBMRI (BMS)

OBJECTIVES

◊ Objectives/status ◊ Preliminary results ◊ First lessons for BBMRI


BETA approach :• specific context : publicly funded R&D projects – ex-post view• specific focus : indirect effects• specific scope : effects for the projects' partners• specific method : micro-based, interviews of (a sample of) partners

THE BETA APPROACH


R&D activityof cies, labs

Public(co-)fundings

Direct effects(techno, products, services… as expected)

Indirect effects

knowledge

methodsnetworks

team building

Cies, labs t

Cies, labs t+1


Not a standard R&D project with public funding

• New "mapping" of effects + adapted metrics, possibly incl. some beyond BETA ones

• Relevance of general approach using case studies, in particular :

• Identification then attempt to quantify some effects

Not every effect quantifiedNot every quantified effect in monetary terms

• Mainly ex-post evaluation• Effects for BBN members• Based on interviews of BBN member

THE BBN CASE



SAMPLING

INTERVIEWS

ANALYSIS OF RESULTS

LESSONS FOR BBMRI

PRESENT STATUS OF THE STUDY


End Feb 2010

6 networks of biobanks :• 3 "detailed studies (3-4 interviews)

• 3 "light studies" (1 interview)

2 biobanks : researchers + biobanker

* population* thematic/deceases focused* mix thematic-population* research* multi-themes* "pure" networking

12 interviews completed, 2-3 plannedValidation phase,

clear out confidentiality issuesetc

Mapping of effects+ metrics


Direct effectsnew buildings, equipments, IT

system, software, staff…

Economic impact of a BBN

Impact of the use of the BBNImpact of the setting up of the BBN

Indirect effectsknowlegde, networks, methods… "transferred" to other activities

Direct effectsnew knowledge, drugs, treatments, diagnosis + network and collaboration

MAPPING OF EFFECTS




Indirect effects

Impact of the setting up of the BBN

Direct effects

DYNAMICS – PHASE 1



DYNAMICS - PHASE 2


Indirect effects


Direct effectsDirect effects

Impact of the use of the BBN

Direct effects



Otherusers

BBN Enrichment Effect-new members, new networks-new samples, collections, data…-new analysis, new info on existing collections

BBNmembers

DYNAMICS - PHASE 2


Indirect effects


Direct effectsDirect effects

Impact of the use of the BBN

Direct effects



DYNAMICS – PHASE 3

Economic impact of the enriched BBN

Indirect effects of the enrichment + continuous indirect effects of the initial BBN

Impact of the enriched BBN Impact of the use of the enriched BBN

Direct effectsDirect effects of the enrichment



FIRST RESULTS FROM CASE STUDIES


• There are effects !• They are relatively numerous (8-10 effects per interview)• They cover most of the expected cases : mapping is relatively exhaustive; however :

• a few "new effects"• possible confusion in typology in some cases

• A few effects are quantified at this stage (not the aim + confidentiality issues) but it seems that each effect taken individually is not very large

=> number, variety, benefit to all partners + not quantified effects = important



RESULTS BY TYPE OF EFFECTS - 1

• Networking vs creating BBN• Upgrading BB

• Transfers between partners, within partners, from partners to others• Standardization - homogeneization -> collection, storage, retrieval, transport + hard, soft, mgt, ethics



If frontiers between scientific domains move, more impact

Mainly researchers coveredBB too recent

Crucial for all, but hard to disintangleNew increase value of oldNeed sustainability

RESULTS BY TYPE OF EFFECTS - 2

Some in new fieldsGeneral level increase


KEY FACTORS FOR GENERATING EFFECTS


• Size of the BBN/ of the BB involved• Project-based BBN vs infrastructure-based BBN• Perennity of BB and of BBN• Reward / feedback mechanisms• Level of development / variety of trajectories of BB

• Reaching maturity level• Accelerating development• Amplifying development

• Type of partners (researcher, coordinator, biobanker)


TOWARDS BBMRI EVALUATION ?


• Effects of BB vs effects of networking BB• "Internal" dynamics of BB vs dynamics of the BBN

how networking BB amplify, accelerate effects of BB ? • Extreme variety of actors, BB, projects…

sampling issues / basic evaluation + case studies for illustration and/or providing range ?

• Detailed quantification : hard, time consuming

proof of existence vs quantification ?• Ex-post evaluation difficult

wait for evaluating ? progressive implementation … ?

• Complexity : difficulty to "isolate" a chain : one programme – one funding scheme – effects

Impact of BBMRI as a whole vs impact of specific actions ?

beta report

Technology