Connecting Research

American Evaluation Association - Anaheim, CANovember 2011

Agenda•show how a common data

dictionary can address the challenges of tracking impact in the research community•Challenges•Options•CASRAI approach

Challenges

Challenges

•efficiency•multiplicity•clarity

Efficiency challenges

•doing vs measuring•capturing vs remembering

Multiplicity challenges

•multiple participants•multiple disciplines•multiple institutions•multiple funders•...all on multiple projects

Clarity challenges

•terminology•comparability•identifiability•... all across multiple independent

players

Options

Options

•standardize the hosting•standardize the software•standardize the storage format•standardize the data dictionary

CASRAI approach

Modular dictionary

•Terms, definitions, relationships, thesauri

•Core, discipline, jurisdictional layers

•Simple and compound elements

Exchange format•any concept representable as data•any data representable as

documents•any exchange processable•a common ‘currency’ for

information

Evaluation: what•Multiple frameworks of research measurement

can share common source data•The impact of people and projects on:•Capacity (human, physical, integration)•Knowledge & Innovation (quantity & quality)•Society (economic, health, culture ,

environment)

Evaluation: how•Linking inputs to outputs•If it can be recorded it can be

identified•Example: person on project with

funding produced output resulted in impact

© casrai.org

CASRAI Dictionary

1) Elements where meaning* & structures are used by all nations and all disciplines

Nation-specificNation-specific

Core DisciplineCore Discipline

Core CommonCore Common

2) Extensions to above elements that are unique by discipline3) Extensions to above elements that are unique by nation

Common concepts defined, structured and identified

* Including common classifications and constrained list values.

© casrai.org

can be reused to generate...

Any database with...PersonPerson

ID, Contact, ID, Contact, Education, Education,

Employment, Employment, DistinctionsDistinctions

ContributionsContributionsID, Outputs, ID, Outputs,

Outcomes, ImpactsOutcomes, Impacts

ProjectProjectID, Proposal, Team, ID, Proposal, Team, Partners, Funding Partners, Funding

RequestsRequests

OrganizationOrganizationID, Institution, Funder, ID, Institution, Funder,

PartnerPartner

FundingFundingID, Source, Program, ID, Source, Program,

Amount, PeriodAmount, Period

InfrastructureInfrastructureID, Host Org, ID, Host Org,

UtilizationUtilization

AcademicCV

FundingApplication

FinancialReportCompliance

Reports

CommercialImpact Report

Quality of Life

Impact Report

ProgressReport

Proposal

Statementof Intent

Dean’sReport

Funding ResultsPeer Review

ReportPublic

CV

Funding Opportunities

PublicationsList

© casrai.org

Using any softwareCONCEPTS RECORDED:

researchers and organizations in projects produce outputs with impacts

Proposals

CONCEPTS SHARED.

CVs

Reports

Recap•Research = multiplicity•Harmonization = efficiency/clarity•Harmonization = HARD (dictionary less

hard)

•Impact = evidence that can be connected

© casrai.org

Why connect the dots?

Save time

See patterns

Build bridges

Estimated time* spent administering research grants rather than doing the research.

42%

* Source: US-FDP

Identifiers reveal links between research inputs and outputs. Common dictionary enables better evidence for comparing and benchmarking.

Easier for researchers to collaborate across boundaries of discipline, institution, region, nation. Easier for organizations to raise or lower the information draw-bridge throughout the coopetition lifecycle. Position your organization as a champion of harmonization and standards.

© casrai.org

CASRAI StatusAdoption momentum within national and regional funders and universities.

Discussions started with NSF and NIH towards collaboration options.

Endorsement by eruoCRIS and moving towards adoption of CASRAI dictionary within CERIF.

Introductions & first presentation made to the National Science Foundation of China. A commitment to explore options for collaboration.Discussions being planned for participation in Australia. Forum for European-Australian Science & Technology Cooperation (FEAST) acknowledges CASRAI in a recent discussion paper as a key opportunity for interoperability.

Connecting Research

Thank-you.