data citation update

Data Citation UpdateDavid Kernohan

Image: dkernohan (cc-by)

02/05/2023

Contents

» Data download metrics» Collaboration» Understanding citation

Jisc Journal Research Data Policy Registry

02/05/2023

IRUS for Research Data

» Added compatibility with Figshare – brought in four new institutions (Salford, Sheffield, Loughborough, Cranfield).

» Compatibility with Elsevier PURE – still teething troubles.

» Pursuing discussions with Thompson Reuters (Converis)

» Ongoing work on API (based on SUSHIlite)


02/05/2023

Collaboration (1)

»Linked to ongoing NIH-supported BioCaddie project, hosted by the Force11 Collaboration

»Aimed at developing an implementation pathway for the JDDCP principles…

The Data Citation Implementation Pilot (DCIP)


02/05/2023

Collaboration (2)

»International group managed by Counter – aims to codify practice for research data downloads

»“Making Data Count” is a collaborative project led by California Digital Library, PLOS and DataOne.

http://mdc.lagotto.io

COUNTER/MDC/Jisc Research Data sub-group


http://mdc.lagotto.io/



Complexities of Citation

This section draws on unpublished work commissioned by Jisc from Cameron Neylon. For preference, please cite from Cameron’s final report rather than this presentation.

Citation and referencing are central

» Citation is one of the few universal practices across all of research

» Important (some would say too important) in research evaluation

» An important component of how researchers see their own work

➤ Not surprising that citation is seen as a tool for developing, implementing, and promoting policy.

» Examples include citation advantage for OA, making sure preprints are “citeable”, data and software citation

We don’t understand citation and referencing

1.Why do we account appearance in a reference list, not the number of times an article is referenced?

2.Why do we award a full count to all authors of an article rather than dividing up the credit? What is the best way to divide it up?

3.Are all citations equally valuable? Is a citation from a highly cited paper worth more or worth less?

02/05/2023

Why is this important for data citation?

» Citation practices have developed over centuries – there are strengths but also flaws..

» These lead to serious issues around the way citations are used for recognition.

» Similar questions are frequently posed in mainstream scientometrics.

» RD metrics gives us a “blank slate”: a chance to develop a more useful system.


02/05/2023

What is citation? What is it for?


Normative motivations• Recognising

contributions• Assigning credit• Providing supporting

evidence

Social Constructivist Motivations• Pleasing referees and

editors• Creating community

identity• Persuasion, reputation

building

Related to generally understood community expectations of behaviour and culture in the creation of knowledge

Related to unstated or unrecognised social and contextual behaviour that is not connected to knowledge creation

Defining Contexts for Motivations

Consensus in referencing community

Literalness(consistency ofmeaning between referred work and referencing work)

LowLow

High

High

Misattribution,Reinterpretation,Idiosyncratic negative,Revolutionary

Substantive, organicCreative connection,Unusual quotation

Perfunctory, ceremonial,Common direct quoteConventional interpretation,Paradigmatic

Ritual negative,Common misattributionConventional transformationObliteration by incorporation

Adapted from Small (2004), Scientometrics, 60(1): 71-79

Citation and referencing are complex

These are challenging problems because:» There are many different activities» By many different agents (people, organisations…)

» With many different motivations

There is no one thing which is “citation” done by a single group for a single purpose, but many different activities, by different people, with multiple and differing motivations.

Who•Authors•Journals•Indexes•Evaluators

What•Referencing•Formatting•Collecting Citations•Generating metrics

Why•Rules•Norms•Persuasion•Identity

Citation and referencing are complex

A general framework for understanding will have to integrate how different actors (the who) do a range of different things (the what) and what incentives and motivations affect (and effect) those practices (the why)




LowLow

High

High

Misattribution,Reinterpretation,Idiosyncratic negative,Revolutionary



Ritual negative,Common misattributionConventional transformationObliteration by incorporation





LowLow

High

HighMisattribution,Reinterpretation,Idiosyncratic negative,Revolutionary



Ritual negative,Common misattributionConventional transformationObliteration by incorporationSocial Constructivist Motivations

Normative Motivations


That gives us who and why but not what

»This has been a problem in the past›Are we talking about the author adding the reference (in the text, in the bibliography?) the journal having restrictions on what’s citeable (or how many citations are permitted), or the work of the indexor in creating the citation?

»We need a way of being precise about what is being done at each stage of a complex process.

Meaningfulness over the course of process

Info

rmat

ion/

Mea

ning

Citation

Citation count

H-indexReference

02/05/2023

Meaningfulness over the process

» Is this the same for data citation?

»How do the two edges connect?


Signs and References: Pierce’s Sign Triad

Sign-vehicle

ReferantInterpretant

Adapted from the work of CS Pierce


Sign-vehicle

ReferantInterpretant

In text reference

Work referred toMeaning in context

Reference


Bibiliography entry


Reference Citation

Citation (in index)

Connection (Absent) referring text

A references transformed to a citation

Bibliography entry


Reference Citation

Citation (in index)

Connection (Absent) referring text

Indicator

Drawing on work by P Wouters and others

05/02/2023

02/05/2023

Further work

»Expand and develop the semiotic approach to carefully define the processes occurring in the citation life cycle. Place these processes in their social, cultural and technological context to identify how community norms and individual choices affect them.

»Support the development of large scale open datasets that support large scale analysis of the context and manipulation of references and citations eg conduct a literature wide analysis of citation contexts

»Expand both of these to include new forms of target referent (data, software, online materials)

»Develop the semiotic approaches to provide a sound basis for a theoretical framing of data and analysis quality issues.


Follow the project

» blog: https://rdmetrics.jiscinvolve.org/ » webpage:

https://www.jisc.ac.uk/rd/projects/research-data-metrics-for-usage » IRUS portal available to users (images above)02/05/2023Title of presentation (Insert > Header & Footer > Slide > Footer > Apply to all) 25

https://rdmetrics.jiscinvolve.org/

https://www.jisc.ac.uk/rd/projects/research-data-metrics-for-usage

data citation update

Education