publishing and impact : presentation for phd infoirmation literacy course
TRANSCRIPT
Publishing and ‘impact’
Information Literacy PhD students
February 16th, 2016 – Hugo Besemer & Ellen Fest
Programme
Tools Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
Analyze Search results
to find interesting journals to identify key researchers / institutes
Scopus or Web of Science
use it to set up alerts contact people e.g. on ResearchGate
Analyze Search results - Scopus
Analyze Search results – Web of Science
Use BrowZine to access Scholarly Journals
Access your key scholarly journals on mobile or PC
Journal subscribed by WageningenUR Library and OA journals
Personalised bookshelf Sync across devices Alerts for new content Integration with Endnote and
Mendeley Export to Dropbox, Evernote, Google
Drive Free!
8
BrowZine Video
Programme
Tools Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
Motives for publishing
Edge, P., Martin, F., Fao, S. R., & Manning, N. (2011). Researcher Attitudes and Behaviour Towards the “ Openness ” of Research Outputs in Agriculture and Related Fields.
Motives for publishing
Choosing the right journal to publish
Many factors influence journal selection●Journal scope/Intended audience●Editorial board/standing●Open Access●The speed of reviewing and publication●Acceptance/Rejection rate●Journal circulation●Coverage in A&I databases (bibliographies)●Journal performance
Open Access
OA publishing e.g. PLoS, BMC and Sage Open Self-archiving in repositories e.g. Wageningen Yield (WaY) SHERPA/RoMEO: Publisher copyright policies & self-
archiving http://www.sherpa.ac.uk/romeo/ Directory of open access journals DOAJ (currently ca.
10,000 journals)
Be aware of predatory OA publishers Beall's List
“Predatory publishers”
“Green” open access: deposit author versions to WaY
see: http://edepot.wur.nl/169331
Send your version of the article to: [email protected]
Speed of publicationPLOS ONE1,5 months
Euphytica>1 year
Rejection / acceptance rates
Sugimoto, C. R., Larivière, V., Ni, C., & Cronin, B. (2013). Journal acceptance rates: A cross-disciplinary analysis of variability
and relationships with journal measures. Journal of Informetrics, 7(4), 897–906. doi:10.1016/j.joi.2013.08.007
Journal circulation
Compare e.g.●“Agricultural Systems”●"Proceedings
of the National Academy of Sciences of the United States of America"
journal reviews
share your experience with the scientific review process of journals
duration of manuscript handling phases●duration first review round●total handling time accepted manuscripts●decision time immediate rejection
characteristics of peer review process●average number of review reports●average number of review rounds
20
Coverage in A&I databases
Looking for journals?
use our journal browser! www.wageningenur.nl/library
Exercises
Manual Chapter 9.8●Exercise 1
Coffee or tea?
Making your publications known: networking
Networking is important
Start early, make use of Social Networking tools●Facebook●LinkedIn●Twitter●Social networks for scientists
●Academia.edu, Researchgate.net
Imagine what happens when Michael Müller tweets about his latest article
Advertise yourself
Cite your previous articles! Be active at conferences Cooperate with other people/research groups Write, or expand, articles in the Wikipedia, refer to your
thesis. Blog or tweet about your research and thesis research Make use of social networking tools (LinkedIn,
Researchgate.net, Mendeley etc.) Create author’s identifiers (ScopusID, Researcher ID,
ORCID)
Claim your publications
ResearcherID (Web of Science) Scopus Author ID (Scopus) Google Scholar Citations
Enserink, M. (2009). Scientific Publishing: Are You Ready to Become a Number? Science,
323(5922): 1662-1664 http://dx.doi.org/10.1126/science.323.5922.1662
ORCID●http://orcid.scopusfeedback.com/
Interested in new Scholarly Communications tools?
http://innoscholcomm.silk.co/
What's in a name
On the cover:●Arina Schrier
First first title page:●A.P. Schrier-Uyl
Second title page:●Adriana Pia Uyl
In here own publication list●A. Uyl●A. Uijl●A.P. Schrier Uyl
This also applies to the names of groups
Environmental Policy Group, Department of Social Sciences, Wageningen University
Environmental Policy Group, Wageningen University
Environmental Policy Group, Wageningen University and Research Centre
Environmental Policy Group, Wageningen UR
Get your affiliation right
For the university:Chair group + Wageningen UniversityPlant Production Systems Group, Wageningen University, P.O. box ..., 6700 HA Wageningen, The Netherlands
For the institutes:Institute + Wageningen University & Research CentreAlterra, Wageningen University & Research Centre, P.O. box ..., 6700 HA Wageningen, The Netherlands
Some other options to make you articles effective
Apart from doing good research and writing well, that is
Collaboration with private sector effective
Kamalski, J., & Aisati, M. h. (2013). International comparative benchmark of Dutch research performance in TKI themes: Food Safety research. A report prepared by Elsevier for Agentschap NL.
36
(source: SciVal 14-10-2015)
2009 2010 2011 2012 2013 20140
5
10
15
20
25
30
35
Collaboration Impact for Wageningen UR (articles & reviews)
without Academic-Corporate Collaboration with Academic Corporate Collaboration
University-industry collaboration and impact
"The average scientific impact of university-industry papers is significantly above that of both university-only papers and industry-only papers"
Lebeau, L. M., Laframboise, M. C., Larivière, V., & Gingras, Y. (2008). The effect of university-industry collaboration on the scientific impact of publications: The Canadian case, 1980-2005. Research Evaluation, 17(3), 227-232. http://dx.doi.org/10.3152/095820208x331685
Choosing journals with High Impact factors?
A: strong or definite predictor
More co-authors?
A: strong or definite predictor; B: Weak predictor or predictive power dependent on the model
References?
Recent article! N. Onodera and F. Yoshikane, “Factors affecting citation rates of research articles,” J. Assoc. Inf. Sci. Technol. Jun. 2014.
A: strong or definite predictor; B: Weak predictor or predictive power dependent on the model; C: Not significant or negative predictor
Self citations and more
Self citations
The model [...] implies that external citations are enhanced by self-citations, so that we have the “chain reaction:” Larger size leads to more self-citations, which lead to more external citations.
van Raan, A. F. J. (2008). Self-citation as an impact-reinforcing mechanism in the science system. Journal of the American Society for Information Science and Technology 59(10): 1631-1643.
More articles per research project?
Publishing more articles results in higher citation counts if the articles provide sufficient substantive content to other researchers.
●Beware of the ethical standards●Bornmann looked at total citations, not to relative
impact
Bornmann, L. & H.-D. Daniel (2007). Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicine. Journal of the American Society for Information Science and Technology, 58(8): 1100-1107 http://dx.doi.org/10.1002/asi.20531
Publish your data!
Henneken et al. (2011) "articles with links to data result in higher citation rates than articles without such links"
http://arxiv.org/abs/1111.3618 Piwowar et al. (2007) "Sharing detailed research data is
associated with increased citation ratehttp://dx.doi.org/10.1371/journal.pone.0000308
Library assists in curating datasets:www.wageningenur.nl/datamanagement
Programme
Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
Web of Science
Search: ●Articles are found based on Authors, Addresses, etc.●For each article Times cited is presented
Cited reference search: ●Searches in the reference lists of records●Not all of your articles are found. Non-cited articles
are missing
How do we compare numbers
Scientist Z. Math has a publication from 2003 with 17 citations
Scientist M. Biology has a publication from 2009 with 24 citations
Baselines for Mathematics
Baselines for Molecular Biology
0
100
200
300
400
0 2 4 6 8 10 12
Years after publication
Cum
ulat
ive
no. c
itatio
ns
Baselinetop 10%top 1%
Citation enhanced A&I databases
Web of Science● Based on ± 12000 journals● Metrics: Impact factor● Baselines per ‘discipline’
(ESI)● Analysis tools (Insight)
Scopus ● Based on ± 19000 journals
+ other publication types● Metrics: SNIP and SJR● Baselines + analysis tool
(Scival)
Google Scholar (http://scholar.google.com)
● Based on unknown journals + many other things
● No baselines
There are other citation enhanced databases: • PsychInfo, • SciFinder (Chemical abstracts)• ArXiv (Physics)• Spires (high energy physics)• Citeseer (ICT)
Programme
Publishing Metrics
●Article metrics●Author metrics●Research group metrics
Essential Science Indicators (ESI)
Analytical database, covering 10 years + current year building
Comparisons between Countries, Institutes, Scientists and Journals
Hot papers / Highly cited papers Research fronts Baselines
Steps in a citation analysis
1. Look up the citation data (Web of Science)2. Matching Journal(s) with appropriate research fields
(Essential Science Indicators)3. Collect baseline data (Essential Science Indicators) 4. Calculate the relative impact
Bibliometric indicators: An example
Kroes-Nijboer, A; Venema, P; Bouman, J; van der Linden, E (2009) The Critical Aggregation Concentration of beta-Lactoglobulin-Based Fibril Formation. Food Biophysics 4(2):59-63.
●Citations from WoS: 12 Journal: Food Biophysics
●Categorised by ESI in Agricultural Sciences Baseline data for Agricultural Sciences.
●Article from 2009 in Agricultural Sciences: ●On average: 9.19 citations; top 10%: 23 citations; top
1%: 59 citations Relative Impact: 12/9.19 = 1.40 Values June 2015
Alternative to ESI: Scival (Elsevier)
Alternative to ESI: Scival (Elsevier)
interested? have a look: www.scival.comlogin with Scopus-account or create oneonly access on campus
Exercises
Manual Chapter 9.8●Exercise 2: Number of publications and times cited
●Exercise 2.1●Exercise 2.2 is optional
●Exercise 3: Citation impact and rankings (Essential Science Indicators)
●Exercise 3.1a ●Exercise 3.1b is optional
Programme
Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
H-index
Balance between productivity and citedness
To rule out the effect of one or two highly cited papers
Applicable to authors, journals, research groups, compounds, subjects etc.
But there are some serious doubts about robustness
Waltman, L. & N. J. van Eck (2011). The inconsistency of the h-index. Journal of the American Society for Information Science and Technology 63(2):406-415 http://dx.doi.org/10.1002/asi.21678
H-index
Omnipresent h-index
54 47
57
70 57
76
Programme
Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
Journal Performance Indicators
Journal performance indicators are based on citations to articles
Journal Citation Reports (JCR)●a.o. standard Journal Impact Factors and 5-year
Impact Factors Scopus Journal Analyzer (SJA)
●a.o. SCImago Journal Rank (SJR) and Source Normalized Impact per Paper (SNIP)
●Also available on http://journalmetrics.com/
Journal Citation Reports (JCR)
Reports three measures Impact factor Immediacy Index Cited half life
Adapted from: Amin, M and Mabe, M. (2000) Impact factors: use and abuse. Perspectives in Publishing, No. 1, 6 pp. http://www.elsevier.com/framework_editors/pdfs/Perspectives1.pdf
IF in 2011 for Agricultural Systems
Selecting journals on the basis of IF
Word of warning●Our opinion: Be careful when using Journal Impact
factors to judge the performance of a group or individual scientist
●Used for NWO grant applications and Tenure track at Wageningen UR
Opthof, T. (1997) Sense and nonsense about he impact factor. Cardiovascular Research, 33(1): 1-7 http://dx.doi.org/10.1016/S0008-6363(96)00215-5
Q1
Q2
Q3
Q4
Exercises
Manual Chapter 9.8 ●Exercise 4: Journal Citation Reports (JCR)
Programme
Publishing Metrics
●Article metrics●Author metrics●Journal metrics●Research group metrics
Journal quality and article impact 2003-2009, for Wageningen UR
Source: Wageningen Yield, Feb. 2012
Bibliometric analysis
effect of publication strategy
73
%Q1 and Relative Impact (RI) as function of time for WageningenUR output
Interpretation of RI for small groups
With 10-50 publications per yearRI ≤ 0.8 : below world average impact0.8 < RI ≤ 1.2 : world average impact1.2 < RI ≤ 2.0 : above world average impact2.0 < RI ≤ 3.0 : very good average impactRI > 3.0 : excellent average impact
Exercises
●Exercise 5: (Group) Bibliometric analysis
library links
library: www.wageningenur.nl/library information on writing, citing, publishing and research
impact: http://www.wageningenur.nl/en/Expertise-Services/Facilities/Library/Expertise/Write-cite.htm
author profiles: http://www.wageningenur.nl/en/Expertise-Services/Facilities/Library/Expertise/Write-cite/Profiles.htm
data management support: www.wageningenur.nl/datamanagement
76
