Upload File

using research metrics to tell your storylibrary.msstate.edu/li/ssfgs/researchmetrics.pdfusing...

  • Home
  • Documents
  • USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
37
USING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY LIBRARIES Dr. Deborah Lee Mississippi State University Libraries [email protected]

Upload: others

Post on 03-Jul-2020

8 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

USING RESEARCH METRICS TO TELL

YOUR STORYPRACTICAL PROFESSOR WORKSHOPS

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Dr. Deborah Lee

Mississippi State University Libraries

[email protected]

Page 2: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

PRACTICAL PROFESSOR WORKSHOPS

MISSISSIPPI STATE UNIVERSITY LIBRARIESHTTP://GUIDES.LIBRARY.MSSTATE.EDU/PRACTICAL_PROFESSOR

DR. DEBORAH LEE

PROFESSOR AND COORDINATOR, GRADUATE STUDENT SERVICES

Page 3: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

SESSION OVERVIEW

Explore the use of research metrics.

Review resources available to the MSU

community.

Discuss best practices.

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 4: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

What are research metrics?

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 5: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

WHO CARES?

Faculty and Researchers

Promotion & Tenure Committees

Universities/Research Institutions

Funders

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 6: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

RESEARCH METRICS: CAVEATS

YOU are more than a number!

Research metrics augment traditional measures of impact.

(Peer-review, funding, etc….)

All data have a context: always report the date/source of your

measure.

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 7: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

RESEARCH METRICS

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Author Metrics

Citation MetricsSource Metrics

(Journals, Books)

Page 8: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

AUTHOR METRICS

Total Citations

Problems?

Difficult to interpret

Subject to the norms of the field

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 9: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

H-INDEX

J. E. Hirsch (2005): “How does one quantify the cumulative

impact and relevance of an individual’s scientific research

output?”

Wanted to be able to compare physicists.

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 10: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

H-INDEX

Statistical measure that includes BOTH the productivity and impact of a work or researcher.

Index of h = h papers published that

have been cited h times.

An h-index of 8 means you have at least 8

publications that have been cited by at

least 8 other articles.

Source: h-Index, Wikipedia. http://en.wikipedia.org/wiki/H-indexAccessed October 6, 2014.MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 11: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

H-INDEX

One of the most often used metrics of impact.

Included on CVs, biographical statements (for grants), and even

on web pages.

Problems:

May under-represent the impact of a key piece of research.

Varies depending on the source of data. MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 12: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

H-INDEX: SOURCES

Scopus

Google Scholar

Publish or Perish (software program)

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 13: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 14: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 15: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 16: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

CITATION METRICS

Total Citations

Field-Weighted Citation Impact (FWCI)

Considers the differences in citation behavior across disciplines.

Compares the number of citations an article has with the average

number of citations received by all other similar publications in

Scopus.

1.44 = article has been cited 44% more times than expected.MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 17: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 18: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 19: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

SOURCE METRICS

Select metrics that are appropriate to your research and field:

Books

Journals

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 20: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

BOOKS

Citation Information

Google Scholar

Scopus, Google Books (Limited)

Other Metrics

Reviews in the professional literature

Ranking/sales in Amazon

Purchase/Cataloging by libraries (WorldCat)

Adoption in courses

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 21: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 22: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 23: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 24: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

JOURNALS

Impact Factor (JCR)

CiteScore Metrics (Scopus)

Average of citations based on three years of data

Citation Count 2015 / Documents 2012-2014

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 25: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 26: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 27: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 28: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 29: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 30: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 31: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

ALT-METRICS

Alternative measures of impact

Sources:

PlumX (Scopus)

Altmetrics

ImpactStory

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 32: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 33: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 34: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY
Page 35: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

NEED HELP?

Ask a Librarian!

http://lib.msstate.edu

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 36: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

REFERENCES

Ball, A. and M. Duke. (2015). “How to Track the Impact of

Research Data with Metrics.” Available online:

http://www.dcc.ac.uk/resources/how-guides/track-data-impact-

metrics.

Hirsch, J. E. (2005). “An Index to Quantify an Individual’s Scientific

Research Output.” PNAS. 102 no. 26 (November): 16569-16572.

MISSISSIPPI STATE UNIVERSITY LIBRARIES

Page 37: USING RESEARCH METRICS TO TELL YOUR STORYlibrary.msstate.edu/li/ssfgs/ResearchMetrics.pdfUSING RESEARCH METRICS TO TELL YOUR STORY PRACTICAL PROFESSOR WORKSHOPS MISSISSIPPI STATE UNIVERSITY

QUESTIONS?

Dr. Deborah Lee

[email protected]

MISSISSIPPI STATE UNIVERSITY LIBRARIES


DEVELOPING A LITERATURE REVIEWlibrary.msstate.edu/li/ssfgs/LitRev.pdf · WHY IS THE LITERATURE REVIEW IMPORTANT? Demonstrates that you are familiar with the literature relevant to

BERT Rediscovers the Classical NLP Pipeline · 2019. 7. 15. · 3 Metrics We define two complementary metrics. The first, scalar mixing weights (x3.1) tell us which lay-ers, in

Rethinking metrics: metrics 2.0 @ Lisa 2014

Rethinking metrics: metrics 2.0

Tell me Tell me

Using Metrics to tell Your Story

Unified Security Metrics –Vulnerability Metrics

Cyber Security & GRC Metrics That Tell a Story! - ISACA - Cyber... · Cyber Security & GRC Metrics That Tel la Story! Presented by: Swarnika Mehta. Manager, KPMG Cyber Security Services

What do different evaluation metrics tell us about ... · What do different evaluation metrics tell us about saliency models? Zoya Bylinskii*, Tilke Judd*, Aude Oliva, Antonio Torralba,

Managing with Metrics – What Numbers Can Tell You About Your Business Eric Wetherington Director/Broker Carolina One Property Management

itSMF USA Problem Management Special Interest Group€¦ · Report on specific measurements of Problem Management performance Based on metrics that are important (i.e., tell the story)

Structure Data 2014: AMID BILLIONS OF METRICS, YOUR SOFTWARE IS TRYING TO TELL YOU SOMETHING

Metrics and Evaluation - senduwiki.org · Metrics and Evaluation AD Boot Camp. Your experience Tell us about the best ... bring glory to God. •Taking initiative to focus ... cultivating

Start-up Metrics Smetrics? · Why metrics? Commonwealth Bank can tell when ads are on TV thanks to the visits to NetBank Freelancer.com have a list of public holidays for each country

WHAT DO INTERACTION NETWORK METRICS TELL US ABOUT ... · 2008 by the Ecological Society of America WHAT DO INTERACTION NETWORK METRICS TELL US ABOUT SPECIALIZATION AND BIOLOGICAL

Citation metrics and the stories they tell

Cal Answers HR Census Reporting · • Interactive dashboards • Well-defined metrics selected by ... BAIRS . What does HR Census Reporting tell us about ... What does HR Census

Information Security Metrics - Practical Security Metrics

The Measure of Success: Security Metrics to Tell Your Story

DEMYSTIFYING THE DISSERTATION PROCESSlibrary.msstate.edu/li/ssfgs/demystifying.pdf · DEMYSTIFYING THE DISSERTATION PROCESS SURVIVAL SKILLS FOR GRADUATE STUDENTS MISSISSIPPI STATE

How to Get Promoted - FIRST · ThreatConnect.comThreatConnect.com Copyright © 2019 ThreatConnect, Inc. Metrics to Tell if Improving or Everything is on Fire 23 Easy Difficult

July 30 – 31, 2015 // Philadelphia, Pennsylvaniaism.files.cms-plus.com/Education/Metrics Brochure 6_15.pdf · story to tell about how they deliver value to the organization. With

7. Metrics in Reengineering Context Outline Introduction Metrics and Measurements Some metrics Conclusion

POWER UP YOUR RESEARCH PRODUCTIVITY WITH SCOPUSlibrary.msstate.edu/li/ssfgs/scopus1.pdf · SESSION OVERVIEW Discover Scopus content and search capabilities. Discuss how Scopus can

Metrics and analytics how to tell the recruiting story

An Introduction to Web Metrics. - LibQUAL · Comprehensive Metrics Plan Measure to Control Metrics Business Focused Metrics Customer Focused Metrics 1. Use MTC and MTA metrics cooperatively

How health metrics work: health metrics relevant to ...ccacoalition.org/sites/default/files/Baumgartner_How health metrics... · How health metrics work: health metrics relevant to

V2.0 updated metrics and analytics how to tell the recruiting story

Crafting the Winning Curriculum Vitae (CV)library.msstate.edu/li/ssfgs/CVWorkshop.pdf · 2017-08-23 · CRAFTING THE WINNING CURRICULUM VITAE (CV) SURVIVAL SKILLS FOR GRADUATE STUDENTS

Creation InfoGraphiccreation.design/img/socialmedia/Creation_InfoGraphic.pdf · CREATE AWARENESS Consider These Key Metrics Buddy Media Studio you KPI TELL A STORY trust e 11th Menti

Data-Driven Messaging to Effectively Tell your Market’s Story · Farmers Market Metrics ©2017 Farmers Market Coalition. Page 12. Metrics Selection Sheet . Directions: The Metrics

Metrics, Analytics, Dashboards to Engage Leaders and Tell ... · Diversity Best Practices Follow @DBP_News and use #DBPMember to join the game-changing diversity and inclusion conversation!

Software Metrics - ida.liu.seTDDC88/theory/12Metrics-before.pdf · Software metrics • Usage-based metrics • Verification & Validation metrics • Volume metrics • Structural

H E M ETRI CAFÉ C - D-Lab Cafe... · standard for the industry. CONS One-size-fits-all metrics often fail to tell the full story, much less capture nuance. Metrics can have different

Module Metrics Soc Verification Session3 What Can Metrics Tell Us Ameyer