Upload File

software-native metrics: depsy lessons learned

40
#3amconf Sept 2016 Heather Piwowar and Jason Priem @ImpactStory software-native metrics

Upload: heather-piwowar

Post on 11-Jan-2017

24 views

Category:

Data & Analytics


0 download

Report

TRANSCRIPT

Page 1: Software-Native metrics: Depsy lessons learned

#3amconfSept2016

HeatherPiwowarandJasonPriem@ImpactStory

software-native metrics

Page 2: Software-Native metrics: Depsy lessons learned
Page 3: Software-Native metrics: Depsy lessons learned
Page 4: Software-Native metrics: Depsy lessons learned
Page 5: Software-Native metrics: Depsy lessons learned

depsy.org

Page 6: Software-Native metrics: Depsy lessons learned
Page 7: Software-Native metrics: Depsy lessons learned

10.1038/529115a

Page 8: Software-Native metrics: Depsy lessons learned

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
Page 9: Software-Native metrics: Depsy lessons learned

depsy.org

Page 10: Software-Native metrics: Depsy lessons learned
Page 11: Software-Native metrics: Depsy lessons learned
Page 12: Software-Native metrics: Depsy lessons learned
Page 13: Software-Native metrics: Depsy lessons learned
Page 14: Software-Native metrics: Depsy lessons learned

launched last November

....what did people think?

Page 15: Software-Native metrics: Depsy lessons learned
Page 16: Software-Native metrics: Depsy lessons learned
Page 17: Software-Native metrics: Depsy lessons learned
Page 18: Software-Native metrics: Depsy lessons learned

some areas we weren’t sure about, but feedback suggested we got right

Page 19: Software-Native metrics: Depsy lessons learned

public profiles for everybody!

Page 20: Software-Native metrics: Depsy lessons learned

an overall score, with equal weighting to 3 components

Page 21: Software-Native metrics: Depsy lessons learned

downloads, log transformed vs ranked, and display for interprebility, with percentiles

Page 22: Software-Native metrics: Depsy lessons learned

pagerankto weight or not to weight, displayed in interpretable way

Page 23: Software-Native metrics: Depsy lessons learned

citations

Page 24: Software-Native metrics: Depsy lessons learned

authorship weighting (committers vs pypi author vs maintainer)

Page 25: Software-Native metrics: Depsy lessons learned
Page 26: Software-Native metrics: Depsy lessons learned

and some big requests

Page 27: Software-Native metrics: Depsy lessons learned

biggest one: pull in new data from GitHub

Page 28: Software-Native metrics: Depsy lessons learned

expected:

more package library systems (esp bioconductor)

more languages (import detection complexity)

more platforms like bitbucket (esp to get commit history for authorship)

better deduplication (no orcid, alas)

things that aren't on a version control system at all (not happening)

Page 29: Software-Native metrics: Depsy lessons learned

outstanding challenge:

deciding what is a research package (important b/c refset matters)

Page 30: Software-Native metrics: Depsy lessons learned

future plans

Page 31: Software-Native metrics: Depsy lessons learned

above, plus better text mining

Page 32: Software-Native metrics: Depsy lessons learned

integrate better with libraries.io

Page 33: Software-Native metrics: Depsy lessons learned

tighter integration with Impactstory

Page 34: Software-Native metrics: Depsy lessons learned

https://impactstory.org/u/0000-0001-6728-7745

https://impactstory.org/u/0000-0001-6728-7745
https://impactstory.org/u/0000-0001-6728-7745
Page 35: Software-Native metrics: Depsy lessons learned
Page 36: Software-Native metrics: Depsy lessons learned
Page 37: Software-Native metrics: Depsy lessons learned
Page 38: Software-Native metrics: Depsy lessons learned

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

more Depsy details:

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
Page 39: Software-Native metrics: Depsy lessons learned

thoughts?

tweet @depsy_org or via github issue.

Page 40: Software-Native metrics: Depsy lessons learned

thanks!


The National Library of Medicine’s Native America Outreach Portfolio: Overview and Lessons Learned

Performance Metrics for AGCS Applied to CastGate ...users.utcluj.ro/~dobrota/pdf/Performance_Metrics_for_AGCS_Applied... · CastGate Technology and Native Multicast. ... CastGate

OPERATIONALIZING CLOUD NATIVE WITH KUBERNETES...Cornelia Davis, CTO, Weaveworks Cloud Native Security for Kubernetes in Practice Gadi Naor, CTO & Co-Founder, Alcide Beyond Metrics:

how Languages Are Learned - English Languageelteportfolio.weebly.com/.../7/3/3/6/7336182/how_langua…  · Web viewHOW LANGUAGES ARE LEARNED. ... The learners are matched as native

Consumer Metrics Institute, Inc. What Ben Bernanke Should Have Learned in History 101 Rick Davis President & CEO Consumer Metrics

Vanity Metrics - Why your doctor learned to read your blood panel wrong and what to do about it

Metrics: Lessons Learned - Killing your pre market product illusions

Matching and Clustering Croduct Descriptions using Learned Similarity Metrics William W. Cohen Google & CMU 2009 IJCAI Workshop on Information Integration

Metrics for MMP Development and Operations Lessons Learned: The Sims Online

Metrics Lessons Learned Managing Risks Howard Hays, MD, MSPH Medical Informatics Consultant Carolyn Johnson, RPh, CAC

E-Metrics: Lessons Learned from the ARL E-Metrics Project ...acscinf.org/docs/meetings/226nm/presentations/226nm41.pdfAvg. Annual % Change Serial Unit Cost 7.7% Serial Expenditures

Performance Quality Metrics for Mobile Web and Mobile Native - Agile Testing Days 2014

A Cloud Native Platform for Stateful Streamingibm/cloud-native-patterns. 2. The architecture of cloud native Streams ( 5), deep-dives on specific features ( 6), and lessons learned

From 0 to DevOps: Lessons Learned Moving from On-Prem to Cloud Native

Top Native Advertising Engagement Metrics For 2015

Lessons Learned while Exploring Cloud-Native Architectures for … · 2019. 8. 29. · Lessons Learned while Exploring Cloud-Native Architectures for NASA EOSDIS Applications and

ANNUAL REPORT LEWIS COUNTY - MU Extensionextension.missouri.edu › lewis › documents › Extension... · Grow Native Workshop Participants learned about native plant selection,

Healthcare Benchmarks and Metrics February 2015 · PDF fileHealthcare Benchmarks and Metrics February 2015 ... and lessons learned by 119 healthcare companies related to ... 2015 via

Winter 2018 Kelseya - Montana Native Plant Society...For instance, I first learned about dyeing with native plants from a podcast, “Growing Color,” in which native dye expert Rebecca

Metrics Matter: Lessons Learned from the ABS

What have I learned today? 1 Overview of Caterpillar University: Learning Organization Structure, Governance, Strategic Learning, Metrics and Evaluation

IIIT Hyderabad Diversity in Image Retrieval: Randomization and Learned Metrics P Vidyadhar Rao MS by…

Agile Metrics - Lessons Learned from my FitBitfiles.meetup.com/2974112/Agile Metrics - Lessons Learned from My Fitbit.pdf · Agile Metrics - Lessons Learned from my FitBit . Goodhart’s

Building for the User: Things Learned While Building Native Advertising Products

Metrics and Monitoring Infrastructure: Lessons Learned Building Metrics at LinkedIn

StartUp Metrics Lesson Learned - LeanCamp Barcelona

Fish Assemblage Metrics: Key Focal Species Physical Habitat Metrics Based On Life History Stage Associations and Population Dynamics; Responses of Native

FY2011 Naval Human Systems Integration … HSI processes through metrics, feedback, and lessons learned. These objectives will be used to categorize and track maturity metrics, challenges,

Lessons Learned while Exploring Cloud-Native Architectures ... · Lessons Learned while Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems Dan Pilone ([email protected])

Lessons Learned in Native and How to Avoid Making the Same Mistakes - WTF Native NYC, 11/3/15

Metrics for MMP Development and Operations Lessons Learned: The Sims Online Larry Mellon GDC, Spring 2004

Native Target Language Speaking Teachers’ Role and … · Native Target Language Speaking Teachers ... including teachers who had learned the target language as a foreign ... mainly

Assessing and reporting resilience of native vegetation using metrics of structure, composition and function

Lessons Learned, Benefits, and Strategies for Implementing ICM Adler... · Lessons Learned 1. Integration and Capability Maturity 2. Planning for ICM 3. Performance Metrics 4. Technology

  · Web viewSome Native Americans lived in longhouses. Native Americans learned to use horses. ... Task 4 - Key word definitions, description and comparisons. artillery. bayonet