findings from github. methods, datasets and limitations - msr 2016 at icse

19
Findings from GitHub. Methods, Datasets and Limitations Valerio Cosentino, Javier L. Cánovas Izquierdo, Jordi Cabot Flickr/BenNuttall

Upload: jordi-cabot

Post on 07-Jan-2017

353 views

Category:

Software


0 download

TRANSCRIPT

Page 1: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Findings from GitHub. Methods, Datasets and Limitations

Valerio Cosentino, Javier L. Cánovas Izquierdo, Jordi Cabot

Flickr/BenNuttall

Page 2: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Motivation

Page 3: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Motivation

Page 4: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Motivation

Empirical Methods Employed

Dataset Used

Limitations Reported

Methodology

Page 5: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Motivation

Empirical Methods Employed

Dataset Used

Limitations Reported

Methodology

Discussion

Page 6: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Methodology

Page 7: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Methodology

Title || Abstract || Keywords || IndexTerms INCLUDES

“GitHub” OR “Git hub” OR “github”

Page 8: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Results

Flickr/mararle

Page 9: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Empirical Methods Employed

Page 10: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Datasets Used

Page 11: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Datasets Used

Page 12: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Datasets Used

Page 13: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Limitations Reported

Page 14: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Limitations Reported

Page 15: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Discussion

Flickr/KristinaAlexanderson

Page 16: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Discussion

Data Collection

Dataset Size

Replicability

Sampling

Longitudinal Studies

Variety of methodologies

Page 17: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Discussion

Data Collection

Dataset Size

Replicability

Sampling

Longitudinal Studies

Variety of methodologies

Freshness vs. Curation

Small-medium size

> 2/3 not providing dataset access

Most use non-probaility sampling

Scarcely used

Replication? Comparisons?

Page 18: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Flickr/JimRaffertyExcept where otherwise noted, content on this site is licensed under a Creative Commons Attribution 4.0 International license.

Thanks!

http://tinyurl.com/GitHub-SystRev-Papers

Some works might have been ignored

Subjetivity issues

Page 19: Findings from GitHub. Methods, Datasets and Limitations - MSR 2016 at ICSE

Except where otherwise noted, content on this site is licensed under a Creative Commons Attribution 4.0 International license.

Discussion

Data Collection

Dataset Size

Replicability

Sampling

Longitudinal Studies

Variety of methodologies

Thanks!

http://tinyurl.com/GitHub-SystRev-Papers