impact of installation counts on perceived quality: a case study on debian
TRANSCRIPT
![Page 1: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/1.jpg)
Impact of Installation Counts on Perceived Quality:
A Case Study on Debian
Israel Herraiz Emad ShihabThanh H.D. NguyenAhmed E. Hassan
![Page 2: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/2.jpg)
Intelligence throughout the lifetime of a software system
From inception to production
http://sail.cs.queensu.ca
![Page 3: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/3.jpg)
A Unique View ofSoftware Quality in the Large
Debian has an eco-system of 16,000 packagesThousands of involved developers
~500 reported bugs per month Installation and usage are tracked
![Page 4: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/4.jpg)
The Development Process of Debian
GCC CVS
Mozilla CVS Firefox Browser
ThunderbirdEmail
Upstream Package
GCC C Compiler
GCC CVSDebian BugDatabase
![Page 5: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/5.jpg)
Tracking Installations
Popularity: total install countsRecent Use (Recent 30 days)
Old Use (Beyond 30 days)
![Page 6: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/6.jpg)
Ultimate Debian Database (UDD)
Source Packages
mypkg libmypkg
mypkg
libmypkg-dev
mypkg-common
Type (Game, Dev, Editor)Priority (Essential , Optional)
Bugs (fixed, reported, forwarded)Reporter (email)
Binary Packages
![Page 7: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/7.jpg)
Sub-linear growth (X1/constant)
Log(installations)
Log(
Bugs
)
![Page 8: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/8.jpg)
More installations More Bugs
Log(installations)
Log(
Bugs
)
![Page 9: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/9.jpg)
Pattern holds for optional packages
Log(installations)
Log(
Bugs
)
![Page 10: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/10.jpg)
Essential packages
Log(installations)
Log(
Bugs
)
![Page 11: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/11.jpg)
Pattern holds for Fixed Bugs
Log(installations)
Log(
Fixe
d Bu
gs)
![Page 12: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/12.jpg)
Bugs increase with recent use
Recent Use
Log(
fixed
bug
s)
![Page 13: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/13.jpg)
Bug profiles differ between package types
Technical users Casual users
Software Development Games
![Page 14: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/14.jpg)
![Page 15: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/15.jpg)
“With many eyes, all bugs become shallow”Eric Raymond
![Page 16: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/16.jpg)
Bug Management OverheadVery low % of bugs are fixed for widely installed packages
Log(installations)
% o
f Fix
ed B
ugs
![Page 17: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/17.jpg)
Sub-linear growth (X1/constant)
Log(installations)
Log(
Bugs
)
![Page 18: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/18.jpg)
Is there a representative set of packages?
Log (installations)
Log(
Bugs
)
![Page 19: Impact of Installation Counts on Perceived Quality: A Case Study on Debian](https://reader035.vdocuments.net/reader035/viewer/2022062823/5878d7ba1a28ab917a8b66cd/html5/thumbnails/19.jpg)
Try this at home http://purl.org/net/who/iht/wcre2011