holistic software assessment at the university of zurich
DESCRIPTION
I used this set of slides to argue for the creation of a new domain around software assessment.TRANSCRIPT
![Page 2: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/2.jpg)
assessment is the process of understanding a given situationto support decision making
![Page 3: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/3.jpg)
hypothesize applyanalysis
interpretconfident?
act
![Page 4: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/4.jpg)
development
![Page 5: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/5.jpg)
Basili - 1997, Ko etal - 2005
assessmentdevelopment
![Page 6: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/6.jpg)
![Page 7: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/7.jpg)
![Page 8: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/8.jpg)
assessmentdevelopment
![Page 9: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/9.jpg)
holisticsoftwareassessment
![Page 10: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/10.jpg)
explicit
holisticsoftwareassessment
![Page 11: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/11.jpg)
integrated
explicit
holisticsoftwareassessment
![Page 12: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/12.jpg)
integrated
explicit
tailored
holisticsoftwareassessment
![Page 13: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/13.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
![Page 14: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/14.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
![Page 15: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/15.jpg)
forward engineering
}
{
}
{
}
{
}
{
![Page 16: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/16.jpg)
forward engineering
actual development}
{
}
{
}
{
}
{}
{
}
{
}
{}
{
}
{
![Page 17: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/17.jpg)
Chikofsky Cross - 1990
forward engineering
actual development}
{
}
{
}
{
}
{}
{
}
{
}
{}
{
}
{
reve
rse
engi
neer
ing
![Page 18: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/18.jpg)
}
{
}
{
}
{}
{
}
{
reve
rse
eng
inee
ring
![Page 19: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/19.jpg)
}
{
}
{
}
{}
{
}
{
reve
rse
eng
inee
ring
![Page 20: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/20.jpg)
}
{
}
{
}
{}
{
}
{
reve
rse
eng
inee
ring
assessment
![Page 21: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/21.jpg)
![Page 22: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/22.jpg)
tailoredmanual automatic
generic
![Page 23: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/23.jpg)
tailoredmanual automatic
generic
![Page 24: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/24.jpg)
tailoredmanual automatic
generic
![Page 25: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/25.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
![Page 26: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/26.jpg)
hypothesize applyanalysis
interpretconfident?
act
![Page 27: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/27.jpg)
hypothesizeexistinganalysis?
applyanalysis
interpretconfident?
act
![Page 28: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/28.jpg)
hypothesizeexistinganalysis?
craftanalysis
applyanalysis
interpretconfident?
act
![Page 29: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/29.jpg)
hypothesizeexistinganalysis?
craftanalysis
applyanalysis
interpretconfident?
act
![Page 30: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/30.jpg)
12 L. Renggli, S. Ducasse, T. Gı̂rba, O. Nierstrasz
1
2
3
4
Lint
Slime
14 000
16 000
18 000
LOC
Seaside2.6
Seaside2.7
Seaside2.8
Seaside2.8.1
Seaside2.8.2
Seaside2.8.3
Seaside2.9a1
Seaside2.9a2
Seaside2.9a3
Fig. 4. Average number of Lint and Slime issues per class (above) and lines ofcode (below) in released Seaside versions.
guiding development by the Slime rules significantly improved the quality of thedomain-specific code. This particular period shows the value in domain-specificprogram checking. While the Seaside code base grew significantly, the number ofSlime rules could be reduced to almost zero.
Feedback we got from early adopters of Seaside 2.9 confirms that the quality ofthe code is notably better. Especially the portability between different Smalltalkdialects has improved. The code typically compiles and passes the tests on allplatforms even-though it comes from the shared code repository.
An interesting observation is that even if the Slime smells are reduced andthe quality of the code improves, the standard Lint rules continue to report arather constant proportion of problems. This is due to the fact that the genericLint rules address the wrong level and produce too many false positives.
We further evaluated the number of false positives of the remaining openissues in the last analyzed version of Seaside by manually verifying the reportedissues: this is 67% (940 false positives out of 1403 issues reported) in the case ofLint, and 24% (12 false positives out of 51 issues reported) in the case of Slime.This demonstrates, that applying dedicated rules provides a better report on thequality of the software than when using the generic rules.
Due to the dynamic nature of Smalltalk and its lack of static type informationit seems to be hard to further improve the quality of Slime rules. We howeverdo see potential in future work to reduce the number of false positives by usingstatic [PMW09] and dynamic [DGN07] type analysis.
2.6 2.7 2.8 2.8.1 2.8.2 2.8.3 2.9.1 2.9.2 2.9.3
1
2
3
4
14’000
16’000
18’000
lines of code
dedicated detection
generic detection
Renggli Ducasse Girba Nierstrasz - TOOLS 2010
![Page 31: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/31.jpg)
Girba - case study - 2010
![Page 32: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/32.jpg)
hypothesizeexistinganalysis?
craftanalysis
applyanalysis
interpretconfident?
act
![Page 33: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/33.jpg)
Girba - case study 2011
![Page 34: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/34.jpg)
Girba - case study 2011
![Page 35: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/35.jpg)
hypothesizeexistinganalysis?
craftanalysis
applyanalysis
interpretconfident?
act
![Page 36: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/36.jpg)
Girba - case study 2010
![Page 37: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/37.jpg)
Girba - case study 2010
![Page 38: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/38.jpg)
Girba - case study 2010
![Page 39: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/39.jpg)
hypothesizeexistinganalysis?
craftanalysis
applyanalysis
interpretconfident?
act
![Page 40: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/40.jpg)
![Page 41: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/41.jpg)
Meyer Girba Lungu - Softvis 2006
view shape rectangle width: #numberOfX; height: #numberOfY.view nodes: modules.view edges: modules fromAll: #dependencies
to: #yourself.view dominanceLayout.
![Page 42: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/42.jpg)
![Page 43: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/43.jpg)
Girba Bunge etal - work in progress
![Page 44: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/44.jpg)
![Page 45: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/45.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
![Page 46: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/46.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
![Page 47: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/47.jpg)
![Page 48: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/48.jpg)
Kuhn Girba Ducasse - WCRE 2005
![Page 49: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/49.jpg)
Kuhn Ducasse Girba - IST 2007
data collection
data mining
clustering visualization
![Page 50: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/50.jpg)
Kuhn Ducasse Girba - IST 2007
data collection
data mining
clustering visualization
visualization
![Page 51: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/51.jpg)
Lungu Lanza Girba Heeck - WCRE 2007
![Page 52: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/52.jpg)
![Page 53: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/53.jpg)
integrated
explicit
reshaped
tailored
holisticsoftwareassessment
www.tudorgirba.com
![Page 54: Holistic software assessment at the University of Zurich](https://reader033.vdocuments.net/reader033/viewer/2022042814/554f4023b4c90572088b5270/html5/thumbnails/54.jpg)
Tudor Gîrbawww.tudorgirba.com
creativecommons.org/licenses/by/3.0/