how significant is the effect of faults interaction on coverage based fault localizations? xiaozhen...
TRANSCRIPT
![Page 1: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/1.jpg)
How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations?
Xiaozhen XueAdvanced Empirical Software Testing GroupDepartment of Computer Science Texas Tech University
10.1.2013
![Page 2: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/2.jpg)
Outline
•Introduction
•Research Questions
•Experimental procedure
•Data analysis
•Discussion
•Conclusion
![Page 3: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/3.jpg)
Introduction
•Software testing is an important process in software life cycle.
•Fault localization is a major activity in software testing.
•Fault localization is time consuming and expensive.
![Page 4: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/4.jpg)
Introduction
•Coverage based fault localization
![Page 5: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/5.jpg)
Introduction
•example
![Page 6: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/6.jpg)
Introduction
•Coverage based fault localization techniques is effect when single fault in presence.
•It is a common belief that the coverage based fault localization techniques are less effective in the presence of multiple faults.
![Page 7: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/7.jpg)
Introduction
•Motivation:
Empirically investigate the effectiveness of Coverage Based Faults Localization when multiple faults exist in the program.
![Page 8: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/8.jpg)
Research Questions
•RQ1: How prevalent is the fault interferences phenomenon in the object-oriented programming languages such as Java?
•RQ2: How significant is the influence of fault interactions on debugging cost?
•RQ3: Do the frequencies of fault interferences vary for different ranking metrics?
•RQ4: How different is the frequency of observing fault interference instances for various number of faults?
•RQ5: How different is the frequency of observing fault interference instances for various type of faults?
![Page 9: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/9.jpg)
Experimental procedure
•Subjects programs
![Page 10: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/10.jpg)
Experimental procedure
•Multiple faults
![Page 11: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/11.jpg)
Experimental procedure
•metrics
![Page 12: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/12.jpg)
Experimental procedure
•Metrics proposed in our previous work
![Page 13: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/13.jpg)
Data Analysis
•Data visualization
![Page 14: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/14.jpg)
Data Analysis
•The significance of faults interactions
![Page 15: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/15.jpg)
Data Analysis
•The significance of faults interactions
![Page 16: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/16.jpg)
Data Analysis
•The significance of faults interactions
![Page 17: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/17.jpg)
Data Analysis
•The significance of faults interactions
![Page 18: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/18.jpg)
Discussion
•The prevalence of faults interference
![Page 19: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/19.jpg)
Discussion
•The prevalence of faults interference
![Page 20: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/20.jpg)
Data Analysis
•The roles of ranking metrics
![Page 21: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/21.jpg)
Conclusion
•The coverage-based fault localization techniques are still effective in localizing faults in the presence of multiple faults.
•The effect of fault interactions on debugging cost is negligible and statistically insignificant.
•The frequency of observing fault interference instances differ for various ranking metrics.
![Page 22: How Significant Is the Effect of Faults Interaction on Coverage Based Fault Localizations? Xiaozhen Xue Advanced Empirical Software Testing Group Department](https://reader037.vdocuments.net/reader037/viewer/2022110402/56649e2f5503460f94b200e6/html5/thumbnails/22.jpg)
Thank you!!