quantitative analysis - home | computer sciencecseweb.ucsd.edu › classes › fa11 › cse118-a ›...
TRANSCRIPT
![Page 1: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/1.jpg)
Quantitative AnalysisCynthia Taylor, CSE 118, October 21 2011
![Page 2: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/2.jpg)
General Feedback
• Milestone Feedback
• Research vs Product
• What is a research contribution?
![Page 3: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/3.jpg)
Why are we giving you so much feedback on milestones?
![Page 4: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/4.jpg)
Why are we giving you so much feedback on milestones?
• We are jerks
![Page 5: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/5.jpg)
Why are we giving you so much feedback on milestones?
• We are jerks
![Page 6: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/6.jpg)
Why are we giving you so much feedback on milestones?
• We are jerks
• We want your projects to be awesome.
![Page 7: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/7.jpg)
Why are we giving you so much feedback on milestones?
• We are jerks
• We want your projects to be awesome.
• So that we can give you As.
![Page 8: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/8.jpg)
Research Vs Products
![Page 9: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/9.jpg)
Research Vs Products
• New
• Solves 1 Problem
• “Five Years Ahead”
• Not Perfect
• Doesn’t Need To Be Original
• Fits Current World/Tech
• Needs to be Bulletproof
![Page 10: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/10.jpg)
Research Vs Products
• Add New Idea to Academic Discourse
• Sell Things To People
![Page 11: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/11.jpg)
Research Contribution
33%
33%
33%
Technical SolutionUser Study/EvaluationDesign Space
![Page 12: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/12.jpg)
ZebraNet
5%15%
80%
Technical SolutionUser Study/EvaluationDesign Space
![Page 13: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/13.jpg)
Where Abouts Clock
15%
75%
10% Technical SolutionUser Study/EvaluationDesign Space
![Page 14: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/14.jpg)
Natural Sensing
40%
60%
Technical SolutionUser Study/EvaluationDesign Space
![Page 15: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/15.jpg)
Quantitative Analysis
• What is quantitative analysis?
![Page 16: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/16.jpg)
Quantitative Analysis
• What is quantitative analysis?
• Results where you measure something (with numbers!)
• Statistical analysis of those measurements
![Page 17: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/17.jpg)
Quantitative Analysis
• What are some good things to measure?
![Page 18: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/18.jpg)
Quantitative Analysis• What are some good things to measure?
• Time
• How long it takes something to run, how long a user interacts with something
• Number of Interactions
• Number of clicks, number of times a user performs an action
• Bandwidth, Throughput, etc . . .
• Numerical Ratings from User Studies
![Page 19: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/19.jpg)
Mean/Median
• Mean
• Median
![Page 20: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/20.jpg)
Mean/Median
• Mean
• For values {a1 . . . an}, (a1 + . . . + an)/n
• Median
• For (ordered) values {a1 . . . an}, an/2
![Page 21: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/21.jpg)
Standard Deviation
• Tells you how much variation there is in your data
![Page 22: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/22.jpg)
Standard Deviation
• For values {a1 . . . an}, with mean am
sqrt(((a1-am) + . . . + (an-am))/n)
![Page 23: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/23.jpg)
Standard Deviation
![Page 24: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/24.jpg)
Other Metrics
• Min/Max
• Explain outliers
• Probability Distribution of Data
• Normal, Power law, Binomial
• T-test
• Test for significance of results
![Page 25: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/25.jpg)
Show Trends
![Page 26: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/26.jpg)
Contextualize Your Results
• “It took 30 milliseconds to display a frame of video”
• “It took 30 milliseconds to display a frame of video, which is in keeping with current video rates of 30 frames per second”
• “It took 30 milliseconds to display a frame of video, in comparison to other current systems which take 50 milliseconds.”
![Page 27: Quantitative Analysis - Home | Computer Sciencecseweb.ucsd.edu › classes › fa11 › cse118-a › quantativeanalysis.pdf · 2011-10-21 · Quantitative Analysis • What are some](https://reader035.vdocuments.net/reader035/viewer/2022070804/5f03694e7e708231d4091414/html5/thumbnails/27.jpg)
Always Include
• Sample Size
• Standard Deviation/Variance
• How you performed the experiment