browserscope oscon 2011
TRANSCRIPT
![Page 1: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/1.jpg)
Use 10,000 Browsers - or -
How to Crowdsource, Archive and Share User Agent Data in the Open with Browserscope
OSCON 2011
![Page 2: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/2.jpg)
about:me
Lindsey SimonGoogle Front-End [email protected] / @elsighmon
● AdWords● App Engine● i18n● Closure library● Search● Google Translate● Google+
![Page 3: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/3.jpg)
![Page 4: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/4.jpg)
Your Development Test Environment
![Page 5: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/5.jpg)
Your Mobile Test Environment
![Page 6: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/6.jpg)
http://en.wikipedia.org/wiki/Usage_share_of_web_browsers
![Page 7: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/7.jpg)
understandingcapabilities and performance
![Page 8: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/8.jpg)
Multi-Prong Attack Strategy
![Page 9: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/9.jpg)
Browserscope
Open-source, community-driven project for profiling browsers.
Explicit Goals:● foster innovation by tracking functionality● push browser innovation, uncover regressions● historical resource for web developers
Born September 13th, 2009
![Page 10: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/10.jpg)
crowdsourcing the results
![Page 11: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/11.jpg)
crowdsourcing
● no dedicated test resources
![Page 12: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/12.jpg)
● no dedicated test resources● project runs in perpetuity
crowdsourcing
![Page 13: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/13.jpg)
crowdsourcing
● no dedicated test resources● project runs in perpetuity● real world test conditions
![Page 14: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/14.jpg)
crowdsourcing
● no dedicated test resources● project runs in perpetuity● real world test conditions ● aggregating results reduces bias
![Page 15: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/15.jpg)
crowdsourcing
● no dedicated test resources● project runs in perpetuity● real world test conditions ● aggregating results reduces bias ● new browsers show up immediately
![Page 16: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/16.jpg)
key characteristics
● more matrix than benchmark
![Page 17: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/17.jpg)
key characteristics
● more matrix than benchmark● reproducible tests and results (no video or control setup)
![Page 18: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/18.jpg)
key characteristics
● more matrix than benchmark● reproducible tests and results (no video or control setup)● gather & display historical data, trends
![Page 19: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/19.jpg)
anatomy of a browserscope test
1. create a web page that populates a JS object.2. login and "Add a test" on browserscope.3. add browserscope JS snippet(s) to your test page.4. get lots of users to hit your page
![Page 21: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/21.jpg)
Hosted Tests
![Page 22: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/22.jpg)
hosted test categoriesNetwork Performance
● Steve Souders' original UA Profiler tests● connections, caching, parallel downloads, etc...
Rich Text Edit Mode● Annie Sullivan, Roland Steiner, Ehsan Akhgari● i.e. cut and paste in browsers, w/ bold, italic, formatting
Acid3● Ian Hickson's tests, added by Jacob Moon● javascript, css, rendering
Selectors API Test Suite● John Resig's tests, added by Lindsey Simon● querySelectorAll DOM retrieval syntax
![Page 23: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/23.jpg)
hosted test categoriesSecurity
● Collin Jackson(CMU) & Adam Barth(Berkeley) & team● JSON, x-origin, XSS, sandbox, etc..
JSKB● Mike Samuel (Google Caja)● JavaScript compliance -> compilation● similar to Joe Hewitt's new hascan
![Page 24: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/24.jpg)
Network Results Timeline
browserscope.org/timeline?category=summary
![Page 25: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/25.jpg)
Acid3 Results Timeline
browserscope.org/timeline?category=acid3
![Page 26: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/26.jpg)
Summary Results Timeline
browserscope.org/timeline?category=summary
![Page 27: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/27.jpg)
User Tests
![Page 28: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/28.jpg)
Modernizr 2.0.4 Results Timeline
![Page 29: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/29.jpg)
HTML5 Ready - current desktop
modernizr2 results - browserscope.org/evolution?v=top-d
![Page 30: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/30.jpg)
HTML5 Ready - edge desktop
modernizr2 results - browserscope.org/evolution?v=top-d-e
![Page 31: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/31.jpg)
HTML5 Ready - mobile
modernizr2 results - browserscope.org/evolution?v=top-m
![Page 32: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/32.jpg)
under the hood
● App Engine● runtime median engine driven by task queues● memcache, lots of it● closure-library/compiler● gdata python lib + gviz table component● cross domain iframe posting● jQuery
![Page 33: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/33.jpg)
data points
● 2M tests run● 100M discrete data points● 1308 browsers (600K discrete user agent strings)● 54K User tests● 21GB of data● ~ 10QPS● High traffic integrations:
○ jsperf.com/popular○ www.modernizr.com
User Test demo: browserscope-test.appspot.com/Google UI demo: groupmenuselect.appspot.com/results
![Page 34: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/34.jpg)
roadmap
● code linting based on DOM property support● mobile / OS distinction● more data viz
links:browserscope.orgcode.google.com/p/browserscopegroups.google.com/group/browserscope
![Page 35: Browserscope oscon 2011](https://reader034.vdocuments.net/reader034/viewer/2022042512/5587d2b9d8b42aed208b45d9/html5/thumbnails/35.jpg)
Thank You Free Software!