browserscope oscon 2011

Download Browserscope oscon 2011

Post on 22-Jun-2015

1.681 views

Category:

Technology

4 download

Embed Size (px)

TRANSCRIPT

  • 1. Use 10,000 Browsers- or -How to Crowdsource, Archive and Share User Agent Data in the Open with BrowserscopeOSCON 2011

2. about:meLindsey SimonGoogle Front-End Developerelsigh@gmail.com / @elsighmon AdWords App Engine i18n Closure library Search Google Translate Google+ 3. Your Development Test Environment 4. Your Mobile Test Environment 5. http://en.wikipedia.org/wiki/Usage_share_of_web_browsers 6. understandingcapabilities and performance 7. Multi-Prong Attack Strategy 8. BrowserscopeOpen-source, community-driven project for profiling browsers.Explicit Goals: foster innovation by tracking functionality push browser innovation, uncover regressions historical resource for web developersBorn September 13th, 2009 9. crowdsourcing the results 10. crowdsourcing no dedicated test resources 11. crowdsourcing no dedicated test resources project runs in perpetuity 12. crowdsourcing no dedicated test resources project runs in perpetuity real world test conditions 13. crowdsourcing no dedicated test resources project runs in perpetuity real world test conditions aggregating results reduces bias 14. crowdsourcing no dedicated test resources project runs in perpetuity real world test conditions aggregating results reduces bias new browsers show up immediately 15. key characteristics more matrix than benchmark 16. key characteristics more matrix than benchmark reproducible tests and results (no video or control setup) 17. key characteristics more matrix than benchmark reproducible tests and results (no video or control setup) gather & display historical data, trends 18. anatomy of a browserscope test1. create a web page that populates a JS object.2. login and "Add a test" on browserscope.3. add browserscope JS snippet(s) to your test page.4. get lots of users to hit your page 19. DEMO!http://goo.gl/LGRqA 20. Hosted Tests 21. hosted test categoriesNetwork Performance Steve Souders original UA Profiler tests connections, caching, parallel downloads, etc...Rich Text Edit Mode Annie Sullivan, Roland Steiner, Ehsan Akhgari i.e. cut and paste in browsers, w/ bold, italic, formattingAcid3 Ian Hicksons tests, added by Jacob Moon javascript, css, renderingSelectors API Test Suite John Resigs tests, added by Lindsey Simon querySelectorAll DOM retrieval syntax 22. hosted test categoriesSecurity Collin Jackson(CMU) & Adam Barth(Berkeley) & team JSON, x-origin, XSS, sandbox, etc..JSKB Mike Samuel (Google Caja) JavaScript compliance -> compilation similar to Joe Hewitts new hascan 23. Network Results Timelinebrowserscope.org/timeline?category=summary 24. Acid3 Results Timelinebrowserscope.org/timeline?category=acid3 25. Summary Results Timelinebrowserscope.org/timeline?category=summary 26. User Tests 27. Modernizr 2.0.4 Results Timeline 28. HTML5 Ready - current desktopmodernizr2 results - browserscope.org/evolution?v=top-d 29. HTML5 Ready - edge desktopmodernizr2 results - browserscope.org/evolution?v=top-d-e 30. HTML5 Ready - mobilemodernizr2 results - browserscope.org/evolution?v=top-m 31. under the hood App Engine runtime median engine driven by task queues memcache, lots of it closure-library/compiler gdata python lib + gviz table component cross domain iframe posting jQuery 32. data points 2M tests run 100M discrete data points 1308 browsers (600K discrete user agent strings) 54K User tests 21GB of data ~ 10QPS High traffic integrations: jsperf.com/popular www.modernizr.comUser Test demo: browserscope-test.appspot.com/Google UI demo: groupmenuselect.appspot.com/results 33. roadmap code linting based on DOM property support mobile / OS distinction more data vizlinks:browserscope.orgcode.google.com/p/browserscopegroups.google.com/group/browserscope 34. Thank You Free Software!