jonathan elkin - tackling mobile web testing: overcoming challenges, with scrum
TRANSCRIPT
Tackling Mobile Web Testing: Overcoming challenges, with ScrumJono ElkinTrade Me Ltd
Your pic
Topics to discuss
Context
The significance of the Mobile Web and it’s testing challenges
How Scrum has helped
Practical tips
Who am I?
At Work
Senior Test Analyst
Mobile Web Tester
Test Chapter Lead
ScrumMaster/Coach
Outside of work
> 3.4 million live accounts
Around 2.5 million live listingsAn item is sold every 2.5 seconds
More than 1 million people have bought or sold on TM in the past year
> 700k unique visits per day New Zealand’s most visited domestic site
3rd most visited site overall
Trade Me accounts for ~70% of domestic web traffic (as measured by Nielsen)
www.trademe.co.nz
http://touch.trademe.co.nz
Working at Trade Me
High Profile
Our Culture
How we work
9 deploys a week
Formed into 20 self-organising teams (‘Squads’)
Various forms of Agile being used
Testing at Trade MeAll ‘normal’ testing activity + Run deploys and deploy related comms Maintain business rules Liaise directly with all areas of the business Run demos
All the above + No BA 2 product owners covering 6 squads ScrumMaster
Mobile Web Testing at Trade Me
Testing the Mobile Web
The Mobile Web Matters% of Trade Me sessions from mobile devices
The Mobile Web MattersInteraction breakdown between Trade Me
Mobile platforms - July 2014
Challenges for Testing
ChallengesOperating Systems and Browsers
Responsive designChallenges
Devices and UpdatesChallenges
Working against a constantly evolving API
Changing the API may not break the API, but it may break those who are consuming that API!
Challenges
How Scrum has helped
Stand ups
Estimation/Grooming
Retrospectives
EventsHow Scrum has helped
How Scrum has helped
Identify who you impact Identify who impacts you Build relationships Constant informal communication
Neighbours
Automation
To maintain high velocity, we need automated regression
How did we get it in?Collaborative nature of Scrum
Collective voiceHelped each other
Create stories and undertook a maintenance sprintGround rulesDefinition of Done
How Scrum has helped
Everyone helps
Ownership & Pride
Self-OrganisationHow Scrum has helped
Self-ImprovementHow Scrum has helped
Collectively: Feel the pain Identify problem Agree on best way to avoid it happening again
Self-ImprovementHow Scrum has helped
Automation
Self-ImprovementHow Scrum has helped
Self-ImprovementHow Scrum has helped
Ground Rules
Scrum events
The neighbours concept
Focus on Automation
Ownership Self-organising teams
Recap: How Scrum has helped overcome Mobile Web Testing Challenges
General Mobile Web Testing Advice
Some other testing advice Standards = Limited Scope STATS (help to justify decisions and reduce effort)
Desktop first
Operating System Version PercentageAndroid 4 (combined) 47.2%
iOS 7 (combined) 35.6%Android 2 (combined) 6.2%
iOS 6 (combined) 4.8%iOS 7.1.2 15.60%
Android 4.4.2 11.35%Android 4.1.2 11.05%
iOS 7.1.1 10.34%Android 4.2.2 9.48%Android 4.3 9.27%Android 2.3.6 3.66%
iOS 7.0.4 3.15%Android 4.1.1 3.13%
Windows Phone (not set) 3.07%
Jan 14. Our 3rd most used OS
Summary
Scrum can help: Scrum events The neighbours concept Focus on Automation Ownership and self-organising teams
Be pragmatic: Agree on stats based standards Test desktop first
The Mobile Web is a BIG deal and testing it is Complex Browsers Devices diversity Consuming an evolving API
No Operating System uniformity Responsive Design Updates
