Download - Human testing iOS apps
© Mobtest 2013
Human Testing iOS apps
Dirk de [email protected]/dirkdk
Renaissance conferenceJan 23rd 2013
‣ works technically as intended
App quality
‣ offers considerable value
‣ intuitive and easy to use
Human testing
Manual QA testing
Concept testing
Usability testing
Beta testing
Live testing
{User testing
Test to create better apps
not just bug free apps
‣ if high quality, app might get featured
‣ initial ratings drive subsequent downloads
‣ reaching a top 25 normally happens
around launch
‣ critical updates take still 1-2 weeks
because of Apple review process
Test early, before launch
Concept testing
Goal
validate app idea with target market
How
‣ find respondents
‣ do interview with factual questions
‣ show mockup or prototype
Usability testing
Goal
test how easy it is to use your app
How
‣ in person
‣ remote
‣ meet testers in office or coffee shop
‣ give tasks with only end result
‣ let user think out loud
‣ observe usage, facial expression, posture
In person usability testing
‣ easier to remember
‣ easier to share with your team
can’t do it on iOS device itself
Record usability test
Via Skype DIY camera
‣ recruit larger group of users
‣ distribute ad hoc build
‣ give tasks with only end result
‣ track task completion in app and
ask questions afterwards by survey
Remote usability testing
‣ does it work as user expects?
‣ discoverability
‣ areas of confusion
‣ positive experience
What to look for
Goals
‣ final feedback from users
‣ integration test with real data
‣ get early adopters enthusiastic about
app (reviews and ratings!)
Beta testing
How
‣ Recruit testers via own network or service
‣ Get their UDID, create ad hoc build and
distribute
‣ Reward feedback
Beta testing
QA testing
Goals
‣ make sure app works technically fine
QA testing
How
‣ get a good test engineer
‣ write a detailed plan
‣ execute plan
QA methods
‣ structured testing with predefined test
scripts with expected outcomes
‣ “go break it” exploratory testing
What to look for
‣ Hardware models x iOS versions
‣ Connectivity (wifi, cell, intermittent)
‣ Gestures, moves, tilting and multitouch
‣ Location/geofencing
Live testing
‣ A/B testing
‣ Monitoring usage patterns
‣ Crash log analysis
‣ Feedback options for user
http://github.com/mobtest/
Thank you
