user testing by alvin chai

User Testing

Alvin Chai, Speaker UX Indonesia – Malaysia 2014, 26th April 2014

Copyright © 2014 Netizen Testing Sdn. Bhd. All rights reserved. All other trademarks, logos and copyrights are the property of their respective owners. 2

Topics To Be Covered Today 1. Introduction 2. Ways of Doing User Testing 3. Case Studies 4. When to Test 5. Demo


Introduction

• What is user testing?

source:static.pb.pl/picture/40479,40918/f663x450

Introduction

• A method by which users are asked to perform certain tasks in an effort to measure the product’s user friendliness, task time, and how user feel about the usage experience.

• Think Aloud!


User Testing For The Digital World

Test websites/apps to find usability issues (where users are confused, why they are leaving)

UX Myth

“YOU know a lot about your service & website, you are passionate about it.”

“Your USER doesn’t necessarily care.”

YOU are NOT your USER no matter how good you think you are


2 Ways of Doing Usability Testing


(i) In Person Testing

2 Ways of Usability Testing

(ii) Online User Testing


1. Set up test questions

2. Look for participants

3. Arrange time to come in and availability of user and facilitator

4. Wait for everyone to finish

5. Collect test results

6. Analyse test results

7. Reporting

(i) In Person Testing Cycle

3-4 weeks

(ii) Online Usability Testing


An Online Testing Cycle

1. Test Instruction

2. Testing with Users

3. Research & Analysis

6-7 days


Faster & Lower Cost & Natural

Online Tester Matching

Customers

Internet + Software

You

T T T

T T

Online Usability Testing Software

T T

T T

Example of Online Usability Testing


Converting All User Experience Into Useful Marketing Data


Education E-commerce Web Portal Entertainment

Some Of The Companies That We Help To Do Online User Testing


Quality Assurance

Evidence Based

Understanding Users

Empowerment

Increase Loyalty

Value of user testing

Difference Between Testing Methods?

Quantitative Qualitative Google Analytics, Heat map, A/B Testing

User Testing (UX Testing)

Quantitative method tells you how many people come to the website, how many leave, how much time they stay on your website etc.

Qualitative method tells you why people are leaving and the reasons why users behave in a particular way. Both Quantitative and Qualitative methods are complementary to each other. You will need both methods to have a better understanding of your user’s behavior.


Case Studies: User Testing Conducted Using Online Software


Case Study 1

Car Maker Websites Review 2013

Industrial Review

85 user testing sessions

1 month


Service Centre & Sales Outlet

Before

After

Using The Right Colours For Easy Reading

Before

No Map for Sales & Service Outlets

No Map for Sales & Service Outlets

After

Under The Sea Showroom


Case Study 2

Singapore National Day Rally 2013

Website


Which Design is the Best Based On User Testing?

The Winning Design

120% more engaging


Case Study 3

Mobile Apps Experience Testing The button design is not immediately obvious to the user as a ‘bookmark’ function.


Quality Assurance

Evidence Based

Understanding Users

Empowerment

Increase Loyalty

Value of user testing


When to Test?


What Stages To Do User Research & Testing?

1. Research & Planning

2. Low-fi & High-fi Designs

3. Prototype

4. Development

5. Staging 6. Pre Launch

7. Post Launch & Monitoring

Continuous Improvement


Testing on Competitors

User testing helps you benchmark your website and other competitor websites.


Prototype User Testing

User testing helps you to learn about any critical issues with your user journey early on.


1. If you want a great product, you have got to test.

2. Testing is a repeating process. 3. Testing with 1 user is better than none. 4. Testing with 1 user is better than testing

with 100 users near the end. 5. Testing insights will allow you to make

informed decision.

Facts to Remember

How to plan test instruction?

1. Task oriented

How to plan test instruction?

2. Non-leading questions Non-leading: Try to buy plane tickets for your family vacation. Leading: Press the red button and then click the 1st top left button with a airplane icon…

How Many Testers Do You Need?

Source:media.nngroup.com/media/editor/alertbox/20000319-user-testing-diminshing-returns-curve.gif


Live Demo Any volunteer? It will be fun!

Being a Tester

1. Think Aloud

2. Say the Truth

3. It not testing your IQ

4. Give Suggestion

5. Say What You Like / Don’t Like

Moderator’s Role

1. Tour guide

2. Interrupt only when necessary

3. Don’t answer questions for tester

4. Ask questions starting with “What” or

“How” if tester becomes quiet

Winner of People’s Choice Award of Global Innovation through Science & Technology by the U.S. Department of State

Media Coverage

Online User Testing Software

Terima Kasih

Email & LinkedIn: [email protected]