Usability Testing

Meredith W. Zoetewey and Julie Staggers

Three basic stages of usability testing: Preparation for testing Testing Follow-up

Three Stages: Before the test, testers… Survey and/or interview participants

regarding their attitudes towards the task and their skill level (i.e., do audience analysis).

Determine evaluation criteria. (i.e. What are you testing for and why?)

Design the test. Ask yourselves: What sort of tasks does the

user/tester need to perform in order for you to determine whether the product/documentation meets/exceeds your criteria for success.

Example: Glaucoma Societies

http://www.globalaigs.org/ Who are our users? If we wanted to test this web page,

what criteria would we use to determine whether or not it is usable?

What kind of tests could we do with real users to determine whether or not the site meets our criteria for usability?

Three Stages: During the test, testers… Observe participants using a

document/product to accomplish the task.

Record specific problems that interrupted the participant’s process.

Record the amount of time it took the user to complete the task.

Assess participant’s relationship with the document/product.

three Stages: After the test, testers… Survey and/or interview participants.

Assess satisfaction with the document/product.

Determine what revisions might be necessary. Write up results.

Key players in a well-designed test Participants (multiple) Facilitator (one) Observer (one or more) Recorder (one or more)

The “active” players

Participants The people who perform the task.

Always test with multiple participants. May test individually or with groups.

Facilitator Plays the role of host to the participants.

Explains procedures and answers participants’ questions.

Puts participants at ease.

The “observing” participants

Observers and Recorders both observe participants as they perform defined tasks.

Observer Takes notes detailing trouble spots and successes. Makes note of aspects of the text/product that users find

problematic or particularly effective. Recorder

Records anything that’s measured quantitatively, (i.e. amount of time required for each task, how many times do participants become confused, or how many times they become frustrated.

Can also pay attention to participant’s non-verbal cues: count smiles, frowns, etc.