usability testing basics: what's it all about? at web sig cleveland
DESCRIPTION
Presented to Web SIG Cleveland on May 21, 2011 at Notre Dame College in South Euclid (Cleveland), Ohio.Learn all you need to get started:- Where you can conduct studies (does it have to be in a lab?)- Types of studies (RITE, think aloud, etc.)- Tips for recruiting participants- Tips for Interacting with participants without biasing the study- Preparing for the study (materials needed, forms, etc.)- Guidance for analyzing the studyTRANSCRIPT
![Page 1: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/1.jpg)
Usability Testing Basics: What's it All About?
Web SIG ClevelandMay 21, 2011
![Page 2: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/2.jpg)
Talking About Today
#WebSigCLE
@carologic@sos_jr
![Page 3: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/3.jpg)
Agenda
• What is Usability?• Why we test usability• Planning studies• Facilitating sessions• Analyzing data
![Page 4: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/4.jpg)
What is Usability?
![Page 5: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/5.jpg)
Usability is an important characteristic
of what makes a good User Experience
![Page 6: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/6.jpg)
Functional Aspects
• Effective• Efficient• Learnable
![Page 7: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/7.jpg)
User’s Perspective
• Useful experience• Feel in control and supported• Supplements and enhances skills and
expertise• Satisfied Delighted
![Page 8: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/8.jpg)
Usability Testing
• Measures users ability to achieve specific goals of effectiveness, efficiency, and satisfaction.
![Page 9: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/9.jpg)
What is it?
• Real Users doing real tasks• Being observed• Using prototypes or live products
![Page 10: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/10.jpg)
Can Test…
•Websites, Mobile, Blenders, Airport service
•Simulations or mockups•Early prototypes (paper, low-fi)•Production prototypes (html, hi-fi)•Help documentation•Processes (receipt of materials, purchase)
![Page 11: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/11.jpg)
It is not…
• Quality testing• Full accessibility testing• System testing• Acceptance testing
![Page 12: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/12.jpg)
Do I need a lab?
Rubin, Jeffrey. Handbook of Usability Testing. John Wiley & Sons, Inc.; 1994.
Computer / Concept
Facilitator
Participant
Observer
Timer Logger
![Page 13: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/13.jpg)
Just Do It!
• Anywhere (conference room, remotely)• Any Stage (earlier in process the better)• Anytime (un-moderated)• Realistic test environment
Photo by Roebot at http://www.flickr.com/photos/roebot/2964156413/
![Page 14: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/14.jpg)
Why we test Usability
![Page 15: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/15.jpg)
"The biggest waste of all is building something no one wants"
- @ericries #LeanStartupMI via @MelBugai
![Page 16: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/16.jpg)
You are not the user
• Designing for someone else– Need to step back - may miss details– May be perfect for you, but not the user
• Honest feedback from users– Validate understanding of tasks and context– Unforeseen requirements
![Page 17: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/17.jpg)
Rationale
• Goals being met• Content & purpose clear• Match expectations• Verify product meets customer needs• Gather information for future product
development • Comparison testing
![Page 18: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/18.jpg)
Save Time & Money
• Up front by testing prototypes• Reduce maintenance issues• Reduce Customer Service requests
![Page 19: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/19.jpg)
Minimize Human Cost
• Tiredness• Discomfort• Embarrassment• Frustration• Effort
![Page 20: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/20.jpg)
Find Design Problems
• System status available• Wording choices clear• Placement of content • Consistency• Recognition, Not Recall
![Page 21: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/21.jpg)
Benefits of Good UX
• Increased Usefulness• Increased Efficiency ($$$) • Improved Productivity
![Page 22: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/22.jpg)
Benefits (continued)
• Fewer Errors• Reduced Training Time• Improved Acceptance
Happy Users!
![Page 23: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/23.jpg)
Planning studies
![Page 24: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/24.jpg)
Define Goals
• Specific• Measurable– Qualitative– Quantitative
• What you need to learn about the product and its audience
![Page 25: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/25.jpg)
Scope Effort
• Consider budget, resources• Time– Recruiting– Facilitating– Analyzing
• Adding participants increases budget & time
![Page 26: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/26.jpg)
Design the Test
• Select Methodology• Based on goals• Identify participants • Tasks to be completed• Team roles
![Page 27: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/27.jpg)
Types of Usability Tests
• Single participant• Co-discovery (two)• Group usability testing (3 or more)• Rapid iterative testing
![Page 28: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/28.jpg)
Facilitation Styles
• Talk aloud/Think aloud• Task focused (limited/no discussion)• Cooperative usability testing• Video review with participant after study
(Retrospective)
![Page 29: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/29.jpg)
Location
• Formal Lab• On-site– Workplace, conference room– In home– At a conference
• Remote – Moderated– Un-moderated
![Page 30: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/30.jpg)
Test Roles
• Facilitator• Participant• “Computer” (paper prototypes)• Note taker / data logger / timer• Software, recording operator• Product / Technical Expert(s)• Observers
![Page 31: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/31.jpg)
Use A Script/Guide
• Memory tool for facilitator• Promote consistency– Questions– Order of questions
•List out scenarios representative of typical tasks
![Page 32: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/32.jpg)
Test Guide Includes
• Welcome to participants• Steps in study(forms, tasks, questions)• Notes to yourself • Reset/configuration prompts• Thank you to participants (incentives if any)
![Page 33: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/33.jpg)
Participant Materials
• Provide with – Usernames– Passwords– Text for forms– Images to upload, etc.
• Tasks in writing if complex (3x5 cards)
![Page 34: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/34.jpg)
Task BuildingTask Component DescriptionTask Load paper into copier
Machine State Copier with four labels attached and an empty cassette tray
Successful Completion Criteria
Test subject loads paper into cassette after first fanning the stack of paper
Benchmark Loads correctly within one minute
Rubin, Jeffrey. Handbook of Usability Testing. John Wiley & Sons, Inc.; 1994.
![Page 35: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/35.jpg)
Questions
• Quality of questions correlates to quality of answers:– Don’t lead or make assumptions– Use participant’s words
![Page 36: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/36.jpg)
Stretch & Exercise
36
![Page 37: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/37.jpg)
Question 1
• Do you regularly book your travel online to save money?
![Page 38: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/38.jpg)
Alternates – Question 1
• How often do you travel? – <listen>
• What proportion of that do you book online? – <listen>
• Why do you book travel online? – <listen>
![Page 39: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/39.jpg)
Rationale - Question 1
• Do you regularly book your travel online to save money?
• Address one issue at a time and avoid double-barreled questions.
![Page 40: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/40.jpg)
Question 2
• What are your thoughts about a new feature that allows you to instant message a travel agent with any questions as you book your travel?
![Page 41: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/41.jpg)
Alternates – Question 2
• Would you like to correspond with a travel agent while you are booking travel? – <listen>
• What are some ways that you would like to correspond with a travel agent while you are booking travel? – <listen>
![Page 42: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/42.jpg)
Rationale – Question 2
• What are your thoughts about a new feature that allows you to instant message a travel agent with any questions as you book your travel?
• This question asked the participant to predict the future.
![Page 43: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/43.jpg)
Schedule & Recruit
• Schedule location for pilot and study– Leave time between sessions– Sessions no longer than 2 hours
• Invite Observers (key stakeholders, project managers, etc.)
![Page 44: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/44.jpg)
Pilot Study – Find Problems
• Verify – Tasks are typical– Concept is on-track– Time needed to complete
• Practice before going live with participants• New ideas for follow-on questions or things
to observe• Refine script and tasks
![Page 45: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/45.jpg)
How Do I Find Participants?
![Page 46: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/46.jpg)
Create a Screener
• List of questions to determines who will participate• Describe, then get details:– Computer activities– Use of product/service
• People who pass screener = user group
![Page 47: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/47.jpg)
Which Student?Rick Connie
http://www.flickr.com/photos/mrjkbh/ via http://creativecommons.org/licenses/by-nc-nd/2.0/deed.en http://www.flickr.com/photos/caharley72/ (Christopher Alison Photography) via http://creativecommons.org/licenses/by-nc-nd/2.0/
![Page 48: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/48.jpg)
Representative Users
• Two weeks on average to recruit• Primary user population• People with disabilities– “We are all only temporarily able-bodied.
Accessibility is good for us all.” – Get to spirit of the law (Section 508, WCAG 2.0)
-@mollydotcom at #stirtrek 2011 via @carologic
![Page 49: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/49.jpg)
Hire a Recruiter
• Allows you to focus on activity.• Can tell if person will be a good participant.• May already have a list they can start with.
• Good recruiters:– find right participants.– give regular updates.– take care of directions, confirmations, incentives,
etc.
![Page 50: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/50.jpg)
If You Must Do it Yourself...
• Go where users go and intercept– Online user groups– Professional organizations– Craigslist
• Online tools thru your site:http://ethnio.com
![Page 51: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/51.jpg)
Final Recruiting
• Final recruit by phone.– Ask questions that force them to talk.– Don’t recruit non-talkers.– Confirm participant eligibility
• Note unusual issues• Recruit for pilot test
![Page 52: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/52.jpg)
Number of Participants
• As many as possible (rarely statistically significant)• Usability Testing Research (in 1990’s)– 5 from distinct sub-group of the user population will
yield 80% of the findings (Nielsen, Virzi, Lewis)– Assumes expert has reviewed concept for obvious issues
• Recommend: – Early tests with 8 – 12 users per user group– Iterative testing (3 per day, iterate, 3 new users)
Barnum, Carol M. (Jan. 2003). What’s in a Number? STC Usability SIG Newsletter, Usability Interface. http://www.stcsig.org/usability/newsletter/0301-number.html Retrieved: 20080323
![Page 53: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/53.jpg)
Honorarium
• Pay them or give product credits• Amount varies by:– Amount of time needed– Their role (doctors need more to persuade them)– Their interest, devotion to product
![Page 54: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/54.jpg)
Facilitating sessions
![Page 55: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/55.jpg)
Welcome & Prepare
• Offer beverage• Express appreciation for help• Explain purpose of research• Sign paperwork– Consent Form– Non-Disclosure Agreement(s)
![Page 56: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/56.jpg)
Participant Reassurance
• Make sure they are comfortable• Not testing them, rather testing…• Encourage feedback (positive and negative)• “I was not involved in the design of this so you can’t hurt
my feelings”
![Page 57: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/57.jpg)
During Session
• Remain passive (body, face) • Don’t confirm or reject answers• Use participant’s words• Listen for vocalizations • Watch non-verbal gestures– Encourage participant to elaborate
• Ask your question and let them talk
![Page 58: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/58.jpg)
Silence is
Golden
User’s Time to Think!
58
![Page 59: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/59.jpg)
Get Them Unstuck
• Progressively give assistance–What are you trying to do right now?–What do you think the next step is?–What would you do in this situation if you were at work?
• Hints–Do you see anything that might help you? (small hint)–Have you checked the Help? (medium hint)–What do you think the xxx button does? (large hint)
![Page 60: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/60.jpg)
Debrief Participant
• Post-Study questionnaire• Thank for participation• Explain honorarium and delivery
![Page 61: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/61.jpg)
Analyzing data
![Page 62: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/62.jpg)
Look for Patterns
• Identify repetition
• Continuation of study – Adds cost – Delays reporting– Low probability of many new findings
![Page 63: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/63.jpg)
Measurements
• Success• Time on task• % of tasks completed/not completed• Number of steps to accomplish task• Learning time• Number of errors• Number of times help consulted• Satisfaction
![Page 64: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/64.jpg)
Transform Data
• Create Findings and Recommendations• High level or detailed report– Think about audience– How will it be used?
![Page 65: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/65.jpg)
Reporting Includes
• Executive summary• Positive findings• Provide solutions for negative findings• Provide level of effort and prioritize• Examples, screen shots• Quotes• Appendix with questionnaires, test materials
![Page 66: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/66.jpg)
Do UX Early & Often
• Put it on the Wall as information radiators– Test findings– Artifacts– Competitor info
![Page 67: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/67.jpg)
Recommended Readings
67
![Page 69: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/69.jpg)
References• Cato, John. User-Centered Web Design. Addison Wesley Longman; 2001. • Hackos, JoAnn T., PhD and Redish, Janice C. User and Task Analysis for Interface
Design. Wiley; 1998. • Henry, S.L. and Martinson, M. Evaluating for Accessibility, Usability Testing in
Diverse Situations. Tutorial, 2003 UPA Conference. (Activity)• Krug, Steve. Don't Make Me Think: A Common Sense Approach to Web Usability.• Kuniavsky, Mike. Observing the User Experience: a Practitioner's Guide to User
Research. Morgan Kaufmann, 2003.• Nielsen, Jakob and Robert L. Mack. Usability Inspection Methods. John Wiley &
Sons, Inc. 1994.• Redish, Janice (Ginny). Letting Go of the Words: Writing Web Content that
Works.• Rubin, Jeffrey and Dana Chisnell. Handbook of Usability Testing: How to Plan,
Design, and Conduct Effective Tests. John Wiley & Sons, Inc.
![Page 70: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/70.jpg)
Tool Considerations
• In person or remote? • Lab or on-site?• Prototype limitations (can it be online?, is it a document or
a clickable site?)• Number of observers, number of participants?• Number of facilitators?• Logging and video editing needs (time on task, highlight
video creation)?• Surveys before or after?• Eye tracking?
![Page 71: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/71.jpg)
Usability Testing Software
• Morae • Ovo• SilverBack (Mac only)• UserWorks• Noldus• Tobii (Eye-tracker)• SMI (Eye-tracker)• SurveyMonkey
![Page 72: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/72.jpg)
Screen Sharing Software
• GoToMeeting – http://www.gotomeeting.com • Lotus Sametime Unyte – http://www.unyte.com• YuuGuu -- http://www.yuuguu.com • WebEx – http://www.webex.com• Yugma -- https://www.yugma.com/
• Trouble Shooting: CoPilot - https://www.copilot.com/
![Page 73: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/73.jpg)
Satisfaction Questionnaires
• Standard Usability Measurement Inventory (SUMI) – office/desktop software, purchase– 50 questions
• Website Analysis and MeasureMent Inventory (WHAMMI)– Purchase– 20 questions
• System Usability Scale (SUS) – Free– 10 questions
![Page 74: Usability Testing Basics: What's it All About? at Web SIG Cleveland](https://reader035.vdocuments.net/reader035/viewer/2022062702/554bbb3cb4c90530298b4c12/html5/thumbnails/74.jpg)
Recommended Sites
• Usability.gov• W3C Web Accessibility Initiative
– http://www.w3.org/WAI/
• Accessibility Standards in US (Section 508)– http://www.access-board.gov/sec508/508standards.htm
• Jakob Nielsen – http://www.useit.com
• UPA – professional usability organization– http://www.usabilityprofessionals.org/