preparing and running user experiments
DESCRIPTION
Preparing and Running User Experiments. By Mei Li, Pearl Ho, and Deepika Gandhi. How to Prepare and Run Usability Testing. How to gather participants and prepare a proposal. --Mei Preparing the environment, test materials, and test team. --Pearl - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/1.jpg)
Preparing and Running User Experiments
By Mei Li, Pearl Ho, and Deepika Gandhi
![Page 2: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/2.jpg)
How to Prepare and Run Usability Testing
How to gather participants and prepare a proposal. --Mei
Preparing the environment, test materials, and test team.
--Pearl
How to measure usability and deal with participants.
--Deepika
![Page 3: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/3.jpg)
IntroductionWe cover everything that happens or that you should be aware of prior to collect your data.
Preparing for your User Requirements Activity
![Page 4: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/4.jpg)
Creating a proposal Deciding the duration and timing of your session Recruiting participants Tracking participants Creating a protocol Piloting your activity
Preparing for your User Requirements Activity
![Page 5: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/5.jpg)
A usability activity proposal is a road map for the activity you are about to undertake.
Why create a proposal?
Surprises Assumptions Misconceptions
Tip:Multiple activities, separate proposals
Creating a proposal
![Page 6: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/6.jpg)
History Objectives, measures,
scope of the study Method User profile
Recruitment Incentives Responsibilities Proposed schedule
Creating a proposal
![Page 7: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/7.jpg)
RecruitmentE.g. John Smith from Product team will recruit total 30 participants by an advertisement on the web and a recruitment agency.
Creating a proposal
![Page 8: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/8.jpg)
Incentives
E.g. Participants will receive $75 in AMEX gift checks for the
participation.
Creating a proposal
![Page 9: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/9.jpg)
Incentives
E.g. Participants will receive $75,000 in AMEX gift checks for the
participation.
Creating a proposal
![Page 10: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/10.jpg)
Responsibilities Who is responsible for what task? Key word – Specific
The product team is responsible for recruiting participants.
John Brown from the product team is responsible for recruiting participants.
Creating a proposal
![Page 11: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/11.jpg)
Proposed Schedule Indicate time for each deliverable Key word – Specific People often underestimate the amount of time it
takes to prepare for an activity.Tip:
Request deliverables a week before we absolutely need them. Then, if deliverables are late (which they often are), it's OK.
Creating a proposal
![Page 12: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/12.jpg)
Getting Commitment Email the proposal? Issues:
stakeholders will criticize: Skills/knowledge/objectivity of the person who
conducted the activity – Be a member of the team and earn their respect Participants in the activity Tasks/activity conducted – Getting everyone sign off on the proposal
Creating a proposal
![Page 13: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/13.jpg)
Organize a meeting: Objective of the activity Data which will be collected User profile Responsibility Schedule
Signed
Creating a proposal
![Page 14: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/14.jpg)
Creating a proposal Deciding the duration and timing of your session Recruiting participants Tracking participants Creating a protocol Piloting your activity
Preparing for your User Requirements Activity
![Page 15: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/15.jpg)
Deciding the duration and timing of your session
Group Session5-7pm or 6-8pm bestWith some food, perfectBreak the session into small chunks if
possible
![Page 16: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/16.jpg)
Creating a proposal Deciding the duration and timing of your session Recruiting participants Tracking participants Creating a protocol Piloting your activity
Preparing for your User Requirements Activity
![Page 17: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/17.jpg)
Recruiting participants
Participants numberParticipant incentivesDeveloping a recruiting screenerCreating a recruitment advertisementRecruitment methodsPreventing no-showsRecruiting international participants Recruit
special populations
![Page 18: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/18.jpg)
Recruiting participants
Participants number Facts to be concerned
Availability Representative
Method – Convenience sampling Use the available sample of the population, instead of
representatives from the population at large. e.g. Research done by college professors often uses college
students for participants. Tip – Identify participants types
![Page 19: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/19.jpg)
Where should you go to Find Participants
For this type of Product Look to this sourceTravel reservation system Travel agencies
Bank teller system Banks
New version of existing operating system
Customer lists
Medical office software Phone lists of local doctors' offices
![Page 20: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/20.jpg)
Recruiting participants
Participant incentives Mode
Cash, normally not. Store? One of your product for free Gift certificate (an electronics store, movie pass) Gift checks Charitable donations in the participant's name (for highly
paid individuals CEOs) Amount
Make the incentive large enough to thank people for their time and expertise, but nothing more.
Pay everyone in the same session the same amount in case of amount changing.
![Page 21: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/21.jpg)
Recruiting participants
Developing a recruiting screener Via phone, don't email Work with the product team, instill team-work sense. Keep it short Use test questions, you want honest participants Collect demographic information, once decide a candidate Eliminate competitors Provide important details
Time, date, location, compensation, rules, signature Prepare a response for people who do not match the profile
![Page 22: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/22.jpg)
Recruiting participants
Creating a recruitment advertisement Provide some details about your study Include date, time, location of the study Indicate key characteristics, not all Don't stress the incentive State how they should respond
e.g. generic email address Be aware of types of bias
![Page 23: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/23.jpg)
Recruiting participants
Recruitment Methods Advertise on community bulletin board sites Create an in-house database Use a recruiting agency Make use of customer contacts
![Page 24: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/24.jpg)
Recruiting participants
Preventing no-shows A 10% "no show " rate is common Provide contact information Remind Over-recruit
![Page 25: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/25.jpg)
Confirm the Appointment: Thanks for agreeing to participate The date and time you expect them to be there Where to come, including a map and directions How long to expect to be with you The purpose of the test Reminders about the video cameras Incentive A person's name and a phone number to call if they
have questions or need to reschedule
Recruiting participants
![Page 26: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/26.jpg)
![Page 27: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/27.jpg)
Recruiting participants
Recruiting International Participants Agency Cultural and behavioral taboos books Translator Punctuality Holiday concern
![Page 28: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/28.jpg)
Recruiting participants
Recruiting Special Populations Children, elderly, disabilities
Transportation Escorts Facilities
![Page 29: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/29.jpg)
Recruiting participants
Recruitment Methods Advertise on community bulletin board sites Create an in-house database Use a recruiting agency Make use of customer contacts
![Page 30: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/30.jpg)
Creating a proposal Deciding the duration and timing of your session Recruiting participants Tracking participants Creating a protocol Piloting your activity
Preparing for your User Requirements Activity
![Page 31: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/31.jpg)
Tracking Participants
Tax implications Avoid professional participant Create a watch list
Tax Dishonesty Poor attendance No show-up
![Page 32: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/32.jpg)
Creating a Protocol
All procedures and their order Act as a checklist for all of the session steps
![Page 33: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/33.jpg)
Piloting your Activity
Check audio-visual equipment working Clarity of instructions and questions Find bug or glitches Attendee
Experienced Product team member
![Page 34: Preparing and Running User Experiments](https://reader036.vdocuments.net/reader036/viewer/2022070404/56813c09550346895da56fa6/html5/thumbnails/34.jpg)
Preparing the environment, test materials, and test team.
--Pearl Ho