wireframe testing and card sorting
TRANSCRIPT
User TestingWebpage Comparisons Card Sorting
After Deployment / Guided Navigation
“Medically Ready Force…Ready Medical Force” 1
2
After Deployment / Guided Navigation
Wireframes
3
A vs. B
User Testing – Explosive Ordnance Disposal
18 ParticipantsLt. SSgt. C+16 members from 3D EOD BN
4
User Testing
5
# Participants Test
4 Wireframes A, Web Comparison
5 Wireframes B, Web Comparison
4 Closed-Card Sort
5 Open-Card Sort
Wireframes
6
A vs. B
• Off-site testing with prototypes
User Testing
“In the following scenario, you’re a newly recruited active duty soldier.…”
1. You’ve heard about soldiers exercising less when returning home; you’re seeking information...
User Testing
• Feedback for design features• Does the layout make sense?
User Testing
User Feedback – Wireframes A
10
2/4 users skipped “I am curious”
4/4 said the categories make sense
1/4 commented on the Reset button…“Reset would clear everything?”
• Explore functionality• Able to find information?
User Testing
User Feedback – Wireframes B
12
5/5 users selected “I am curious”
3/5 commented on “I need help”…• “A personal problem?”• “Help and concerned are similar”• “If I were concerned, I would also need help”
User Feedback – Wireframes B
13
5/5 said the categories make sense
3/5 commented on the “Reset / Results” buttons…• “Reset would start all over?”• “Results is confusing… from the past? Averages?”• “I’d make these options brighter to pop out”
User Feedback – Results Screen
14
9/9 users liked the results overall…• “Good information”• “I think they’re useful”• “Results are what was expected”
5/9 users liked the Videos• “I’d click on videos first, then read what they’re about”• “I’d like to see more videos, don’t like to read a lot”• “I’d watch the video… we get surveyed constantly”
Recommendations
15
Selecting a Level of Interest
When the user was prompted to select a level of interest (Curious, Concerned or Need Help) Design B was most successful
Based on user testing results these are the design recommendations:
Recommendations
16
Both designs were successful for category selectionsCombining the drop-down menus with color icons is recommended
Design A Design B
+ =
Recommendations
17
Reset / Results Bar
Users seemed confused with the terms Reset and Results
- Change the term “Reset” to “Clear”- Change the term “Results” to “Next”
When graphics design the bottom bar we need to ensure that it looks clickable and static
Recommendations
18
Results Screen
Users seemed interested in the videos, we recommend trying to show at least one video above the fold
• Compare designs• Features more/less appealing?
Webpage Comparisons
Menu button confusion
“Can’t identify with soldier”
Military emphasis
“People in uniform… more identifiable as military”
Less identifiable imagery
“Soldier is standing way in the background”
4/7 2/7 1/7
Home Page
Organized but compact
“Topics seem too small and busy”
Colors and illustrations
“Images are close to home”
Distracting and depressing
“The pictures and colors are really negative”
5/7 2/7 0/7
Topics
Card Sorting
22
Closed-Card• Pre-defined categories• Typically takes 10-15 minutes
Open-Card• User-defined categories• Typically takes 20-30 minutes
Card Sorting Results
Consistent Categories• “Problems with drinking” (100% agreement)• “Problems with people” (67% agreement)
24
Inconsistent Categories• “Problems with feelings” (35% agreement)• “Problems with thoughts” (41% agreement)
25
Card Sorting Analysis
26
Card Sorting Analysis
“Mental”
Always worryingRacing thoughtsAlways thinkingFeel mind doesn’t work
“Physical”
AlertRestlessNervousSleep
NervesDistractedFeeling amped
27
Card Sorting Analysis
“Emotional”
HopelessWorthlessAngryGuilty
AshamedNo feelingSad
• Use the following words: “Mental” and “Physical”
• Rather than: “Thoughts” and “Feelings”
• “Mental” issues leading to “Physical” consequences
28
Recommendations
Before Sorting
29
CATEGORY ITEMSPhysical problems Pain
HeadachesHead injury…
Problems about feelings SadAnxious…
Problems with thoughts RestlessEasily distractedTrouble staying focused…
Problems with people SpouseFriends…
30
CATEGORY ITEMSPhysical symptoms Pain
HeadachesHead injury…
Mental health issues SadAnxious…RestlessEasily distractedTrouble staying focused…
Relationships SpouseFriends…
After Sorting
31
Future Testing
• Categories: Tree testing symptoms and issues
• Additional user testing: Tasks for experienced service members
32
After Deployment / Guided Navigation
• Questions for me?
33
After Deployment / Guided Navigation
• Thanks!