wireframe testing and card sorting

User TestingWebpage Comparisons Card Sorting

After Deployment / Guided Navigation

“Medically Ready Force…Ready Medical Force” 1

2

After Deployment / Guided Navigation

Wireframes

3

A vs. B

User Testing – Explosive Ordnance Disposal

18 ParticipantsLt. SSgt. C+16 members from 3D EOD BN

4

User Testing

5

# Participants Test

4 Wireframes A, Web Comparison

5 Wireframes B, Web Comparison

4 Closed-Card Sort

5 Open-Card Sort

Wireframes

6

A vs. B

• Off-site testing with prototypes

User Testing

“In the following scenario, you’re a newly recruited active duty soldier.…”

1. You’ve heard about soldiers exercising less when returning home; you’re seeking information...

User Testing

• Feedback for design features• Does the layout make sense?

User Testing

User Feedback – Wireframes A

10

2/4 users skipped “I am curious”

4/4 said the categories make sense

1/4 commented on the Reset button…“Reset would clear everything?”

• Explore functionality• Able to find information?

User Testing

User Feedback – Wireframes B

12

5/5 users selected “I am curious”

3/5 commented on “I need help”…• “A personal problem?”• “Help and concerned are similar”• “If I were concerned, I would also need help”

User Feedback – Wireframes B

13

5/5 said the categories make sense

3/5 commented on the “Reset / Results” buttons…• “Reset would start all over?”• “Results is confusing… from the past? Averages?”• “I’d make these options brighter to pop out”

User Feedback – Results Screen

14

9/9 users liked the results overall…• “Good information”• “I think they’re useful”• “Results are what was expected”

5/9 users liked the Videos• “I’d click on videos first, then read what they’re about”• “I’d like to see more videos, don’t like to read a lot”• “I’d watch the video… we get surveyed constantly”

Recommendations

15

Selecting a Level of Interest

When the user was prompted to select a level of interest (Curious, Concerned or Need Help) Design B was most successful

Based on user testing results these are the design recommendations:

Recommendations

16

Both designs were successful for category selectionsCombining the drop-down menus with color icons is recommended

Design A Design B

+ =

Recommendations

17

Reset / Results Bar

Users seemed confused with the terms Reset and Results

- Change the term “Reset” to “Clear”- Change the term “Results” to “Next”

When graphics design the bottom bar we need to ensure that it looks clickable and static

Recommendations

18

Results Screen

Users seemed interested in the videos, we recommend trying to show at least one video above the fold

• Compare designs• Features more/less appealing?

Webpage Comparisons

Menu button confusion

“Can’t identify with soldier”

Military emphasis

“People in uniform… more identifiable as military”

Less identifiable imagery

“Soldier is standing way in the background”

4/7 2/7 1/7

Home Page

Organized but compact

“Topics seem too small and busy”

Colors and illustrations

“Images are close to home”

Distracting and depressing

“The pictures and colors are really negative”

5/7 2/7 0/7

Topics

Card Sorting

22

Closed-Card• Pre-defined categories• Typically takes 10-15 minutes

Open-Card• User-defined categories• Typically takes 20-30 minutes

Card Sorting Results

Consistent Categories• “Problems with drinking” (100% agreement)• “Problems with people” (67% agreement)

24

Inconsistent Categories• “Problems with feelings” (35% agreement)• “Problems with thoughts” (41% agreement)

25

Card Sorting Analysis

26

Card Sorting Analysis

“Mental”

Always worryingRacing thoughtsAlways thinkingFeel mind doesn’t work

“Physical”

AlertRestlessNervousSleep

NervesDistractedFeeling amped

27

Card Sorting Analysis

“Emotional”

HopelessWorthlessAngryGuilty

AshamedNo feelingSad

• Use the following words: “Mental” and “Physical”

• Rather than: “Thoughts” and “Feelings”

• “Mental” issues leading to “Physical” consequences

28

Recommendations

Before Sorting

29

CATEGORY ITEMSPhysical problems Pain

HeadachesHead injury…

Problems about feelings SadAnxious…

Problems with thoughts RestlessEasily distractedTrouble staying focused…

Problems with people SpouseFriends…

30

CATEGORY ITEMSPhysical symptoms Pain

HeadachesHead injury…

Mental health issues SadAnxious…RestlessEasily distractedTrouble staying focused…

Relationships SpouseFriends…

After Sorting

31

Future Testing

• Categories: Tree testing symptoms and issues

• Additional user testing: Tasks for experienced service members

32

After Deployment / Guided Navigation

• Questions for me?

33

After Deployment / Guided Navigation

• Thanks!