Prepared For:
Kevin McGowan, Project Sponsor
Luke Bjerring, Software Engineer
Completed By:
Alanna Lewis
B l o g g e r . c o m
7 / 2 0 / 2 0 1 5
Usability Test Plan for Blogger Mobile Application
Usability Test Plan for Blogger Mobile Application 2015
Page | 2
Table of Contents
Purpose ................................................................................................................................ 3 User Profiles Summary ......................................................................................................... 4
User 1 ............................................................................................................................... 4
User 2 ............................................................................................................................... 4
User 3 ............................................................................................................................... 4
Problem Statement and Test Objectives ............................................................................... 5
Test Environment ................................................................................................................. 6
Methodology ......................................................................................................................... 6
Number of Participants ...................................................................................................... 6
Length of Sessions ............................................................................................................ 7
Test Procedure ..................................................................................................................... 7
Pre-Test Questionnaire and Lab Orientation ..................................................................... 7
User Specific Scenarios .................................................................................................... 7
Post-Test Questionnaire and Closing ................................................................................ 7
Appendix A: User Scenarios and Tasks................................................................................ 8
User 1 Scenarios ............................................................................................................... 8
Scenario 1 ...................................................................................................................... 8
Scenario 2 ...................................................................................................................... 9
Scenario 3 ...................................................................................................................... 9
User 2 Scenarios ............................................................................................................. 10
Scenario 1 .................................................................................................................... 10
Scenario 2 .................................................................................................................... 11
Scenario 3 .................................................................................................................... 11
User 3 Scenarios ............................................................................................................. 12
Scenario 1 .................................................................................................................... 12
Scenario2..................................................................................................................... 12
Scenario 3 .................................................................................................................... 13
Appendix B: Pre-Test Questionnaire .................................................................................. 14
Appendix C: Post-Test Questionnaires ............................................................................... 15
User 1 Post-Test Questionnaire ...................................................................................... 15
User 2 Post-Test Questionnaire ...................................................................................... 16
User 3 Post-Test Questionnaire ...................................................................................... 17
Usability Test Plan for Blogger Mobile Application 2015
Page | 3
Purpose The purpose of the Blogger Mobile Application usability test is to collect feedback
regarding how users use the Mobile application on both iOS and Android mobile
devices, including tablets, iPads and mobile phones. The usability test will also collect
feedback about problems users may encounter while using the application, and what
improvements users would like to see made to the Blogger mobile application in order
to improve the user experience.
Mr. Kevin McGowan, is the project sponsor, and is working closely with Luke Bjerring,
the Blogger software engineer. They would like to learn about users’ experiences on
Android devices as compared to their experiences on iOS devices.
The test plan describes:
user profiles to recruit for testing
problem statement and test objectives
testing methodology
test environment and equipment required in the usability center
test procedure
User scenarios
o Appendix A: User Scenarios and Tasks
questionnaires in appendices:
o Appendix B: Pre-Test Questionnaire
o Appendix C: Post-Test Questionnaire
Usability Test Plan for Blogger Mobile Application 2015
Page | 4
User Profiles Summary To recruit prospective test participants, five user profiles were developed and submitted
previously. Personas for each user were also developed and submitted. Three of these
five user profiles will be the target for participant recruitment. The following user profiles
were selected as they represent target audiences for customer expansion for Blogger.
User 1 Bill Keeley, age 65
Goals:
Grow his business’ customer base.
Showcase specialty work done by his company.
Educate potential clients about his products.
“I need to spread the word about my business, but I have very little time to invest in this
project. I need to showcase my work and connect with new clients. This tool needs to
be effective and efficient.”
User 2 Melanie Nicholls, age 22
Goals:
Document her travels, and share her experiences with friends and family.
Create a journal for herself.
Upload pictures.
“I have lots of friends and family who want to follow my journey, many of who are looking for tips
for their own trips. I want to be able to share my experiences with them, and have a journal of
lasting memories for myself.”
User 3 Bethany Shaw, age 37
Goals:
Host her resume.
Keep a current portfolio online.
Accept freelance jobs.
“I need a site that I can customize to get the right look and feel for me, but that I won’t have to
build from scratch, that’s too much like my work.”
Usability Test Plan for Blogger Mobile Application 2015
Page | 5
Problem Statement and Test Objectives The usability test of the Blogger Mobile Application will provide qualitative and
quantative data addressing Blogger’s corporate management team and Blogger’s
software engineers’ interest in understanding the user experience across multiple
platforms. We will assess the users’ experience with creating an account, personalizing
a blog, and uploading photos across multiple devices, as well as overall satisfaction with
the mobile application. Tasks for testing the Blogger Mobile Application will include:
The general feeling/layout of the application:
o Is the layout comparable across multiple devices and operating systems?
Does the layout suggest the route first time users will take to create a
blog?
The procedure for creating an account:
o Entering personal information – does the application require reasonable
information from users?
o Are users able to easily create an account on all platforms including iOS
and Android devices?
The procedure for personalizing a blog:
o Are users able to easily select a template for their blog?
o Are users able to personalize and edit a template?
o Are users able to develop their own blog layout if they have prior
knowledge with web design?
o Is template display consistent and accurate across both Android and iOS
devices?
o Is template selection and application intuitive for the user?
The procedure for uploading photos:
o Are users able to easily upload photos taken on their mobile device?
o Are users able to easily upload photos from their email on a mobile
device?
o Are upload procedures intuitive for the users?
o Are upload procedures comparable across both Android and iOS devices?
Navigation:
o Can users intuitively navigate the application across all devices?
Satisfaction:
o Which aspects do users like and which aspects do they dislike?
o What would users like to see improved?
o Are satisfaction levels consistent across all devices and operating
systems?
Usability Test Plan for Blogger Mobile Application 2015
Page | 6
This usability study will be designed to allow us to obtain mostly qualitative data. The
questions used in the testing were developed from a range of user personas, including
target audiences across a wide age range. The focus of the study will be task-oriented.
Participants will be given a pre-test questionnaire to obtain information about their
typical device usage, preferred operating system, prior usage of Blogger and/or similar
blogging applications, as well as their expectations regarding the mobile application.
Participants will be given scenarios that direct them to perform specific tasks that will
help assess the issues listed in the questions above. Post-test questionnaires will be
completed after each scenario, as well as a summative questionnaire with opportunity
for user comments at the end of the testing session.
Participants will be scheduled in sessions 90 minutes in length to include pre-test and
post-test questionnaires. Users will be given one hour to complete 3 scenarios using
two different devices. Before and after the scenarios are complete users will be given a
15 minute window to complete questionnaires. If users complete the scenarios in less
than one hour, they will be able to begin the post-test questionnaire immediately, in
order to obtain accurate responses.
Test Environment The tests will be conducted in a full-scale usability lab in Toronto Ontario, at Consumer
Vision Ltd. Participants will be recruited through the Consumer Vision Ltd in-house
recruiting telephone survey centre. Logging and recording of sessions will be performed
using Morae, with additional eye tracking technology provided by Consumer Vision Ltd.
Methodology This section describes the testing methodology and scenarios that users will complete.
A total of 12 participants will take part in the 3 scenarios in 90 minute sessions. Three
users will participate in the test simultaneously.
Number of Participants A total of 12 participants will partake in the test scenarios. Four users will be recruited
from each of the three user profiles outlined previously. Participant age ranges may vary
from the user profiles ± 3 years, and participants will be recruited based on similarity to
the previously submitted user personas in order to achieve the desired demographic for
testing.
Usability Test Plan for Blogger Mobile Application 2015
Page | 7
Length of Sessions The total length of each session will be 90 minutes including:
Pre-test questionnaire and usability lab orientation (15 minutes)
Task scenarios (60 minutes)
Post-test questionnaire and user comments (15 minutes)
Test Procedure The test will begin with a pre-test questionnaire as well as a basic usability lab
orientation. This will give users the opportunity to have any basic device operation
questions or test procedure questions answered such as how to turn on the devices,
which devices will be used, number of tests that will be conducted. Users will not be
allowed to ask any questions about the scenarios or about the Blogger Mobile
Application during this time.
Following the orientation scenarios will be presented as described in the following
sections, and afterwards a post-test questionnaire will be completed.
Participants will have access to the Blogger Mobile application, Gmail, and the photo
gallery on each device. All other applications will be locked using “Kid Mode” on the
devices. This information will be stated during the orientation to reduce participant
confusion and frustration during the scenarios.
Pre-Test Questionnaire and Lab Orientation The moderator will welcome participants and provide the pre-test questionnaire
(Appendix A). The moderator will allow the users to view the facilities and answer
questions following the guidelines as listed above. The moderator will ask users to think
out loud during the scenarios. Finally the moderator will have participants sign a video
consent form before testing begins.
User Specific Scenarios Users will be presented with 3 scenarios, each containing 2 similar tasks to complete on
different devices (Appendix A). The scenarios will be suited to match their user profile
as established during the screening process.
Post-Test Questionnaire and Closing The moderator will ask the participant to complete the post-test questionnaire, collect
any additional comments, and thank the participant for their involvement.
Usability Test Plan for Blogger Mobile Application 2015
Page | 8
Appendix A: User Scenarios and Tasks
User 1 Scenarios Users from the User 1 demographic will complete these scenarios using an iPad and an
iPhone.
Scenario 1 You run a small business named Polytek Systems Limited which provides custom floor
coatings for a wide range of clients. You have decided to start a website using Blogger
to showcase your work. Complete the following tasks on the iPad provided in order to
start your blog.
Task 1 (iPad)
Use the Blogger app loaded on the iPad to create an account with the following
information. Your account information will be deleted following the test.
Name: Provide your real first and last name for testing purposes.
Email: [email protected]
Password: create your own password according to the password requirements.
Blog name: Polytek Ltd
Web address: polytekltd.blogspot.com
Task 2 (iPhone)
Use the Blogger app loaded on the iPhone to create an account with the following
information.
Your account information will be deleted following the test.
Name: Provide your real first and last name for testing purposes.
Email: [email protected]
Password: create your own password according to the password requirements.
Blog name: Polytek Systems
Web address: polyteksystems.blogspot.com
Usability Test Plan for Blogger Mobile Application 2015
Page | 9
Scenario 2 You have successfully created a Blogger account. You want to present a professional
appearance for your Blogger website. Your company colours are blue and grey. You
want your website to reflect these colours.
Task 1 (iPad)
Select an appropriate template to use on your site polytekltd.blogspot.com based on
these colours. Apply the template to the website using the Blogger app on the iPad. Add
your company logo to the website from the photo gallery on your iPad.
Task 2 (iPhone)
Select an appropriate template to use on your site polyteksystems.blogspot.com based
on these colours. Apply the template to the website using the Blogger app on the
iPhone. Add your company logo to the website from the photo gallery on your iPhone.
Scenario 3 You are visiting a potential client tomorrow, and want to show them some of the work
you have done for other clients in the past. You need to be able to show the client
photos of your work during the meeting, by having your Blogger site open on your
mobile device. You will need to add pictures with captions to your site.
Task 1 (iPad)
Upload a photo of a jobsite to your site polytekltd.blogspot.com on your iPad from the
photo gallery. Upload a photo of a jobsite to your website using Gmail. You will already
be signed into a Gmail account. The photo is attached to the only email in your inbox.
Add a caption summarizing the photo.
Task 2 (iPhone)
Upload a photo of a jobsite to your site polyteksystems.blogspot.com on your iPhone
from the photo gallery. Upload a photo of a jobsite to your website using Gmail. You will
already be signed into a Gmail account. The photo is attached to the only email in your
inbox. Add a caption summarizing the photo.
Usability Test Plan for Blogger Mobile Application 2015
Page | 10
User 2 Scenarios User 2 will complete the following scenarios using an iPad and an Android tablet.
Scenario 1 You have recently graduated from university and are spending the next several months
backpacking across Asia. You want to create a travel journal for yourself to log your
memories.
Task 1 (iPad)
Use the Blogger app loaded on the iPad to create an account and site with the following
information.
Your account information will be deleted following the test.
Name: Provide your real first and last name for testing purposes.
Email: [email protected]
Password: create your own password according to the password requirements.
Blog name: Trip Abroad
Web address: tripabroad.blogspot.com
Select a template for your site and add an introduction paragraph of text. Text is as
follows:
“Hello, my name is <insert name> welcome to my travel blog. I will be logging my
travels through Asia over the next several months.”
Task 2 (Android Tablet)
Use the Blogger app loaded on the Android tablet to create an account and site with the
following information.
Your account information will be deleted following the test.
Name: Provide your real first and last name for testing purposes.
Email: [email protected]
Password: create your own password according to the password requirements.
Blog name: Trip to Asia
Web address: triptoasia.blogspot.com
Usability Test Plan for Blogger Mobile Application 2015
Page | 11
Select a template for your site and add an introduction paragraph of text. Text is as
follows:
“Hello, my name is <insert name> welcome to my travel blog. I will be logging my
travels through Asia over the next several months.”
Scenario 2 You have now been travelling for three weeks. You are about to move on to a new
country, and want to upload a gallery of photos from your first stop before getting on the
plane.
Task 1 (iPad)
Upload 5 photos to the site tripabroad.blogspot.com from the gallery on the iPad.
Task 2 (Android Tablet)
Upload 5 photos to the site triptoasia.blogspot.com from the gallery on the Android
tablet.
Scenario 3 Your family has emailed you some photos from home and you want to include them in
one of your blog posts.
Task 1 (iPad)
Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in
on the iPad. The photos are located in the only email in the inbox.
Task 2 (Android Tablet)
Upload 3 photos to the site tripabroad.blogspot.com from the Gmail account logged in
on the Android tablet. The photos are located in the only email in the inbox.
Usability Test Plan for Blogger Mobile Application 2015
Page | 12
User 3 Scenarios User 3 will complete the following scenarios using an Android tablet and an Android
phone.
Scenario 1 You are graphic designer who has been doing mostly freelance work since graduating.
You want to start a website to host your resume in the hopes of finding more stable full-
time work. You have already signed up for a Blogger account and created a website,
and have the blogger app on your mobile device.
Task 1 (Android Tablet)
Using the Android tablet provided, upload your resume to the website called
mydesignservices.blogspot.com. Your resume is located in the Gmail inbox of the
account signed in on the device. The email subject line is “resume” and should be the
most recent email in the inbox.
Task 2 (Android Phone)
Using the Android phone provided, upload your resume to the website called
hiremetodesign.blogspot.com. Your resume is located in the Gmail inbox of the account
signed in on the device. The email subject line is “resume” and should be the most
recent email in the inbox.
Scenario2 You have been working at your new full-time job for a few months now, but miss
working with your freelance clients. You have decided to do a bit of freelance work on
the weekends and advertise your services through your Blogger website. You have
decided to add sample projects to your website to act as a portfolio for potential clients.
You are starting with the websites you designed for clients last summer.
Task 1 (Android Tablet)
Make a blog post containing 2 links to external sites on your blog
mydesignservices.blogspot.com using the Android tablet provided. Have the link text
read as specified below, use any font colour of your choice other than blue.
Link text Link to site
Poppytalk http://www.poppytalk.com/
I Heart Organizing http://iheartorganizing.blogspot.com/
Task 2 (Android Phone)
Make a blog post containing 2 links to external sites on your blog
hiremetodesign.blogspot.com using the Android phone provided. Have the link text read
as specified below, use any font colour of your choice other than blue.
Usability Test Plan for Blogger Mobile Application 2015
Page | 13
Link text Link to site
My New Roots http://www.mynewroots.org/site/
Print and Pattern http://printpattern.blogspot.ca/
Scenario 3 You have a bit of spare time to work on your website this afternoon. You want to
personalize it to make it fit your design preferences. You are expecting friends in 20
minutes, so you need to be able to make small design and layout changes, not a
complete design overhaul.
Task 1 (Android Tablet)
Change the following components of your blog mydesignservices.blogspot.com using
the Blogger app on the Android tablet.
Adjust the layout
Adjust the width of the left sidebar
Change the colour scheme of your blog
Task 2 (Android Phone)
Change the following components of your blog hiremetodesign.blogspot.com using the
Blogger app on the Android phone.
Adjust the layout
Adjust the width of the left sidebar
Change the colour scheme of your blog
Usability Test Plan for Blogger Mobile Application 2015
Page | 14
Appendix B: Pre-Test Questionnaire This test is suitable for all users
Name:
Age:
Have you ever run a blog before?
Have you ever used Blogger before?
If you were to start a blog what would the subject be?
Have you ever heard of these blog hosting sites before? (Circle all that apply)
Blogger Wordpress Weebly Squarespace.com
Which devices do you use most when working with mobile apps? Specify operating
system (Android or iOS).
Usability Test Plan for Blogger Mobile Application 2015
Page | 15
Appendix C: Post-Test Questionnaires
User 1 Post-Test Questionnaire Test to be given to participants in User 1 category: iPad and iPhone
Overall how easy was it to use this application? (Circle one)
1 2 3 4 5
Very difficult Somewhat difficult
Neither difficult nor easy
Somewhat easy Very easy
Did you prefer using the Blogger application on the tablet or the phone? (Circle one)
iPad iPhone
Why?
How much time do you think you would need before you felt comfortable using Blogger?
Would you recommend the Blogger mobile app to a friend? Why or why not?
What was the most frustrating task you had to perform?
What was your favourite feature of the Blogger mobile application?
If you could add one feature to the app what would it be?
Usability Test Plan for Blogger Mobile Application 2015
Page | 16
User 2 Post-Test Questionnaire Test to be given to participants in User 2 category: iPad and Android Tablet
Overall how easy was it to use this application? (Circle one)
1 2 3 4 5
Very difficult Somewhat difficult
Neither difficult nor easy
Somewhat easy Very easy
Did you prefer using the Blogger application on the iPad or the Android Tablet? (Circle
one)
iPad Android Tablet
Why?
How much time do you think you would need before you felt comfortable using Blogger?
Would you recommend the Blogger mobile app to a friend? Why or why not?
What was the most frustrating task you had to perform?
What was your favourite feature of the Blogger mobile application?
If you could add one feature to the app what would it be?
Usability Test Plan for Blogger Mobile Application 2015
Page | 17
User 3 Post-Test Questionnaire Test to be given to participants in User 3 category: Android Tablet and Android Phone
Overall how easy was it to use this application? (Circle one)
1 2 3 4 5
Very difficult Somewhat difficult
Neither difficult nor easy
Somewhat easy Very easy
Did you prefer using the Blogger application on the iPad or the Android Tablet? (Circle
one)
Android Tablet Android Phone
Why?
How much time do you think you would need before you felt comfortable using Blogger?
Would you recommend the Blogger mobile app to a friend? Why or why not?
What was the most frustrating task you had to perform?
What was your favourite feature of the Blogger mobile application?
If you could add one feature to the app what would it be?