developing and evaluating a personal task analysis … · evaluating a personal task analysis app...
TRANSCRIPT
![Page 1: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/1.jpg)
DEVELOPING AND EVALUATING A PERSONAL
TASK ANALYSIS APPUniversity of Hawai`i at Mānoa
Elon Ng
Master’s in Learning Design and Technology
ptayng.app.appery.io
![Page 2: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/2.jpg)
DEVELOPING AND EVALUATING A PERSONAL
TASK ANALYSIS APPUniversity of Hawai`i at Mānoa
Elon Ng
Master’s in Learning Design and Technology
ptayng.app.appery.io
![Page 3: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/3.jpg)
Quick Survey!
How many apps do you have on your phone?
A. 0-5
B. 6-10
C. 11-15
D. I have an app to count all my apps (too many)!
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 4: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/4.jpg)
Quick Survey!
How many of those apps would you say are “self-
help” or “productive?”
A. 1-4
B. 5-8
C. 8+
D. Candy Crush is pretty productive (none)!
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 5: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/5.jpg)
Problem
■ Technology has exploded over the previous decade – seemingly making our lives
more convenient
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 6: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/6.jpg)
Problem
■ Technology has exploded over the previous decade – seemingly making our lives
more convenient
■ Interest in digitalizing an in-class activity for a graduate class
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 7: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/7.jpg)
Problem
■ Technology has exploded over the previous decade – seemingly making our lives
more convenient
■ Interest in digitalizing an in-class activity for a graduate class
■ Personal motivations
to develop and
evaluate an app
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 8: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/8.jpg)
Purpose
The purpose of this usability project was to develop
and evaluate the ease of use for a gamified app of a
personal task analysis from an activity in a graduate
course used at a university on the island of O`ahu.
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 9: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/9.jpg)
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
The In-Class Activity
Maslow, A. H. (1943). A theory of human motivation. Psychological review,50(4), 370.
=
Personal
Professional
Student
Life
![Page 10: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/10.jpg)
=
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
The In-Class Activity
Maslow, A. H. (1943). A theory of human motivation. Psychological review,50(4), 370.
Personal
Professional
Student
Life
![Page 11: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/11.jpg)
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
Paper Prototype
First Iteration
Second Iteration
Future Iterations
Design Process
First
Round of
Testing
Second
Round of
Testing
Materials
Developed
![Page 12: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/12.jpg)
Paper Prototype Ideas
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 13: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/13.jpg)
Choosing a Platform
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 14: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/14.jpg)
First Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 15: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/15.jpg)
First Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 16: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/16.jpg)
First Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 17: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/17.jpg)
First Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 18: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/18.jpg)
Second Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 19: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/19.jpg)
Second Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 20: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/20.jpg)
Second Iteration
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 21: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/21.jpg)
Implementation
■ Usability Protocol
■ 6 Participants, two
rounds of 3
participants each
■ Pre-Test and Post-
Test
■ Given four tasks to
perform
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 22: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/22.jpg)
Implementation
■ Recording Using
FlashBack Express
■ Free software that
lets you see user
input
■ Sound Recording and
Screen Capture with
no watermark!
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 23: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/23.jpg)
Participants
■ Recruitment Email Sent
■ Six Participants
■ 2 Male, 4 Female
■ 25-54 years old
■ 4 Master’s Students,
2 Doctorate Students
■ Most did look at their
weekly schedule
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 24: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/24.jpg)
Pre Test Results
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
• Sample apps include –
• Social Media programs (Instagram, Facebook, Twitter)
• Organizational Apps (Calendar, Mail, Scheduler)
• Activity Apps (Nike+, Runtastic, Bus Schedule)
![Page 25: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/25.jpg)
During the Study – Round 1
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
Task 1 – Average 4 clicks
Task 2 – Average 3 clicks
Task 3 – Average 2 clicks
Task 4 – Average 2 clicks
![Page 26: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/26.jpg)
During the Study – Round 1
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
Participant 1 Participant 3
![Page 27: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/27.jpg)
During the Study – Round 2
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
Task 1 – Average 3 clicks
Task 2 – Average 2 clicks
Task 3 – Average 1 clicks
Task 4 – Average 1 clicks
![Page 28: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/28.jpg)
During the Study – Round 1
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
Participant 4 Participant 5
![Page 29: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/29.jpg)
Post Test Results
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
1 2 3 4 5
Labels for buttons or pages are clear and concise.
I can use the app without instructions.
The app is user-friendly.
Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree
Round 1 Testing Post-Study Survey
Participant 1 Participant 2 Participant 3
![Page 30: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/30.jpg)
Post Test Results
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
1 2 3 4 5
Labels for buttons or pages are clear and concise.
I can use the app without instructions.
The app is user-friendly.
Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree
Round 1 Testing Post-Study Survey
Participant 1 Participant 2 Participant 3
1 2 3 4 5
Labels for buttons or pages are clear and concise.
I can use the app without instructions.
The app is user-friendly.
Likert Rating 1 = Strongly Disagree, 5 = Strongly Agree
Round 2 Testing Post-Study Survey
Participant 4 Participant 5 Participant 6
![Page 31: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/31.jpg)
Written Results (Round 1 Post-Test)
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 32: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/32.jpg)
Written Results (Round 2 Post-Test)
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 33: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/33.jpg)
Findings (discussion)
■ Second Iteration an improvement– Improved visuals– Less confusion on Home page– Higher post-test results (more
satisfaction overall)
■ Further iterations incorporating feedback continues to improve the app
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 34: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/34.jpg)
Conclusion (Reflections)
■ Limitations
– Time and Resources
– Settling on a Platform
– Gamification might better be
reserved for another type of app
■ Usability Study Protocol
■ Technical Skills
– Javascript
■ Conducting a Usability Study
INTRO PROBLEM/PURPOSE DESIGN IMPLEMENTATION RESULTS FINDINGS CONCLUSION
![Page 35: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/35.jpg)
Questions?
![Page 36: DEVELOPING AND EVALUATING A PERSONAL TASK ANALYSIS … · EVALUATING A PERSONAL TASK ANALYSIS APP University of Hawai`i at Mānoa Elon Ng ... Quick Survey! How many apps do you have](https://reader035.vdocuments.net/reader035/viewer/2022081402/5f0e9ba97e708231d4400e5d/html5/thumbnails/36.jpg)
Thank you for Listening!
A HUGE thank you hug to:
■ My advisor, Dr. Catherine Fulford
■ LTEC Ohana -- Faculty and Staff
■ Critical Friends
■ My Cohort
■ Good Friends at UH
■ Tea