contextual inquiry & analysis – web-based user survey...

44
Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™ Carrie A. Sitz, Tamerat Aligaz, Petr Chadraba, Kim Lewandowski - DePaul University, CTI, Winter 2005 HCI 445 - Professor Daniel Mittleman

Upload: ngodung

Post on 15-Mar-2018

222 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

Contextual Inquiry & Analysis – Web-based User SurveyCase Study - TiVo™Carrie A. Sitz, Tamerat Aligaz, Petr Chadraba, Kim Lewandowski - DePaul University, CTI, Winter 2005HCI 445 - Professor Daniel Mittleman

Page 2: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 2 of 44Contextual Inquiry & Analysis – Web-based Survey

Inquiry Analysis Team

Carrie Sitz – Human-Computer Interaction, DePaul [email protected]

Tamerat Aligaz – Human-Computer Interaction, DePaul [email protected]

Petr Chadraba – Human-Computer Interaction, DePaul [email protected]

Kim Lewandowski – Human-Computer Interaction, DePaul [email protected]

Page 3: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 3 of 44Contextual Inquiry & Analysis – Web-based Survey

Report Contents

IntroductionStakeholdersSurvey Implementation SummaryProfile of Survey RespondentsAnalysis of Findings & RecommendationsConclusionAppendix A – Survey Results MatrixAppendix B – Web-based Survey QuestionsAppendix C – Charted Survey Results

Page 4: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 4 of 44Contextual Inquiry & Analysis – Web-based Survey

Introduction

TiVo is a next-generation technology that automatically finds and records televisionprogramming. It is controlled and commanded manually by the user via a remote control anddelivers feedback via the user’s television screen. TiVo can also pause and rewind live television,and play it in slow motion. TiVo Two is now in development and will boast a new AI feature thatanticipates what the user might want to watch (based on his or her viewing history) and recordssuch programming. Another significant difference between TiVo and TiVo Two is an increasedamount of available hard-disk space. Our goal is to interview and survey existing users of theTiVo technology to determine requirements for TiVo Two’s interface and to create a report on thefindings derived from this research.

Our team, eyeConsultancy, conducted a Web-based survey with the intent of furthering ourunderstanding of current TiVo users’ needs and wants concerning TiVo Two. Our survey wasformed based on the feedback we had received during our interviews and focus group. Afterprocessing the data that was acquired during the interviews and focus group, we designed thesurvey to expand upon pre-existing knowledge while shedding new light on previously revealeduser requirements. The survey questions addressed the popularity of current features, possibleimprovements upon current features, as well as potential new features. Ultimately, the surveyfurthered our understanding of current TiVo users’ needs and wants, helping to paint a clearerpicture of how to improve upon the current TiVo system.

Page 5: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 5 of 44Contextual Inquiry & Analysis – Web-based Survey

Stakeholders

Following is a preliminary list of the stakeholders in the development of TiVo Two. Certainly, theproject’s success will ultimately depend on user adoption of the new system; however, there aremany other groups of people that hold a stake in this project’s success.

1) Users (current TiVo and potential TiVo Two users): Users could enjoy a moresatisfactory and easy usage experience through an enhanced interface.

2) Owners of TiVo, Inc.: Their revenue is dependant upon the success/failure of therelease of TiVo Two.

3) Skip Commershel (VP of Development): His job and reputation could be dependantupon the success/failure of the release of TiVo Two.

4) Product Developers: These people must build TiVo Two according to the establishedrequirements.

5) TiVo Marketing and Public Relations Staff: These people are required to promoteTiVo Two new product features. They (and the company as a whole) will benefit fromany increased customer base resulting from TiVo Two’s enhancements.

6) Vendors/Merchants Selling the TiVo Product: Their revenue is partially dependantupon the success/failure of the release of TiVo Two.

7) Service Technicians and Customer Support Staff: They will be required to maintainthe functionality of the enhanced TiVo Two for all users.

8) Advertisers: They will be concerned with the TiVo Two’s viewership and the visibility oftheir marketing efforts within the system.

9) Television Stations and Cable Companies: These organizations make theirprogramming data available to the TiVo Two system for download by customers. Theyhave existing relationships with advertisers and sponsors that should be honored by theTiVo Two system.

Page 6: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 6 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey Implementation Summary

Our survey was a Web-based (using DePaul ITD’s QuickData2 software) and, as such, providedus with an Excel spreadsheet of data from which to do our calculations and analyses. The surveyallowed us to check for errors as well as missing data within the spreadsheet. It wasadministered to 31 participants, all current or previous TiVo users. The survey was administeredover the course of one week. Participants were recruited by word of mouth, via a posting on thecraigslist TV Forum, and through e-mails directed at known TiVo users.

The survey dealt with user requirements that surfaced during our previously conductedinterviews and focus group. These requirements concerned programming recommendations, theorganization of recorded programs, user accounts, customization abilities, a help guide/TiVosupport, the physical design of the remote control, and the implementation of a storage-capacityindicator.

Initially, a paper-based pilot survey was administered to 12 participants. This survey contained awide range of questions dealing with the above-mentioned requirements. Based upon feedbackreceived during this pilot session, we trimmed the survey down to 32 questions and administeredthe final version in an on-line format.

The final results were tabulated in an Excel spreadsheet and converted to graphs and charts forinterpretation. The end results revealed usage patterns and user opinions regarding theaforementioned requirements.

Page 7: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 7 of 44Contextual Inquiry & Analysis – Web-based Survey

Profile of Survey Respondents

The following information was gleaned from the responses to demographics questions posed atthe close of our survey (see Appendix C for charts depicting these results):

GenderMale................................... 58%Female............................... 42%

Age Range15 or younger ...................... 0%16 – 25 .............................. 23%26 – 35 .............................. 42%36 – 45 .............................. 32%46 – 55 ................................ 3%56 or older ........................... 0%

Television Usage (hours per week)0 – 5.................................... 3%6 – 10.................................. 6%11 – 20 .............................. 26%21 – 30 .............................. 39%31 – 40 .............................. 10%50 or more......................... 16%

DVR (e.g., TiVo) ExperienceCurrently uses a DVR.......... 68%Does not currently use ....... 32%but has previouslyused a DVR

Computer UsageDaily .................................. 90%Weekly............................... 10%Monthly................................ 0%Never................................... 0%

Internet UsageDaily .................................. 94%Weekly................................. 6%Monthly................................ 0%Never................................... 0%

Page 8: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 8 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey Analysis, Findings, and RecommendationsTIVO RECOMMENDATIONS FOR PROGRAMMING (Survey Questions1–5)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included five questions to uncover whether or not the participants are using therecommendations feature, are satisfied with the recommendations feature, and how they wouldlike to see the recommendations feature change if they could change it. The recommendationquestions were the first five questions within the survey. Essentially, the survey data uncoveredthat the majority of the survey participants (55% or 17 survey participants) are currently notusing the recommendations feature (question 1); however, the majority of the participants(56%) would like to keep this feature as part of the TiVo system (question 3). Twenty of thesurvey participants found the recommendations feature of the current TiVo system to be'somewhat helpful' or 'not helpful at all' (question 2); however, as mentioned, the majority (56%)of the participants still want to make sure that the recommendations feature remains part of theTiVo system (question 3). The majority (18) of the participants indicated that they would wantto be able to enable and disable the recommendation feature at will (question 4). More thanone-third (13) of the participants want to see these recommendations for programming byselecting a recommendation button on the remote control and another one-third (11) of theparticipants indicated that they would want to see the recommendations on a recommendationscreen. The other participants (7) split their selections between the “now playing” page (1), the“recommendations” page in TiVo central (3), and an auto pop-up screen indicating therecommendations (3). The option of displaying the programming recommendations on the“record” page was not selected by any of the survey participants (question 5). When weanalyzed the usefulness of the ability to enable/disable the TiVo recommendations according tothose who are currently using the recommendations feature, the data indicated that 4 of the 14found it to be 'very useful', 6 of the 14 found it to be 'quite useful', 4 of the 14 found it to be'somewhat useful', and none of the 14 found it to be 'not useful at all'. When we analyzed thefavored way for TiVo to display its current recommendations among those that are currentlyusing the recommendation feature, the data indicated that 6 out of 14 want to see this feature asan option on the remote control. The other options for recommendations access each receivedless than 3 selections, with the “record” screen receiving no selections by the participants thatcurrently use the feature.

RECOMMENDATIONSBased on the data collected from the first five survey questions, TiVo should keep theprogramming recommendations feature as part of the TiVo system but make some changes tobetter meet the needs of the users. The data points to improving the recommendations featuressince the majority of the users are not satisfied with the recommendations feature as it presentlyexists. The data suggests users should have the option to enable or disable the recommendationfeature at will, which is not an option that the current TiVo system offers. The data alsosuggests the best place for viewing TiVo recommendations would be by having the option toselect a “recommendations” button on the TiVo remote control in order to view therecommendations that TiVo has available and to have a specific screen dedicated to TiVorecommendations. Based on the data collected within this survey, it would be difficult to inferthat just by adding an enable/disable option to the recommendations feature, in addition to thenew ways of viewing recommendations with the remote hot button and the special screen, thatTiVo could increase the number of users that utilize its recommendations or improve thelikeability and usefulness of this feature. It is our conclusion, however, that the option to enableor disable the recommendations feature should be added to the TiVo Two system. It is ourconclusion that the hot button on the remote should be added as well as a special, dedicatedrecommendations page to the TiVo system. It is also our conclusion that more data would need

Page 9: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 9 of 44Contextual Inquiry & Analysis – Web-based Survey

to be collected to determine what else could be changed within the recommendations feature toincrease the number of users that find the recommendations helpful and useful.

KEY POINTS• Keep the recommendations feature• Add an enable/disable option to the recommendations feature• Add a hot button to the TiVo remote that takes the user to the recommendations• Add a special/dedicated recommendations page to the TiVo interface

Page 10: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 10 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisORGANIZING RECORDED PROGRAMS (Survey Questions 6–11)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included six questions to uncover whether the participants are organizing theirrecorded programming with the current TiVo system, whether it is important to them to organizetheir programming, and how they would like to organize their recorded programs. Theorganization questions were questions 6–11 within the survey. Essentially, the survey datauncovered that the majority of the survey participants (61%) are currently not organizing theirrecorded programs (question 6). Nineteen of the survey participants (almost two-thirds)indicated that they think it is 'very important' (11) or 'quite important' (8) to be able to organizetheir shows (question 8). Only 3 of the survey participants thought that it was 'not important atall' to be able to organize their recorded shows (question 8). Six of the participants indicatedthat they are 'not interested at all' in being able to organize their shows by the day of the week,with 10 of the participants being ‘somewhat interested’, 9 of the participants being ‘quiteinterested’, and 6 of the participants being ‘not interested at all’ (question 9). Almost two-thirds(18) of the participants indicated that they are 'very interested' in being able to order all of theepisodes of a recorded show chronologically according to the actual air dates (question 10).More than two-thirds of the participants (21) indicated that they would be interested in the abilityto custom-create their own categories and genres for storing recorded programming (question11). When we compared the interest in organizing shows by day of the week among those thatwere currently organizing their shows (12), we found that 5 participants were 'very interested', 1was 'quite interested', 4 were 'somewhat interested', and 2 were 'not at all interested'. When wecompared the participants’ interest in custom-created categories among those that were currentlyorganizing their shows (12), the data indicated that 7 of the 12 were 'very interested'.

RECOMMENDATIONSBased on the data collected from questions 6–11, TiVo should consider improving theorganization options for recorded programming since not many users are presently using thisfeature. However, the majority of the survey participants indicated that it is important to them tobe able to organize their recorded programming. The data suggests that it would not be a badidea to offer options for organizing by the day of the week and that the majority of theparticipants would be interested in chronological ordering of episodes or the ability to create acustom category or genre for the storage organization. It is our conclusion that providing theuser with the freedom to choose the best organization system would be the best way to go withthis feature. Possibly offering three options (by day of the week, by show episode chronologicalorder, and within a custom created organization system) would give the user the options thatthey seem to be looking for here.

KEY POINTS• Improve options for organization of recorded programming• Add a custom organization option• Add an option that organizes shows by days of the week• Add an option that organizes shows chronologically by episode

Page 11: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 11 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisUSER ACCOUNTS (Survey Questions 12–14)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included three questions to uncover whether or not the participants are interested inuser accounts within their TiVo systems and if they would want these accounts to be passwordprotected and/or sharable with other TiVo users. The questions concerning user accounts werequestions 12–14 within the survey. Essentially, the survey data uncovered that the one-third ofthe participants (10) would be 'very interested' in user accounts and that only 4 of the surveyparticipants would be 'not interested at all' (question 12). The data also indicated a fairly equaldistribution among those who are interested in password-protecting a private folder and thosethat are not at all interested, with 7 participants being ‘very interested’, 7 being ‘quite interested’,10 being ‘somewhat interested’, and 7 being ‘not interested at all’ (question 13). A similardistribution of selections occurred when we asked the participants if they would want to sharethis folder with others using the same TiVo system: 7 indicated that they would be ‘veryinterested’, 7 indicated that they would be ‘quite interested’, 7 indicated that they would be‘somewhat interested’, and 10 indicated that they are ‘not interested at all’ (question 14). Whenwe analyzed the participants that expressed interest in having an individual user accounts amongthose that are ‘very interested’ or ‘quite interested’ in having these accounts password protected,and the data indicated that 6 of the 19 are ‘very interested’ in the password feature, 4 are ‘quiteinterested’, 6 are ‘somewhat interested’, and 3 are ‘not interested at all’. When we analyzedthose participants that are interested in having an individual user account among those that arecurrently organizing their recorded programming, the data indicated that 3 of the 12 are ‘veryinterested’, 4 are ‘quite interested’, 2 are ‘somewhat interested’, and 3 are ‘not interested at all’.

RECOMMENDATIONSBased on the data collected from questions 12–14, TiVo should consider adding an individualaccount option for those that are interested. The data indicates that our participants have mixedfeelings about this feature but that some are very interested. A feature is something in additionto functionality, and it is an option that the user can take advantage of or not, and in this case,adding the three suggestions concerning accounts would be something that potentially half of theparticipants would take advantage of. It is our recommendation that TiVo add the option forcreating user accounts, the option to make those accounts password-protected, and the optionfor users to share their folders/accounts with other TiVo users.

KEY POINTS• Add the option for users to create individual accounts that store their shows• Add the option for users to password-protect these accounts so that they can remain

private• Add the option for users to share their accounts/folders with others using the same the

TiVo system

Page 12: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 12 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisCUSTOMIZATION (Survey Questions 15–16)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included two questions to uncover whether or not the participants think it isimportant to be able to customize the text size within the TiVo interface and/or the look of theTiVo interface (e.g., screen colors, etc.). The questions concerning customization were questions15–16 within the survey. The survey data indicated that slightly more participants indicated thatcustomizing the interface look is something that interests them (6 participants indicated that theywould be ‘very interested’, and 11 indicated that they would be ‘quite interested’) than indicatedthat customizing the text size would interest them (6 participants indicated they would be ‘veryinterested’, and 9 indicated that they would be ‘quite interested’) (question 15 and 16). In bothcases, more than one-third of the survey participants would like to see these options.

RECOMMENDATIONSBased on the data collected from questions 15–16, TiVo should consider adding some options forcustomizing both the text size and the look of the TiVo interface. The data indicates that ourparticipants have mixed feelings about this feature but that some (more than one-third) are ‘very’or ‘quite interested’. A feature is something in addition to functionality, and it is an option thatthe user can take advantage of or not, and in this case, adding the two suggestions concerningcustomization would be something that potentially one-third of the participants would takeadvantage of. It is our recommendation that TiVo add the option for customizing text size andthe interface look.

KEY POINTS• Add option to customize text size• Add option to customize interface look (color, background, etc.)

Page 13: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 13 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisON-SCREEN HELP GUIDE (Survey Questions 17–18)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included two of questions to uncover whether or not the participants think that likelythat they would use an on-screen help guide and what they think would be the best location forthat help guide. The questions concerning the help guide were questions 17–18 within thesurvey. The survey data indicated that the majority of the participants were ‘somewhat likely’(17) to use an on-screen help guide. 12 of the survey participants were equally distributed intothe ‘very likely’ and ‘quite likely’ selections (6 participants each), and only 2 participants indicatedthat they are ‘not likely at all’ to use an on-screen help guide (question 17). An overwhelmingmajority of the participants (16) indicated that they would want the help screen to be available(via pop-up) when they press a hot button on the remote control, leaving only 1 participantindicating interest in a help guide option on all of TiVo’s screens, 8 indicating interest in a specialhelp-guide screen, and 6 indicating interest in accessing a help guide from the TiVo main menu(question 18). However, when we analyzed the data surrounding the location of the help guidewith the participants that are ‘very’ or ‘quite likely’ to use the on-screen help, the majority ofrecommendations were split between the hot button on the remote and a dedicated help-guidescreen.

RECOMMENDATIONSBased on the data collected from questions 17–18, TiVo should consider adding an on-screenhelp guide, since only 2 of the survey participants indicated that it is ‘not likely at all’ that theywould use this feature. Although the majority of the participants indicated that they are‘somewhat likely’ to take advantage of this feature, we feel that this is indication enough toimplement the feature in the next version of TiVo. A feature is something in addition tofunctionality and is an option that the user can take advantage of or not, and in this case, addingthe help feature would be something that the majority of the survey participants would be likelyto use at some point when they encounter difficulties with the new TiVo system and interface. Itwould be particularly important to include this feature if TiVo Two has a large number of changesthat could cause usability issues. When it comes to accessing the on-screen help, it is ourrecommendation to include a specific help-guide screen that is dedicated to assistance with thenew interface but to also give the users the hot button access to this screen from their remote.10 of the 12 participants who responded that they are likely to use the help guide split theirselections equally between these two options, and there would be no reason not to include bothbased on the data that we collected. It seems unreasonable to include a help option on all of theTiVo screens since none of the participants that stated interest in the help feature indicated thatthis would be a good idea.

KEY POINTS• Add an on-screen help guide feature to TiVo with a dedicated interface or screen• Add a hot button on the remote that takes the user directly to the help-guide screen

Page 14: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 14 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisREMOTE CONTROL (Survey Questions 19–24)See Appendix A for a matrix of these results and Appendix C for charts depicting these results.

ANALYSIS OF DATAThe survey included six questions to uncover whether or not the participants are satisfied withthe current TiVo remote control. The questions concerning the remote control were questions19–24 within the survey. More than two-thirds of the survey participants indicated that they areeither ‘very satisfied’ (9) or ‘quite satisfied’ (17) with the record button on the remote control(question 19). Only 5 of the participants indicated that they are only ‘somewhat satisfied’ withthe record button, and none of the participants indicated that they are ‘not satisfied at all’(question 19). A similar distribution was indicated in the data concerning the location of the playbutton on the remote control: 12 were ‘very satisfied’, 14 were ‘quite satisfied’, only 5 were‘somewhat satisfied’, and none of the participants were ‘not satisfied at all’ (question 21). A verysimilar distribution occurred with the question concerning the pause button on the remote: 13were ‘very satisfied’, 14 were ‘quite satisfied’, 4 were ‘somewhat satisfied’, and none of theparticipants were ‘not satisfied at all’ (question 23). Overall, the data that we collected indicatedthat the majority of our survey participants are ‘very’ and ‘quite satisfied’ with these existingremote buttons.

RECOMMENDATIONSBased on the data collected from questions 19–24, TiVo should consider keeping the remote as itis now. However, data from both the earlier help guide and recommendations questions indicatethat a few new buttons should be added to the remote. It is our recommendation that TiVo keepthe remote as similar as possible to the existing remote but run some prototype usability testingto determine the best location to place the hot buttons for the help-guide screen and therecommendations screen. At this time, we do not have enough data to recommend where thosebuttons should be located on the new remote design.

KEY POINTS• The remote is satisfactory as it is, and the location of the play, pause, and record buttons

should not be moved• Add a hot button to access the help-guide from the remote (suggestion from “On-Screen

Help Guide” section of this survey analysis)• Add a hot button to access TiVo recommendations from the remote (suggestion from

“TiVo Recommendations for Programming” section of this survey analysis)• Add a hot button to access the storage-level indicator from the remote (suggestion from

“Storage-Level Indicator” section of this survey analysis)• Run prototype usability testing to determine the best location for the new hot buttons

Page 15: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 15 of 44Contextual Inquiry & Analysis – Web-based Survey

Survey AnalysisSTORAGE-LEVEL INDICATOR (Survey Questions 25–26)

ANALYSIS OF DATAThe survey included two questions to uncover some details surrounding a potential storage-levelindicator. In our past studies, we learned that the storage indicator is something that many ofthe users want—almost consistently across the board. Our survey focused on where theindicator should be located and how the user would like to be alerted about the status of thestorage level. The questions concerning the storage-level indicator were questions 25–26 withinthe survey. More than one-third of the participants (12) indicated that they would like to see theindicator within the main menu of TiVo Central (question 25). Placing the indicator on the TiVoset-top box came in a close second with 8 participant responses. The record screen came inthird with 6 participant responses, followed by a special storage-level indicator screen with 5participant responses (question 25). Question 26 concerned what the participants feel would bethe most helpful way of being alerted on the storage-level status. More than one-third of theparticipants indicated that they would like to see the storage-level indicator screen when theypress a button on the remote control. Surprisingly, only 4 of the participants indicated that theywould like to see the indicator always present on the TiVo box, when in the previous question(question 25) they indicated that this is where they would like to see the indicator. Nine of theparticipants were interested in seeing the indicator every time you turn on TiVo, and only 4wanted an alert noise to let them know when they are getting low on storage.

RECOMMENDATIONSBased on the data collected from questions 25–26, we can offer two recommendationsconcerning the storage indicator. The first recommendation is that the remote incorporateanother hot button that brings the user straight to the screen indicating the storage level. Thesecond recommendation is that the new TiVo box incorporates an indicator directly on the set-topbox in plain sight that gives a visual cue for the user as to how much storage they have availablewithout him or her having to do anything. The indicator on the box likely would not containmuch detail and would be intended as a quick reference. Since 8 of the participants indicatedthat this is something that would interest them, we think it would be reasonable to incorporatethis option in addition to the more detailed screen that would be accessible via the remote hotbutton.

KEY POINTS• Create a storage-level indicator program (determined from past research data, i.e.,

interviews and focus group)• Add a storage-level indicator to the TiVo set-top box that is visible to the user and could

serve as a quick reference to assess storage availability• Add a storage-level indicator screen to the TiVo interface• Add a hot button to the remote that allows quick access to the storage-level indicator

screen

Page 16: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 16 of 44Contextual Inquiry & Analysis – Web-based Survey

Conclusion

In conclusion, our survey responses successfully refined the insights we acquired during ourinterviews and focus group. These insights concern current TiVo users’ attitudes towardprogramming recommendations, the organization of recorded programs, user accounts,customization abilities, TiVo support (via a help guide), the physical design of the remote control,and the implementation of a storage-capacity indicator. This survey served as the final phase offeedback iteration and has built upon our knowledge of what TiVo users want from their TiVosystems, while also strengthening our understanding of their overall needs.

Page 17: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 17 of 44Contextual Inquiry & Analysis – Web-based Survey

Appendix A - Survey Results Matrix

Matrix Category Question Overall Results(Out of 31 Respondents)

Technological 1. Do you currently useTiVo’s recommendationsfeature?

Yes: 45%No: 55%

Technological 2. Please rate howhelpful you feel TiVo’srecommendations arefor you.

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.16

User Control and Freedom 3. If given the choice,would you keep therecommendation-makingfeature in your TiVosystem?

Yes: 56%No: 44%

User Control and Freedom 4. Would you find ituseful to be able toenable/disable therecommendationsfeature at will?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 3.48

Technological/Feedback 5. Which of thefollowing do you feel isthe best way for TiVo toshow you itsrecommendations?

Automatic pop-up of recommendationson screen when turning on TiVo: 3responses

When pushing a “Recommendations”button on the remote control: 13responses

Display of recommendations on the mainmenu (TiVo Central): 3 responses

Display of recommendations on the“Now Playing” page: 1 responses

Display of recommendations on the“Record” page: 0 responses

Display of recommendations on aspecific “Recommendations” screen: 11responses

User Control and Freedom 6. Do you currentlyorganize the showsyou’ve recorded throughTiVo in any particularorder?

Yes: 39%No: 61%

Page 18: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 18 of 44Contextual Inquiry & Analysis – Web-based Survey

User Control and Freedom 7. If you do currentlyorganize the shows thatTiVo records for you,how do you typicallyorganize them?

Chronologically by date recorded

In alphabetical order by name

By category/genre (e.g., comedy, drama)

By episode (grouping together ofepisodes of the same show

User Control and Freedom 8. Please, rate theimportance of being ableto organize yourrecorded shows.

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.87

User Control and Freedom 9. How interested wouldyou be in organizingyour recorded shows byday of the week?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.48

User Control and Freedom 10. How interestedwould you be inordering all episodes ofa recorded showchronologically (actuallyseeing the air dates)?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 3.23

User Control and Freedom 11. How interestedwould you be in theability to custom-createyour own categories andgenres for your recordedshows?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.87

User Control andFreedom/Security

12. How interestedwould you be in havingyour own individual useraccount/folder forstoring your recordedshows?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.81

Security 13. How interestedwould you be in havingthis user account/folderbe private (password-protected)?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.45

User Control andFreedom/Security

14. How likely wouldyou be to share yourindividual folder withothers using the sameTiVo system?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.35

Environmental/Aesthetics 15. How important doyou think the ability tocustomize the text sizeon the TiVo screen is?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.45

Page 19: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 19 of 44Contextual Inquiry & Analysis – Web-based Survey

Aesthetics 16. How interestedwould you be in havingthe ability to customizethe look of the TiVoscreen (for example,changing thebackground color)?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.55

Learnability 17. How likely wouldyou be to use an on-screen help guide?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 2.52

Learnability 18. Which of thefollowing do you feel isthe best location for anon-screen help guide?

Display of help guide option on the mainmenu (TiVo Central): 6 responses

Display of help guide on a specific “HelpGuide” screen: 8 responses

Display of help guide option in all TiVoscreens: 1 responses

Pop-up display of help guide whenpushing a “Help” button on the remotecontrol: 16 responses

Technological/Aesthetic

19. Are you satisfiedwith the location of the“Record” button on theTiVo remote control?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 3.13

Technological/Aesthetic 20. If you are"Somewhat satisfied" or"Not satisfied at all" withthe location of the"Record" button on theTiVo remote control,where would you like tosee it located?

[Note: There were very few write-inresponses.]Move the Record button to top of remote

Make the Record button bigger

Technological/Aesthetic 21. Are you satisfiedwith the location of the“Play” button on theTiVo remote control?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 3.23

Technological/Aesthetic 22. If you are"Somewhat satisfied" or"Not satisfied at all" withthe location of the "Play"button on the TiVoremote control, wherewould you like to see itlocated?

[Note: There were very few write-inresponses.]Switch the Play and the Pause buttons

Make the Play button as big as the Pausebutton

Technological/Aesthetic 23. Are you satisfiedwith the location of the“Pause” button on theTiVo remote control?

(4 = Very; 3 = Quite; 2 = Somewhat;1 = Not at all)Average rating: 3.29

Page 20: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 20 of 44Contextual Inquiry & Analysis – Web-based Survey

Technological/Aesthetic 24. If you are"Somewhat satisfied" or"Not satisfied at all" withthe location of the"Pause" button on theTiVo remote control,where would you like tosee it located?

[Note: There were very few write-inresponses.]Switch the Pause and the Play buttons

Technological/Aesthetic 25. If TiVo had anindicator to display howmuch storage space wasleft for recording shows,where do you feel thisindicator would be bestlocated?

On the main menu (TiVo Central): 12responses

On the "Record" screen: 6 responses

On a special "Storage-Level Indicator"screen: 5 responses

On the TiVo box: 8 responsesTechnological/Feedback 26. If TiVo had an

indicator to display howmuch storage was leftfor recording shows,which manner of alertdo you feel would be themost helpful inindicating storage-levelstatus?

Alert noise is sounded when storage islow: 4 responses

Indicator always appears on the screenwhen TiVo is turned on: 9 responses

Indicator only appears when “Storage-Level Indicator” button is pressed on theremote control: 14 responses

Indicator is always visible on the TiVobox: 4 responses

Demographics 27. What is yourgender?

Male: 58%Female: 42%

Demographics 28. How old are you? 15 or younger: 0%16 – 25: 23%26 – 35: 42%36 – 45: 32%46 – 55: 3%56 or older: 0%

Demographics 29. How many hours perweek, on average, doyou watch TV?

0 – 5: 3%6 – 10: 6%11 – 20: 26%21 – 30: 39%31 – 40: 10%50 or more: 16%

Demographics 30. What is yourexperience in using aDigital Video Recorder(Example: TiVo is aDVR)?

I currently use a DVR: 68%I do not currently use but havepreviously used a DVR: 32%

Page 21: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 21 of 44Contextual Inquiry & Analysis – Web-based Survey

Demographics 31. How frequently doyou use a computer?

Daily: 90%Weekly: 10%Monthly: 0%Never: 0%

Demographics 32. How often do youaccess the Internet?

Daily: 94%Weekly: 6%Monthly: 0%Never: 0%

Page 22: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 22 of 44Contextual Inquiry & Analysis – Web-based Survey

Appendix B - Web-Based Survey Questions

LINK TO SURVEY: http://www.itd.depaul.edu/quickdata2/viewwebform.asp?id=1338

TiVo Survey

InstructionsThe intent of this survey is to help make TiVo a better product for you. This survey will help usunderstand the needs and desires of people using the current TiVo system so we can makerecommendations on how to make improvements in the next version of the system. Yourparticipation in this survey is very important to us. All of your answers are confidential and willbe used strictly for research purposes. There will be no sales or marketing follow-ups after yourparticipation in this survey. This survey is being administered for scholastic purposes only. Ifyou have any questions or comments about this survey, you may e-mail them to Tamerat Aligazat [email protected]. Thank you for participating.

1. Do you currently use TiVo’s recommendations feature?o Yeso No

2. Please rate how helpful you feel TiVo’s recommendations are for you.o Very helpfulo Quite helpfulo Somewhat helpfulo Not helpful at all

3. If given the choice, would you keep the recommendation-making feature in yourTiVo system?

o Yeso No

4. Would you find it useful to be able to enable/disable the recommendations featureat will?

o Very usefulo Quite usefulo Somewhat usefulo Not useful at all

5. Which of the following do you feel is the best way for TiVo to show you itsrecommendations?

o Automatic pop-up of recommendations on screen when turning on TiVoo When pushing a “Recommendations” button on the remote controlo Display of recommendations on the main menu (TiVo Central)o Display of recommendations on the “Now Playing” pageo Display of recommendations on the “Record” pageo Display of recommendations on a specific “Recommendations” screen

6. Do you currently organize the shows you’ve recorded through TiVo in anyparticular order?

o Yeso No

Page 23: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 23 of 44Contextual Inquiry & Analysis – Web-based Survey

7. If you do currently organize the shows that TiVo records for you, how do youtypically organize them? Please provide your answer in the space below. If you donot currently organize your shows, please skip this question.

8. Please rate the importance of being able to organize your recorded shows.o Very importanto Quite importanto Somewhat importanto Not important at all

9. How interested would you be in organizing your recorded shows by day of theweek?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

10. How interested would you be in ordering all episodes of a recorded showchronologically (actually seeing the air dates)?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

11. How interested would you be in the ability to custom-create your own categoriesand genres for your recorded shows?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

12. How interested would you be in having your own individual user account/folderfor storing your recorded shows?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

13. How interested would you be in having this user account/folder be private(password-protected)?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

14. How likely would you be to share your individual folder with others using thesame TiVo system?

o Very likelyo Quite likelyo Somewhat likelyo Not likely at all

Page 24: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 24 of 44Contextual Inquiry & Analysis – Web-based Survey

15. How important do you think the ability to customize the text size on the TiVoscreen is?

o Very importanto Quite importanto Somewhat importanto Not important at all

16. How interested would you be in having the ability to customize the look of theTiVo screen (for example, changing the background color)?

o Very interestedo Quite interestedo Somewhat interestedo Not interested at all

17. How likely would you be to use an on-screen help guide?o Very likelyo Quite likelyo Somewhat likelyo Not likely at all

18. Which of the following do you feel is the best location for an on-screen helpguide?

o Display of help guide option on the main menu (TiVo Central)o Display of help guide on a specific “Help Guide” screeno Display of help guide option in all TiVo screenso Pop-up display of help guide when pushing a “Help” button on the remote control

19. Are you satisfied with the location of the “Record” button on the TiVo remotecontrol?

o Very satisfiedo Quite satisfiedo Somewhat satisfiedo Not satisfied at all

20. If you are "Somewhat satisfied" or "Not satisfied at all" with the location of the"Record" button on the TiVo remote control, where would you like to see it located?Please provide your answer in the space below. If you are "Very satisfied" or "Quitesatisfied" with the current placement of the "Record" button on the remote, pleaseskip this question.

21. Are you satisfied with the location of the “Play” button on the TiVo remotecontrol?

o Very satisfiedo Quite satisfiedo Somewhat satisfiedo Not satisfied at all

22. If you are "Somewhat satisfied" or "Not satisfied at all" with the location of the"Play" button on the TiVo remote control, where would you like to see it located?Please provide your answer in the space below. If you are "Very satisfied" or "Quitesatisfied" with the current placement of the "Play" button on the remote, please skipthis question.

Page 25: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 25 of 44Contextual Inquiry & Analysis – Web-based Survey

23. Are you satisfied with the location of the “Pause” button on the TiVo remotecontrol?

o Very satisfiedo Quite satisfiedo Somewhat satisfiedo Not satisfied at all

24. If you are "Somewhat satisfied" or "Not satisfied at all" with the location of the"Pause" button on the TiVo remote control, where would you like to see it located?Please provide your answer in the space below. If you are "Very satisfied" or "Quitesatisfied" with the current placement of the "Pause" button on the remote, pleaseskip this question.

25. If TiVo had an indicator to display how much storage space was left for recordingshows, where do you feel this indicator would be best located?

o On the main menu (TiVo Central)o On the "Record" screeno On a special "Storage-Level Indicator" screeno On the TiVo box

26. If TiVo had an indicator to display how much storage was left for recordingshows, which manner of alert do you feel would be the most helpful in indicatingstorage-level status?

o Alert noise is sounded when storage is lowo Indicator always appears on the screen when TiVo is turned ono Indicator only appears when “Storage-Level Indicator” button is pressed on the remote

controlo Indicator is always visible on the TiVo box

27. What is your gender?o Maleo Female

28. How old are you?o 15 or youngero 16 – 25o 26 – 35o 36 – 45o 46 – 55o 56 or older

29. How many hours per week, on average, do you watch TV?o 0 – 5o 6 – 10o 11 – 20o 21 – 30o 31 – 40o 50 or more

Page 26: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 26 of 44Contextual Inquiry & Analysis – Web-based Survey

30. What is your experience in using a Digital Video Recorder (Example: TiVo is aDVR)?

o I currently use a DVR.o I do not currently use but have previously used a DVR.

31. How frequently do you use a computer?o Dailyo Weeklyo Monthlyo Never

32. How often do you access the Internet?o Dailyo Weeklyo Monthlyo Never

Thank You

Thank you very much for completing our survey! The information you have provided will beextremely helpful to us in making recommendations on how to improve the TiVo system.

Page 27: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 27 of 44Contextual Inquiry & Analysis – Web-based Survey

Appendix C - Charted Survey Results

Question #1: Do you currently use TiVo's recommendations feature?

45%

55%

Yes

No

Question 2: Please rate how helpful you feel TiVo's recommendations are for you.

4

7

10 10

2.16

0

2

4

6

8

10

12

Very helpful(4)

Quite helpful(3)

Somewhathelpful (2)

Not at allhelpful (1)

AverageRating

Response

Nu

mb

er o

f re

spo

nse

s

Page 28: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 28 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 3: Would you keep the recommendation making feature in your TiVo system?

56%

44%Yes

No

Question 4: Would you find it helpful to be able to enable/disable the recommendations feature at

will?

18 8 5 0 3.480

5

10

15

20

Very helpful(4)

Quite helpful(3)

Somewhathelpful (2)

Not at allhelpful (1)

AverageRating

Responses

Nu

mb

er o

f re

spo

nse

s

Page 29: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 29 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 5: Which of the following do you feel is the best way for TiVo to show you its

recommendations?

3

13

31

0

11

02468

101214

Aut

omat

ic p

op-u

p on

scre

en

Rec

omm

enda

tion

butto

n on

rem

ote

Dis

play

on

mai

nm

enu

Dis

play

"N

owP

layi

ng"

page

Dis

play

on

"Rec

ord"

page

Dis

play

on

a sp

ecifi

c"R

ecom

men

datio

ns"

page

Responses

Nu

mb

er o

f re

spo

nse

s

Question 6: Do you currently organize the shows you've recorded through TiVo in any particular

order?

39%

61%

Yes

No

Page 30: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 30 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 8: Please rate the importance of being able to organize your recorded shows.

11

89

3 2.87

0

2

4

6

8

10

12

Veryimportant (4)

Quiteimportant (3)

Somewhatimportant (2)

Not importantat all (1)

AverageRating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 9: How interested would you be in organizing your recorded shows by day of the week

6

9

10

6

2.48

0

2

4

6

8

10

12

Very interested(4)

Quiteinterested (3)

Somewhatinterested (2)

Not interestedat all (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Page 31: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 31 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 10: How interested would you be in ordering all episodes of a recorded show chronoligically (actually seeing

the air dates)

18

5 5

3 3.23

0

2

4

6

8

10

12

14

16

18

20

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 11: How interested would you be in the ability to custom-create your own categories and genres for your

recorded shows?

1110

5 5

2.87

0

2

4

6

8

10

12

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Page 32: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 32 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 13: How interested would you be in having this user account/folder be private (password-protected)?

7 7

10

7

2.45

0

2

4

6

8

10

12

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 14: How likely would you be to share your individual folder with others using the same TiVo system?

7 7 7

10

2.35

0

2

4

6

8

10

12

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Page 33: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 33 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 15: How important do you think the ability to customize the text size on the TiVo screen is?

6

9 9

7

2.45

0

1

2

3

4

5

6

7

8

9

10

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 16: How interested would you be in having the ability to customize the look of the TiVo screen (e.g., changing

background color)?

6

11

8

6

2.55

0

2

4

6

8

10

12

Very interested(4)

Quite interested(3)

Somewhatinterested (2)

Not interested atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Page 34: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 34 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 17: How likely would you be to use an on-screen help guide?

6 6

17

2 2.52

0

2

4

6

8

10

12

14

16

18

Very likely (4) Quite likely (3) Somewhat likely(2)

Not likely at all(1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 18: Which of the following do you feel is the best location for an on-screen help guide?

6

8

1

16

0

2

4

6

8

10

12

14

16

18

Display on main menu Display on specific"Help Guide" screen

Display on all TiVoscreens

Pop-us display whenpushing help button

Responses

Nu

mb

er o

f re

spo

nse

s

Page 35: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 35 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 19: Are you satisfied with the location of the "Record" button on the TiVo remote control?

9

17

5

0

3.13

0

2

4

6

8

10

12

14

16

18

Very satisfied (4) Quite satisfied (3) Somewhatsatisfied (2)

Not satisfied atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 21: Are you satisfied with the location of the "Play" button on the TiVo remote control?

12

14

5

0

3.23

0

2

4

6

8

10

12

14

16

Very satisfied (4) Quite satisfied (3) Somewhatsatisfied (2)

Not satisfied atall (1)

Average Rating

Respnses

Nu

mb

er o

f re

spo

nse

s

Page 36: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 36 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 23: Are you satisfied with the location of the "Pause" button on the TiVo remote control?

1314

4

0

3.29

0

2

4

6

8

10

12

14

16

Very satisfied (4) Quite satisfied (3) Somewhatsatisfied (2)

Not satisfied atall (1)

Average Rating

Responses

Nu

mb

er o

f re

spo

nse

s

Question 25: If TiVo had an indicator to display how much storage space was left for recording shows, where do you feel

this indicator would be best located?

12

65

8

0

2

4

6

8

10

12

14

On the main menu On the "Record"screen

On a special "Storage-Level Indicator" screen

On the TiVo box

Responses

Nu

mb

er o

f re

spo

nse

s

Page 37: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 37 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 26: If TiVo had an indicator to display how much storage was left for recording shows, which manner of alert do you feel would be the most helpful in indicating storage-level

status?

4

9

14

4

0

2

4

6

8

10

12

14

16

Alert noise whenstorage is low

Indicator alwaysappears on screen

Indicator only appearswhen button is pressed

Indicator is alwaysvisible on TiVo box

Responses

Nu

mb

er o

f re

spo

nse

s

Question 27: What is your gender?

58%

42%Male

Female

Page 38: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 38 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 28: How old are you?

0%

23%

42%

32%

3%

0%

15 or younger

16-25

26-35

36-45

46-55

56 or older

Question 29: How many hours per week, on average, do you watch TV?

3% 6%

26%

39%

10%

16%

0-5

6--10

11--20

21--30

31--40

50 or more

Page 39: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 39 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 30: What is your experience using a Digital Video Recorder (e.g., TiVo is a DVR)?

68%

32%

Use DVR

Used DVR

Question 31: How frequently do you use a computer?

90%

10%

0%

0%

Daily

Weekly

Monthly

Never

Page 40: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 40 of 44Contextual Inquiry & Analysis – Web-based Survey

Question 32: How frequently do you access the Internet?

94%

6%

0%

0%

Daily

Weekly

Monthly

Never

Usefulness of the the ability to enable/disable TiVo's recommendations feature according to

those who currently use the feature

4

6

4

0

3

0

1

2

3

4

5

6

7

Very useful(4)

Quite useful(3)

Somewhatuseful (2)

Not at alluseful (1)

AverageRating

Responses

Nm

ber

of

Res

po

nd

ents

Page 41: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 41 of 44Contextual Inquiry & Analysis – Web-based Survey

Favored way for TiVo to display itsrecommendations among those who currently use

the recommendations feature

2

6

2

1

0

3

012345678

Aut

omat

ic p

op-u

p of

reco

mm

enda

tion

scre

en w

hen

turn

ing

on T

iVo

Whe

n"R

ecom

men

datio

ns"

butto

n is

pus

hed

onth

e re

mot

e

Dis

play

of

reco

mm

enda

tions

on th

e M

ain

Men

u

Dis

play

of

reco

mm

enda

tions

on th

e "N

owP

layi

ng"

scre

en

Dis

play

of

reco

mm

enda

tions

on th

e "R

ecor

d"sc

reen

Dis

play

of

reco

mm

enda

tions

on a

spe

cific

"Rec

omm

enda

tions

"sc

reen

Responses

Nu

mb

er o

f R

esp

on

den

ts

Interest in organizing recorded shows by dayof the week among those who currenty

organize their shows

5

1

4

2

2.75

0

1

2

3

4

5

6

Veryinterested (4)

Quiteinterested (3)

Somewhatinterested (2)

Not at allinterested (1)

AverageRating

Response

Nu

mb

er o

f R

esp

on

den

ts

Page 42: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 42 of 44Contextual Inquiry & Analysis – Web-based Survey

Interest in ordering all episodes of a recorded how chronologically (by air date) among those

who currenty organize their shows

11

01

0

3.8

0

2

4

6

8

10

12

14

Veryinterested

(4)

Quiteinterested

(3)

Somewhatinterested

(2)

Not at allinterested

(1)

AverageRating

Responses

Nu

mb

er o

f R

esp

on

den

ts

Interest in having the ability to custom-create categories and genres for recorded shows among those who currenty organize their

shows

7

3

0

23.25

0

2

4

6

8

10

12

Veryinterested

(4)

Quiteinterested

(3)

Somewhatinterested

(2)

Not at allinterested

(1)

AverageRating

Responses

Nu

mb

er o

f R

esp

on

den

ts

Page 43: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 43 of 44Contextual Inquiry & Analysis – Web-based Survey

Interest in having an individual user account/folder for storing recorded shows

among those who currenty organizetheir shows

3

4

2

32.58

0

1

2

3

4

5

6

Veryinterested

(4)

Quiteinterested

(3)

Somewhatinterested

(2)

Not at allinterested

(1)

AverageRating

Responses

Nu

mb

er o

f R

esp

on

den

ts

Interest in having a password-protected account/folder among those who responded that

they would be "very interested" or "quite interested" in having their own individual user

account/folder

6

4

6

3 2.68

012345678

Veryinterested

(4)

Quiteinterested

(3)

Somewhatinterested

(2)

Not at allinterested

(1)

AverageRating

Responses

Nu

mb

er o

f R

esp

on

den

ts

Page 44: Contextual Inquiry & Analysis – Web-based User Survey …usabilityperspective.tripod.com/survey.pdf · Contextual Inquiry & Analysis – Web-based User Survey Case Study - TiVo™

DePaul University, CTI, Winter 2005HCI 445: Sitz, Aligaz, Chadraba, Lewandowski

Contextual Inquiry Case Study - TiVoTM

Page 44 of 44Contextual Inquiry & Analysis – Web-based Survey

Desired location of an on-screen help guide among those who responded that they would be "very likely" or "quite likely" to use such a guide

2

5

0

5

0123456

On Main Menu On a "HelpGuide" Screen

On all TiVoScreens

In a Pop-UpDisplay WhenPushing "Help"

on Remote

Location

Nu

mb

er o

f R

esp

on

ses