spectator software usability testing system

This document and its content is conf idential and was created f or the solely use of the intended audience. It is not complete unless supported by the underly inganaly ses and oral presentation of BIOBSERVE GmbH. It may not be reproduced, disclosed or passed on to third parties except with the explicit prior consent of

BIOBSERVE GmbH.

© BIOBSERVE Spectator 2

Spectator

Software Usability Testing System

This document and its content is conf idential and was created f or the solely use of the intended audience. It is not complete unless supported by the underly inganaly ses and oral presentation of BIOBSERVE GmbH. It may not be reproduced, disclosed or passed on to third parties except with the explicit prior consent of

BIOBSERVE GmbH.

Europa: North America:BIOBSERVE GmbH BIOBSERVEKoenigswinterer Str. 418 2125 Center Ave., Suite 50053227 Bonn Fort Lee, New Jersey 07024Tel.: +49 228 20 160 20 Tel.: 201-302-6083Fax: +49 228 20 160 29 Fax: 201-302-6062

www.usability.biobserve.com [email protected]

© BIOBSERVE - www.usability.biobserve.com Software Usability Test System

UsabilityKey features I

Project databaseOrganize your sessions! With the integrated user definable project database you can easily manage and arrange your sessions. This is verycomfortable especially for the analysis of multiple sessions because it makes it easy to find and pool your of specific projects.

Participant databaseThe user definable partic ipant database enables you to administrate your usability test partic ipants within our Spectator Usabilitysoftware. You can save contact data and partic ipant skil ls (e.g. education, computer experience, etc.) within the software and send theme-mails with test session appointments right away.

Task listsCreate different task lists within the task lists database. Tasks can be added, changed and deleted easily.

Behav ior listsCreate different l ists with the behaviors you want to code (e.g. web site testing, product testing, etc.). For each behavior you assign a shortcut on the keyboard. To each behavior you can assign so called modifiers to describe the behavior more detailed.You can for exampleadd the modifiers ﾒcontent l inkﾓ, ﾒleft navigation barﾓ and ﾒtop navigation barﾓ to the behavior ﾒweb site navigationﾓ. Later on you cananalyze how many time the partic ipant spend navigating and which of the different navigation possibil ities he used.

Compose a test sessionTo configure a test session, simply choose a task list, a behavior l ist and one or more partic ipants. Assign the session to a project in theproject database and you are ready to go. Of course you can add additional information like team members, a session description, etc.

Session planerThe session planer is a fantastic tool to plan your test sessions. It is a fully featured calendar where you can easily schedule test sessionsvia drag & drop. You can even assign test sessions to your team members and colleagues and send them e-mails with the session dataautomatically. The calendar provides you an overview over the planed sessions and you can share it in your Intranet or the Internet, too.

Data acquisitionDuring the session, the behaviors are coded either with the defined short cuts on the keyboard or with the mouse. An unlimited undofunction is available. You can arrange the flexible interface to your own convenience.


UsabilityKey features II

Play & EditAfter the data acquisition you can play and edit the videos along with the data and insert or delete behaviors easily.

Integrated Task and behav ior analysisThe task & behavior analysis offers statistical tools to summarize and analyze the coded behaviors and tasks. Templates can be used toperform the same statistical analysis in a very comfortable way.

Pattern analysisWith the pattern recognition tool you can detect if there are patterns in the coded behaviors. You can use different parameters and fi ltersto adapt the pattern recognition to your needs.

Reliability analysisIf multiple observers code the behaviors of the partic ipant you can compare their different results with the reliability analysis tool.

Report generatorThe integrated report generator lets you create standardized session reports fast and easily. You can simply summarize the most importantresults (e.g. time spend on task, success, failure, time out, etc.) and send them as a pdf fi le to your colleagues and customers.

Video editingYou can compose highlighted presentation videos with the most interesting scenes and data within the application. No separate videoediting software is required.

Free player softwareWith the free "Spectator Player" software you can share and distribute your videos and data in a very comfortable way.


UsabilityAdvantages

Original sizeThe monitor video is captured in full resolution (up to 1600x1200 pixels with ca. 10-15 frames/sec) as a MPEG video.

Crystal clearThe monitor video has the same size and quality as the original monitor signal. You can see and read everything on the screen.Don't bepeeved by a fuzzy down scaled scan converter video any more

No picture-in-picture v ideo. No covered screensThe monitor video and the user video are two separated but synchronized fi les. You can resize the videos and move them aroundindependently.

Tape free recordingThe system uses only digital video fi les. No mixers, no tape recorders

Small file sizeWe use MPEG and MPEG l ike encoders, what provides great quality and small fi le sizes. A one hour test session fits on one CD.

No software installation requiredDue to the fact that we use an external device to capture the monitor signal there is no software installation on the test computerrequired. You can record any computer operating system.

Easy to set upThe system is very easy to install what is especially important if you want to use it as a mobile lab.

Code behav iorsUse the "Spectator" software to code the behaviors of the partic ipant and mark interesting scenes in the video.

Share your dataWith the free "Spectator Player" software provided by BIOBSERVE you can share your videos and results with your colleagues and c lients.The player enables them to watch the two synchronized videos and see your codings and bookmarks in the videos.

ScalableAnother big advantage of the our system is the possibil ity to expand the setup and to observe multiple partic ipants and computerssimultaneously (e.g. to observe how they work on the same document in a network).


UsabilitySoftware structure

ConfigurationSettings for Tasks, Behaviors, Participants etc.

AcquisitionBehavioral coding during the recording

Play & EditPlay the recorded sessions and edit the codings

Data AnalysisPool and analyze the acquired data and create highlighted videoswith the most interesting scenes.

The software consits of four main sections


UsabilityConfiguration - Behaviors

Behavior name Short cut (free definable, multiple keys possible) Description Category Interactive (additional person involved in the behavior) Exclusive (other behaviors will be terminated if this behavior is activated) Behavior lists (can contain different behavior combinations) Modifier (extension for a behavior, e.g. reading: content, navigation,

license agreement)• Name• Short cut• Description

Behavior settings include


UsabilityConfiguration - Behaviors


UsabilityConfiguration - Tasks

Name Description Number Task lists

Task settings include


UsabilityConfiguration - Participants

Free definable participants database - for example: Name Address Gender Phone E-mail Computer skills Education .......

Participants settings


UsabilityConfiguration - Sessions

Supervisor Team members Description Task list Behavior list Participants Date and time Project structure

Session settings include


UsabilityConfiguration - Sessions planer

The Session Planer is a calendar where you can schedule all open

(planned) sessions in a very comfortable way. It works similar to other

calendars like Microsoft Outlook or the Palm Desktop.


UsabilityConfiguration - Global settings

Set ups (combinations of Screen Recorders and Cameras) Recording device settings (Screen Recorder, Cameras) Participants table (Field settings) Directories (Backup) Project structure (a 5 level data base, e.g. customer, project, subproject,..) Task rating settings (e.g. failure, success, etc.) Colors

Global settings include


UsabilityAcquisition

The acquisition section shows the participant video the behavior list with the short cuts the task list a clock (session time) a table with your codings a time chart with the hevaiors

in different windows that you can switch on or of and arrange on the screen. You can savedifferent window settings (e.g. for different observers).

You can code behaviors comments assign comments directly to behaviors measure the task time independently of the behaviors rate each task after it is finished (according to your rating settings in the configuration)

You can use the mouse or the keyboard for coding.


UsabilityPlay & Edit

In the Play & Edit section you can watch your recorded sessions andedit the coded behaviors and comments. Of course you can add anddelete behaviors and comments as well.

A table with all codings and a time chart graph are presented alongwith the video data.


UsabilityData Analysis

Pool and analyze the acquired data

Session selectionSelect the session(s) you want to analyze from the project data base

Task analysisAnalyze the tasks (how many completed, failed, etc.)

Behavior analysisAnalyze the behaviors (occurrence, duration, etc.)

Pattern AnalysisFind out if certain patterns occur in the behavior of the participants.

Reliability AnalysisIf more than one observer code the behaviors you can compare the codings

Highlighted VideosCreate highlighted videos of the most interesting scenes for your clients.

spectator software usability testing system

Documents