friday, december 2, 2005 human information processing personal memex virginia tech plans with...

Friday, December 2, 2005

Human InformationProcessingPersonal Memex

Virginia Tech Plans with SenseCam: Early Ideas

Microsoft Memex Workshop, July 2006

Beyond Human Memory:SenseCam Use in Veterinary

College and as Assistive Technology

Manuel A. Pérez-Quiñones,Edward A. Fox



Virginia-Maryland Regional College of Veterinary Medicine

• Context of student life at the Vet School• Goals:

– improve the recall of clinical procedures studied in lab sessions

– promote learning through sharing of information among students

• which should result from integration of– audio/photos from multiple SenseCams,– video from the professor, and– live notes taken by several students

• Sharing:– Students will have the option of providing access to

particular pieces of information by particular users.– Information will be uploaded automatically to a web server

where it will be available to other students for download into their MyLifeBits data store.


Human InformationProcessingPersonal MemexStudents with Disabilities

• Help students with disabilities in their day-to-day activities on campus

• Use location tracking and some form of simple tagging of the audio or video data to help students with prospective remembering

• Allow students with motor disabilities to share data with their care-giver and/or with the staff of the Assistive Technologies office

• Track locations indoors with 802.11 device



Term Veterinary School Students with Disabilities

Spring 2006

Early-semester - 2 students use SenseCam for week at a timeMid-semester - administer memory test; design and prototype data sharing functionalityLate-semester - focus group, interview students

Early-semester – identify students that will participate; consider privacy and legal issuesMid-semester – allow student to use SenseCam for a period of time. Design and prototype indoor route visualization.Late-semester – analyze effectiveness of SenseCam for students with disabilities

Summer 2006

Implementation of new functionality into MyLifeBits schema.Write papers with early results, participate in workshops

Fall 2006

Repeat memory study using new functionality.Consider collaboration and sharing of data more explicitly.

Recruit new participantsDeploy system with participants and care-giversEvaluate effectiveness.

Publish results, participate in workshops

Original Timeline



Human Information Processing

with the

Personal Memex

Ingrid Burbey, Gyuhyun Kwon, Uma Murthy, Nicholas Polys, Prince Vicent

Human Information Processing Project Presentation


Human InformationProcessingPersonal MemexOverview

Literature Search:

HIP Principles

Initial Prototype

Expert Interviews

Cognitive Walkthroughwith experts

Scenarios

Task Analysis

Revised PrototypeDesign Guidelines

1. Project Overview

AnnotatedBibliography


Human InformationProcessingPersonal MemexOverview

Literature reviewExpert Interview

Studies of current related systemsBrainstorming

Design

Analysis

Prototype&Evaluation

Scenario generationFunction decomposition

Task decompositionSpecifying interaction

Low fidelity prototypeCognitive walkthrough

Iterative analysis and design based on Usability claims and HIP principle

1. Project Overview



Memex Prototyping

Test ScenarioDescription

Performing Cognitive Walkthrough

Record usability

problems found

Fix the usability

problems

System Requirements

HIP/Usability Principle

Cognitive Walkthrough

1. Cognitive Workthrough Process


Human InformationProcessingPersonal MemexHuman Information Processing: Memory

• The Multi-Store Model (Atkinson & Shiffrin, 1968)

• Encoding, Storage, Retrieval



Human Information Processing: Long-term Memory

• Types of LTM (evidence from Amnesiacs)– Semantic: Knowledge & Facts– Episodic: Events & Experiences – Procedural: Skill

• Aspects of LTM– Explicit aka ‘declarative’– Implicit aka ‘non-declarative’




• Structure of LTM: Schemas– Developed by experience and pre-

programming; accommodation & assimilation

– Prototypical elements are always given priority

– Can be applied non-consciously– Shared across individuals within a culture– Stable over time




Recall can be confounded by:• Proactive interference

– prior learning interferes with subsequent learning

• Retroactive interference – post hoc learning confounds the prior

learning




Models of LTM retrieval• Associative Memory

– Levels of Processing – Cue-dependent forgetting

•Encoding Specificity Principle : Context !!!

– Priming & Cues : visual, verbal, …



Human Information Processing: Working Memory

• Working Memory, Baddeley, 2003


Human InformationProcessingPersonal MemexSymptoms of Macular Degeneration

• Difficult to see colors• Difficulty recognizing faces• Prefer dim backgrounds


Human InformationProcessingPersonal MemexMild Cognitive Impairment

• Due to Hippocampus shrinking • No universally, accepted definition• Symptoms

– Loss of short-term memory– Forgetfulness– Deteriorates over time– Difficulty in associative memory

• Remembering names of people or things


Human InformationProcessingPersonal MemexDesign Guidelines

Design Guidelines• Formulated in the tradition of

Nielsen, Tognazzini • Discovered or confirmed through:

– Literature search– Expert interviews– Cognitive walkthrough



General Results

• Maintain consistent, meaningful graphics• Support opportunistic navigation

– user control and freedom – ‘Bookmarking’ paths, previous searches

• Leverage user recognition rather than recall – provide context for users while searching and browsing memories

• Provide visibility for mode & system status • Provide Internationalized Tool Tips for icons and buttons• Provide Help w/o loosing state• Provide Tutorials explicitly demonstrating functionality



Population-specific Results: Mild Cognitive Impairment

• Simplify task steps• Provide views that can represent time and objects

graphically • Provide time, space, and object reminders

(for schedules, directions, medication)



Population-specific Results: Visual Impairment

• Provide enlargeable fonts & interface items (e.g., buttons)• Provide contrast between font and background• Provide options for audio output: voice, speed,

pitch



Prototype


Human InformationProcessingPersonal MemexGeneral Comments

• Integration with other applications/devices

• Date/time on main screen• Mouse-over magnification• Help menu item• Prototypical terms• Scroll forward to future events


Human InformationProcessingPersonal MemexTablet Idea

• Monday Tablet session• Discussion that people aided by

assistive technologies are delayed a long time before the right affordances arise

• Idea that SenseCam could be used along with a Tablet

• in synergistic capture, analysis, design, deployment methodology


Human InformationProcessingPersonal MemexSummary and Conclusions

• Two planned efforts• Student project report• Tablet idea• Looking forward to new version!• Hoping Microsoft’s many projects

(search, image processing, Tablet, etc.) can be integrated with MyLifeBits

• Hope Microsoft staff can help run a JCDL workshop on personal DLs in 2007

• Open for collaboration– [email protected]

friday, december 2, 2005 human information processing personal memex virginia tech plans with...

Documents

human memory

sharing of information

personal memex ingrid

time slide

retrieval slide

interview students

fox slide

device slide