memex summit, july 2006 sensecam & memory rehabilitation georgina browne, emma berry, narinder...

Memex Summit, July 2006

SenseCam & memory SenseCam & memory rehabilitationrehabilitationGeorgina Browne, Emma Berry, Narinder KapurGeorgina Browne, Emma Berry, Narinder Kapur

Steve Hodges, Lyndsay Williams, Gavin Smyth, James Srinivasan, Steve Hodges, Lyndsay Williams, Gavin Smyth, James Srinivasan, Alex Butler, Alban Rrustemi, Ken WoodAlex Butler, Alban Rrustemi, Ken Wood

2 Memex Summit, July 2006

BackgroundBackground

• Cambridge Memory Clinic, Cambridge Memory Clinic, Addenbrooke’s Hospital Addenbrooke’s Hospital


Causes and treatment of memory lossCauses and treatment of memory loss

• Neurodegenerative disease Neurodegenerative disease – Alzheimer’s disease and Lewy Body dementia Alzheimer’s disease and Lewy Body dementia

can be treated with medication – with limited can be treated with medication – with limited successsuccess

– No medical treatment for other dementiasNo medical treatment for other dementias

– External memory aids (in theory)External memory aids (in theory)

• Acquired brain injury (traumatic and non-Acquired brain injury (traumatic and non-traumatic) traumatic) – External memory aids (in theory)External memory aids (in theory)


Improving memory with SenseCam Improving memory with SenseCam

• Different types of memory:Different types of memory:– Episodic – things you have done (personal Episodic – things you have done (personal

experiences)experiences)

– Semantic – facts and conceptsSemantic – facts and concepts

– Prospective – things you intend to do (go Prospective – things you intend to do (go shopping, visit friends, make and keep shopping, visit friends, make and keep appointments)appointments)

• Almost all memory aids treat prospective Almost all memory aids treat prospective memorymemory


Improving memory with SenseCamImproving memory with SenseCam

• Episodic memory critical to quality of lifeEpisodic memory critical to quality of life– Forms basis for semantic memoriesForms basis for semantic memories– Guides actions, creates bonds, builds self-concept Guides actions, creates bonds, builds self-concept

• SenseCam records experiencesSenseCam records experiences– Captures events from patient’s point of view Captures events from patient’s point of view – Without conscious thought or intrusionWithout conscious thought or intrusion– Plays back quickly in simple-to-use, easy-to-view ‘movie’Plays back quickly in simple-to-use, easy-to-view ‘movie’

• Subsequent viewing of image sequencesSubsequent viewing of image sequences– Cues recall & so consolidates storage of memoriesCues recall & so consolidates storage of memories



• Cambridge Memory Clinic, Cambridge Memory Clinic, Addenbrooke’s Hospital Addenbrooke’s Hospital

• 63 year old, well-educated, 63 year old, well-educated, married woman ‘Mrs B’married woman ‘Mrs B’

• Diagnosed with limbic Diagnosed with limbic encephalitis in 2002encephalitis in 2002

• Now has marked amnesiaNow has marked amnesia– usually no memory a couple of days after eventusually no memory a couple of days after event



• Goals of patient and husbandGoals of patient and husband

– To improve Mrs B’s episodic memoryTo improve Mrs B’s episodic memory

– To share experiences with each otherTo share experiences with each other

– To improve Mrs B’s self-esteem and To improve Mrs B’s self-esteem and confidenceconfidence



• Study ProtocolStudy Protocol

– Experimental condition: SenseCam used to record Experimental condition: SenseCam used to record ‘special’ days (N=9) ‘special’ days (N=9)

– Control condition: written diary used to record ‘special’ Control condition: written diary used to record ‘special’ days (N=3)days (N=3)

– Baseline condition: no memory aid used to help recall Baseline condition: no memory aid used to help recall ‘special’ days (N=2)‘special’ days (N=2)

– Information reviewed every 2 days for 2 weeksInformation reviewed every 2 days for 2 weeks

– Memory evaluated before each reviewMemory evaluated before each review


Results Results

0.0

0.5

1.0

1.5

2.0

2.5

x

ResultsResults

Pro

port

ion

of e

vent

re

mem

bere

d

Memory of an event over time

Baseline

Days elapsed following event


0.0

0.5

1.0

1.5

2.0

2.5

x

Results Results ResultsResults



Diary

Baseline

Pro

port

ion

of e

vent

re

mem

bere

d


0.0

0.5

1.0

1.5

2.0

2.5

x




Diary

SenseCam

Baseline

Pro

port

ion

of e

vent

re

mem

bere

d


Results: SenseCam feedbackResults: SenseCam feedback

• Results from patient’s point of view:Results from patient’s point of view:

– More relaxed socially and less anxiousMore relaxed socially and less anxious

– Sharing experiences again was a ‘sheer Sharing experiences again was a ‘sheer pleasure’pleasure’

– Seeing images brings memories ‘flooding back’Seeing images brings memories ‘flooding back’

– ‘‘It has enormous potential as a memory aid It has enormous potential as a memory aid and has been a great success for us personally’and has been a great success for us personally’


Results: SenseCam feedbackResults: SenseCam feedback

• PublicationsPublications

– Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B. (in Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B. (in press). The use of SenseCam as a pictorial diary to improve press). The use of SenseCam as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A autobiographical memory in a patient with limbic encephalitis: A preliminary report. preliminary report. Neuropsychological RehabilitationNeuropsychological Rehabilitation. .

– Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory aid. To appear in aid. To appear in UbiComp 2006, 8UbiComp 2006, 8thth International Conference on International Conference on Ubiquitous Computing, September 17-21, 2006Ubiquitous Computing, September 17-21, 2006..

– Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J., Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J., Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood, K. Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood, K. (in press). Supporting human memory with a personal digital lifetime (in press). Supporting human memory with a personal digital lifetime store. To appear in J. Teevan & W. Jones (Eds.), store. To appear in J. Teevan & W. Jones (Eds.), Readings in Personal Readings in Personal Information ManagementInformation Management. Seattle: University of Washington Press. . Seattle: University of Washington Press.


Ongoing research: MSRCOngoing research: MSRC

• SenseCam as an episodic memory aid in SenseCam as an episodic memory aid in patients with early Alzheimer’s diseasepatients with early Alzheimer’s disease

• SenseCam as an episodic memory aid in SenseCam as an episodic memory aid in other patients with memory lossother patients with memory loss

• SenseCam factors facilitating consolidationSenseCam factors facilitating consolidation– Image-reviewing schedulesImage-reviewing schedules


Ongoing research: collaborative workOngoing research: collaborative work• Collaborations agreed/underway with:Collaborations agreed/underway with:

– Professor Narinder Kapur, Head Professor Narinder Kapur, Head of Neuropsychology, of Neuropsychology, Addenbrookes Hospital, Addenbrookes Hospital, CambridgeCambridge

– Professor Adam Zeman, Professor Professor Adam Zeman, Professor of Cognitive and Behavioural of Cognitive and Behavioural Neurology, Peninsula Medical Neurology, Peninsula Medical School, ExeterSchool, Exeter

– Professor Jon Evans, Professor of Professor Jon Evans, Professor of Applied Neuropsychology, Applied Neuropsychology, University of Glasgow University of Glasgow

– Dr Chris Butler, Clinical Research Dr Chris Butler, Clinical Research Fellow, Department of Neurology, Fellow, Department of Neurology, University of EdinburghUniversity of Edinburgh

– Dr Nick Alderman, Consultant Dr Nick Alderman, Consultant Neuropsychologist, St Andrews Neuropsychologist, St Andrews Hospital, NorthamptonHospital, Northampton

– Professor Barbara Wilson, Senior Professor Barbara Wilson, Senior Scientist, MRC Cognition and Brain Scientist, MRC Cognition and Brain Sciences Unit, CambridgeSciences Unit, Cambridge

– Professor John Hodges, Professor Professor John Hodges, Professor of Behavioural Neurology, of Behavioural Neurology, University of CambridgeUniversity of Cambridge

– Professor Phillip Barnard, Research Professor Phillip Barnard, Research Scientist, MRC Cognition and Brain Scientist, MRC Cognition and Brain Sciences Unit, CambridgeSciences Unit, Cambridge

– Professor Martin Conway, Director Professor Martin Conway, Director of Research & ESRC Professorial of Research & ESRC Professorial Fellow, Leeds Memory Group, Fellow, Leeds Memory Group, University of LeedsUniversity of Leeds

– Dr Andrew Bateman, Clinical Dr Andrew Bateman, Clinical Director, Oliver Zangwill Centre of Director, Oliver Zangwill Centre of Neuropsychological Rehabilitation, Neuropsychological Rehabilitation, ElyEly


Ongoing research: collaborative workOngoing research: collaborative work

• John Hodges, Professor of Behavioural Neurology, John Hodges, Professor of Behavioural Neurology, Addenbrooke’s HospitalAddenbrooke’s Hospital

– Mild Cognitive ImpairmentMild Cognitive Impairment– Early Alzheimer’s Disease Early Alzheimer’s Disease

• Adam Zeman, Professor of Cognitive & Adam Zeman, Professor of Cognitive & Behavioural Neurology, ExeterBehavioural Neurology, Exeter

– Epileptic amnesiaEpileptic amnesia– Semantic dementiaSemantic dementia

• Oliver Zangwill Centre, CambridgeOliver Zangwill Centre, Cambridge– Brain Injury RehabilitationBrain Injury Rehabilitation– TherapyTherapy



• Collaboration with Martin Conway, Collaboration with Martin Conway, Professor of Cognitive Psychology, Professor of Cognitive Psychology, Leeds Memory Group, Editor of the Leeds Memory Group, Editor of the journal journal MemoryMemory

SenseCam is potentially SenseCam is potentially ‘the first truly powerful ‘the first truly powerful 21st century memory stimulant’21st century memory stimulant’ which could which could generally improve and strengthen memory in generally improve and strengthen memory in normal aging populations and in those with normal aging populations and in those with brain diseasebrain disease



• Undertaking SenseCam memory studies based on Undertaking SenseCam memory studies based on two hypotheses:two hypotheses:

1.1. SenseCam movies mimic episodic memorySenseCam movies mimic episodic memory• VisualVisual• From ‘egocentric’ point of viewFrom ‘egocentric’ point of view• Temporally orderedTemporally ordered• Formed outside awarenessFormed outside awareness• Time compressedTime compressed• Correspond to changes in goal-directed behaviourCorrespond to changes in goal-directed behaviour

Using SenseCam in experimental studiesUsing SenseCam in experimental studies• Investigating extent to which SenseCam stimulates recall and Investigating extent to which SenseCam stimulates recall and

strengthens learningstrengthens learning• Asking ‘How do we forget over time?’ and ‘How do our memories Asking ‘How do we forget over time?’ and ‘How do our memories

decline with age?’decline with age?’



• Professor Conway’s hypotheses cont’d…Professor Conway’s hypotheses cont’d…

2.2. SenseCam movies stimulate brain regions important for SenseCam movies stimulate brain regions important for memory consolidationmemory consolidation

• Hippocampus and related memory structures Hippocampus and related memory structures

• Neural networks not easily activated otherwiseNeural networks not easily activated otherwise

Using SenseCam in neuroimaging studiesUsing SenseCam in neuroimaging studies• Investigating the functional neuroanatomy of episodic memory in Investigating the functional neuroanatomy of episodic memory in

the normal population and in patientsthe normal population and in patients


Final wordsFinal words

• SenseCam may be an extremely powerful aid for SenseCam may be an extremely powerful aid for people with memory disorderspeople with memory disorders

• SenseCam may be a potential ‘innoculation’ SenseCam may be a potential ‘innoculation’ against memory decline in the normal ageing against memory decline in the normal ageing populationpopulation

memex summit, july 2006 sensecam & memory rehabilitation georgina browne, emma berry, narinder...

Documents

resultsresults memory

memory losssensecam

autobiographical memory

human memory

weeks memory

prospective memory slide

episodic memory aid

retropsective memory