NN B 09 1

Lecture 10:Some experimental data on

cognitive processes in the brain

Wolfgang Maass

Institut für Grundlagen der InformationsverarbeitungTechnische Universität Graz, Austria

Institute for Theoretical Computer Science http://www.igi.tugraz.at/maass/

NN B 09 2

Open Problems

• Models for „thinking“ in networks of neurons.

• Models for the implementation of processing rules in neural circuits (and for the application of such rules to external or internal information)

• Models for the encoding of internal information(memory) in neural circuits

NN B 09 3

NN B 09 4

Overview of experimental methods foranalyzing brain activity

Fig. on p. 81 of Purves et al

NN B 09 5

fMRI (functional magnetic resonance imaging): a non-invasive window into brain activity

• Show movie

NN B 09 6

Methodological problems of fMRI analysis

What exactly does the BOLD signal tell us about neuralcomputation in a concrete brain area ?

How can one explain that some brain regions exhibit areduced BOLD signal usual when a cognitive task isperformed (or when some item is successfully storedin memory) ?

NN B 09 7

Does the BOLD signal recorded by fMRI indicateincreased excitation of neuronal activity ?

It is currently still not known, whether the fMRI could also indicateincreased inhibition of local neuronal circuits

Fig. 2 of N. Logothetis, What we can do and what we cannot do with fMRI, Science 2008

NN B 09 8

Some brain regions exhibit a smaller BOLD signal(compared with average level) when a cognitive taskis performed.

(from Purves et al, p.375)

NN B 09 9

Some typical fMRI results for higher levelbrain operations

NN B 09 10

Deductive versus inductive reasoningFig. from p. 631 of Purves et al :

NN B 09 11

fMRI traces of „insight“

Fig. from p. 639 of Purves et al

NN B 09 12

Larger BOLD signal in frontopolar cortexwhen abtract operations are performed on internally

generated information („thinking“)

Fig. A, B, C from p. 629 of Purves et al

NN B 09 13

Some remarks on the prefrontal cortex (PFC)Purves et al, fig. on p 582

NN B 09 14

Some areas in the PFC exhibit a larger BOLD signalwhen a routine response has to be inhibited

• Purves et al. P. 588, A, B, C

NN B 09 15

Patients with damages in specific parts (ventro-medial) of PFC are trouble in inhibiting behaviours

Purves et al, figures on p. 592

NN B 09 16

…another example for that

• Purves et al, figures on p. 593

NN B 09 17

Other typical deficits of patients withdamages in certain parts of PFC

Inferring and applying behavioural rules from sensorycues:

Purves et al p 587 fig. 23.5.(Wisconsin card sorting test)

NN B 09 18

Results on the organization of memory in the brain

Apparently the brain uses several different memory systems:Purves et al. Fig. 13.10 from p. 341

NN B 09 19

Creation of longterm memory goes throughseveral stages of consolidation

Baars et al fig. 19.17 on p. 273

NN B 09 20

The medial temporal cortex: an importantarea for creating lasting declarative memory

Purves et al. Panel A from p. 336

NN B 09 21

Some results on theneural code for memory traces during consolidation

NN B 09 22

An example for the interaction of hippocampus with primary visual cortex in memory formation

Coordinated memory replay in the visual cortex and hippocampus during sleep.Ji D, Wilson MA. Nat Neurosci. 2007 Jan;10(1):100-7

NN B 09 23

Experimental setup

NN B 09 24

Results of simultaneous recording fromhippocampus and visual cortex

NN B 09 25

A „memory trace“ in the visual cortex

NN B 09 26

A „memory trace“ in the hippocampus

NN B 09 27

Interaction between both „memory traces“

NN B 09 28

Is „thinking“ or „dreaming“ faster thanexperiencing an event ?

Science. 2007 Nov 16;318(5853):1147-50. Fast-forward playback of recent memory sequences in prefrontal cortex during sleep. Euston DR, Tatsuno M, McNaughton BL – Fig 1B, 2 B

NN B 09 29

Results on faster replay of „memory traces“

NN B 09 30

Statistical analysis of the temporal compression factor

NN B 09 31

A hypothesis for the role of REM sleep in memory consolidation

NN B 09 32

Reverberation, storage, and postsynaptic propagation of memories during sleep. Ribeiro S, Nicolelis MA.

Learn Mem. 2004 Nov-Dec;11(6):686-96

NN B 09 33

Open Problems

• Models for „thinking“ in networks of neurons.

• Models for the implementation of processing rules in neural circuits (and for the application of such rules to external or internal information)

• Models for the encoding of internal information(memory) in neural circuits