remembering to decide: discrimination of temporally separated stimuli (selecting the best apple)...

48
Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Upload: jarred-jenney

Post on 22-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Remembering to decide: discrimination of temporally separated stimuli

(selecting the best apple)

Paul MillerBrandeis University

Page 2: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Parametric Working Memory and Sequential Discrimination

Experiments by group of R. Romo et al., UNAMNature 399:470 (1999), Cereb. Cort. 13:1196 (2003)

Page 3: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Choose f1 > f2

f2f1

Page 4: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

or f2 > f1

f1 f2

Page 5: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Rastergram:f1(Hz)10141822263034

base delay

Trial-averaged firing rate

Fir

ing

rate

(H

z)

0

30

Time (sec)0.5 3.5

(from Miller et al. Cerebral Cortex 2003)

Tuning curve ofmemory activity

Fir

ing

rate

(H

z)

Stimulus, f1 (Hz)5

18

10 34

Romo et al. Nature 1999

Page 6: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

A continuous attractor acts as an integrator

Time

Time

Input

Memoryactivity

Page 7: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

... but integration yields magnitude x time

Time

Time

Input

Memoryactivity

Page 8: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Problem: How can a network compare an incoming stimulus with an earlier one in memory?

Especially as discrimination ≡ subtraction whereas integration ≡ addition

Sequential Discrimination

Integral feedback control: memory neurons (M) inhibit their inputs (D).

Solution:

-

+

∫ rDdt

Input

Page 9: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 1 low

cue1 delay cue2

Page 10: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 1 low

cue1 delay cue2

Page 11: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 2 higher

cue1 delay cue2

Page 12: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 2 lower

Threshold not reached

cue1 delay cue2

Page 13: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 1 high

cue1 delay cue2

Page 14: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 2 lower

Threshold not reached

cue1 delay cue2

Page 15: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue1 delay cue2

cue 2 higher

Page 16: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

A continuous attractor for memory

Page 17: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

A continuous attractor for memory

Page 18: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too high

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 19: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too high

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 20: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too high

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 21: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too low

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 22: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too low

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 23: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Feedback too low

Gradient is proportional to difference between current needed to produce a firing rate and the feedback current generated by that firing rate.

Page 24: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Continuous or discrete memory?

Note psychophysics: for most continuous quantities, we can only remember (even recognize?) them in discrete categoriesExcept when quantity is encoded across different neurons (eg vision, pitch)

Page 25: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Simulation results

Look at Discriminating neuron

Memory = Discrete Integrator

Page 26: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Activity of model discriminating neuron.

base delay comparison

Page 27: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

base delay comparison

Activity of model discriminating neuron.

Page 28: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Trial-averaged firing rate through time of model discriminating neuron for different pairs of stimuli

f1 = 34Hz

f1 = 10Hz

f2>f1

f2<f1

Base, f1 Delay Comparison, f2

Time (sec)0 0.5 3.5 40

100

Fir

ing

rate

(H

z) f1 = 22Hz

Miller and Wang, PNAS 2006

Page 29: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Base tuning

Comparison tuning

Delay tuning

f2>f1

f2<f1

Page 30: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Trial-averaged firing rate through time from experimental data of Romo (prefrontal cortex)

Base, f1 Delay Comparison, f2

Time (sec)0 0.5 3.5 40

35

Fir

ing

rate

(H

z) f2>f1

f2<f1

f1=12Hzf1=20Hzf1=28Hz

Page 31: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

PFC cell from Romo's data:Initial tuning +ve to f1 : final tuning to +f2-f1

Base, f1 Delay Comparison, f2

Time (sec)0 0.5 3.5 40

60

Fir

ing

rate

(H

z)

f2>f1

f2<f1

f1=10Hzf1=22Hzf1=34Hz

Page 32: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

PFC cell from Romo's data Initial tuning -ve to f1 : final tuning to +f1-f2

Base, f1 Delay Comparison, f2

Time (sec)0 0.5 3.5 40

35

Fir

ing

rate

(H

z)

f2<f1

f2>f1

f1=10Hzf1=22Hzf1=28Hz

Page 33: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Decision-making as a competition between pools

Page 34: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

f1=22Hz

Probability of choosing f2>f1 from simulations

Page 35: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

f1=14Hz f1=22Hz

Probability of choosing f2>f1 from simulations

Page 36: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

f1=14Hz f1=22Hz f1=30Hz

Probability of choosing f2>f1 from simulations

Miller, in preparation

Page 37: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Probability of choosing f2>f1 from experiment

f1 = 20Hz f1 = 30Hz

f2

Page 38: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Probability of choosing f2>f1 from experiment

= fix f2 (20Hz), vary f1= fix f1 (20Hz), vary f2

Page 39: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Probability of choosing f2>f1 from experiment

Hernandez et al, 1997

= fix f2 (20Hz), vary f1= fix f1 (20Hz), vary f2

= fix f2 (30Hz), vary f1= fix f1 (30Hz), vary f2

Page 40: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

fixed f1=22Hz fixed f1=30Hz

Probability of choosing f2>f1 from simulations

Page 41: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

fixed f1=22Hz fixed f1=30Hz

Probability of choosing f2>f1 from simulations

fixed f2=22Hz fixed f2=30Hz

Page 42: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 1:low

Is magnitude dissociated from duration of input?

Page 43: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Input

rD

rM

ID=Input -W

MD r

M

t

t

t

tcue1 delay cue2

cue1 delay cue2

cue 1:longer

Is magnitude dissociated from duration of input?

Page 44: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Duration of initial stimulus: = 0.5s

Is magnitude dissociated from duration of input?Simulation results

Page 45: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Duration of initial stimulus: = 0.5s= 0.25s

Is magnitude dissociated from duration of input?Simulation results

Page 46: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

Duration of initial stimulus: = 0.5s= 0.25s

= 0.75s+

Is magnitude dissociated from duration of input?Simulation results

Page 47: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University

From Luna et al., Nat Neurosci 2005

Is magnitude dissociated from duration of input?Experimental results

Page 48: Remembering to decide: discrimination of temporally separated stimuli (selecting the best apple) Paul Miller Brandeis University