reward-based decision making under social interaction damon tomlin muri kick-off meeting september...

21
Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Post on 20-Dec-2015

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Reward-based decision making under social interaction

Damon Tomlin

MURI Kick-Off meeting

September 13, 2007

Page 2: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

The decision task

A B

Page 3: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

The underlying structure . . .

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Re

wa

rd Reward A

Reward B

Average

Page 4: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

A more interesting case . . .

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Re

wa

rd Reward A

Reward B

Average

Page 5: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Adding social interaction . . .

• Feedback

– None

– Choice history

– Individual rewards

Page 6: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Adding social interaction

• Feedback

• Different games

• NEO data

Page 7: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Conditions in the experiment: “Alone”

Page 8: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Conditions in the experiment: “Rewards”

Page 9: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Conditions in the experiment: “Choices”

Page 10: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Logistics

• Group size

• Subject payment

• Behavioral cohort

• Imaging cohort

Page 11: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Game elements

• Crossing points

• Optimal reward

• Short term vs. long term gains

Page 12: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Games within the experiment"Simple" Rising Optimum

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Reward A

Reward B

Average

Re

wa

rd

How frequently do subjects find the optimum?

Once found, do they stay?

Page 13: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Games within the experiment"Simple" Rising Optimum

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Reward A

Reward B

Average

Re

wa

rd

Are subjects naturally biased toward A or B?

Page 14: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Games within the experiment“Complex" Rising Optimum

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Reward A

Reward B

Average

Re

wa

rd

Can subjects find a more subtle strategy?

How do social partners affect adherence to it?

Page 15: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Individual behavior

QuickTime™ and aCinepak decompressor

are needed to see this picture.

Page 16: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Individual behavior

QuickTime™ and aCinepak decompressor

are needed to see this picture.

Page 17: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Games within the experimentConverging Gaussians

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Reward A

Reward B

Average

Re

wa

rd

How much exploration occurs in a simple task?

Page 18: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Individual behavior

QuickTime™ and aCinepak decompressor

are needed to see this picture.

Page 19: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Games within the experimentDiverging Gaussians

0

0.25

0.5

0.75

1

0 0.25 0.5 0.75 1

% A

Reward A

Reward B

Average

Re

wa

rd

How does social information produce herd behavior?

Page 20: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Individual behavior

QuickTime™ and aCinepak decompressor

are needed to see this picture.

Page 21: Reward-based decision making under social interaction Damon Tomlin MURI Kick-Off meeting September 13, 2007

Summary

• Binary choice decision paradigm

• Social conditions:– Alone– Reward Information– Choice Information

• Games examining:– Exploratory behavior– Herd behavior– Strategy maintenance