in search of ambient vision · 15 nov 00 . ambient vision: background ... • realistic scene...

29
IN SEARCH OF AMBIENT VISION Dr. Fred H. Previc Litton/TASC Recent Trends in SD Research San Antonio TX 15 Nov 00

Upload: others

Post on 30-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

IN SEARCH OF AMBIENT VISION

Dr. Fred H. PrevicLitton/TASC

Recent Trends in SD Research San Antonio TX

15 Nov 00

Page 2: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Background

• Term first coined in 1968

• “ … Subserves spatial localization and [spatial] orientation”

• Known as “where” system

• Contrasted with “focal” vision

Page 3: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Location

Action Extrapersonal

(topographical)

Peripersonal(reaching)

Ambient Extrapersonal(earth-fixed)

Focal Extrapersonal

(saccadic)

Previc (1998)

Page 4: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: General Features

• Area-dependent (biased toward peripheral eccentricities)

Page 5: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Peripheral Dependence

110o55o

Previc & Neel (1995)

Page 6: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: General Features

• Dominated by visual background

• Prefers relatively sluggish inputs (<0.2 Hz)

• Contributes to self-motion, sense of upright, slant perception

• Area-dependent (biased toward peripheral eccentricities)

Page 7: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Functions

Self-motion perception

Sense of upright

Slant perception

Page 8: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: General Features

• Most dependent on background

• Prefers relatively sluggish inputs (<0.2 Hz)

• Contributes to self-motion, sense of upright, slant perception

• Area-dependent (biased toward peripheral eccentricities)

• Mainly preconscious system

Page 9: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

Page 10: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

ASDD visual system(114o, nearly collimated)

Page 11: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

Failure to achieve “visual dominance”

ASDD visual system(114o, nearly collimated)

Page 12: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

Previc et al. (1992)

Page 13: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

Previc et al. (1992)

Page 14: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

Otakeno et al. (in preparation)

Page 15: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

0.0

1.0

2.0

3.0

4.0

5.0

Pitc

h

Roll R

t

Roll L

t

Pitc

h

Roll R

t

Roll L

t

Pitc

h

Roll R

t

Roll L

t

Profile

Thre

shol

ds (D

eg) Pilots

Non-pilots

Day NightBlank

Otakeno et al. (in preparation)

Page 16: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

35o 115o

Near

Coplanar

Far

Near

Coplanar

Far

Previc et al. (in press)

Page 17: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Problems in its Recreation

35o 115o

Near

Coplanar

Far

Near

Coplanar

Far

10

15

20

25

OG

I Dur

atio

n (s

ec)

NB 35-deg 115-deg

VISUAL BACKGROUND

NearCoplanarFar

Previc et al. (in press)

Page 18: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

• Relatively greater distance, FOV (“beyond frame-of-motion”)

• “Believability”• Sufficient temporal resolution (>100 Hz?),• Spatial resolution (1 min of arc resolution?)• Realistic scene content

• No conflicting depth cues or lags

AMBIENT VISION: What Recreates It?

Page 19: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

• Relatively greater distance, FOV (“beyond frame-of-motion”)

• “Believability”• Sufficient temporal resolution (>100 Hz),• Spatial resolution (<1 min)• Realistic scene content

• No conflicting depth cues or lags

AMBIENT VISION: What Recreates It?

Painted surrounds (e.g., optokinetic chamber, room, or tilt-translation device) work better

than computer displays!

Page 20: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

Action Extrapersonal

Focal Extrapersonal

PeripersonalAmbient

Extrapersonal

AMBIENT VISION: Brain Mechanisms

Previc (1998)

Page 21: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Brain Mechanisms

Previc et al. (2000)

Page 22: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

wide-FOV motion

wide-FOV motion

AMBIENT VISION: Brain Mechanisms

Previc et al. (2000)

Page 23: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

wide-FOV motion

wide-FOV motion wayfinding

AMBIENT VISION: Brain Mechanisms

Previc et al. (2000)

Page 24: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Brain MechanismsCoherent vs.

incoherent

Page 25: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Brain Mechanisms

RIGHT

L

insula

L temporal (BA 37)

L KO

R V5/MT

R parahippocampus &hippocampus

L frontal (ant. cing.)

R amygdala

R pulvinar

V1/V2dorsalcuneus

L V5/MT

L midbrain tegmentum

LEFT

R anteriorcerebellum

Coherent vs. incoherent

Coherent vs. incoherent (Beer et al., 2000)

Page 26: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Brain MechanismsCoherent vs.

incoherent

RIGHT

L

insula

L temporal (BA 37)

L KO

R V5/MT

R parahippocampus &hippocampus

L frontal (ant. cing.)

R amygdala

R pulvinar

V1/V2dorsalcuneus

L V5/MT

L midbrain tegmentum

LEFT

R anteriorcerebellum

Coherent vs. incoherent (Beer et al., in prep.)

CCW vs. CW

Page 27: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Brain Mechanisms

0

10

20

30

40

50

Numberof

Clusters

Left Right

Hemisphere

MinimaMaxima

Right - Left Visual Yaw (Previc et al., in press)

Page 28: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Its Footprints?

Page 29: IN SEARCH OF AMBIENT VISION · 15 Nov 00 . AMBIENT VISION: Background ... • Realistic scene content ... CCW vs. CW. AMBIENT VISION: Brain Mechanisms 0 10 20 30 40 50 Number of Clusters

AMBIENT VISION: Summary

• Ambient vision mostly relies on wide-FOV, distant inputs

• Ambient vision dependent on preconscious inferences

• Current computer-generated displays can only partially duplicate ambient vision

• Ambient vision uses separate visual pathways; may ultimately prove to be a highly distributed system