the primate visual systemhelmuth radrich, 24.06.2004 the primate visual system 1.structure of the...

73
The primate visual system Helmuth Radrich, 24.06.2004 The primate visual system 1. Structure of the eye 2. Neural responses to light 3. Brightness perception & visual acuity 4. Spatial frequency analysis & spatial context 5. Form perception (psychological) 6. Visual pathways & visual cortex (humans) 7. Visual System & form

Upload: trevor-edwin-norman

Post on 13-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 2: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Visible spectrum

Page 3: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 4: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The crystalline lens

Page 5: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 6: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The fovea

Page 7: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Rods and cones distribution

Page 8: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 9: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Information flow from eye to brain

• Via optic nerve• Data is not “raw”… preprocessed by retina• Human eye:

– 120 million rods– 5 million cones– Another few millions of bipolar/amacrine/horizontal cells– Optic nerver: 1 million axons

=> A single ganglion cell axon receives information from many receptors in a region of the retina defining the cells receptive field

Page 10: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 11: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Neural response types

Page 12: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Receptive fields

Page 13: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Parvo and magno cells

Page 14: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Parvo and magno cells

Page 15: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 16: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Intensity & perceived brightness

Page 17: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Dark adaptation

Page 18: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Relative sensitivity (wavelength)

Page 19: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Visual angle

Page 20: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Visual acuity

Page 21: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis&spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 22: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Light distributions

Page 23: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Approximation of square waves

Page 24: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 25: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Apparent brightness

Page 26: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Modulation transfer function

Page 27: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Frequency analysis (biological)

Page 28: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 29: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Spatial context (lat. inhibition)

Page 30: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 31: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Temporal context effects

Page 32: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 33: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Properties of visual environment

Page 34: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Masking

Page 35: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Feature extraction

Page 36: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Emergent features

Page 37: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Figure and ground

Page 38: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 39: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Subjective contours

Page 40: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Figural grouping

Page 41: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 42: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Texture defined grouping

Page 43: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Spatial frequency grouping

Page 44: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Good figures

Page 45: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Good figures

Page 46: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Good figures

Page 47: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

What is this???

Page 48: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Conceptually driven processing

Page 49: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Global vs. local processing

Page 50: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Context and identification

Page 51: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 52: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 53: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque)

Page 54: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 55: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 56: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 57: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Receptive fields (simple cortical)

Page 58: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 59: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Layer of V1

Page 60: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 61: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Visual pathways (human)

Page 62: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 63: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The primate visual system

1. Structure of the eye

2. Neural responses to light

3. Brightness perception & visual acuity

4. Spatial frequency analysis & spatial context

5. Form perception (psychological)

6. Visual pathways & visual cortex (humans)

7. Visual System & form perception (macaque monkey)

Page 64: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Oram&Prett proposal

• Neurobiological data form macaque monkeys

• Analogies to human visual system

Object recognition as series of 4 computational stages in 7 major hierarchically arranged processing areas

Simple feed-forward network sufficient for computer simulation

Page 65: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 66: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

• like in humans two major processing streams (only form perception is discussed)

• strong similarities to human brain

• Interconnection not as complete as it could be

Why????

Combinatorial explosion if object is to be recognized from simple features (only edges, etc.)

Basic edges etc. information not helpful in complex feature recognition at higher level

Page 67: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 68: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 69: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 70: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Min.-timings in information-stream

Assumptions (biologically plausible):

• about 5 ms to trigger firing in the next neuron + some ms for signal transmission inside neurons (minimum)

With the experimentally measured timings for the arrival of the first reactions in STPa after stimulus presentation (above):

Only 7 interneuron connections can lay on the way of the signal (correspond to biological layers of the visual cortex)

No time for lateral inhibition or feedback processes to interact with the information processing

Feed-forward only model is plausible, but only half of the story in higher perception

Page 71: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Page 72: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

Reference

• Coren, S., Ward, L. M. and Enns, J. T. (1993). Sensation and perception

• Oram M. W. and Prrett, D. I. (1994), Modeling visual cognition from neurobiological constraints. Neural Networks 7 (6/7), 945-972

Page 73: The primate visual systemHelmuth Radrich, 24.06.2004 The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception

The primate visual system Helmuth Radrich, 24.06.2004

The END

Thank you for your attention!