recognition: gnosia - york u · 2006. 3. 23. · recognition: gnosia vision: knowing what is where?...

14
1 Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural analysis Recognition By Components Biederman

Upload: others

Post on 18-Jun-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

1

Recognition: gnosia

Vision: knowing what is where?

Bottom-up and top-down strategies

Bottom up approach

Primitives – featuresStructural analysisRecognition By Components —Biederman

Page 2: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

2

Bottom up approachPrimitives – features:

Hubel and Wiesel Treisman

Anne Treisman

Page 3: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

3

POP-

OUT

NO POP OUT

NO POP OUT Structural analysislaws of Gestalt:– simplicity– similarity– proximity– common fate

figure-ground grouping

Page 4: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

4

ABC

Page 5: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

5

types of connections:– T junction– X junction– shadow– curvature– perspective

Structural analysis

--> occlusion--> transparency--> depth--> depth--> depth

Why are these imagesimpossible?

Page 6: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

6

Page 7: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

7

Page 8: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

8

Page 9: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

9

Recognition By ComponentsBiederman

Biederman: Recognition by Components (Geons)

Non accidental properties: correspondence between the world and the retina

Collinearity

Curvilinearity

Symmetry

Parallelism

Vertices

Geons

Top-down approach

memory knowledge familiarity physiological state

Page 10: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

10

Page 11: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

11

Does attention help vision? Does our knowledge influencewhat we see?

Page 12: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

12

Does our knowledge influencewhat we see?

Anatomy & physiology what & where systemsMinskin, Ungerleider & Marco

prosopagnosia infero-temporal area: IT face selective neurons

object agnosia: John

Page 13: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

13

How system

Goodale and colleagues

"the world is out of focus to my brain"John

1981: strokeoccipital lobes –> temporal lobes --> ventral pathway

What is wrong with John?prosopagnosiaobject agnosia achromatopsiano spatial orientationproblem with short-term memory with sight

What is not wrong with John?

acuity eye movements intelligence first memories from sounds, smell draw objects out of memories copy object line by line memory before the operation

More about his vision:

intact registration of features trouble to put features together no top down influencemore information = better

Page 14: Recognition: gnosia - York U · 2006. 3. 23. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies Bottom up approach Primitives – features Structural

14

DFMilner & Goodale

Visual form agnosia

34 years old womanDamage to the ventral pathway from carbon monoxide poisoning

• Cannot copy,but can draw from memory

• Cannot visually match orientation

• Could “mail” an oriented paper

DF

• One mechanism for judging orientation

• One mechanism for coordination ofvision & action

Double dissociation: another patient can’t “mail” but is fine with judging line orientation.

Single dissociation: