taylor j. meek october 22, 2009 physiology features patterns evidence and consequences of feature...

51
Visual Pattern Recognition Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading by Taylor J. Meek is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License . These original publications may be accessed electronically from: http://www.lingnik.com/visual-pattern-recognition

Upload: ruth-waters

Post on 05-Jan-2016

215 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Visual Pattern Recognition

Taylor J. MeekOctober 22, 2009

Physiology

Features

Patterns

Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading by Taylor J. Meek is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.These original publications may be accessed electronically from: http://www.lingnik.com/visual-pattern-recognition

Page 2: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

PHYSIOLOGICAL VISUAL SYSTEM

Difference Detectors and Visual AftereffectsFinding the Feature DetectorsBuilding Feature Detector Systems

Physiology

Features

Patterns

Page 3: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Difference Detectors

Input A

Input B

DifferenceDetector

+

-

A

B

No Activity

Basal Activity

+

-No Activity

Base Level

+

-No Activity

Base Level

Physiology

Features

Patterns

Page 4: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Difference Detectors

Red

Green

DifferenceDetector

+

-

Red

Green

No Activity

Neutral Color(Yellow)

Red

TiredNo Activity

Base Level

Green

TiredNo Activity

Base Level

Physiology

Features

Patterns

Page 5: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Difference Detectors

Red

Green

DifferenceDetector

+

-

Red

Green

No Activity

Neutral Color(Yellow)

Red

TiredNo Activity

Base Level

Green

TiredNo Activity

Base Level

Physiology

Features

Patterns

Page 6: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Difference Detectors

MovementUp

Movement Down

DifferenceDetector

+

-

Up

Down

No Activity

Basal Activity

+

-No Activity

Base Level

+

-No Activity

Base Level

Physiology

Features

Patterns

Page 7: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Aftereffects

Complementary Color PhotoreceptorsSomething More Abstract

“The McCollough Effect”

Page 8: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 9: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 10: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 11: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 12: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 13: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

(Gibson & Harris 1968 in Lindsay & Norman 1977)

1

Page 14: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

(Gibson & Harris 1968 in Lindsay & Norman 1977)

2

Page 15: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

(Gibson & Harris 1968 in Lindsay & Norman 1977)

Page 16: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 17: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 18: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 19: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Difference Detectors

So what?Eye Transfer

Color DesensitizationMotion Detector DesensitizationOrientation-specific Line Detectors

Physiology

Features

Patterns

Page 20: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Feature Detectors

Edge

Slit/Line

Dimness

++-++-++-

--+--+--+

+-++-++-+

-+--+--+-

+++++++++

---------

Physiology

Features

Patterns

Page 21: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Physiological Feature Detectors

Edge ConvexEdge

MovingContrast(Edge)

Dimness

http://flickr.com/photos/thomashawk/90125879/Toad by Thomas Hawk, under CC License

Physiology

Features

Patterns

Page 22: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Feature Detectorsin Higher-Order Species

Ganglion & Bi-Polar Cells• On-Center, Off-Surround• Off-Center, On-Surround• Light Onset, Extinction• Peculiar Receptive Fields• Color Specificity, Contrast• Movement (Directional)

(Lindsay & Norman 1977, p.215) Physiology

Features

Patterns

Light

ReceptiveField

Ganglion Cell

Page 23: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Simple Feature Detector Cellsin Higher-Order Species

Slit and Line

Edge++-++-++-

--+--+--+

+-++-++-+

-+--+--+-

Physiology

Features

Patterns

Selective to:LocationTypeOrientation/directionWidth

Page 24: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Complex Feature Detector Cellsin Higher-Order Species

Slit and Line

Edge++-++-++-

+-++-++-+

-+--+--+-

Physiology

Features

Patterns

Selective to:LocationTypeOrientation/directionWidth

--+--+--+

Page 25: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Movement (Axial Bidirectional)

Angle

Page 26: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Page 27: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Size/Endpoint Termination

Page 28: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Movement (Bidirectional)

Page 29: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Hyper-Complex Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Angle

Page 30: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

Page 31: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

http://flickr.com/photos/crowolf/205180735/ The Monkey Paw by John “Jay” Glenn, under CC License

Page 32: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Higher-Level Feature Detector Cellsin Higher-Order Species

Physiology

Features

Patterns

(Lindsay & Norman 1977, p.250)

Page 33: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Building UpComplex Feature Detectors

Ganglion & Bipolar Cells

Simple Feature Detectors

Complex Feature Detectors

Hyper-Complex Feature Detectors

Higher-Level Feature Detectors

http://flickr.com/photos/residae/386508456/ Father of the Eye by Desirae, under CC license

Physiology

Features

Patterns

Page 34: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 35: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

COGNITIVE FEATURE DETECTION

Features and GroupingGeon Theory

Physiology

Features

Patterns

Page 36: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Features and Objects

Page 37: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Physiological NystagmusJiggly Eye Movements

Physiology

Features

Patternshttp://en.wikipedia.org/wiki/Image:Optokinetic_nystagmus.gif Available under GNU Free Documentation License,http://commons.wikimedia.org/wiki/Commons:GNU_Free_Documentation_License

Page 38: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 39: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

(Verheijen 1961 in Lindsay & Norman 1977)

Page 40: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading
Page 41: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Physiological NystagmusJiggly Eye Movements

Physiology

Features

Patterns

(Dodwell 1970, p.188)

Page 42: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Physiological NystagmusJiggly Eye Movements

(Lindsay & Norman 1977, p.40-44)

Physiology

Features

Patterns

Page 43: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Segmental Image Loss

(From R.M. Pritchard, Scientific American, 1961 in Lindsay & Norman 1977)

Physiology

Features

Patterns

Page 44: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Object Segmentation into Features

Physiology

Features

Patterns

Page 45: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Feature Classes

Biederman (1995)

Physiology

Features

Patterns

Page 46: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Feature Relation

Physiology

Features

Patterns

Page 47: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Geons

Biederman (1995)

Physiology

Features

Patterns

Page 48: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Geons to Scenes

Biederman (1995)

Physiology

Features

Patterns

Page 49: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Features

Sensory InputPhysiological FeaturesSimpleComplexHypercomplexHigher-LevelFeature Classes + Feature RelationsObject SegmentsObjects

Page 50: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

PATTERN RECOGNITIONPandemonium Revisited

Physiology

Features

Patterns

Page 51: Taylor J. Meek October 22, 2009 Physiology Features Patterns Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading

Evidence and Consequences of Feature Detection in The Visual Pattern Recognition of Reading by Taylor J. Meek is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.These original publications may be accessed electronically from: http://www.lingnik.com/visual-pattern-recognition