![Page 1: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/1.jpg)
CSE252a, Fall 2011 Computer Vision I
Human Visual System
Computer Vision I CSE 252 Lecture 2
![Page 2: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/2.jpg)
CSE252a, Fall 2011 Computer Vision I
Announcement Assignment 0: “Getting started with Matlab”
is posted to the web page and due next Tuesday.
![Page 3: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/3.jpg)
CSE252a, Fall 2011 Computer Vision I
Kepler
Kepler, 1604
Eye as an optical instrument
Image is inverted on retina
First such experiment by Scheiner, 1625
![Page 4: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/4.jpg)
CSE252a, Fall 2011 Computer Vision I
Ways to study human vision 1. Physiological 2. Phenomenological/Psychophysical 3. Cellular recordings 4. Functional MRI 5. Computational modeling
![Page 5: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/5.jpg)
CSE252a, Fall 2011 Computer Vision I
Physiological level
![Page 6: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/6.jpg)
CSE252a, Fall 2011 Computer Vision I
What does this do?
Can we readily understand whole from understanding pieces?
![Page 7: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/7.jpg)
CSE252a, Fall 2011 Computer Vision I
Ways to study human vision 1. Physiologically 2. Phenomenological/Psychophysical 3. Cellular recordings 4. Functional MRI 5. Computational modelling
![Page 8: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/8.jpg)
CSE252a, Fall 2011 Computer Vision I
Psychophysical Testing of Subjects
![Page 9: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/9.jpg)
CSE252a, Fall 2011 Computer Vision I
Example: Show gratings w/ different spatial frequencies
![Page 10: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/10.jpg)
CSE252a, Fall 2011 Computer Vision I
Gradients/Motion
Look Here
![Page 11: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/11.jpg)
CSE252a, Fall 2011 Computer Vision I
Perceptual Organization
Occlusion provides a different organization
![Page 12: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/12.jpg)
CSE252a, Fall 2011 Computer Vision I
Perceptual Organization
![Page 13: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/13.jpg)
CSE252a, Fall 2011 Computer Vision I
Ways to study human vision 1. Physiologically 2. Phenomenological/Psychophysical 3. Cellular recordings 4. Functional MRI 5. Computational modeling
![Page 14: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/14.jpg)
CSE252a, Fall 2011 Computer Vision I
Single Cell Recordings
![Page 15: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/15.jpg)
CSE252a, Fall 2011 Computer Vision I
fMRI
Activation in the right fusiform gyrus. [ Tarr, Cheng 2003]
![Page 16: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/16.jpg)
CSE252a, Fall 2011 Computer Vision I
Ways to study human vision 1. Physiologically 2. Phenomenological/Psychophysical 3. Cellular recordings 4. Functional MRI 5. Computational modeling
![Page 17: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/17.jpg)
CSE252a, Fall 2011 Computer Vision I
Computational Modeling
What is being computed and why?
![Page 18: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/18.jpg)
CSE252a, Fall 2011 Computer Vision I
Structure of the eye
![Page 19: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/19.jpg)
CSE252a, Fall 2011 Computer Vision I 1 lux = 1 lumin/m2
![Page 20: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/20.jpg)
CSE252a, Fall 2011 Computer Vision I
Rods and cones
Cones
![Page 21: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/21.jpg)
CSE252a, Fall 2011 Computer Vision I
Rods & Cones
![Page 22: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/22.jpg)
CSE252a, Fall 2011 Computer Vision I
Three types of cones: R,G,B
There are three types of cones S: Short wave lengths (Blue) M: Mid wave lengths (Green) L: Long wave lengths (Red)
• Three attributes to a color • Three numbers to describe a color
Response of k’th cone =
![Page 23: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/23.jpg)
CSE252a, Fall 2011 Computer Vision I
Distribution of Rods & Cones
![Page 24: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/24.jpg)
CSE252a, Fall 2011 Computer Vision I
Retina edge on
![Page 25: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/25.jpg)
CSE252a, Fall 2011 Computer Vision I
Retinal Neuron
![Page 26: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/26.jpg)
CSE252a, Fall 2011 Computer Vision I
Other Eyes
![Page 27: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/27.jpg)
CSE252a, Fall 2011 Computer Vision I
Trilobite Visual System • Most ancient known visual system. • Compound eye with single crystal for each
lens. Electron Micrograph of Holochroal eye
Good trilobite eye info at: http://www.aloha.net/~smgon/eyes.htm
![Page 28: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/28.jpg)
CSE252a, Fall 2011 Computer Vision I
Scallop eyes • Hundreds of primitives eyes, mirror in back • Changes in light and motion and very rough images are
registered on the retinas of the mollusk. • Nice material at: http://soma.npa.uiuc.edu/courses/bio303/Ch11b.html
![Page 29: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/29.jpg)
CSE252a, Fall 2011 Computer Vision I
Stomatopod eyes • Dumb bell shaped, compound eyes • Stereo vision with just one eye; • Each eye is up on a stalk, with a wide range of motion; • Stomatopods have up to 16 visual pigments stomatopods
can also see ultra-violet and infra-red light, and some can even see polarized light.
• See http://www.ucmp.berkeley.edu/aquarius/
Larva Mantis Shrimp Adult Mantis Shrimp
![Page 30: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/30.jpg)
CSE252a, Fall 2011 Computer Vision I
Visual Pathways
![Page 31: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/31.jpg)
CSE252a, Fall 2011 Computer Vision I
Single Cell Recordings
![Page 32: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/32.jpg)
CSE252a, Fall 2011 Computer Vision I
What: Recognition, Object representation
Where: Location & Motion, control
![Page 33: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/33.jpg)
CSE252a, Fall 2011 Computer Vision I
CUES
![Page 34: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/34.jpg)
CSE252a, Fall 2011 Computer Vision I
Fixate at center What color are the dots
![Page 35: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/35.jpg)
CSE252a, Fall 2011 Computer Vision I
Shading Cues
![Page 36: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/36.jpg)
CSE252a, Fall 2011 Computer Vision I
Subjective Contours Kanizsa’s Triangle
![Page 37: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/37.jpg)
CSE252a, Fall 2011 Computer Vision I
Which square is darker?
![Page 38: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/38.jpg)
CSE252a, Fall 2011 Computer Vision I
Which square is darker?
![Page 39: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/39.jpg)
CSE252a, Fall 2011 Computer Vision I
Global vs. Local information: Fraser’s Spiral
![Page 40: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/40.jpg)
CSE252a, Fall 2011 Computer Vision I
![Page 41: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/41.jpg)
CSE252a, Fall 2011 Computer Vision I
![Page 42: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/42.jpg)
CSE252a, Fall 2011 Computer Vision I
Context
Who is taller? Who is taller?
![Page 43: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/43.jpg)
CSE252a, Fall 2011 Computer Vision I
Context: Whose faces do you see?
![Page 44: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/44.jpg)
CSE252a, Fall 2011 Computer Vision I
A picture of a man
![Page 45: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/45.jpg)
CSE252a, Fall 2011 Computer Vision I
In this shot, what is his facial exprssion?
![Page 46: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/46.jpg)
CSE252a, Fall 2011 Computer Vision I
In this shot, what is his facial exprssion?
Thatcher illusion
![Page 47: Human Visual System - Computer Science and Engineeringcseweb.ucsd.edu/classes/fa11/cse252A-a/lec2.pdf · CSE252a, Fall 2011 Computer Vision I Human Visual System Computer Vision I](https://reader031.vdocuments.net/reader031/viewer/2022022009/5aecfe8f7f8b9a3b2e8fe3e0/html5/thumbnails/47.jpg)
CSE252a, Fall 2011 Computer Vision I
Hidden Human Face