lecture(2( cameramodels( - silvio savarese · lecture(2(cameramodels((reading:( ([fp]...
TRANSCRIPT
![Page 1: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/1.jpg)
Lecture 2 - Silvio Savarese 8-‐Jan-‐15
Professor Silvio Savarese Computa(onal Vision and Geometry Lab
Lecture 2 Camera Models
![Page 2: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/2.jpg)
Lecture 2 - Silvio Savarese 10-‐Jan-‐15
• Pinhole cameras • Cameras & lenses • The geometry of pinhole cameras
Lecture 2 Camera Models
Reading: [FP] Chapter 1, “Geometric Camera Models” [HZ] Chapter 6 “Camera Models”
Some slides in this lecture are courtesy to Profs. J. Ponce, S. Seitz, F-F Li
![Page 3: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/3.jpg)
How do we see the world?
• Let’s design a camera – Idea 1: put a piece of film in front of an object – Do we get a reasonable image?
![Page 4: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/4.jpg)
Pinhole camera
• Add a barrier to block off most of the rays – This reduces blurring – The opening known as the aperture
Aperture
![Page 5: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/5.jpg)
Milestones: • Leonardo da Vinci (1452-1519): first record of camera obscura
Some history…
![Page 6: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/6.jpg)
Milestones: • Leonardo da Vinci (1452-1519): first record of camera obscura • Johann Zahn (1685): first portable camera
Some history…
![Page 7: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/7.jpg)
Photography (Niepce, “La Table Servie,” 1822)
Milestones: • Leonardo da Vinci (1452-1519): first record of camera obscura • Johann Zahn (1685): first portable camera • Joseph Nicephore Niepce (1822): first photo - birth of photography
Some history…
![Page 8: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/8.jpg)
Photography (Niepce, “La Table Servie,” 1822)
Milestones: • Leonardo da Vinci (1452-1519): first record of camera obscura • Johann Zahn (1685): first portable camera • Joseph Nicephore Niepce (1822): first photo - birth of photography
• Daguerréotypes (1839) • Photographic Film (Eastman, 1889) • Cinema (Lumière Brothers, 1895) • Color Photography (Lumière Brothers, 1908)
Some history…
![Page 9: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/9.jpg)
Let’s also not forget…
Motzu (468-376 BC)
Aristotle (384-322 BC)
Also: Plato, Euclid
Al-Kindi (c. 801–873) Ibn al-Haitham
(965-1040) Oldest existent book on geometry
in China
![Page 10: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/10.jpg)
Pinhole perspective projection Pinhole camera f
f = focal length o = aperture = pinhole = center of the camera
o
![Page 11: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/11.jpg)
⎪⎪⎩
⎪⎪⎨
⎧
=
=
zyf'y
zxf'x
⎥⎦
⎤⎢⎣
⎡ʹ′
ʹ′=ʹ′→yx
P⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
zyx
P
Pinhole camera
Derived using similar triangles
[Eq. 1]
f
![Page 12: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/12.jpg)
O
P = [x, z]
P’=[x’, f ]
f
zx
fx=ʹ′
i
k
Pinhole camera
[Eq. 2]
f
![Page 13: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/13.jpg)
Kate lazuka ©
Pinhole camera Is the size of the aperture important?
![Page 14: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/14.jpg)
Shrinking aperture size
- Rays are mixed up
Adding lenses! - Why the aperture cannot be too small?
- Less light passes through
![Page 15: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/15.jpg)
Cameras & Lenses
• A lens focuses light onto the film
image P
P’
![Page 16: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/16.jpg)
• A lens focuses light onto the film – There is a specific distance at which objects are “in
focus” – Related to the concept of depth of field
Out of focus
Cameras & Lenses
image P
P’
![Page 17: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/17.jpg)
• A lens focuses light onto the film – There is a specific distance at which objects are “in
focus” – Related to the concept of depth of field
Cameras & Lenses
![Page 18: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/18.jpg)
• A lens focuses light onto the film – All parallel rays converge to one point on a plane
located at the focal length f – Rays passing through the center are not deviated
focal point
f
Cameras & Lenses
![Page 19: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/19.jpg)
f
Paraxial refraction model
zy'z'y
zx'z'x
⎪⎪⎩
⎪⎪⎨
⎧
=
= ozf'z +=
)1n(2Rf −
=
zo -z
Z’
From Snell’s law:
[Eq. 3]
[Eq. 4]
![Page 20: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/20.jpg)
No distortion
Pin cushion
Barrel (fisheye lens)
Issues with lenses: Radial Distortion – Deviations are most noticeable for rays that pass through
the edge of the lens
Image magnification decreases with distance from the optical axis
![Page 21: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/21.jpg)
Lecture 2 - Silvio Savarese 8-‐Jan-‐15
• Pinhole cameras • Cameras & lenses • The geometry of pinhole cameras
• Intrinsic • Extrinsic
Lecture 2 Camera Models
![Page 22: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/22.jpg)
Pinhole perspective projection Pinhole camera
f = focal length o = center of the camera
23 ℜ→ℜE
⎪⎪⎩
⎪⎪⎨
⎧
=
=
zyf'y
zxf'x
⎥⎦
⎤⎢⎣
⎡ʹ′
ʹ′=ʹ′→yx
P⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
zyx
P
[Eq. 1]
f
![Page 23: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/23.jpg)
From retina plane to images
Pixels, bottom-left coordinate systems
f Retina plane
Digital image
![Page 24: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/24.jpg)
Coordinate systems
f
x
y
xc
yc
C’’=[cx, cy]
)czyf,c
zxf()z,y,x( yx ++→
1. Off set
[Eq. 5]
![Page 25: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/25.jpg)
Converting to pixels
)czylf,c
zxkf()z,y,x( yx ++→
1. Off set 2. From metric to pixels
x
y
xc
yc
C=[cx, cy] Units: k,l : pixel/m
f : m : pixel
α β
,α βNon-square pixels
f
[Eq. 6]
![Page 26: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/26.jpg)
• Is this a linear transformation?
x
y
xc
yc
C=[cx, cy]
P = (x, y, z)→ P ' = (α xz+ cx, β
yz+ cy )
Converting to pixels
f
[Eq. 7]
No — division by z is nonlinear
• We can expressed it in a matrix form?
![Page 27: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/27.jpg)
Homogeneous coordinates
homogeneous image coordinates
homogeneous scene coordinates
• Converting back from homogeneous coordinates
EàH
HàE
![Page 28: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/28.jpg)
Projective transformation in the homogenous coordinate system
xyz1
!
"
####
$
%
&&&&
= Ph
M =
α 0 cx 00 β cy 0
0 0 1 0
!
"
####
$
%
&&&&
[Eq.8]
→ P ' = (α xz+ cx, β
yz+ cy )Ph '
Homogenous Euclidian
Ph ' =α x + cx zβ y+ cy z
z
!
"
####
$
%
&&&&
=
α 0 cx 00 β cy 0
0 0 1 0
!
"
####
$
%
&&&&
![Page 29: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/29.jpg)
P ' =M P
= K I 0!"
#$P
The Camera Matrix
⎥⎥⎥⎥
⎦
⎤
⎢⎢⎢⎢
⎣
⎡
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=ʹ′
1zyx
01000c00c0
X y
x
β
α
Camera matrix K
f
[Eq.9]
![Page 30: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/30.jpg)
Camera Skewness
x
y
xc
yc
C=[cx, cy] θHow many degree does K have? 5 degrees of freedom!
f
⎥⎥⎥⎥
⎦
⎤
⎢⎢⎢⎢
⎣
⎡
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡ −
=ʹ′
1zyx
01000v0
0ucot
P o
o
sinθβ
θαα
![Page 31: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/31.jpg)
Canonical Projective Transformation
P ' =xyz
!
"
####
$
%
&&&&
=1 0 0 00 1 0 00 0 1 0
!
"
###
$
%
&&&
xyz1
!
"
####
$
%
&&&&
xzyz
!
"
####
$
%
&&&&
Pi ' =
P ' =M P
M 3
H4 ℜ→ℜ
[Eq.10]
![Page 32: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/32.jpg)
Lecture 2 - Silvio Savarese 8-‐Jan-‐15
• Pinhole cameras • Cameras & lenses • The geometry of pinhole cameras
• Intrinsic • Extrinsic
• Other camera models
Lecture 2 Camera Models
![Page 33: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/33.jpg)
World reference system
Ow
iw
kw
jw R,T
• The mapping so far is defined within the camera reference system • What if an object is represented in the world reference system
f
![Page 34: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/34.jpg)
2D TranslaUon
P
P'
t
• For details please refer to the CA session held on Friday Jan 9th.
![Page 35: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/35.jpg)
2D TranslaUon EquaUon
P
x
y
tx
ty
P’
t
)ty,tx(' yx ++=+= tPP
),(),(
yx ttyx
=
=
tP
![Page 36: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/36.jpg)
2D TranslaUon using Homogeneous Coordinates
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
⋅
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
+
+
→
11001001
1' y
xtt
tytx
y
x
y
x
P
P = (x, y)→ (x, y,1)
= I t0 1
!
"#
$
%&⋅
xy1
!
"
###
$
%
&&&=T ⋅
xy1
!
"
###
$
%
&&&
P
x
y
tx
ty
P’
t
?
![Page 37: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/37.jpg)
Scaling
P
P'
![Page 38: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/38.jpg)
Scaling EquaUon
P
x
y
sx x
P’ sy y
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
⋅
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
→
11000000
1' y
xs
sysxs
y
x
y
x
P
P = (x, y)→ (x, y,1)
S
= S ' 00 1
!
"#
$
%&⋅
xy1
!
"
###
$
%
&&&= S ⋅
xy1
!
"
###
$
%
&&&
)ys,xs(')y,x( yx=→= PP
![Page 39: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/39.jpg)
RotaUon
P
P'
![Page 40: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/40.jpg)
RotaUon EquaUons • Counter-‐clockwise rotaUon by an angle 𝜃
⎥⎦
⎤⎢⎣
⎡⎥⎦
⎤⎢⎣
⎡ −=⎥
⎦
⎤⎢⎣
⎡
yx
yx
θθ
θθ
cossinsincos
''P
x
y’ P’
θ
x’ y PRP' =
' cos sinx x yθ θ= −
' cos siny y xθ θ= +
How many degrees of freedom? 1 P '→cosθ −sinθ 0sinθ cosθ 00 0 1
#
$
%%%
&
'
(((
xy1
#
$
%%%
&
'
(((
![Page 41: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/41.jpg)
RotaUon + Scale + TranslaUon
P '→
1 0 tx0 1 ty0 0 1
"
#
$$$$
%
&
''''
cosθ −sinθ 0sinθ cosθ 00 0 1
"
#
$$$
%
&
'''
sx 0 0
0 sy 0
0 0 1
"
#
$$$$
%
&
''''
xy1
"
#
$$$
%
&
'''
cos in 0 0sin cos 0 00 0 1 0 0 1 1
x x
y y
s t s xt s y
θ θθ θ
−⎡ ⎤ ⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥ ⎢ ⎥= ⎢ ⎥ ⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥ ⎢ ⎥⎣ ⎦ ⎣ ⎦ ⎣ ⎦
= R t0 1
!
"#
$
%& S 00 1
!
"#
$
%&xy1
!
"
###
$
%
&&&= R S t
0 1
!
"##
$
%&&
xy1
!
"
###
$
%
&&&
If sx = sy, this is a similarity transformaUon
![Page 42: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/42.jpg)
3D Rotation of Points Rotation around the coordinate axes, counter-clockwise:
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡ −
=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
−
=
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
−=
1000cossin0sincos
)(
cos0sin010
sin0cos)(
cossin0sincos0001
)(
γγ
γγ
γ
ββ
ββ
β
αα
ααα
z
y
x
R
R
R
p
x
Y’ p’
γ
x’
y
z P '→ R 0
0 1
"
#$
%
&'4×4
xyz1
"
#
$$$$
%
&
''''
A rotation matrix in 3D has 3 degree of feedom
![Page 43: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/43.jpg)
= K R T!"
#$Pw
World reference system
Ow
iw
kw
jw R,T
P = R T0 1
!
"#
$
%&4×4
PwIn 4D homogeneous coordinates:
Internal parameters External parameters
P ' = K I 0!"
#$P =K I 0!
"#$
R T0 1
!
"%
#
$&4×4
Pw
M
P
P’
f
xwywzw1
!
"
#####
$
%
&&&&&
[Eq.11]
![Page 44: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/44.jpg)
P '3×1 =M3x4 Pw = K3×3 R T"#
$% 3×4
Pw4×1
The projective transformation
Ow
iw
kw
jw R,T
How many degrees of freedom? 5 + 3 + 3 =11!
P
P’
f
![Page 45: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/45.jpg)
The projective transformation
Ow
iw
kw
jw R,T
P '3×1 =M Pw = K3×3 R T"#
$% 3×4
Pw4×1⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
3
2
1
mmm
M
=
m1
m2
m3
!
"
####
$
%
&&&&
PW =m1PWm2PWm3PW
!
"
####
$
%
&&&&
→ (m1Pwm3Pw
, m2Pwm3Pw
)E
P
P’
f
[Eq.12]
![Page 46: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/46.jpg)
Theorem (Faugeras, 1993)
⎥⎥⎥
⎦
⎤
⎢⎢⎢
⎣
⎡
=
3
2
1
aaa
A[ ] [ ] ][ bATKRKTRKM ===[Eq.13]
![Page 47: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/47.jpg)
Properties of projective transformations • Points project to points • Lines project to lines • Distant objects look smaller
![Page 48: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/48.jpg)
Properties of Projection
• Angles are not preserved • Parallel lines meet!
Parallel lines in the world intersect in the image at a “vanishing point”
![Page 49: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/49.jpg)
Horizon line (vanishing line)
![Page 50: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/50.jpg)
One-point perspective • Masaccio, Trinity,
Santa Maria Novella, Florence, 1425-28
Credit slide S. Lazebnik
![Page 51: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/51.jpg)
Next lecture
• How to calibrate a camera?
![Page 52: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/52.jpg)
Supplemental material
![Page 53: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/53.jpg)
Thin Lenses
Snell’s law:
n1 sin α1 = n2 sin α2
Small angles: n1 α1 ≈ n2 α2
n1 = n (lens) n1 = 1 (air)
zo
zy'z'y
zx'z'x
⎪⎪⎩
⎪⎪⎨
⎧
=
=
ozf'z +=
)1n(2Rf −
=
Focal length
[FP] sec 1.1, page 8.
![Page 54: Lecture(2( CameraModels( - Silvio Savarese · Lecture(2(CameraModels((Reading:( ([FP] Chapter(1,(“Geometric(CameraModels”((([HZ](Chapter(6(“CameraModels”(Some slides in this](https://reader034.vdocuments.net/reader034/viewer/2022042311/5ed902c06714ca7f4768fad4/html5/thumbnails/54.jpg)
Horizon line (vanishing line)
horizon
∞l