cameras and projections dan witzner hansen course web page: email: [email protected]
Post on 21-Dec-2015
220 views
TRANSCRIPT
![Page 1: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/1.jpg)
Cameras and Projections
Dan Witzner Hansen
Course web page:www.itu.dk/courses/MCV
Email:[email protected]
![Page 2: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/2.jpg)
Previously in Computer Vision….
• Homographies• Estimating homographies• Applications (Image rectification)
![Page 3: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/3.jpg)
Outline• Projections• Pinhole cameras• Perspective projection
– Camera matrix– Camera calibration matrix
• Affine Camera Models
![Page 4: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/4.jpg)
Single view geometry
Camera model
Camera calibration
Single view geom.
![Page 5: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/5.jpg)
![Page 6: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/6.jpg)
Pinhole camera model
TT ZfYZfXZYX )/,/(),,(
101
0
0
1
Z
Y
X
f
f
Z
fY
fX
Z
Y
X
![Page 7: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/7.jpg)
Pinhole camera model
101
0
0
Z
Y
X
f
f
Z
fY
fX
101
01
01
1Z
Y
X
f
f
Z
fY
fX
PXx
0|I)1,,(diagP ff
![Page 8: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/8.jpg)
Principal point offset
Tyx
T pZfYpZfXZYX )/,/(),,(
principal pointT
yx pp ),(
101
0
0
1
Z
Y
X
pf
pf
Z
ZpfY
ZpfX
Z
Y
X
y
x
x
x
![Page 9: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/9.jpg)
Principal point offset
101
0
0
Z
Y
X
pf
pf
Z
ZpfY
ZpfX
y
x
x
x
camX0|IKx
1y
x
pf
pf
K calibration matrix
![Page 10: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/10.jpg)
Camera rotation and translation
C~
-X~
RX~
cam
X10
RCR
1
10
C~
RRXcam
Z
Y
X
camX0|IKx XC~
|IKRx
t|RKP C~
Rt PXx
![Page 11: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/11.jpg)
CCD camera
1yx
xx
p
p
K
11y
x
x
x
pf
pf
m
m
K
![Page 12: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/12.jpg)
Finite projective camera
1yx
xx
p
ps
K
1yx
xx
p
p
K
C~
|IKRP
non-singular
11 dof (5+3+3)
decompose P in K,R,C?
4p|MP 41pMC
~ MRK, RQ
{finite cameras}={P4x3 | det M≠0}
If rank P=3, but rank M<3, then cam at infinity
![Page 13: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/13.jpg)
Camera anatomy
Camera centerColumn pointsPrincipal planeAxis planePrincipal pointPrincipal ray
![Page 14: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/14.jpg)
Camera center
0PC
null-space camera projection matrix
λ)C(1λAX
λ)PC(1λPAPXx
For all A all points on AC project on image of A,
therefore C is camera center
Image of camera center is (0,0,0)T, i.e. undefined
Finite cameras:
1
pM 41
C
Infinite cameras: 0Md,0
d
C
![Page 15: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/15.jpg)
Column vectors
0
0
1
0
ppppp 43212
Image points corresponding to X,Y,Z directions and origin
![Page 16: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/16.jpg)
Row vectors
1p
p
p
0 3
2
1
Z
Y
X
y
x
T
T
T
1p
p
p0
3
2
1
Z
Y
X
w
yT
T
T
note: p1,p2 dependent on image reparametrization
![Page 17: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/17.jpg)
The principal point
principal point
0,,,p̂ 3332313 ppp
330 Mmp̂Px
![Page 18: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/18.jpg)
Action of projective camera on point
PXx
MdDp|MPDx 4
Forward projection
Back-projection
xPX 1PPPP
TT IPP
(pseudo-inverse)
0PC
λCxPλX
1
p-μxM
1
pM-
0
xMμλX 4
-14
-1-1
xMd -1
CD
![Page 19: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/19.jpg)
Camera matrix decomposition
Finding the camera center
0PC (use SVD to find null-space)
432 p,p,pdetX 431 p,p,pdetY
421 p,p,pdetZ 321 p,p,pdetTFinding the camera orientation and internal parameters
KRM (use RQ decomposition ~QR)
Q R=( )-1= -1 -1QR
(if only QR, invert)
![Page 20: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/20.jpg)
Euclidean vs. projective
homography 44
0100
0010
0001
homography 33P
general projective interpretation
Meaningful decomposition in K,R,t requires Euclidean image and space
Camera center is still valid in projective space
Principal plane requires affine image and space
Principal ray requires affine image and Euclidean space
![Page 21: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/21.jpg)
Cameras at infinity
00
dP
Camera center at infinity
0Mdet
Affine and non-affine cameras
Definition: affine camera has P3T=(0,0,0,1)
![Page 22: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/22.jpg)
Affine cameras
![Page 23: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/23.jpg)
Summary parallel projection
1000
0010
0001
P canonical representation
10
0KK 22 calibration matrix
principal point is not defined
![Page 24: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/24.jpg)
A hierarchy of affine cameras
Orthographic projection
Scaled orthographic projection
1000
0010
0001
P
10
tRH
10rr
P 21T
11T
tt
ktt
/10rr
P 21T
11T
(5dof)
(6dof)
![Page 25: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/25.jpg)
A hierarchy of affine cameras
Weak perspective projection
ktt
y
x
/10rr
1α
αP 2
1T1
1T
(7dof)
![Page 26: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/26.jpg)
1. Affine camera= proj camera with principal plane coinciding with P∞
2. Affine camera maps parallel lines to parallel lines3. No center of projection, but direction of
projection PAD=0(point on P∞)
A hierarchy of affine camerasAffine camera
ktts
y
x
A
/10rr
1α
αP 2
1T1
1T
(8dof)
1000P 2232221
1131211
tmmmtmmm
A
affine 44100000100001
affine 33P
A
![Page 27: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/27.jpg)
Next: Camera calibration
![Page 28: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/28.jpg)
The principal axis vector
3m
camcamcam X0|IKXPx T1,0,0mMdetv 3
camcam PP k vv 4k
4p|MC~
|IKRP k
0)Rdet(
vector defining front side of camera
(direction unaffected)
vmMdetv 43 kkk camcam PP k
because
![Page 29: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/29.jpg)
Depth of points
C~
X~
mCXPXPT3T3T3 w
(dot product)(PC=0)
1m;0det 3 MIf , then m3 unit vector in positive direction
3m
)sign(detMPX;depth
T
w
TX X,Y,Z,T
![Page 30: Cameras and Projections Dan Witzner Hansen Course web page: Email: witzner@itu.dk](https://reader036.vdocuments.net/reader036/viewer/2022081514/56649d5d5503460f94a3caca/html5/thumbnails/30.jpg)
When is skew non-zero?
1yx
xx
p
ps
K
1 g
arctan(1/s)
for CCD/CMOS, always s=0
Image from image, s≠0 possible(non coinciding principal axis)
HPresulting camera: