numerical optimization€¦ · • numerical optimization (16.12.12) • graph slam • loop...
TRANSCRIPT
![Page 1: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/1.jpg)
Numerical Optimization2016.12.12
김태원
![Page 2: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/2.jpg)
Feature based method1,0kL
1,1kL
1,2kL
1,3kL
1kQ
0, 1kp
1, 1kp
2, 1kp
3, 1kp
1k wO O
kQ
0,kp
1,kp
2,kp
3,kp
kO
1
k
k kT T
• Real case
2
1 0k
1 expk
k kT
, 1,
, 1,
2
, ,
, |
ˆ |
ˆargmin
k k
k
i k k k i
i k k i
i k i k
p Q L Q K R t
p K R t L
p p
![Page 3: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/3.jpg)
Direct method
2 is pixel coordinates
is intensity
is depth
i
ref i
ref i
I
D
p R
p R
p R
ip
ref
iP
i iT P P
ip
2
, ,ref i i ref i
i
E I I D p p p
2
2
2
,ref i i
i
ref i i
i
ref i i
i
E I I
E I I
E I I
p P
p P
p p
ref iD p
![Page 4: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/4.jpg)
Cost functions
, 1,
, 1,
2
, ,
*
, |
ˆ |
ˆ
argmin
k k
k
i k k k i
i k k i
k i k i k
k k
p Q L Q K R t
p K R t L
E p p
E
• Feature based method • Direct method
Find pairMotion
estimationMotion
estimation
2
, 1 , 1argminN
k
i k k i k
i
L T L
* argmin E
2
, ,ref i i ref i
i
E I I D p p p
![Page 5: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/5.jpg)
5
![Page 6: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/6.jpg)
Goal of Numerical Optimization
* argmin E
E
*
![Page 7: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/7.jpg)
Search Problem
* argmin E
E
0
0E
![Page 8: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/8.jpg)
Two Approaches to Numerical Minimization
1. Gradient Search
2. Gradient-free search
![Page 9: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/9.jpg)
Gradient• Gradient
E
0
0
E
0
3
2
20
3
3
E
E
E
ex)
1 2 3 4 5 6
1 2 3 4 5 6
T
E E E E E E E
• Jacobian
0
2 2 2 2 2 2
1 2 3 4 5 6
1 2 3 4 5 6
0
2 2 2 2 2 2
1 1 1 1 1 1
2 2 2 2 2 2
T
E
E
E
ex)
1
1
E
![Page 10: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/10.jpg)
= Steepest Descent
![Page 11: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/11.jpg)
Example
2 25 10 25
2 10
E
E
1 ( )
0.1
k k kJ
0
0 0
10E
1
1
0 0.1( 10)
1
1
1 1
8E
2
2
1 0.1( 8)
1.8
2
2 1.8
6.4E
3
3
1.8 0.1( 6.4)
2.44
0 1 2 3
![Page 12: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/12.jpg)
12
Multi Dimension Example 1
• Update rule1 ( )k k kJ
![Page 13: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/13.jpg)
13
Multi dimension example 2
• Update rule1 ( )k k kJ
![Page 14: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/14.jpg)
14
Multi dimension example 3
• Update rule1 ( )k k kJ
![Page 15: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/15.jpg)
15
Gradient descent problem
• Update rule
1 ( )k k kJ
![Page 16: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/16.jpg)
1 2 1( ) ( )kk k kJJ
1 ( )k k kJ
![Page 17: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/17.jpg)
17
![Page 18: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/18.jpg)
18
![Page 19: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/19.jpg)
19
Local Minima Problem
![Page 20: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/20.jpg)
Two Types Gradient-Free Search
• Find Global Minima
• Just Gradient-Free
![Page 21: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/21.jpg)
![Page 22: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/22.jpg)
![Page 23: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/23.jpg)
23
![Page 24: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/24.jpg)
24
![Page 25: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/25.jpg)
25
![Page 26: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/26.jpg)
26
![Page 27: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/27.jpg)
27
![Page 28: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/28.jpg)
28
![Page 29: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/29.jpg)
29
![Page 30: Numerical Optimization€¦ · • Numerical optimization (16.12.12) • Graph SLAM • Loop closure detection. Title: Numerical Optimization Author: taewon Created Date: 4/10/2019](https://reader036.vdocuments.net/reader036/viewer/2022081613/5fba80b6acd5e639ec6ab142/html5/thumbnails/30.jpg)
30
Paper study
• Feature based method
• Direct method
1. Real-time Depth Enhanced Monocular Odometry
2. Lidar Odometry and Mapping in Real-time
4. Large-Scale Direct SLAM with Stereo Cameras
3. LSD-SLAM
5. Semi-Direct Visual Odometry for a fisheye-stereo camera
Tutorial• Frame to frame motion estimation (16.11.14)• Numerical optimization (16.12.12)• Graph SLAM• Loop closure detection