(plain black-on-white slides are evan’s). dense nrsfm approach overview
TRANSCRIPT
![Page 1: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/1.jpg)
(plain black-on-white slides are Evan’s)
![Page 2: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/2.jpg)
![Page 3: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/3.jpg)
![Page 4: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/4.jpg)
Dense NRSFM Approach Overview
![Page 5: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/5.jpg)
Multi-Frame Optical Flow Details
• Set of points to be tracked comes from a reference frame
• Represent trajectories with a linear basis
• Penalties for deviating from the low-rank structure
• Spatial pyramid
= .8 + .2 + .4
Garg, Roussos, Agapito, “Robust Trajectory-Space TV-L1 Optical Flow for Nonrigid Sequences”, EMMCVPR11
![Page 6: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/6.jpg)
![Page 7: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/7.jpg)
![Page 8: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/8.jpg)
![Page 9: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/9.jpg)
![Page 10: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/10.jpg)
![Page 11: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/11.jpg)
![Page 12: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/12.jpg)
Orthographic Projection
• Orthographic:
• Perspective:
• Requires small variation in depth
u = su x + uc
v = sv y + vc
u = (x – xc) f / z + uc
v = (y – yc) f / z + vc
linear in (x, y, z)
nonlinear in (x, y, z)
![Page 13: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/13.jpg)
![Page 14: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/14.jpg)
![Page 15: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/15.jpg)
![Page 16: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/16.jpg)
![Page 17: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/17.jpg)
![Page 18: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/18.jpg)
![Page 19: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/19.jpg)
![Page 20: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/20.jpg)
Optimizing for 3-D Shape
becomes
![Page 21: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/21.jpg)
Qualitative Results
• [online videos]
![Page 22: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/22.jpg)
Quantitative Comparison
• Top row: ground truth; bottom row: their result
• RMS reconstruction error, with matrix rank in parens
![Page 23: (plain black-on-white slides are Evan’s). Dense NRSFM Approach Overview](https://reader037.vdocuments.net/reader037/viewer/2022103123/56649d1a5503460f949ef42c/html5/thumbnails/23.jpg)