introduction - ulisboaadb/tutorial_2009/2011.11.tutorial-iccv... · iv’11, arcelona, spain –...
TRANSCRIPT
![Page 1: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/1.jpg)
Introduction
Adrien Bartoli
ALCoV – ISIT
Université d’Auvergne
Clermont-Ferrand, France
Fourth Tutorial on Computer Vision in a Nonrigid World ICCV’11, Barcelona, Spain – octobre 6, 2011
Lourdes Agapito, Adrien Bartoli, Alessio Del Bue
![Page 2: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/2.jpg)
Millennia
Century
Decades
![Page 3: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/3.jpg)
“Vision is the act of knowing what is where by looking.”
- Aristotle
Object detection Person detection Person recognition
Tob
y
Ad
rien
Ab
ed
Jae-Hak
Florian
Image Understanding in Computer Vision
Measurements
![Page 4: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/4.jpg)
“Vision is the act of knowing what is where by looking.”
- Aristotle
Measurements
3D Computer Vision
Depth map Partial 3D surface
![Page 5: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/5.jpg)
Real world
A General Sketch of Visual Process
Tob
y
Ad
rien
Ab
ed
Jae-Hak
Florian
![Page 6: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/6.jpg)
Image Formation
![Page 7: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/7.jpg)
Shape-from-X: Inversing Image Formation
?
![Page 8: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/8.jpg)
The X of Shape-from-X
Shading Focus Shadow
Texture Shading+specularity
Silhouette Occlusion
… and more!
![Page 9: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/9.jpg)
Scene Priors
Shape priors – often statistical
→ A kettle is rigid
→ Pretrained models: I saw faces before, I learnt their shape
Deformation priors – often physical
→ Untrained models: the shape is structured
→ A piece of paper is isometric and developable
→ A face is quasi-isometric
= 𝑓( ) From [Blanz and Vetter, PAMI’03]
= 𝑓( )
![Page 10: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/10.jpg)
Real world
A Sketch of the Current Visual Process in SfX
Tob
y
Ad
rien
Ab
ed
Jae-Hak
Florian
![Page 11: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/11.jpg)
Using Multiple-Views
Photometric stereo
Shape-from-Motion - SfM
Image formation
Stereovision Monovision
![Page 12: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/12.jpg)
Are Multiple Views Always Enough?
The answer depends on the scene prior
Rigid Deformable
In general, yes No general answer
State of research: mature State of research: open
![Page 13: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/13.jpg)
Rigid SfM has Two Main Steps
Image registration Shape inference
Registered images with matched keypoints
![Page 14: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/14.jpg)
Non-Rigid SfM / Deformable SfM
Image registration Shape inference
Registered images with visualization grid
![Page 15: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/15.jpg)
Template-Based Deformable 3D Reconstruction
Image
registration
template
Shape
inference
![Page 16: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/16.jpg)
Tutorial Roadmap
• Introduction
1. Deformable Image Registration – Feature-based – Pixel-based
2. Template-Based Deformable Shape Inference – Isometric surfaces – Elastic surfaces
3. Non-Rigid Structure-from-Motion – The Low-Rank Shape Model – Alternative Models
• Conclusion
+
… …
Mo
rnin
g M
orn
ing
Aft
ern
oo
n
![Page 17: Introduction - ULisboaadb/tutorial_2009/2011.11.Tutorial-ICCV... · IV’11, arcelona, Spain – octobre 6, 2011 Lourdes Agapito, Adrien Bartoli, Alessio Del Bue . Millennia Century](https://reader035.vdocuments.net/reader035/viewer/2022070112/6058e08daad9b8748e2f4ed1/html5/thumbnails/17.jpg)
Introduction
Adrien Bartoli
ALCoV – ISIT
Université d’Auvergne
Clermont-Ferrand, France
Fourth Tutorial on Computer Vision in a Nonrigid World ICCV’11, Barcelona, Spain – octobre 6, 2011
Lourdes Agapito, Adrien Bartoli, Alessio Del Bue