lecture 5, part 2: retrographic sensing for the ... · edward h. adelson mit october 9, 2009. no...
TRANSCRIPT
![Page 1: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/1.jpg)
Retrographic SSensing for the Measurement of Suurface Texture and
ShaShaapeape
Micah K. JohnsonEdward HH. Adelson
MIT
October 9, 2009
![Page 2: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/2.jpg)
no
CapturingCapturing geometrygeometry
• Woodham, 1980
• Zickler, 2002
•• Goldman, 2005
• Hertzmann 2005Hertzmann, 2005
Immages removed due to copyright restrictions.
Seee: 1)) Fig. 10 (baby doll head) in Zickler, T. et al.
International Journal of Computer Vision 49, no. 2-3 (2002): 215. (PDF)
2)) Fig. 1 (cast iron teapot) in Goldman, D. B., et al. Proc. Of ICCV 2005. (PDF)
3)) Ceramic cat from Hertzmann, A., and S. Seitz. “Shape and Materials by Example: A Photometric Stereo ApproachStereo Approach.” IEEE PAMI 27 8 (2005)” IEEE PAMI 27, no. 8 (2005).
![Page 3: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/3.jpg)
Surface texture and shapeSurface texture and shape
![Page 4: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/4.jpg)
CookieCookie
Paint
Cl ElClear Elasttomer
![Page 5: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/5.jpg)
![Page 6: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/6.jpg)
![Page 7: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/7.jpg)
t
ElastoElastoomersomers • M t i l ld b • Material shhould be
clear, soft, durable, etc.
• Have tried siliconesHave tried silicones and polyurethanes
•• Thermoplastic elastomers (TPEs)
See accompanying video “ThermoplasticSee accompanying video Thermoplastic elastomers” (lec05_tpe.mov)
![Page 8: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/8.jpg)
Bake at 3350 for 30 minutes...
![Page 9: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/9.jpg)
PaaintPaaint
![Page 10: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/10.jpg)
Lights, camLights, cammera, actionmera, action Sensor Ligghts
Cammera
![Page 11: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/11.jpg)
Why threWhy threee lightsee lights?
shading SFSFFSFS shape
• Shape-from-shadinng
![Page 12: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/12.jpg)
Multiple lightsMultiple lightss: photometrics: photometric stereo
Woodham, 1980Woodham, 1980
![Page 13: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/13.jpg)
RGB RedRGB Red
Green Blue
![Page 14: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/14.jpg)
CalibrrationCalibrration
![Page 15: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/15.jpg)
Lookup Table
B
R G
Loo GradientRGB color RGB color Lookupkup Gradient
(10,200,3) (0,-0.3)
(200,10,3) (0.2, 0.2)
![Page 16: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/16.jpg)
S rface rec constructionSurface recconstr ction
![Page 17: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/17.jpg)
![Page 18: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/18.jpg)
![Page 19: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/19.jpg)
See accompanying video ““20 dollar bill” (lec05_20.mov)
![Page 20: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/20.jpg)
S nyiing videoSee accompan id “Fingertip” (lec05_finger.mov)
![Page 21: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/21.jpg)
S mpanyiing videoSee accom id “Fingertip with lotioon” (lec05_finger2.mov)
![Page 22: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/22.jpg)
LimitaLimitaationsations • pends on gel• Limited depth - dep
• Some objects distoSome objects distoort when pressedort when pressed
- fingertips, cloth
![Page 23: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/23.jpg)
RetrographRetrographhic sensinghic sensing
• Inexpensive
• High-resolution
• SimpleSimple
• Portable / Interactivve
• Acknowledgementss
- Funding from NSFunding from NSSF and Adobe SystemsSF and Adobe Systems
![Page 24: Lecture 5, part 2: Retrographic Sensing for the ... · Edward H. Adelson MIT October 9, 2009. no CapturingCapturing geometrygeometry • Woodham, 1980 • Zickler, 2002 •• Goldman,](https://reader033.vdocuments.net/reader033/viewer/2022052015/602d62c97fb4c16a665de94d/html5/thumbnails/24.jpg)
MIT OpenCourseWarehttp://ocw.mit.edu
MAS.531 Computational Camera and Photography Fall 2009
For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.