©20th century fox - massachusetts institute of technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf ·...
TRANSCRIPT
![Page 1: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/1.jpg)
2.71704/20/05 – wk11-b-1
©© 2020thth Century FoxCentury Fox
![Page 2: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/2.jpg)
2.71704/20/05 – wk11-b-2
![Page 3: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/3.jpg)
2.71704/20/05 – wk11-b-3
The “4F system” (telescope) : a general model for imaging
2f 2fx ′′ x′x
1f 1f
az
imageimageplane
objectobjectplane
FourierFourierplane planeplane plane
![Page 4: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/4.jpg)
2.71704/20/05 – wk11-b-4
Imaging a 2½D object
2f 2fx ′′ x′x
1f 1f
DepthDepthof of
FocusFocus
DefocusDefocus
z
( )2NA5.0 λ
≈
a
22½½DDobjectobject
![Page 5: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/5.jpg)
2.71704/20/05 – wk11-b-5
Imaging a 2½D object
2f 2fx ′′ x′x
1f 1f
z∆z
portion of objectportion of objectdefocused by defocused by ΔΔzz
![Page 6: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/6.jpg)
2.71704/20/05 – wk11-b-6
Imaging a 2½D object
2f 2fx ′′ x′x
1f 1f
z
…… is equivalent to same portion is equivalent to same portion inin--focusfocus PLUS PLUS ……
…… fictitious quadratic fictitious quadratic phase mask phase mask
on the Fourier plane
( )⎭⎬⎫
⎩⎨⎧ ∆′′+′′− 2
1
22
2expf
zyxiλ
π (applied (applied locally locally -- shift variantshift variant))on the Fourier plane
![Page 7: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/7.jpg)
2.71704/20/05 – wk11-b-7
Example: multi-surface object
2 (DoF)s 4 (DoF)s
focal plane
![Page 8: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/8.jpg)
2.71704/20/05 – wk11-b-8
Raw image (collected by camera – noise-free )
z=0 mm z=3.2 mm z=6.4 mm
λ=0.5µm, f1=f2=20cm, a=2.5mm→ NA=0.0125, DoF=1.6mmSpatially incoherent illuminationDistance between planes = 2 Depths of FieldImage blurred by diffraction (lateral aperture) as well
![Page 9: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/9.jpg)
2.71704/20/05 – wk11-b-9
Deconvolution using depth as prior (noise-free)
z=0 mm z=3.2 mm z=6.4 mm
Deconvolution using Tikhonov regularized inverse filter, µ=10-5
Utilized a priori knowledge of depth of each digit (alternatively,needs depth-from defocus algorithm)
Note: regularization necessary because of numerical noise!
![Page 10: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/10.jpg)
2.71704/20/05 – wk11-b-10
Effect of regularizer – low noise
![Page 11: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/11.jpg)
2.71704/20/05 – wk11-b-11
Effect of regularizer – moderate noise
![Page 12: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/12.jpg)
2.71704/20/05 – wk11-b-12
Effect of regularizer – strong noise
![Page 13: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/13.jpg)
2.71704/20/05 – wk11-b-13
Quadratic error vs µ – moderate noise
SNR=10SNR=10
![Page 14: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/14.jpg)
2.71704/20/05 – wk11-b-14
Quadratic error vs µ – strong noise
SNR=3SNR=3
![Page 15: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/15.jpg)
2.71704/20/05 – wk11-b-15
Cubic Phase Mask (the George B explanation)
2f 2fx ′′ x′x
1f 1f
z
extended depthextended depthof uniform blurof uniform blur
digital digital deblurring
The CDM solution (The CDM solution (DowskiDowski & & CatheyCathey, 1995), 1995)add cubic phase distortion in the Fourier planeadd cubic phase distortion in the Fourier plane
deblurring( ){ }33exp yxi ′′+′′− α
![Page 16: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/16.jpg)
2.71704/20/05 – wk11-b-16
Raw image (collected by camera – noise-free )
Image using the cubic phase apertureNote blur is almost independent of depth
![Page 17: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/17.jpg)
2.71704/20/05 – wk11-b-17
Deconvolution (noise-free) – no prior necessary
Deconvolution using Tikhonov regularized inverse filterUniform quality, comparable to in-focus image using clear apertureNo a priori depth information was used (i.e. depth filter is shift invariant)
![Page 18: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/18.jpg)
2.71704/20/05 – wk11-b-18
Effect of regularizer on cubic phase – low noise
![Page 19: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/19.jpg)
2.71704/20/05 – wk11-b-19
Effect of regularizer on cubic phase – moderate noise
![Page 20: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/20.jpg)
2.71704/20/05 – wk11-b-20
Effect of regularizer – strong noise
![Page 21: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/21.jpg)
2.71704/20/05 – wk11-b-21
Quadratic error vs µ – moderate noise
SNR=10SNR=10& cubic& cubic
![Page 22: ©20th Century Fox - Massachusetts Institute of Technologyweb.mit.edu/2.717/www/2.717-wk11-b.pdf · 2005. 4. 17. · ©20thCentury Fox. 2.717 04/20/05 – wk11-b-2. 2.717 04/20/05](https://reader035.vdocuments.net/reader035/viewer/2022071411/610683d617869d352018f590/html5/thumbnails/22.jpg)
2.71704/20/05 – wk11-b-22
Quadratic error vs µ – strong noise
SNR=3SNR=3& cubic& cubic