lenses and depth of field - university of california,...

68
Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s Lectures at MIT

Upload: doanquynh

Post on 06-Mar-2018

220 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Lenses and Depth of Field

Prepared by Behzad Sajadi

Borrowed from Frédo Durand’s Lectures at MIT

Page 2: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

3 major type of issues• Diffraction

– ripples when aperture is small

• Third-order/spherical aberrations– Rays don’t focus– Also coma, astigmatism,

field curvature• Chromatic aberration

– Focus depends on wavelength

Page 3: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

References

Page 4: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Links• http://en.wikipedia.org/wiki/Chromatic_aberration• http://www.dpreview.com/learn/?/key=chromatic+aberration• http://hyperphysics.phy-

astr.gsu.edu/hbase/geoopt/aberrcon.html#c1• http://en.wikipedia.org/wiki/Spherical_aberration• http://en.wikipedia.org/wiki/Lens_(optics)• http://en.wikipedia.org/wiki/Optical_coating• http://www.vanwalree.com/optics.html• http://en.wikipedia.org/wiki/Aberration_in_optical_systems• http://www.imatest.com/docs/iqf.html• http://www.luminous-landscape.com/tutorials/understanding-

series/understanding-mtf.shtml

Page 5: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Other quality issues

Page 6: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Flare

From "The Manual of Photography" Jacobson et al

Page 7: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Example of flare "bug"• Some of the first copies of the Canon 24-105 L had

big flare problems• http://www.the-digital-picture.com/Reviews/Canon-

EF-24-105mm-f-4-L-IS-USM-Lens-Review.aspx•

Page 8: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Flare and Ghosting

source: canon red book

Page 9: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Flare/ghosting special to digital

source: canon red book

Page 10: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Use a hood! (and a good one)

Adapted from Ray's Applied Photographic Optics

Hood is to shortFlare ray

Good hood

Flare

Page 11: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Lens hood

From Ray's Applied Photographic Optics

Page 12: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Coating• Use destructive interferences• Optimized for one wavelength

From "The Manual of Photography" Jacobson et al

Page 13: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Coating for digital

source: canon red book

Page 14: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Vignetting• The periphery does not get as much light

source: canon red book

Page 15: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Vignetting• http://www.photozone.de/3Technology/lenstec3.htm

Page 16: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Lens design

Page 17: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Optimization software• Has revolutionized lens design• E.g. zooms are good now

From Hecht's Optics

Page 18: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Lens design, ray tracing

source: canon red book

Page 19: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Optimization• Free parameters

– Lens curvature, width, position, type of glass– Some can be fixed, other vary with focal length, focus (e.g.

floating elements)– Multiplied by number of lens elements

• Energy/merit function– MTF, etc.– Black art of massaging the merit function

• Optimize for– All image locations– All wavelengths– All apertures– All focusing distances– All focal lengths (zoom only)

• Usually uses simulated annealing

Page 20: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Floating elements• Move with focus to optimize response

(but are not responsible for focusing)

source: canon red book

Page 21: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Image stabilization

Page 22: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Image stabilization

source: canon red book

Page 23: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Image stabilization

source: canon red book

Page 24: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Image stabilization

source: canon red book

Page 25: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

1000mm, 1/100s, monopod, IS

Page 26: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Different versions• Canon, Nikon: in the lens• Panasonic, Konica/Minolta: move sensor

Page 27: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

6.088 Digital and Computational Photography 6.882 Advanced Computational Photography

Focus and Depth of Field

Frédo DurandMIT - EECS

Page 28: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Focusing

fDD’

1D’ D

1 1f+ =• Move film/sensor

• Thin-lens formula

Page 29: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

In practice, it’s a little more complex• Various lens elements

can move inside the lens– Here in blue

Source: Canon red book.

Page 30: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Defocus & Depth of field

Page 31: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s
Page 32: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Circle of confusion

From Basic Photographic Materials and Processes, Stroebel et al.

circle of confusion

Page 33: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of focus

From Basic Photographic Materials and Processes, Stroebel et al.

Page 34: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Size of permissible circle?• Assumption on print size, viewing distance, human

vision– Typically for 35mm film: diameter = 0.02mm

• Film/sensor resolution (8µ photosites for high-end SLR )

• Best lenses are around 60 lp/mm• Diffraction limit

Page 35: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field: Object space

lens

sensor

Point in focus

Object with texture

• Simplistic view: double cone– Only tells you about the value of one pixel– Things are in fact a little more complicated to asses

circles of confusion across the image– We're missing the magnification factor

(proportional to 1/distance and focal length)

Page 36: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field: more accurate view• Backproject the image onto the plane in focus

– Backproject circle of confusion– Depends on magnification factor

• Depth of field is slightly asymmetrical

lens

Point in focus

Conjugate of circle of confusion

Depth of field

Page 37: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

DoF & aperture• http://www.juzaphoto.com/eng/articles/depth_of_field.htm

f/2.8 f/32

Page 38: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field and focusing distance• Quadratic (bad news for macro)

(but careful, our simplifications are not accurate for macro)

f/N

d1 d2

D

CD/f

Page 39: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Double cone perspective• Seems to say that relationship is linear• But if you add the magnification factor, it's actually

quadratic

lenssensor

Point in focus

Page 40: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field & focusing distance

From Photography, London et al.

Page 41: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field & focal length• Recall that to get the same image size,

we can double the focal length and the distance• Recall what happens to physical aperture size when

we double the focal length for the same f number?– It is doubled

24mm 50mm

Page 42: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

• Same image size (same magnification), same f number

• Same depth of field!

Depth of field & focal length

Wide-anglelens

Telephotolens (2x f), same aperture

DoF

DoF

Page 43: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

DoF & Focal length• http://www.juzaphoto.com/eng/articles/depth_of_fiel

d.htm

50mm f/4.8 200mm f/4.8(from 4 times farther)

See also http://luminous-landscape.com/tutorials/dof2.shtml

Page 44: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Important conclusion• For a given image size and a given f number, the

depth of field (in object space) is the same. • Might be counter intuitive.

• Very useful for macro where DoF is critical. You can change your working distance without affecting depth of field

• Now what happens to the background blur far far away?

Page 45: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Sensor size

Page 46: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Depth of field• It’s all about the size of the lens aperture

lenssensor

Point in focus

Object with texture

lens

sensor Point in focus

Object with texture

Page 47: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Equation• Smaller sensor

– smaller C– smaller f

• But the effect of f is quadratic

Page 48: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Sensor size• http://www.mediachance.com/dvdlab/dof/index.htm

Page 49: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

The coolest depth of field solution• http://www.mediachance.com/dvdlab/dof/index.htm• Use two optical systems

lensdiffuser

Point in focus

Object with texture

lens

sensor

Page 50: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

The coolest depth of field solution• http://www.mediachance.com/dvdlab/dof/index.htm

lensdiffuser

Point in focus

Object with texture

lens

sensor

Page 51: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Seeing through occlusion

Page 52: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Seeing beyond occlusion• Photo taken through zoo bars• Telephoto at full aperture• The bars are so blurry

that they are invisible

Page 53: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Synthetic aperture• Stanford Camera array (Willburn et al.

http://graphics.stanford.edu/papers/CameraArray/)

Page 54: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Autofocus

Page 55: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

How would you build an Auto Focus?

Page 56: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Polaroid Ultrasound (Active AF)• Time of flight (sonar principle)• Limited range, stopped by glass• Paved the way for use in robotics• http://www.acroname.com/robotics/info/articles/sonar/sonar.html• http://www.uoxray.uoregon.edu/polamod/• http://electronics.howstuffworks.com/autofocus2.htm

http://www.uoxray.uoregon.edu/polamod/

From Ray’s Applied Photographic Optics

Page 57: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Infrared (Active AF)• Intensity of reflected IR is assumed to be

proportional to distance• There are a number of obvious limitations• Advantage: works in the dark• This is different from Flash assistant for AF where

the IR only provides enough contrast so that standard passive AF can operate

Page 58: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Triangulation• Rotating mirror sweeps the

scene until the image is aligned with fixed image from mirror M– pretty much stereovision and

window correlation)

From The Manual of Photography

Page 59: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Different types of autofocus

From The Manual of Photography

Page 60: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Contrast • Focus = highest contrast

http://electronics.howstuffworks.com/autofocus3.htm

Page 61: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Phase detection focusing • Used e.g. in SLRs

From The Manual of Photography From the Canon red book

Page 62: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Phase detection focusing • Stereo vision from two portions of the lens on the

periphery• Not at the equivalent

film plane but farthercan distinguish

too far and too close• Look at the phase

difference between the two images

From The Manual of Photography

In focus

Too close

Too far

Detector

phase

Page 63: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

compute phase difference, deduce distance

Page 64: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Fake Depth of Field

Page 65: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Photoshop• Using layers: • One sharp layer, one blurry layer (using Gaussian

blur)• Layer mask selects focusInput (sharp layer)

Result

Blurred layer

Mask of blurry layer)

Page 66: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Photoshop• Problem: halo around edges

Page 67: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Photoshop lens blur• Reverse-engineered algorithm: average over circle• Size of circle depends on pseudo depth • Discard pixels that are too much closer

Input Depth map (painted manually)

Page 68: Lenses and Depth of Field - University of California, Irvinemajumder/PHOTO/LensesAndDepthOfField.pdf · Lenses and Depth of Field Prepared by Behzad Sajadi Borrowed from Frédo Durand’s

Photoshop lens blur• Filter>Blur>Lens blur

Input

Result

Depth map (painted manually)