burst photography - stanford universityweb.stanford.edu/class/ee367/slides/lecture7.pdf ·...
TRANSCRIPT
![Page 1: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/1.jpg)
![Page 2: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/2.jpg)
![Page 3: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/3.jpg)
![Page 4: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/4.jpg)
![Page 5: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/5.jpg)
![Page 6: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/6.jpg)
![Page 7: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/7.jpg)
![Page 8: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/8.jpg)
![Page 9: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/9.jpg)
•
•
•
•
•
•
![Page 10: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/10.jpg)
•
•
![Page 11: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/11.jpg)
•
•
•
•
•
•
•
•
![Page 12: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/12.jpg)
•
•
![Page 13: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/13.jpg)
•
•
![Page 14: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/14.jpg)
•
•
![Page 15: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/15.jpg)
•
![Page 16: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/16.jpg)
•
•
![Page 17: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/17.jpg)
•
![Page 18: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/18.jpg)
•
![Page 19: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/19.jpg)
•
![Page 20: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/20.jpg)
•
•
•
![Page 21: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/21.jpg)
•
•
![Page 22: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/22.jpg)
•
•
•
![Page 23: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/23.jpg)
•
•
![Page 24: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/24.jpg)
•
•
![Page 25: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/25.jpg)
![Page 26: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/26.jpg)
•
![Page 27: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/27.jpg)
•
![Page 28: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/28.jpg)
![Page 29: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/29.jpg)
![Page 30: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/30.jpg)
•
![Page 31: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/31.jpg)
•
•
•
![Page 32: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/32.jpg)
•
•
•
•
•
![Page 33: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/33.jpg)
●
●
●
![Page 34: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/34.jpg)
●
![Page 35: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/35.jpg)
![Page 36: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/36.jpg)
•
![Page 37: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/37.jpg)
• sparse matrix
![Page 38: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/38.jpg)
•
•
![Page 39: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/39.jpg)
•
•
![Page 40: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/40.jpg)
![Page 41: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/41.jpg)
•
![Page 42: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/42.jpg)
![Page 43: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/43.jpg)
•
•
• →
![Page 44: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/44.jpg)
![Page 45: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/45.jpg)
![Page 46: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/46.jpg)
![Page 47: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/47.jpg)
→
•
•
•
•
•
•
![Page 48: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/48.jpg)
![Page 49: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/49.jpg)
4.7 mm2
canon.com
1360 mm24.7 mm2
![Page 50: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/50.jpg)
Larger aperture Long exposure Flash
![Page 51: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/51.jpg)
How to collect more light? Capture multiple photos
video denoising[Kokaram, 1993]
[Dabov et al., 2007][Liu et al., 2014]
exposure bracketing[Debevec et al., 2007][Gallo and Sen 2016]
image stacking
weatherandsky.com
1 frame
16 frames
[Fruchter and Hook, 2002]
![Page 52: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/52.jpg)
● burst with constant exposure○ more robust merge○ underexposed up to 8x
● reference image○ physically consistent fallback
● raw images○ merge in raw too
● burst with constant exposure○ more robust merge○ underexposed up to 8x
● burst with constant exposure○ more robust merge○ underexposed up to 8x
● reference image○ physically consistent fallback
Our approach
![Page 53: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/53.jpg)
exposure bracketing● higher SNR● challenging merge
● HDR capture as noise reduction [Hasinoff et al. 2010] [Zhang et al. 2010]
Underexposure for HDR
single underexposed shot● low SNR
underexposed burst● moderate SNR● more robust merge ...
![Page 54: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/54.jpg)
...
12 MPix, 10-bit
System overview
customautoexposure
processing
align & merge
12 MPix, 14-bit
zeroshutterlagcapture
finish
12 MPixring
buffer
![Page 55: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/55.jpg)
Autoexposure and tonemapping
![Page 56: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/56.jpg)
Example-based autoexposure
AE database~5,000 scenes
scenedescriptor
AE result
scenedescriptor
dual AE result - controls capture and rendition
shortexposure
longexposure
AE result
raw input
![Page 57: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/57.jpg)
● synthetic exposures from AE○ single merged input image○ digital gains
● automatically set tuning parameters
Local tonemapping
pyramid blending for HDR tonemapping[Mertens et al., 2007]
[Paris et al. 2011][Aubry et al. 2014]
![Page 58: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/58.jpg)
Align and merge
![Page 59: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/59.jpg)
Burst alignment
reference frame
R+Gr+Gb+B
input burst
local alignmentto reference
reference frame
alternate frame
raw
120x90 (or 60x45)12 MPix3 MPix
![Page 60: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/60.jpg)
Coarse to fine alignment
4x
4x
● 4 pyramid levels● upsample with multiple hypotheses [Tao et al., 2012]
metric search range subpixel?
L1
L2 9x9
3x3 no
yes
2x
![Page 61: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/61.jpg)
Example alignment
aligned to reference
reference frame
![Page 62: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/62.jpg)
Tiled Fourier-based merge● divide into 16x16 or 32x32 tiles
○ 50% overlap - every pixel covered by 4 tiles● merge in Fourier domain
...
reference tile
aligned alternate tiles
merged tile
![Page 63: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/63.jpg)
Robust per-frequency merge
robust pairwise merge
reference frame
aligned average
![Page 64: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/64.jpg)
Finish
![Page 65: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/65.jpg)
Finish pipeline
demosaic,white balance
chroma denoise
lens shading, color correction
local tonemapping
global tonemapping
sharpen
suppress aberrations
color tuning YUV→U'V' LUT
merged raw
final result
12 MPix, 14-bit
12 MPix, 8-bit
auto exposure
luma
chroma
![Page 66: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/66.jpg)
Results
![Page 67: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/67.jpg)
HDR+ Off
![Page 68: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/68.jpg)
HDR+ On
![Page 69: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/69.jpg)
HDR+ Off
![Page 70: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/70.jpg)
HDR+ On
![Page 71: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/71.jpg)
Released Nov. 2018
![Page 72: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/72.jpg)
Siggraph Asia 2019
HDR+ Night Sight
![Page 73: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/73.jpg)
Night Sight● Dedicated mode
○ positive shutter lag○ heavier processing
● More light○ bigger bursts○ much longer exposures
● Motion metering● Stronger merge
○ more aggressive○ super-resolution merge
● ML-based AWB● Night "look"
○ brighter AE○ more HDR
![Page 74: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/74.jpg)
● less motion?○ longer exposure○ better SNR
Measure scene motion in real time, to choose the exposure time
Motion metering
motion metering off8.3 ms, ISO 346
motion metering on59 ms, ISO 53
● more motion?○ shorter exposure○ less motion blur
![Page 75: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/75.jpg)
● less motion?○ longer exposure○ better SNR
Measure scene motion in real time, to choose the exposure time
Motion metering
● more motion?○ shorter exposure○ less motion blur
motion metering off17 ms, ISO 183
motion metering on6 ms, ISO 512
![Page 76: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/76.jpg)
Motion metering - "tripod detection"
● When camera is very stable, allow even longer exposures● Combine signals from gyro (camera motion) and images
(camera+scene motion)○ Discount motion due to shutter tap
● For fixed time budget, prefer fewer frames○ Less read noise start of burst
![Page 77: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/77.jpg)
77
Without tripod detection 15 frames x 333ms
With tripod detection 6 frames x 1000ms
![Page 78: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/78.jpg)
78
Without tripod detection 15 frames x 333ms
With tripod detection 6 frames x 1000ms
![Page 79: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/79.jpg)
Challenges for Night Sight merge
object motion camera motion low SNR
![Page 80: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/80.jpg)
Merge increases →High noise, motion robust Low noise, motion blur
80
![Page 81: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/81.jpg)
Motion-Adaptive Burst Merging
![Page 82: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/82.jpg)
Modifying the merge strength
HDR+ Increased merge
![Page 83: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/83.jpg)
HDR+Temporal strength = 16
Increased mergeTemporal strength = 200
Ours: Tile-wise merge using mismatch maps
Modified merge: spatially varying merge strength
![Page 84: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/84.jpg)
Super Res Zoom on Pixel 3
Siggraph 2019
![Page 85: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/85.jpg)
White balance gains are applied to make “white” appear white
Captured image
Predicted “illumination”
Predicted imageInverse rgb gains
=/
![Page 86: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/86.jpg)
White balance is an ill-posed problem
Learning based white balance: "Fast Fourier Color
Constancy", Barron & Tsai, 2017
Extended to low-light scenes
![Page 87: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/87.jpg)
Challenges of Color Constancy in low light
Noisier images
➡ Train on real images that have noise
➡ New training data set for low light (3,500 images)
Various illuminants:Highly colorful illuminants result in color channels with practically zero signal (“missing channels”)
➡ New error metric: Anisotropic Reproduction Error (ARE)
![Page 88: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/88.jpg)
Auto white balance results
Left: camera default, Right: ours
![Page 89: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/89.jpg)
Baseline system(HDR+, Hasinoff et
al, 2016)
13 frames,exposure time:
1/15 s
![Page 90: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/90.jpg)
Adding new tone mapping to
baseline
Results are noisy
![Page 91: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/91.jpg)
Adding motion metering
Exposure time 1/3 s
Noise and detail improve
![Page 92: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/92.jpg)
Adding motion-robust
merge
Noise and detail improve further
![Page 93: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/93.jpg)
Adding motion-robust
merge
Noise and detail improve further
![Page 94: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/94.jpg)
Adding low-light auto white
balance
Color improves
![Page 95: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/95.jpg)
Side by side comparison
Previously described result (HDR+, Hasinoff et al 2016) Our result
![Page 96: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/96.jpg)
Results across a variety of scenes: indoor
Previously described result (HDR+, Hasinoff et al 2016) Our result
![Page 97: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/97.jpg)
Results across a variety of scenes: outdoor
Previously described result (HDR+, Hasinoff et al 2016) Our result
![Page 98: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/98.jpg)
“Learning to see in the dark”, Chen et al, 2018
End to end network
Training set is pairs on short and long exposures
![Page 99: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/99.jpg)
Comparison to “Learning to See in the Dark” (Chen et al, 2018)
Chen et al 2018 Our result
![Page 100: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/100.jpg)
Comparison to “Learning to See in the Dark” (Chen et al, 2018)
Chen et al 2018 Our result
![Page 101: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/101.jpg)
Astrophotography
![Page 102: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/102.jpg)
Astrophotography
Extending exposure time
● Up to 4 minutes total exposure: ○ Capture even more light to improve signal to noise○ Extend the capture time per frame
● Detect when the camera is static using gyro signals● Detect when the scene is static
![Page 103: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/103.jpg)
![Page 104: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/104.jpg)
![Page 105: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/105.jpg)
![Page 106: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/106.jpg)
![Page 107: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/107.jpg)
![Page 108: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/108.jpg)
![Page 109: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/109.jpg)
![Page 110: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/110.jpg)
![Page 111: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/111.jpg)
● Traditional: extend the exposure time● Computational:
● Burst photography● Motion metering● Motion-adaptive merge● Tone mapping for nighttime scenes● Device stability detection● “Warm pixel” removal
● Machine learning:● Learning based white balance● Semantically aware image processing of the skies
● Implemented on a mobile device
In Summary,To Capture Low Light Scenes:
![Page 112: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/112.jpg)
2019 Smartphone Camera of the year award“If you shoot Night Sight - even during daylight hours - you'll be rewarded with some of the best detail retention and balanced noise reduction we've seen from a smartphone... A new astrophotography mode is not just cool but inspiring, and also benefits any nighttime scene where longer exposures can be used. The combination of super-res zoom and a new telephoto module make 'zoomed in' photos better than many peers.” dpreview.com
![Page 113: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/113.jpg)
![Page 114: Burst Photography - Stanford Universityweb.stanford.edu/class/ee367/slides/lecture7.pdf · Computational Photography - Overview! Debevec & Malik, 1997 • high dynamic range!! •](https://reader036.vdocuments.net/reader036/viewer/2022062607/6021426c647b5e461422a108/html5/thumbnails/114.jpg)
HDR
• Mann, Picard “On Being ‘Undigital’ with Digital Cameras: Extending Dynamic Range by Combining Differently Exposed Pictures”, IS&T 1995
• Debevec, Malik, “Recovering High Dynamic Range Radiance Maps from Photographs”, SIGGRAPH 1997
• Robertson, Borman, Stevenson, “Estimation-Theoretic approach to Dynamic Range Improvement Using Multiple Exposures”, Journal of Electronic Imaging 2003
• Mitsunaga, Nayar, “Radiometric self Calibration”, CVPR 1999
• Reinhard, Ward, Pattanaik, Debevec (2005). High dynamic range imaging: acquisition, display, and image-based lighting. Elsevier/Morgan Kaufmann
• Fattal, Lischinski, Werman, “Gradient Domain High Dynamic Range Compression”, ACM SIGGRAPH 2002
• Durand, Dorsey, “Fast Bilateral Filtering for the Display of High Dynamic Range Images”, ACM SIGGRAPH 2002
Super-resolution
• Baker, Kanade, Limits on super-resolution and how to break them“ IEEE Transactions on Pattern Analysis and Machine Intelligence 24(9), 1167–1183 (2002)
• Ben-Ezra, Lin, Wilburn, Zhang,, “Penrose pixels for super-resolution” EEE Transactions on Pattern Analysis and Machine Intelligence 33(7), 1370–1383 (2011)
• Ben-Ezra, Zomet, Nayar, “Jitter Camera: High Resolution Video from a Low Resolution Detector”, CVPR 2004
• Ben-Ezra, Zomet, Nayar, “Video super-resolution using controlled subpixel detector shifts” IEEE Trans. PAMI27(6), 977–987 (2005)
• Elad, Feuer, “Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images” IEEE Trans. Im. Proc. 6(12), (1997)
Other
• Hasinoff, Sharlet, Geiss, Adams, Barron, Kainz, Chen, Levoy “Burst photography for high dynamic range and low-light imaging on mobile cameras”, SIGGRAPH Asia 2016
• Orly Liba, Kiran Murthy, Yun-Ta Tsai, Tim Brooks, Tianfan Xue, Nikhil Karnad, Qiurui He, Jonathan T. Barron, Dillon Sharlet, Ryan Geiss, Samuel W. Hasinoff, Yael Pritch, Marc Levoy, “Handheld mobile photography in very low light.” SIGGRAPH
Asia 2019.
• Liba, Orly, Longqi Cai, Yun-Ta Tsai, Elad Eban, Yair Movshovitz-Attias, Yael Pritch, Huizhong Chen, and Jonathan T. Barron. "Sky Optimization: Semantically Aware Image Processing of Skies in Low-Light Photography." In Proceedings of the
IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 526-527. 2020.
• Chen, et al. "Learning to see in the dark." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018.
• Wronski B, Garcia-Dorado I, Ernst M, Kelly D, Krainin M, Liang CK, Levoy M, Milanfar P . “Handheld multi-frame super-resolution”, SIGGRAPH 2019.
• Ben-Ezra and Nayar, "Motion Deblurring using Hybrid Imaging”, CVPR 2003
• Yuan, Sun, Quan, Shum, “Image Deblurring with Blurred/Noisy Image Pairs”, ACM SIGGRAPH 2007
• Hasinoff, Kutulakos, “Confocal Stereo”, ECCV 2006
• Hasinoff, Kutulakos, “A Layer-Based Restoration Framework for Variable-Aperture Photography”, ICCV 2007
• Raskar, Tan, Feris, Yu, Turk, “Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering using Multi-Flash Imaging”, ACM SIGGRAPH 2004
• Pettschnigg, Agrawala, Hoppe, Szeliski, Cohen, Toyama, “Digital Photography with Flash and No-Flash Image Pairs”, ACM SIGGRAPH 2004
• Eisemann, Durand, “Flash Photography Enhancement via Intrinsic Relighting”, ACM SIGGRAPH 2004