amit agrawal, ashok veeraraghvan, srinivasa narasimhan and

22
Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and Ankit Mohan Mitsubishi Electric Research Labs (MERL) Robotics Institute, CMU MIT Media Lab Coded Computational Imaging Coded Computational Imaging Course WebPage : http://www.umiacs.umd.edu/~aagrawal/CVPR10Tutorial/index.html

Upload: others

Post on 01-May-2022

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and Ankit Mohan

Mitsubishi Electric Research Labs (MERL)Robotics Institute, CMU

MIT Media Lab

Coded Computational ImagingCoded Computational Imaging

Course WebPage : http://www.umiacs.umd.edu/~aagrawal/CVPR10Tutorial/index.html

Page 2: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Course OrganizersCourse Organizers

Amit Agrawal(Research Scientist ,MERL)

http://www.umiacs.umd.edu/~aagrawal/

Ashok Veeraraghavan(Research Scientist ,MERL)

http://www.cfar.umd.edu/~vashok/

Ankit Mohan(Post-doc, MIT Media Lab)

http://www.umiacs.umd.edu/~aagrawal/

Srinivasa Narasimhan(Associate Professor, CMU) http://www.cs.cmu.edu/~srinivas/

Page 3: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Shree NayarRamesh RaskarMarc LevoyAnat LevinBill FreemanShuntaro YamazakiLi ZhangJames DavisBrian CurlessVlad BranzoiTerry Boult

AcknowledgementsAcknowledgements

Moshe Ben EzraYoav SchechnerPaul DebevecHendrik LenschWojciech MatusikRavi RamamoorthiTakeo KanadeTodd ZicklerPradeep SenWikipedia (Imaging History)

Page 4: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Camera Obscura, Gemma Frisius, 1544

1544A Brief History of ImagesA Brief History of Images

Page 5: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Lens Based Camera Obscura, 1568

1544

1568A Brief History of Images

Page 6: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Joseph Nicéphore Niépce (1765-1833) The first negative (not original)[Not fixed…quickly vanished]

1544

1568A Brief History of Images

1816

Page 7: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1568A Brief History of Images

18161826

The first permanent photograph (8 hour exposure), Niepce

Page 8: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Still Life, Louis Jaques Mande Daguerre, 1837

1544

1837

1568A Brief History of Images

18161826

Page 9: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Daguerreotype Panorama (wiki)

A Brief History of Images

Page 10: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1837

1568A Brief History of Images

18161826

1841

William Henry Fox Talbot , negative to positive photographic process

Page 11: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1837

1568A Brief History of Images

18161826

18411861

tartan ribbon, James Clerk Maxwell, additive color photograph

Page 12: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1837

1568A Brief History of Images

18161826

18411861

Louis Ducos du Hauron, subtractive color photograph

1868

Page 13: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1837

1568A Brief History of Images

18161826

1841186118681878

The Horse in Motion, Muybridge, fast motion using 24 cameras.

Page 14: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

1544

1837

1568A Brief History of Images

18161826

1841186118681878

Page 15: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

The Leica, the 35mm format in still photography.

1544

1837

1568A Brief History of Images

18161826

1841186118681878

1925

The photographic film is cut into strips 35 millimeters wide.

Page 16: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Poloroid instant image camera

1544

1837

1568A Brief History of Images

18161826

1841186118681878

19251948

Edwin H. Land

Page 17: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Silicon Image Detector, 1973

A Brief History of ImagesA Brief History of Images

1973

1544

1837

1568

18161826

1841186118681878

19251948

Page 18: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

A Brief History of ImagesA Brief History of Images

1973

1544

1837

1568

18161826

1841186118681878

19251948

1995

Digital Cameras

Page 19: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

Canon.com

Page 20: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

[Shree Nayar, CAVE Lab]

Page 21: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

GoalsGoals

– Focus on understanding concepts in computational imaging

• Thinking beyond pixels in ray-space

– 4D Lightfield, Plenoptic Sampling

• New ways of sampling the visual world

– Multiplexing

• Modifying the capture process to simplify the problem

– Motion blur, Defocus blur

• Using reconstruction algorithms and priors

– Compressive Sensing

– What we will not cover

• Traditional image processing, photo manipulations & editing

Page 22: Amit Agrawal, Ashok Veeraraghvan, Srinivasa Narasimhan and

Coded Computational Imaging Agrawal, Veeraraghavan, Narasimhan & Mohan

ScheduleSchedule

Introduction Narasimhan, 10 mins

Assorted Pixels Narasimhan, 20 mins

Coding and Modulation in Cameras Agrawal, 45 mins

Break 10 min

Light Fields and Applications Mohan, 60 mins

Break 10 min

Computational Illumination Narasimhan, 45 mins

Future Trends Agrawal, 15 mins

Discussion