raskar uist keynote 2015 november

91
Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar Innovating for Billions Ramesh Raskar Associate Professor MIT Media Lab

Upload: cameraculture-mit-media-lab

Post on 16-Apr-2017

534 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: Raskar UIST Keynote 2015 November

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Innovating for Billions

Ramesh RaskarAssociate Professor

MIT Media Lab

Page 2: Raskar UIST Keynote 2015 November
Page 3: Raskar UIST Keynote 2015 November

Slit Lamp for Cataracts

Page 4: Raskar UIST Keynote 2015 November

4

Slit Lamp Exam Retinal Scan

Retinal Scan

Page 5: Raskar UIST Keynote 2015 November

Phoropter

Page 6: Raskar UIST Keynote 2015 November

Next 5 Billion

Emerging InterfacesEmerging Worlds

Page 7: Raskar UIST Keynote 2015 November

Pamplona, Mohan, Oliveira, Raskar SIGGRAPH 2010

eyeNETRA: Glasses and Cataract

Page 8: Raskar UIST Keynote 2015 November

Shack-Hartmann WS

Wavefront aberrometer

Refraction Map using Wavefront Sensor

Page 9: Raskar UIST Keynote 2015 November

300+ DPI LCDs

Page 10: Raskar UIST Keynote 2015 November

Shack-Hartmann Wavefront Sensor

Lase

r

Sensor

10

Microlens Array

Planar Wavefront

Shack & Platt 1971Liang et al 1994

David Williams et al, Rochester

Spot Diagram

Page 11: Raskar UIST Keynote 2015 November

Lase

r

Sensor

Displacement = Local Slope

of the Wavefront

Spot Diagram

Shack-Hartmann Wavefront SensorShack & Platt 1971

Liang et al 1994David Williams et al, Rochester

Page 12: Raskar UIST Keynote 2015 November

NETRA = Inverse of Shack-Hartmann

12

Spot Diagram on LCD

Cell Phone Displa

y

Eye Piece

Shack-Hartmann ~ Augmented LightfieldsOh, Raskar, Barbastathis 2009: Augmented Light Field

Page 13: Raskar UIST Keynote 2015 November

NETRA = Inverse of Shack-Hartmann

13

Eye Piece

Shack-Hartmann ~ Augmented LightfieldsOh, Raskar, Barbastathis 2009: Augmented Light Field

Spot Diagramon LCD

CellPhone LCD

Page 14: Raskar UIST Keynote 2015 November

14

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensor

User interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

Page 15: Raskar UIST Keynote 2015 November

15

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensorUser interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

Page 16: Raskar UIST Keynote 2015 November

16

Spot Diagramon LCD

NETRA = Inverse of Shack-Hartmann wavefront sensorUser interactively creates the Spot Diagram

1. Displace 25 spots with smart UI

CellPhone LCD

EyePiece

2. Displace spots till single dot

perceived

Page 17: Raskar UIST Keynote 2015 November

17

Kenya

Thermometer for Eye

Page 18: Raskar UIST Keynote 2015 November

India

Page 19: Raskar UIST Keynote 2015 November

Brazil

Page 20: Raskar UIST Keynote 2015 November
Page 21: Raskar UIST Keynote 2015 November

EyeSelfie, Swedish et al SIGGRAPH 2015

Page 22: Raskar UIST Keynote 2015 November
Page 23: Raskar UIST Keynote 2015 November

MIT Media Lab

Page 24: Raskar UIST Keynote 2015 November

Next 5 Billion

Page 25: Raskar UIST Keynote 2015 November

Rethinking Engineering Design Execution

Page 26: Raskar UIST Keynote 2015 November

LVPEI@ Hyderabad

Page 27: Raskar UIST Keynote 2015 November
Page 28: Raskar UIST Keynote 2015 November
Page 29: Raskar UIST Keynote 2015 November
Page 30: Raskar UIST Keynote 2015 November
Page 31: Raskar UIST Keynote 2015 November
Page 32: Raskar UIST Keynote 2015 November
Page 33: Raskar UIST Keynote 2015 November
Page 34: Raskar UIST Keynote 2015 November
Page 35: Raskar UIST Keynote 2015 November
Page 36: Raskar UIST Keynote 2015 November
Page 37: Raskar UIST Keynote 2015 November
Page 38: Raskar UIST Keynote 2015 November
Page 39: Raskar UIST Keynote 2015 November
Page 40: Raskar UIST Keynote 2015 November

Doctor Instrument Patient

Page 41: Raskar UIST Keynote 2015 November

IA > AIIntelligence

AmplificationArtificialIntelligence

Page 42: Raskar UIST Keynote 2015 November

Health and Wellness Interfaces

Page 43: Raskar UIST Keynote 2015 November
Page 44: Raskar UIST Keynote 2015 November

Saving Lives

Markets Partners

Page 45: Raskar UIST Keynote 2015 November

Kadambi, Gupta et al

Page 46: Raskar UIST Keynote 2015 November
Page 47: Raskar UIST Keynote 2015 November

F. Huang, G. Wetzstein, B. Barsky, R. Raskar, Siggraph 2014

Page 48: Raskar UIST Keynote 2015 November

Pre-corrected

Images on

Lightfield Display Siggraph 2012

Siggraph 2014

Page 49: Raskar UIST Keynote 2015 November

Read a book without opening pages using THz

Page 50: Raskar UIST Keynote 2015 November
Page 51: Raskar UIST Keynote 2015 November

Read a book without opening pages using THz

Page 52: Raskar UIST Keynote 2015 November

Sanchez, Heshmat, Reza, Romberg, Raskar 2015

Page 53: Raskar UIST Keynote 2015 November

Zensei: Bio ImpendanceCasual Indentification

Sato, Puri, Ivan

Page 54: Raskar UIST Keynote 2015 November

?

Page 55: Raskar UIST Keynote 2015 November

Receiver/Transmitte

r

TX

RX1

RX2

RX3

RX4

Chervat, McCullum, Feignin, Raskar 2015, NATURE SciRep 2015

Page 56: Raskar UIST Keynote 2015 November

See Through Walls, NATURE SciRep 2015

Page 57: Raskar UIST Keynote 2015 November

Demo: Rflow, Bedri et al

Page 58: Raskar UIST Keynote 2015 November

FLIM

Satat et al. Nature Comm 2015Bhandari et al. 2015

Page 59: Raskar UIST Keynote 2015 November

Pratik Shah, Hyunsung Park

Page 60: Raskar UIST Keynote 2015 November

Hospitals Schools

Food Transactions

Page 61: Raskar UIST Keynote 2015 November

Here There Together

Page 62: Raskar UIST Keynote 2015 November

Kumbh Mela: 30M Visitors 30 Days

Page 63: Raskar UIST Keynote 2015 November
Page 64: Raskar UIST Keynote 2015 November

Health

Food Transport

Housing Payments

Civic

Page 65: Raskar UIST Keynote 2015 November
Page 66: Raskar UIST Keynote 2015 November
Page 67: Raskar UIST Keynote 2015 November

Next: Jan 24-30, 2016

Page 68: Raskar UIST Keynote 2015 November

Crowds from Cell Tower Data

Page 69: Raskar UIST Keynote 2015 November

DataThings

Citizens

Emerging Worlds

Page 70: Raskar UIST Keynote 2015 November

Ram

esh

Raskar

Ale

x (

San

dy)

Pen

tlan

d

Ken

t L

ars

on

Eth

an

Zu

ckerm

an

Iyad

Rah

wan

Cesar

Hid

alg

o

Page 71: Raskar UIST Keynote 2015 November

uist@

Emerging InterfacesEmerging Worlds

Page 72: Raskar UIST Keynote 2015 November

Publish Demo Deploy

Page 73: Raskar UIST Keynote 2015 November

Pencil + Cassettes

Page 74: Raskar UIST Keynote 2015 November

Photo of women and weighing scale

Entrepreneur

Page 75: Raskar UIST Keynote 2015 November

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Innovating for Billions

IA > AI

Page 76: Raskar UIST Keynote 2015 November

END

Page 77: Raskar UIST Keynote 2015 November

neXt

Page 78: Raskar UIST Keynote 2015 November

• What will a camera/display look like in 20 years?

• How will the next billion cameras change the social culture?

• How can we augment the camera to support best ‘image search’?

• How will portable health diagnostics impact healthcare?

• Will we live mostly in virtual/augmented reality, telepresent?– TiVo for life?

• How will ultra-high-speed/resolution imaging change us?

• How can we improve ‘trust’ in imaging?

• Can we print anything .. Cars, food, .. babies .. – (what will make Amazon obsolete)

• What are the opportunities in pervasive recording?– e.g. GoogleEarth Live

• What will be in Photoshop2030?

• What is the future of movie-making, news reporting, sports viewing?

Page 79: Raskar UIST Keynote 2015 November
Page 80: Raskar UIST Keynote 2015 November

Camera in 20 years

Photoshop 2032

Pervasive Recording

Movies and News

Trust and Social Stability

Health Diagnostics

Augmented Reality

3D Displays

Print Anything

Page 81: Raskar UIST Keynote 2015 November
Page 82: Raskar UIST Keynote 2015 November

Saving Lives

Markets Partners

Page 83: Raskar UIST Keynote 2015 November

DOPS, DAPS and DIPS

Digital Opportunities for Physical SystemsDigital Applications for Physical Systems

Digital Interfaces for Physical Systems

Page 84: Raskar UIST Keynote 2015 November

Jesse Schell

Comfort

Excitement

Page 85: Raskar UIST Keynote 2015 November

Solo

Multi-year

Team

Swift

Page 86: Raskar UIST Keynote 2015 November

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Ramesh RaskarAsso. ProfessorMIT Media Lab

What isSiggraph NEXT

Page 87: Raskar UIST Keynote 2015 November

Geometry Rendering Animation

CAD

Imaging

Movies Games Photography

???

Page 88: Raskar UIST Keynote 2015 November

G R A I

Games/Movies

Page 89: Raskar UIST Keynote 2015 November

MLSPOpticsAudioGraph Cuts…

G R A I

Games/Movies

'Does this work contribute TO Siggraph techniques’

Page 90: Raskar UIST Keynote 2015 November

MLSPOpticsAudioGraph Cuts…

G R A I

Games/Movies

?

'Does this work contribute Siggraph techniques TO ..’

Page 91: Raskar UIST Keynote 2015 November

NewFabrication, VR, Displays, Cameras, Perception, …

EmergingHealth, Drones, Transport, Materials, Food, Energy, …

NEXT Speakers’ key challenges + visual computing can solve