Computer Vision I:an overview

Credits

TheseslidesarepartoftheDuckietownproject.FormoreinformationaboutDuckietown,seethewebsitehttp://duckietown.org

Explains Prerequisites

• Whatcomputervision(CV)isandwhyitisimportant

• None

• JacopoTani(ETHZ)– October2017,October2018,October2019

• MatthewR.Walter(TTIC)- September2017

• Changhyun Choi(MIT)– February2016

SomeslidesadaptedfromAyan ChakrabartiandLanaLazebnik

ComputerVisionI

Duckietown

Big Picture

4

ModelingClass

Todaywetalkabouthowacamerasensestheworld

Today’sClass

ControlClassPlanningClassPerceptionClass

Duckietown

Motivation for computer vision

6

Onlyonboardsensorisacamera

The Board of Trustees of the London Science Museum

Duckietown

Camera obscura

8

Beforeyougettooexcited:folksknewaboutthisawhilebackBasicprincipleknownto Mozi (470–390BCE)and Aristotle(384–322BCE)

Duckietown

What is computer vision?

Whatallows computers(robots)tomakesenseofthephysicalworldbaseduponmeasurements

ofreflectedlight

9

one-waysign

duckie duckie

swissduckie

stopline

• Locateitselfintheworld• Recognizeobject• Identifyobjectproperties• Determine3Dgeometry• Identifyobject’spose• Inferringactionandmotion• Classifyingscenes• …

Howweseeanimage Howacomputerseesanimage

Duckietown

Computer vision is important for self-driving cars

10https://www.youtube.com/watch?v=_dvyzAA1Cn8

Duckietown

Scale ambiguity

11

Duckietown 12

Scale ambiguity

Duckietown 13

Scale ambiguity

Duckietown 14

Illumination and surface color ambiguity

Duckietown 15

Indirect reflection

Duckietown 16

Indirect reflection

Duckietown 17

In-class (appearance) variation

Duckietown 18

Is it actually possible?

Seemslikeahopelesstask,yethumansandanimalsalldoit

Duckietown

History of CV: Summer Vision Project

19

• figure-groundanalysis:“divideavidisectorpictureintoregionssuchaslikelyobjects,likelybackgroundareasandchaos”

• regiondescription:“analysisofshapeandsurfaceproperties”

• objectclassification:“nameobjectsbymatchingthemwithavocabularyofknownobjects”

…allinonesummer!

Duckietown

History of CV: Everyday applications

20

Duckietown

History of CV: Everyday applications

21

Duckietown

History of CV: Everyday applications

22

Duckietown

History of CV: Everyday applications

23

Courtesy:Mobileye

Duckietown

History of CV

24

Duckietown

History of CV

25