Section 4- Project Discussion

CS231ASection:CourseProjectOutline

AmirSadeghianApril2017

1Amir Sadeghian

Section 4- Project Discussion

Overview

• ProjectLogistics• TypesofProjects• ClassCoverageandIdeas• WheretoGetProjects• HelpfulResources

Amir Sadeghian 2

Section 4- Project Discussion

ProjectLogistics

• Teamsof1-3:Numberofpeopleistakenintoaccountwhengradingproject

• MoremembersàMorework

• Suggestionsforprojectdirection• Replicateaninterestingpaper• Comparedifferentmethods toabenchmark• Useanewapproachtoanexistingproblem• Implementaninterestingsystem• Originalresearch

Amir Sadeghian 3

Section 4- Project Discussion

SharingaProjectwithAnotherClass

• Sharingprojectsisgenerallyallowed• Specifyinreports• Mustbeapprovedbybothourstaffandtheothercoursestaff• Projectmustbeprofoundenoughthatyoucanclarifywhichpartsoftheprojectweredoneforwhichclass

• Eachpartmustbesubstantialenough toholdasasingleproject• Technicalpartsandexperimentsshouldsufficientanddifferent• IfusingCNNforflowerclassificationincludesomeothercomponents relatedtothiscourse(e.g.geometry,…)

• Willneedaseparatewrite-upforeachclass

Amir Sadeghian 4

Section 4- Project Discussion

ProjectGrading- ImportantDates

• Courseproject:38%• Projectproposal1%(dueApril21)• Midtermprogressreport5%(dueMay12)• presentation7%(willbeheldonJune7)• finalreport25%(due June9,11:59pm)

Amir Sadeghian 5

Section 4- Project Discussion

ProjectProposal

• Maximumof2pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:

• Titleandauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.TechnicalApproach:Howdoyoupropose tosolveit?• Sec.Milestones(datesandsub-goals)• References

• Youwillbeassignedaprojectmentor

Amir Sadeghian 6

Section 4- Project Discussion

ProjectMilestoneReport

• Maximumof4pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:

• Titleandauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.TechnicalApproach:Howdoyoupropose tosolveit?• Sec.Milestonesachievedsofar• Sec.RemainingMilestones(datesandsub-goals)• References

Amir Sadeghian 7

Section 4- Project Discussion

ProjectPresentations

• ShortpresentationwithtimeforabriefQ&A• Includethefollowing:

• ProblemMotivation/Description• TechnicalApproach• Results

Amir Sadeghian 8

Section 4- Project Discussion

ProjectFinalReport

• Maximumof10pages• SubmitthereportasaPDFdocumentthroughGradescope• EmailyourcodetoTBA.• Includethefollowing:

• Titleandauthors• Abstract• Sec.Introduction• Sec.Previouswork• Sec.TechnicalApproach• Sec.Experiments• Sec.Conclusions• References

Amir Sadeghian 9

Section 4- Project Discussion

ClassCoverage:Geometry,Recognition

• Cameramodelsandcalibration• Singlecameraandhowwemodel it

• Singleviewmetrology• Estimatinggeometryfromasingleview

• Epipolar Geometry(StereoVision)• Estimatinggeometryfromtwoviewpoints

• StructurefromMotion• Usingmotion/severalviewpoints toestimatestructure

• VolumetricStereo• Usingmultipleviewstomap3Dpoints

Amir Sadeghian 10

Section 4- Project Discussion

ViewMorphing

Amir Sadeghian 11

S. M. Seitz and C. R. Dyer, Proc. SIGGRAPH 96, 1996, 21-30

Image morphing techniques can generate compelling 2D transitions between images.

Section 4- Project Discussion

ViewMorphing

Amir Sadeghian 12

Section 4- Project Discussion

AutomaticPhotoPop-Up

Amir Sadeghian 13

A fully automatic method for creating a 3D model from a single photograph

Hoiem, D., Efros, A. A., and Herbert, M, “Automatic Photo Pop-Up”, SIGGRAPH 2005.

Section 4- Project Discussion

PhotoTourism

Amir Sadeghian 14

Snavely, N., Seitz, S. M., Szeliski, R. “Photo Tourism: Exploring Photo Collections in 3D”, SIGGRAPH 2006.

Browsing and exploring large unstructured collections of photographs of a scene using a novel 3D interface

Section 4- Project Discussion

NovelHardware

Amir Sadeghian 15

Section 4- Project Discussion

MobileDevices

Amir Sadeghian 16

Can you take an existing vision algorithm and adapt it to a mobile device to make it more useful?

Section 4- Project Discussion

CourseCoverage:Geometry,Recognition

• Fittingandmatching• Detectorsanddescriptors• Objectclassification• 2D/3Dobjectdetection• 2D/3Dsceneunderstanding

Amir Sadeghian 17

Section 4- Project Discussion

RecognizingPanoramas

Amir Sadeghian 18

Brown, M. and Lowe, D. G., “Recognizing Panoramas”, ICCV 2003.

Section 4- Project Discussion

ImageSegmentation

Amir Sadeghian 19

Partition an image into multiple segments (sets of pixels) in order to make it easier to analyze

Section 4- Project Discussion

ImageCompletion

Amir Sadeghian 20

Hays, J and Efros, A. A., “Scene Completion Using Millions of Photographs”, SIGGRAPH 2007.

Section 4- Project Discussion

2D/3DObjectRecognition

Amir Sadeghian 21

Or a 3D point cloud?

Can you recognize an object in a 2D image?

Section 4- Project Discussion

Tracking

Amir Sadeghian 22

Section 4- Project Discussion

FaceDetection– FaceIdentification

Amir Sadeghian 23

Section 4- Project Discussion

OtherTopics

• PoseEstimation:Estimatetheskeletonanglesforapersonfromanimage/video

• ActionandGestureRecognition:Isapersonstanding,walking,orsittinginanimage/video?Ishe/shewaving?

• SceneUnderstanding:Canyouclassifyascene?Canyourecognizeand/orsegmenteachcomponentofthescene?

• TrajectoryForecasting• ...

Amir Sadeghian 24

Section 4- Project Discussion

Negativeprojectexamples

• Projectswithoutcomponentsrelatedtothecourse• ApplyingAlexnet forimageclassification• FindingandrunninganexistingGithub code• OnlyrunningOpenCV librariesforatask• …

Amir Sadeghian 25

Section 4- Project Discussion

WheretogetProjectIdeas

• CourseStaff:Postedonwebsiteand/orPiazza• Computervisionpapersandconferences

• CVPR• ICCV• ECCV

• ComputervisionresearchgroupsatStanford• SilvioSavarese• Fei-Fei Li

• Lastyear’sprojects:Seecoursewebsite• Comeupwithyourown!

Amir Sadeghian 26

Section 4- Project Discussion

Datasets

• Manyareavailableontheweb• Seethefollowingaggregators:

• CVDatasetsontheWeb• YetAnotherComputerVision IndexToDatasets(YACVID)

• References foundinpapers• CourseCA’s

Amir Sadeghian 27

Section 4- Project Discussion

ProjectAdvice

• Chooseyourteamwell• Makesurethescopeofyourprojectfitsaquarter

• Setaminimum goal,desiredgoal,andamoonshot

• Constrainyourproblemsmartly• Seewhatdatasetsareavailableifyouaredoingarecognitionproject• Youmayneedtoplanahead/learnoutsidematerials• Usesoftwarewhenavailable

• OpenCV,MATLAB,Deeplearning frameworks

• Comeaskquestions– We’rehappytotalk!

Amir Sadeghian 28

Section 4- Project Discussion

AnyQuestions?

29Amir Sadeghian