introduction - computer science & eyiannisr/590/2018/lectures/00-introductiona.pdf• deep...
TRANSCRIPT
![Page 1: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/1.jpg)
Ioannis Rekleitis
Introduction
![Page 2: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/2.jpg)
WhyImageProcessing?
• Whoherehasacamera?• Howmanycamerasdoyouhave• Pointwherecomputersfast/cheap• Camerasbecomeomnipresent• DeepLearning…
2 CSCE 590: Introduction to Image Processing
![Page 3: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/3.jpg)
MajorTopicsCoveredinClass
• imageacquisition• digitalimagerepresentation• Imageenhancement• Imagerestoration• Colorimageprocessing• Imagecompression• Imagesegmentation• Morphologicalimageprocessing
CSCE 590: Introduction to Image Processing 3
![Page 4: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/4.jpg)
HumanPercep<onVSMachineVision• LimitedvsentireEMspectrum
http://www.kollewin.com/blog/electromagnetic-spectrum/CSCE 590: Introduction to Image Processing 4
![Page 5: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/5.jpg)
ImageAcquisi<onandRepresenta<on
CSCE 590: Introduction to Image Processing 5
![Page 6: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/6.jpg)
Examples
CSCE 590: Introduction to Image Processing 6
1. Brain MRI 2. Cardiac CT 3. Fetus Ultrasound
4. Satellite image 5. IR image
1 and 3. http://en.wikipedia.org 2. http://radiology.rsna.org 4. http://emap-int.com 5. http://www.imaging1.com
![Page 7: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/7.jpg)
ImageRepresenta<on• Discreterepresentationofimages– we’llcarveupimageintoarectangulargridofpixelsP[x,y]– •eachpixelpwillstoreanintensityvaluein[01]– •0àblack;1àwhite;in-betweenàgray– •Imagesizembynà(mn)pixels
CSCE 590: Introduction to Image Processing 7
![Page 8: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/8.jpg)
Applica<onsofDigitalImageProcessing• Digitalcameras,portabledevices• Photoshop• Humancomputerinteraction• Medicalimagingfordiagnosisandtreatment• Surveillance• AerialDrones• AutonomousCars• ConvolutionalNeuralNetworks• Virtual/AugmentedReality• …• Fast-growingmarket!
CSCE 590: Introduction to Image Processing 8
![Page 9: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/9.jpg)
Computervisionalgorithms
• Imageprocessing• Geometriccomputervision• Semanticcomputervision
• ItisfundamentalQirsttounderstandimageformation
CSCE 574: Robotics 9
![Page 10: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/10.jpg)
Difficultscenarios• Incertainsettings,suchastheunderwater,roboticvisionisparticularlychallenging– Differentlightingconditions– Colorloss– Hazingandblur– Textureloss
10 CSCE 574: Robotics
![Page 11: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/11.jpg)
doesn’tneedafullinterpretationofavailableimages
doesneedinformationaboutwhattodo...
• avoidingobstacles(orpredators)
• pursuingobjects
• localizingitself
• Mapping
• Qindingtargets
• reasoningabouttheworld…
“ThisisProf.XinhisofQiceofferingmeacupoficedtea.”
“RunAway!!”
reactive
deliberative
environmentalinteractions
Whatdoesarobotneed?
CSCE 574: Robotics 11
![Page 12: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/12.jpg)
Keyproblems• Recognition:– Whatisthatthinginthepicture?– Whatareallthethingsintheimage?
• Sceneinterpretation– Describetheimage?
• Scene“reconstruction”:– Whatisthe3-dimensionallayoutofthescene?– Whatarethephysicalparametersthatgaverisetotheimage?
– Whatisadescriptionofthescene?
Notionofan“inverseproblem.”12 CSCE 574: Robotics
![Page 13: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/13.jpg)
(1)ImagestreamssimpliQiedviagenerality
simpliQiedviaspeciQicity
(2)Stereovision (orbeyond...)
(3)Incorporatingvisionwithinrobotcontrol
Visual“servoing”3dreconstruction
Abriefoverviewofroboticvisionprocessing...
Robotvisionsampler
CSCE 574: Robotics 13
![Page 14: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/14.jpg)
Thresholdedimage
CSCE 574: Robotics 14
![Page 15: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/15.jpg)
Edgedetec<on
CSCE 574: Robotics 15
![Page 16: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/16.jpg)
Tenta<veSchedule
16 CSCE 590: Introduction to Image Processing
Monday Tuesday Wednesday Thursday Friday
Week01 Introduction ImageGenerationPerspectiveTransformation
ColorSpaces ImageFormats,Compression
Week02 Statistics,Histogram,Thresholding
SingleImageOperations
Holiday Logical,ArithmeticOperations
A1
Week03 Correlation
Segmentation DeNoising Review
Week04 Midterm Convolution NeuronsandConvolutions
CNNs A2
Week05 AdvancedTopics:Stereo
AdvancedTopics:Flow
AdvancedTopics:Motion
AdvancedTopics:ShapefromX
A3
Week06 Features(Detection)
Features(Matching)
Opendiscussion
Review A4
![Page 17: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/17.jpg)
Textbook
DigitalImageProcessingByR.C.GonzalezandR.E.Woods3rdedition
CSCE 590: Introduction to Image Processing 17
![Page 18: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/18.jpg)
Evalua<on
Schedule,deliverables,andevaluation:• Component Undergraduate Graduate• Assignments(4) 12.5% 12.5%• GraduateAssignments(4) --- 2.5%• MidtermExam 15% 10%• FinalExam(standardtime) 30% 25% • ClassParticipation 5% 5%• Total 100% 100%
18 CSCE 590: Introduction to Image Processing
![Page 19: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/19.jpg)
Homeworks
• UsingOpenCV– C++– Python
• UsingMATLAB
CSCE 590: Introduction to Image Processing 19
![Page 20: Introduction - Computer Science & Eyiannisr/590/2018/Lectures/00-IntroductionA.pdf• Deep Learning… CSCE 590: Introduction to Image Processing 2 . Major Topics Covered in Class](https://reader031.vdocuments.net/reader031/viewer/2022041021/5ed08a51fea2a24e8c0398a1/html5/thumbnails/20.jpg)
Contact
• http://www.cse.sc.edu/~yiannisr/• http://www.cse.sc.edu/~yiannisr/590/2018
• Email:[email protected]
• OfYicehours:byappointment
CSCE 590: Introduction to Image Processing 20