![Page 2: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/2.jpg)
2
Administration
• Pre-requisites / prior knowledge• Course Home Page:
– http://www1.idc.ac.il/toky/ImageProc-10– “What’s new” – Lecture slides and handouts – Matlab guides– Homework, grades
• Exercises: – ~5-6 assignments (in Matlab).– Final exam
![Page 3: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/3.jpg)
3
Administration (Cont.)
• Matlab software:– Available in PC labs– Student version– For next week: Run Matlab “demo” and read Matlab primer until
section 13.
• Grading policy: – Final Grade will be based on: Exercises (40%) , Final exam
(60%)– Exercises will be weighted – Exercises may be submitted in pairs
• Office Hours: by email appointment to [email protected]
![Page 4: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/4.jpg)
4
Date Topic
1 25.02.10 Intro and image formation
2 04.03.10 Image Acquisition
3 11.03.10 Point Operations and the Histogram
4 18.03.10 Geometric Operations
25.03.10 Passover Holiday
02.04.10 Passover Holiday
5 08.04.10 Spatial Operations
6 15.04.10 Edge and feature detection
7 22.04.10 FFT – part 1
8 29.04.10 FFT – part 2
9 06.05.10 FFT – part 3
10 13.05.10 Operations in frequency domain
11 20.05.10 Image restoration
27.05.10 Graduation
12 03.06.10 Multi-resolution representation and Wavelets
Planned Schedule
![Page 5: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/5.jpg)
5
TextbooksDigital Image ProcessingKenneth R. CastelmanPrentice Hall--------------------------------------Digital Image Processing Rafael C. Gonzalez and Richards E. Woods, Addison Wesley --------------------------------------Digital Image Processing Rafael Gonzalez and Paul Wintz Addison Wesley --------------------------------------Fundamentals of Digital Image Processing Anil K. Jain Prentice Hall, 1989. --------------------------------------
![Page 6: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/6.jpg)
6
About the courseGoals of this course:
– Introductory course: basic concepts, classical methods, fundamental theorems
– Getting acquainted with basic properties of images
– Getting acquainted with various representations of image data
– Acquire fundamental knowledge in processing and analysis digital images
Pre-requisites:– Algebra A+B
– Calculus A+B
![Page 7: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/7.jpg)
7
• Introduction to Image Processing
• Image Processing Applications
• Examples
• Course Plan
Introduction
![Page 8: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/8.jpg)
8
Computer Vision
Rendering
ImageImage
Processing
Model
3D Object
Geometric Modeling
The Visual Sciences
![Page 9: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/9.jpg)
9
Image Processing v.s. Computer Vision
Image Processing
Computer Vision
Low Level
High Level
Acquisition, representation,compression, transmission
image enhancement
edge/feature extraction
Pattern matching
image "understanding“(Recognition, 3D)
![Page 10: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/10.jpg)
10
Why Computer Vision is Hard?
• Inverse problems
• Apriori-knowledge is required
• Complexity extensive
– Top-Down v.s. Bottom-Up paradigm
– Parallelism
• Non-local operations
– Propagation of Information
![Page 11: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/11.jpg)
11
![Page 12: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/12.jpg)
12
![Page 13: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/13.jpg)
13
![Page 14: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/14.jpg)
14
![Page 15: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/15.jpg)
15
![Page 16: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/16.jpg)
16
Image Processing and Computer Vision are Interdisciplinary Fields
• Mathematical Models (CS, EE, Math)
• Eye Research (Biology)
• Brain Research:
– Psychophysics (Psychologists)
– Electro-physiology (Biologists)
– Functional MRI (Biologists)
![Page 17: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/17.jpg)
17
Industry and Applications
• Automobile driver assistance – Lane departure warning – Adaptive cruise control – Obstacle warning
• Digital Photography – Image Enhancement– Compression– Color manipulation– Image editing – Digital cameras
• Sports analysis – sports refereeing and commentary– 3D visualization and tracking sports actions
MobilEye system
![Page 18: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/18.jpg)
18
• Film and Video– Editing– Special effects
• Image Database– Content based image retrieval– visual search of products– Face recognition
• Industrial Automation and Inspection– vision-guided robotics – Inspection systems
• Medical and Biomedical– Surgical assistance– Sensor fusion– Vision based diagnosis
• Astronomy– Astronomical Image Enhancement– Chemical/Spectral Analysis
![Page 19: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/19.jpg)
19
• Arial Photography– Image Enhancement– Missile Guidance– Geological Mapping
• Robotics – Autonomous Vehicles
• Security and Safety– Biometry verification (face, iris)– Surveillance (fences, swimming pools)
• Military– Tracking and localizing– Detection – Missile guidance
• Traffic and Road Monitoring– Traffic monitoring– Adaptive traffic lights
Cruise Missiles
![Page 20: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/20.jpg)
Image Denoising
20
![Page 21: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/21.jpg)
21
Image Enhancement
![Page 22: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/22.jpg)
22
Image Deblurring
![Page 23: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/23.jpg)
23
Operations in Frequency Domain
Original Noisy image Fourier Spectrum Filtered image
![Page 24: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/24.jpg)
24
Image Inpainting 1
![Page 25: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/25.jpg)
25
Image Inpainting 2
Images of Venus taken by the Russian lander Ventra-10 in 1975
![Page 26: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/26.jpg)
26
Image Inpainting 3
![Page 27: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/27.jpg)
27
Video Inpainting
Y. Wexler, E. Shechtman and M. Irani 2004
![Page 28: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/28.jpg)
Texture Synthesis
28
![Page 29: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/29.jpg)
29
Prior Models of Images
3D prior of 2x2 image neighborhoods, From Mumford & Huang, 2000
![Page 30: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/30.jpg)
30
Image Demosaicing
![Page 31: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/31.jpg)
31
Syllabus
• Image Acquisition• Point Operations• Geometric Operations• Spatial Operation• Feature Extraction• Frequency Domain and the FFT• Image Operations in Freq. Domain • Multi-Resolution • Restoration
![Page 32: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/32.jpg)
32
Image Acquisition
• Image Characteristics• Image Sampling (spatial)• Image quantization (gray level)
![Page 33: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/33.jpg)
33
Image Operations
• Geometric Operations• Point Operations• Spatial Operations• Global Operations (Freq. domain)• Multi-Resolution Operations
![Page 34: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/34.jpg)
34
Geometric Operations
![Page 35: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/35.jpg)
35
Point Operations
![Page 36: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/36.jpg)
36
Geometric and Point Operations
![Page 37: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/37.jpg)
37
Spatial Operations
![Page 38: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/38.jpg)
38
Global Operations
![Page 39: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/39.jpg)
39
Global Operations
Image domain
Freq. domain
![Page 40: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/40.jpg)
40
The Fourier Transform
Jean Baptiste Joseph Fourier 1768-1830
![Page 41: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/41.jpg)
41
Multi-Resolution
High resolution
Low resolution
![Page 42: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/42.jpg)
42
Multi-Resolution Operations
![Page 43: 1 Yacov Hel-Or toky@idc.ac.il. 2 Administration Pre-requisites / prior knowledge Course Home Page: –](https://reader035.vdocuments.net/reader035/viewer/2022062320/56649d955503460f94a7d60d/html5/thumbnails/43.jpg)
43
T H E E N D