Download - Image Restoration
![Page 1: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/1.jpg)
Image Restoration
Digital Image Processing
![Page 2: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/2.jpg)
Content
Introduction Image degradation/restoration model Noise models Restoration by spatial filtering Estimation of degradation functions Inverse filtering Wiener filtering Geometric transformation
![Page 3: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/3.jpg)
Introduction
Objective of image restoration to recover a distorted image to the original
form based on idealized models. The distortion is due to
Image degradation in sensing environment e.g. random atmospheric turbulence
Noisy degradation from sensor noise. Blurring degradation due to sensors
• e.g. camera motion or out-of-focus
Geometric distortion• e.g. earth photos taken by a camera in a satellite
![Page 4: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/4.jpg)
Introduction
Enhancement Concerning the
extraction of image features
Difficult to quantify performance
Subjective; making an image “look better”
Restoration Concerning the
restoration of degradation
Performance can be quantified
Objective; recovering the original image
![Page 5: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/5.jpg)
Image degradation / restoration model
![Page 6: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/6.jpg)
Noise models
Assuming degradation only due to additive noise (H = 1)
Noise from sensors Electronic circuits Light level Sensor temperature
Noise from environment Lightening Atmospheric disturbance Other strong electric/magnetic signals
![Page 7: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/7.jpg)
Noise models
Assuming that noise is independent of spatial coordinates, and uncorrelated with respect to the image content
![Page 8: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/8.jpg)
Noise models
![Page 9: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/9.jpg)
Noise models
![Page 10: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/10.jpg)
Noise models
Other common noise modelsRayleigh noiseGamma noiseExponential noiseUniform noise
![Page 11: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/11.jpg)
Noise Models
Rayleigh Noise
Gamma(Erlang) Noise
Exponential Noise
2( ) /2( ) ( ) for
0 for
z a bp z z a e z a
bz a
( ) for 0
=0 for 0
azp z ae z
z
![Page 12: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/12.jpg)
Noise models
-3-levels-simple constant areas(spans from black to white)
paper
salt
![Page 13: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/13.jpg)
Additive Noise
Histograms
![Page 14: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/14.jpg)
Additive Noise
Histograms
![Page 15: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/15.jpg)
Periodic Noise
Noise components
Are generated due to electrical or electromechanical interference during image acquisition
Periodic noise can be reduced in via frequency domain
![Page 16: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/16.jpg)
Restoration by spatial filtering
Noise is unknown
Spatial filtering is appropriate when only additive noise is present
![Page 17: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/17.jpg)
Restoration by spatial filtering is the set of coordinates in
a rectangular subimage window
of size centered at point
( , )
xyS
m n
x y
![Page 18: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/18.jpg)
Restoration by spatial filtering
![Page 19: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/19.jpg)
Restoration by spatial filtering
![Page 20: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/20.jpg)
Restoration by spatial filtering
Q is the order of filter
![Page 21: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/21.jpg)
Restoration by spatial filtering
Noise level is Mean =0Variance = 400
![Page 22: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/22.jpg)
Restoration by spatial filtering Mean filters (noise reduced by blurring)
Arithmetic mean filter and geometric mean filter are well suited for random noise such as Gaussian noise
Contraharmonic mean filter is well suited for impulse noise• Disadvantage: must know pepper noise or salt noise in
advance
![Page 23: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/23.jpg)
Restoration by spatial filtering
![Page 24: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/24.jpg)
Restoration by spatial filtering
wrong
![Page 25: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/25.jpg)
Restoration by spatial filtering
-- Repeated passes of median filter tend to blur the image.-- Keep the number of passes as low as possible.
![Page 26: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/26.jpg)
Restoration by spatial filtering
Fig. 8 next page
![Page 27: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/27.jpg)
Restoration by spatial filtering
Pepper noise Salt noise
![Page 28: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/28.jpg)
-High level of noise large filter
-Median and alpha-trimmed filter performed better- Alpha-trimmed did better than median filter
![Page 29: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/29.jpg)
Restoration by spatial filtering Filters discussed so far
Do not consider image characteristics Adaptive filters to be discussed
Behaviors based on statistical characteristics of the subimage under a filter window
Better performance More complicated Adaptive, local noise reduction filter Adaptive median filter
![Page 30: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/30.jpg)
Restoration by spatial filtering
![Page 31: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/31.jpg)
Restoration by spatial filtering
![Page 32: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/32.jpg)
Restoration by spatial filtering
![Page 33: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/33.jpg)
Restoration by spatial filtering
Adaptive filtering
![Page 34: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/34.jpg)
Restoration by spatial filtering
![Page 35: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/35.jpg)
Restoration by spatial filtering
Is Z_med impulse?
Is Z_xy impulse?
![Page 36: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/36.jpg)
Restoration by spatial filtering
![Page 37: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/37.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
Band-Reject Filters Ideal Band-reject Filter
0
0 0
0
( , ) 1 if ( , )2
0 if ( , )2 2
1 if ( , )2
WH u v D u v D
W WD D u v D
WD u v D
-D(u,v) =distance from the origin of the centered freq. rectangle-W =width of the band-D0=Radial center of the band.
![Page 38: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/38.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
Butterworth Band-Reject Filter of order n
Gaussian Band-Reject Filter
2
2 20
1( , )
( , )1
( , )
nH u vD u v W
D u v D
22 20( , )1
2 ( , )( , ) 1
D u v D
D u v WH u v e
![Page 39: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/39.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
![Page 40: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/40.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
Band-Pass Filters Opposite operation of a band-reject fiter
1 ( , )bp brH H u v
![Page 41: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/41.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
Notch Filters Rejects (or passes) frequencies in predefined neighborhoods
about a center frequency
Ideal
Butterworth
Gaussian
Must appear in symmetric pairs about the origin.
![Page 42: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/42.jpg)
Periodic Noise Reduction(Frequency Domain Filtering)
Notch FiltersIdeal
1 0 2 0( , ) 0 if ( , ) or ( , )
1 otherwise
H u v D u v D D u v D
1/ 22 21 0 0
1/ 22 22 0 0
( , ) ( / 2 ) ( / 2 )
and
( , ) ( / 2 ) ( / 2 )
D u v u M u v N v
D u v u M u v N v
Center frequency components
Shift with respect to the center
![Page 43: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/43.jpg)
Horizontal lines of the noise pattern I can be seen
Notch pass filter
![Page 44: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/44.jpg)
Optimum Notch Filtering
Several pairs of components are present more than just one sinusoidal component
![Page 45: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/45.jpg)
Optimum Notch Filtering
![Page 46: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/46.jpg)
Estimation of degradation functions
![Page 47: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/47.jpg)
Estimation of degradation functions
![Page 48: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/48.jpg)
Estimation of degradation functions
![Page 49: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/49.jpg)
Estimation of degradation functions
![Page 50: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/50.jpg)
Estimation of degradation functions
![Page 51: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/51.jpg)
Estimation of degradation functions (model bases)
Mathematical model for uniform linear motion between the image and the sensor during image acquisition Let x0(t) and y0(t) denote time varying components of
motion in the x- and y-directions Degradation model
0 00( , ) ( ), ( ) where ( , ) is the blurred image
Tg x y f x x t y y t dt g x y
0 0
0 0
2 ( ) ( )
0
2 ( ) ( )
0
( , ) ( , ) exp where
( , ) is degradation function
T j ux t vy t
T j ux t vy t
G u v F u v dt
H u v e dt
![Page 52: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/52.jpg)
Estimation of degradation functions (model bases)
Uniform Linear motion in the x and y direction x0(t)=at/T and y0(t)=bt/T where the image has been displaced by a total distance a in the x-direction and b in the y-direction
( )( , ) sin ( )( )
j ua vbTH u v ua vb e
ua vb
![Page 53: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/53.jpg)
Estimation of degradation functions (model bases)
![Page 54: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/54.jpg)
Inverse filtering
![Page 55: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/55.jpg)
Inverse filtering
![Page 56: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/56.jpg)
Inverse filtering5 / 62 2( / 2) ( / 2)
( , )k u M v N
H u v e Degradation function
Cutting off values of the ratio outside a radius of 40, 70,85.
Cur
tain
of
nois
e
![Page 57: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/57.jpg)
Wiener filtering
![Page 58: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/58.jpg)
Wiener filtering
( , ) is the degradation functionH u v
![Page 59: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/59.jpg)
Wiener filtering
White noinse
![Page 60: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/60.jpg)
Wiener filtering
![Page 61: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/61.jpg)
Geometric transformations Objective: to eliminate geometric
distortion that occurs when an image is captured
Examples of geometric distortion Pincushion distortion (associated with
zoom lenses)
![Page 62: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/62.jpg)
Geometric transformations
![Page 63: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/63.jpg)
Geometric transformations
Two steps in geometric transformationSpatial transformation: rearrangement
of pixels on the image planeGray-level interpolation: assignment of
gray levels to pixels in the spatially transformed image
![Page 64: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/64.jpg)
Geometric transformations
![Page 65: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/65.jpg)
Geometric transformations • Solution
To formulate the spatial relocation of pixels by the use of the corresponding tiepoints
Tiepoints: a subset of pixels whose locations in the input (distorted) and output (restored) images are known.
![Page 66: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/66.jpg)
Geometric transformations
![Page 67: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/67.jpg)
Geometric transformations
![Page 68: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/68.jpg)
Geometric transformations
![Page 69: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/69.jpg)
Geometric transformations
![Page 70: Image Restoration](https://reader035.vdocuments.net/reader035/viewer/2022062719/5681305d550346895d96287d/html5/thumbnails/70.jpg)
Geometric transformations