Download - Chapter 8
![Page 1: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/1.jpg)
Chapter 8
![Page 2: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/2.jpg)
Documented applications of TRS and affine moment invariants
• Character/digit/symbol recognition • Recognition of aircraft and ship silhouettes
(also from non-perpendicular views)• Recognition of components on an assembly belt• Recognition of biological shapes – algae, fishes, whales, ...• Landmark recognition in robotics• Image registration (medical, satellite, aerial, ...)• Normalization of database images, retriaval• Motion flow estimation• Digital watermarking
![Page 3: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/3.jpg)
Recognition of circular landmarks
Measurement of scoliosis progress during pregnancy
![Page 4: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/4.jpg)
The goal: to detect the landmark centers
The method: template matching by invariants
![Page 5: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/5.jpg)
Recognition of distorted landmarks
![Page 6: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/6.jpg)
Landmark clusters in the space of the AMI’s
![Page 7: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/7.jpg)
Landsat TM SPOT
Satellite image registration
![Page 8: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/8.jpg)
Registration algorithm
• Independent segmentation of both images• Extraction of salient regions• Calculating AMI’s • Finding three most stable pairs in the AMI space• Calculating the primal affine transform parameters• Transforming the SPOT regions over the Landsat• Finding matching regions by minimum distance in the image plane (10 found altogether).
Region centroids serve as final control points• Calculating the final affine transform parameters by a
least-square fit• Resampling and transformation of the SPOT image
![Page 9: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/9.jpg)
Segmentation
![Page 10: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/10.jpg)
Selected regions
![Page 11: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/11.jpg)
Matched region pairs
![Page 12: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/12.jpg)
Matched region pairs
• Three most stable pairs found in the AMI space (the labels in circles) • The other matching regions found by minimum distance in the image plane
![Page 13: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/13.jpg)
Registered and superimposed images
![Page 14: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/14.jpg)
Optical flow estimation
Traditional method A method based on Zernike moments.Note fewer artifacts.
![Page 15: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/15.jpg)
Image retrieval
Moment invariants can be used as features for content-based image retrieval, particularly in case of simple 2D objects.
![Page 16: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/16.jpg)
Digital watermarking by moments
The host image The image with an invisible watermark based on rotation invariants.
![Page 17: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/17.jpg)
Documented applications of convolution and combined invariants
• Character/digit/symbol recognition in the presence of camera shake or other blurs• Robust image registration (medical, satellite)• Camera position estimation through registration• Multichannel deconvolution and superresolution• Detection of image forgeries• Focus/blur measurement
![Page 18: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/18.jpg)
Camera position estimation through registration
Photo at the initial position(sharp)
Photo at the current position,unknown shift and rotation(blurred background because of the object in the foreground)
![Page 19: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/19.jpg)
Position estimation algorithm
• Independent corner detection in both images
• Extraction of salient corner points
• Calculating blur-rotation invariants of a circular neighborhood of each extracted corner
• Matching corners by the invariants (14 matches found)
• Estimating the relative between-image shift and rotation by a least-square fit
![Page 20: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/20.jpg)
Matched corners
![Page 21: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/21.jpg)
Multichannel blind deconvolution
For MBD, robust registration of the input blurred frames is required.
![Page 22: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/22.jpg)
The Poor Fisherman, Paul Gauguin, 1896
MBD of long-exposure images
![Page 23: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/23.jpg)
• Copy-move forgery (clone of a region from the same image)
• The cloned region is often intentionally blurred to make its detection difficult
• Dividing the image into blocks, calculating blur invariants and looking for blocks having the same invariants
• Presence of identical blocks indicates cloning forgery. “Blind” detection without having the original.
Detecting image forgeries
![Page 24: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/24.jpg)
Detecting image forgeries
original
duplicated regions
fake
![Page 25: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/25.jpg)
Recent world-famous photo of Iranian missiles
![Page 26: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/26.jpg)
Duplicated regions indicate that the picture was manipulated
![Page 27: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/27.jpg)
Moment-based focus measure
• Odd-order moments blur invariants
• Even-order moments blur/focus measure
If M(g1) > M(g2) g2 is less blurred
(more focused)
![Page 28: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/28.jpg)
Usage of a focus measure
• Global measurement – ordering a set of images, which differ from each other by a degree of blur, according to their quality. Typically in astronomy.
![Page 29: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/29.jpg)
Images of different level of blur
![Page 30: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/30.jpg)
Sunspots – blurring by atmospheric turbulence
![Page 31: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/31.jpg)
Saturn images – intentional out-of-focus blur
![Page 32: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/32.jpg)
Usage of a focus measure
• Global measurement – ordering a set of images, which differ from each other by a degree of blur, according to their quality. Typically in astronomy.
• The moments perform very well in the above cases because of their robustness to noise.
![Page 33: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/33.jpg)
Usage of a focus measure
• Local measurement – selecting the frame in which a certain small region is sharp/least defocussed. Typically in multifocal image fusion.
![Page 34: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/34.jpg)
Multifocus fusion based on a localblur measurement
![Page 35: Chapter 8](https://reader035.vdocuments.net/reader035/viewer/2022062409/56815170550346895dbfa565/html5/thumbnails/35.jpg)
Usage of a focus measure
• Local measurement – selecting the frame in which a certain small region is sharp/least defocussed. Typically in multifocal image fusion.
• The moments are worse than wavelets and Laplacian because of their global character.