Download - Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration
![Page 1: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/1.jpg)
Using the Local Phase of the Magnitude of the Local Structure Tensor for Image
Registration
Anders Eklund, Daniel Forsberg, Mats Andersson, Hans Knutsson
Linköping University
![Page 2: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/2.jpg)
Agenda
• Phase based image registration• The local structure tensor• Extending the phase idea -
combining local phase and tensor magnitude• Results on synthetic data• Results on real data
![Page 3: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/3.jpg)
Phase based image registration
• Image registration is normally done by using the image intensity, for example by maximizing the correlation or the mutual information between the images
• Easy to create test images for which intensity based algorithms fail…
![Page 4: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/4.jpg)
Phase based image registration
• A better approach is to use the local phase, instead of the image intensity
• The local phase is better suited for the assumptions made in the optical flow algorithm(no intensity difference between images, the image is locally smooth)
• The local phase can for example be estimated by using quadrature filters
![Page 5: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/5.jpg)
Quadrature filters
Frequency domain Spatial domain
Real part
Imaginary part
![Page 6: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/6.jpg)
Phase based image registration
• The complex valued filter response q is a bandpass filtered version of the analytical signal
• Lines are even functions, related to cosine• Edges are odd functions, related to sine
• The quotient of the real and the imaginary filter responses gives information about the neighbourhood (edge or line, bright line, dark line, etc)
![Page 7: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/7.jpg)
Local phase
Bright lineDark line
Dark to bright edge
Bright to dark edge
![Page 8: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/8.jpg)
Phase based registration• Phase based registration works well
for images with different intensity• There are, however, images for which
even the phase based approach fails
• Example, the shapes of the objects are consistent between the images, but a dark to bright edge in one image is a bright do dark edge in the other image
![Page 9: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/9.jpg)
Two nice test images
The image intensity as well as the local phase has changed
What is constant between these images? The shape of the objects!
Reference image Altered image
![Page 10: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/10.jpg)
Real images?• Are there images in the real world for
which the shapes are constant, but the intensity and the local phase changes?
![Page 11: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/11.jpg)
Quantitative MRISame subject, same slice, different MR
settingsSlice 1 Slice 2
Slice 3 Slice 4
![Page 12: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/12.jpg)
Extending the phase idea
• We want a similarity measure that is invariant both to image intensity and to the local phase, i.e. that only considers the shape of the objects
• The local phase is invariant to the image intensity, but is different for dark to bright edges and bright to dark edges
![Page 13: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/13.jpg)
Local phase
Reference image Altered image
![Page 14: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/14.jpg)
The local structure tensor
• The local structure tensor represents the local structure as a 2 x 2 matrix (for 2D) in each pixel
• The local structure tensor can, for example, be estimated by using quadrature filters
![Page 15: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/15.jpg)
Tensor magnitude
• The magnitude of the local structure tensor is invariant to the local phase (the orientation of a line and an edge in the same direction is the same)
• The tensor magnitude is not invariant to the image intensity
• The tensor magnitude is high where there is a well defined orientation
![Page 16: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/16.jpg)
Tensor magnitude
Reference image Altered image
![Page 17: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/17.jpg)
Local phase of tensor magnitude
• Combine the local phase and the tensor magnitude to achieve invariance both to image intensity and to local phase
• Apply quadrature filters to the original image and calculate the tensor magnitude in each pixel
• Apply the quadrature filters again, now to the tensor magnitude
![Page 18: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/18.jpg)
Local phase of tensor magnitude
Reference image Altered image
![Page 19: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/19.jpg)
Evaluation of similarity measure
• How good is our new similarity measure?• Mutual information of the image intensity (blue)• Mutual information of the local phase (green) • Mutual information of local phase of tensor
magnitude (pink)• One image was rotated between -30 and 30
degrees• Normalized values to have a maximum of 1
![Page 20: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/20.jpg)
Reference and altered test image
![Page 21: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/21.jpg)
MRI slices 1 and 3
![Page 22: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/22.jpg)
Evaluation of registration performance
• Tested the new similarity measure both with rigid and non-rigid registration
• No big increase in processing time,possible to use existing algorithms
• Calculate the tensor magnitude of the reference image and the source image
• Send the tensor magnitude images to the registration algorithm
• Apply the found displacement field to the original images
![Page 23: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/23.jpg)
Rigid registration
• For rigid registration of the MRI slices the local phase of the image intensity works as well as the local phase of the tensor magnitude
• If the fat border is removed (constant for all four slices), only the local phase of the tensor magnitude works
![Page 24: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/24.jpg)
Non-rigid registration• Non-rigid registration is harder since it is
not possible to use global information
• For the non-rigid registration the Morphon was used, which is a phase based non-rigid registration algorithm
![Page 25: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/25.jpg)
Shifted test imagesintensity difference
![Page 26: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/26.jpg)
Registration results
Local phase of image intensityLocal phase of tensor magnitude
![Page 27: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/27.jpg)
MRI slices 1 and 3absolute intensity difference
Original Shifted
![Page 28: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/28.jpg)
Registration results
Local phase of image intensityLocal phase of tensor magnitude
![Page 29: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/29.jpg)
Summary• A new similarity measure for image registration
has been presented• The idea of phase based registration was
extended by using the local phase of the tensor magnitude, instead of the local phase of the image intensty
• Promising results for synthetic and real data have been presented
![Page 30: Using the Local Phase of the Magnitude of the Local Structure Tensor for Image Registration](https://reader033.vdocuments.net/reader033/viewer/2022052403/56814d5c550346895dba9936/html5/thumbnails/30.jpg)
Thank you for your attention!