Download - Numerical Geometry in Image Processing
![Page 1: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/1.jpg)
www.cs.technion.ac.il/~ron
Numerical Geometry in Image Processing
Ron Kimmel
Geometric Image Processing Lab
Computer Science Department Technion-Israel Institute of Technology
![Page 2: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/2.jpg)
Heat Equation in Image Analysis
Linear scale space (T. Iijima 59, Witkin 83, Koenderink 84)
)(tIIt )0(*)()( ItGtI
![Page 3: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/3.jpg)
Geometric Heat Equation in Image Analysis
Geometric scale space, Euclidean (Gage-Hamilton 86, Grayson 89, Osher-Sethian 88, Evans Spruck 91, Alvarez-Guichard-Lions-Morel 93)
![Page 4: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/4.jpg)
Geometric Heat Equation in Image Analysis
Gabor 65 anisotropic reaction-diffusion Geometric, Special Affine. (Alvarez-Guichard-Lions-Morel
93, Sapiro-Tannenbaum 93)
![Page 5: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/5.jpg)
Geometric Heat Equation in Image Analysis
Multi Channel, Euclidean.(Chambolle 94, Whitaker-Gerig 94, Proesmans-Pauwels-van Gool 94,Sapiro-Ringach 96, Shah 96, Blomgren-Chan 96, Sochen-Kimmel-Malladi 96, Weickert, Romeny, Lopez, and van Enk 97,…)
Geometric, Bending.(Curves: Grayson 89, Kimmel-Sapiro 95 (via Osher-Sethian),Images: Kimmel 97)
![Page 6: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/6.jpg)
Bending Invariant Scale Space
Invariant to surface bending. Embedding: The gray level sets embedding is preserved. Existence: The level sets exist for all evolution time,
disappear at points or converge into geodesics. Topology: Image topology is simplified. Shortening flow:The scale space is a shortening flow of the
image level sets. Implementation: Simple, consistent, and stable numerical
implementation.
![Page 7: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/7.jpg)
Curves on Surfaces: The Geodesic Curvature
![Page 8: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/8.jpg)
From Curve to Image Evolution
![Page 9: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/9.jpg)
Geodesic curvature flow
![Page 10: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/10.jpg)
The Beltrami Framework
Brief history of color line element theories. A simplified color image formation model. The importance of channel alignment. Images as surfaces. Surface area minimization via Beltrami flow. Applications: Enhancement and scale space. Beyond the metric, the Gabor connection
![Page 11: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/11.jpg)
Images as Surfaces Gray level analysis is sometimes misleading…
Is there a `right way’ to link color channels? process texture? enhance volumetric data?
We view images as embedded maps that flow towards minimal surfaces: Gray scale images are surfaces in (x,y, I), and color images are surfaces embedded in (x,y,R,G,B).
Joint with Sochen & Malladi, IEEE T-IP 98, IJCV 2000.
![Page 12: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/12.jpg)
Helmholtz 1896: Schrodinger 1920:
Stiles 1946: Vos and Walraven 1972: inductive line elements (above), empirical line
elements (MacAdam 1942, CIELAB 1976). Define: the simplest hybrid spatial- color space:
Spatial-Spectral Arclength
![Page 13: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/13.jpg)
Color Image Formation
F. Guichard 93Mondrian world:Lambertian surface patches
![Page 14: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/14.jpg)
Image formationLambetian
model
V
lN
)cos(,),( lNyxI
)cos(,),(
)cos(,),(
)cos(,),(
BB
GG
RR
lNyxB
lNyxG
lNyxR
![Page 15: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/15.jpg)
Color Image Formation
The gradient directions should agree since
![Page 16: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/16.jpg)
Example: Demosaicing
Color image reconstruction Solution: Edges support the colors and the colors support the edges
![Page 17: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/17.jpg)
Color Image Formation
Lambertian shading model: R(x,y) = <N,L> G(x,y) = <N,L> B(x,y) = <N,L>Thus Within an object R/G= / =constant We preserve color ratio weighted by an edge
indication function.
R
G
B
R G
![Page 18: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/18.jpg)
Demosaicing ResultsOriginal Bilinear interpolation Weighted interpolation
![Page 19: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/19.jpg)
Demosaicing ResultsBilinear interpolation Weighted interpolation
![Page 20: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/20.jpg)
Demosaicing ResultsOriginal Bilinear interpolation Weighted interpolation
![Page 21: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/21.jpg)
Demosaicing ResultsBilinear interpolation Weighted interpolation
![Page 22: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/22.jpg)
Demosaicing ResultsOriginal Bilinear interpolation Weighted interpolation
![Page 23: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/23.jpg)
Demosaicing ResultsBilinear interpolation Weighted interpolation
![Page 24: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/24.jpg)
From Arclength to Area
Gray level arclength:
Color arclength
Area
![Page 25: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/25.jpg)
Multi Channel Model
![Page 26: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/26.jpg)
The Beltrami Flow
Gray level:
![Page 27: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/27.jpg)
The Beltrami Flow
Color :
where
![Page 28: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/28.jpg)
Matlab Program
![Page 29: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/29.jpg)
Signal processing viewpoint
Beltrami Smoothing
Gaussian Smoothing
Sochen, Kimmel, Bruckstein, JMIV, 2001.
![Page 30: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/30.jpg)
The Beltrami Flow
Texture:
![Page 31: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/31.jpg)
Inverse Diffusion Across the Edge
![Page 32: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/32.jpg)
Inverse Diffusion Across the Edge
![Page 33: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/33.jpg)
Summary: Geometric Framework
From color image formation to the importance of channel alignment.
From color line element theories to the definition of area in color images.
Area minimization as a unified framework for enhancement and scale space.
Inverse heat operator across the edges. Related applications: Color movies segmentation
and demosaicing
www.cs.technion.ac.il/~ron
![Page 34: Numerical Geometry in Image Processing](https://reader036.vdocuments.net/reader036/viewer/2022062309/56814038550346895daba3ea/html5/thumbnails/34.jpg)
Open Questions
Is there a maximum principle to the Beltrami flow?
Are there simple geometric measures to minimize in color image processing subject to more complicated image formation models?
Can we really invert the geometric heat operator?
Is there a real-time numerical implementation for the Beltrami flow in color?
www.cs.technion.ac.il/~ron