brief: binary robust independent elementary features michael calonder, vincent lepetit, christoph...
TRANSCRIPT
![Page 1: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/1.jpg)
BRIEF: Binary Robust IndependentElementary Features
Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua
CVLab, EPFL, Lausanne, Switzerland
![Page 2: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/2.jpg)
Contributions
• Pros:• Compact, easy-computed, highly discriminative• Fast matching using Hamming distance• Good recognition performance
• Cons:• More sensitive to image distortions and
transformations, in particular to in-plane rotation and scale change
![Page 3: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/3.jpg)
Related work
• Descriptors: SIFT, SURF, DAISY, etc• Descriptor + Dimension Reduction (e.g.
PCA, LDA, etc)• Quantization• Hashing (e.g. Locality Sensitive Hashing)
![Page 4: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/4.jpg)
Method
• Binary test
• BRIEF descriptor
• For each S*S patch1. Smooth it
2. Pick pixels using pre-defined binary tests
![Page 5: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/5.jpg)
Smoothing kernels
• De-noising• Gaussian kernels
![Page 6: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/6.jpg)
Spatial arrangement of the binary tests1. (X,Y)~i.i.d. Uniform
2. (X,Y)~i.i.d. Gaussian
3. X~i.i.d. Gaussian , Y~i.i.d. Gaussian
4. Randomly sampled from discrete locations of a coarse polar grid introducing a spatial quantization.
5. and takes all possible values on a coarse polar grid containing points
![Page 7: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/7.jpg)
![Page 8: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/8.jpg)
![Page 9: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/9.jpg)
Distance Distributions
![Page 10: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/10.jpg)
Experiments
![Page 11: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/11.jpg)
BRISK: Binary Robust Invariant Scalable Keypoints
Stefan Leutenegger, Margarita Chli and Roland Y. Siegwart
Autonomous Systems Lab, ETH Zurich
![Page 12: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/12.jpg)
Contributions
• Combination of SIFT-like scale-space keypoint detection and BREIF-like descriptor• Scale and rotation invariant
![Page 13: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/13.jpg)
Method
• Scale-space keypoint detection
![Page 14: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/14.jpg)
• Sampling pattern
![Page 15: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/15.jpg)
• Local gradient
• All sampling-point pairs
• Short-distance pairings S and long-distance pairings L
![Page 16: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/16.jpg)
• Overall characteristic pattern direction
• Descriptor• Rotation- and scale-normalization
• BRIEF-like
• Matching: Hamming distance
![Page 17: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/17.jpg)
Experiments
![Page 18: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/18.jpg)
![Page 19: BRIEF: Binary Robust Independent Elementary Features Michael Calonder, Vincent Lepetit, Christoph Strecha, and Pascal Fua CVLab, EPFL, Lausanne, Switzerland](https://reader036.vdocuments.net/reader036/viewer/2022062307/551ac02155034656628b58c4/html5/thumbnails/19.jpg)