stereo vision local map alignment for robot environment mapping
DESCRIPTION
Stereo Vision Local Map Alignment for Robot Environment Mapping. Computer Vision Center Dept. Ciències de la Computació UAB. Ricardo Toledo Morales (CVC) David Aldavert Miró (CVC). Introduction. Data association problem: - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/1.jpg)
Stereo Vision Local Map Alignment for Robot Environment Mapping
Computer Vision Center
Dept. Ciències de la Computació
UAB
Ricardo Toledo Morales (CVC)
David Aldavert Miró (CVC)
![Page 2: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/2.jpg)
Introduction
• Data association problem:– Put into correspondence robot sensor measurements
obtained from different locations.
• Different approaches:– Cox– IDC– ICP– Correlation of histograms– Normal Distributions Transform
![Page 3: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/3.jpg)
Introduction
• Using visual features:– Extract image features:
• Harris Laplace/Affine, Hessian Laplace/Affine, MSER, SURF, IBR, EBR, ...
– Characterize local features:• SIFT, GLOH, RIFT, PCA-SIFT, Shape Context, Steerable Filters, ...
– Put features into correspondence:• Distance between descriptors, Hough, RANSAC, ...
– Estimate robot motion from features correspondences.
![Page 4: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/4.jpg)
Introduction
• Using visual features:
![Page 5: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/5.jpg)
Introduction
• Using visual features in indoor environments:– Matching difficulties:
• Depth discontinuities.• Lack of texture.• Repetitive texture.
![Page 6: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/6.jpg)
Local stereo maps
• Local obstacle maps from dense stereo:
Dense disparity map
Right image
Left image
Reconstruction
Projection to the X-Z plane
![Page 7: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/7.jpg)
Map alignment
• Build a PDF of the obstacles:– At each obstacles it is assigned a Gaussian distribution G(μ, σ)
where:• μ is the location of the obstacle.• σ obtained from the covariance matrix of the stereo point
reconstruction.
![Page 8: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/8.jpg)
Map alignment
• Using a Gauss-Newton approach to search the robot motion parameters p = [α, tx, ty] that minimizes the following energy function:
• As wrapping both PDF will be very computational expensive, only image points corresponding to obstacles of PD2 are taking into account in the matching process.
![Page 9: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/9.jpg)
Map alignment
• Example:
![Page 10: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/10.jpg)
Enhancing map alignment
• Color obstacles:– Add image properties to the obstacle maps to improve
matching ratio and avoid ambiguities.– We used a simple color image segmentation method:
• Change from RGB to HSV space.• Select points that have a significant color information:
– Saturation * value = difference between the max and min RGB channel.
• Assign pixel to a different channel depending on its hue.
Red Green Blue Red
![Page 11: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/11.jpg)
Enhancing map alignment
• Color obstacles:– For example:
![Page 12: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/12.jpg)
Enhancing map alignment
• Example: avoiding ambiguities using color
![Page 13: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/13.jpg)
Results
• Alignment results:
![Page 14: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/14.jpg)
Results
• Ratio of correctly aligned maps:
Increasing noise Increasing noise
![Page 15: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/15.jpg)
Conclusions
• The method can align two different local maps without performing explicit matching between obstacles.
• The addition of color helps to increase the convergence ratio and solves some ambiguities.
• The method is quite sensitive to the presence of outliers, specially when they are not uniformly distributed.
• A more robust color segmentation could increase the overall method performance.
• Even when two local maps are aligned using the environment structure, this is not enough to determine if both maps are really related. Additional knowledge that also takes into account environment appearance should help to avoid this ambiguities.
![Page 16: Stereo Vision Local Map Alignment for Robot Environment Mapping](https://reader036.vdocuments.net/reader036/viewer/2022062309/568149e8550346895db712b1/html5/thumbnails/16.jpg)
Conclusions
Thank you for your attention!