traffic sign identification team g project 15. team members lajos rodek-szeged, hungary marcin...
TRANSCRIPT
![Page 1: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/1.jpg)
Traffic SignIdentification
Team GProject 15
![Page 2: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/2.jpg)
Team members
Lajos Rodek- Szeged, Hungary
Marcin Rogucki - Lodz, Poland
Mircea Nanu - Timisoara, Romania
Selman Kulac - Ankara, Turkey
Zsolt Husz - Timisoara, Romania
![Page 3: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/3.jpg)
Lajos Rodek
Sign recognition ideas
Sign library preparation
Presentation
Lots of laughing
![Page 4: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/4.jpg)
Marcin Rogucki
Sign recognition coding
Sign recognition ideas
Sign detection ideas
Presentation
![Page 5: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/5.jpg)
Mircea Nanu
Sign detection ideas
Sign detection coding
Web page preparation
Moral support and jokes
![Page 6: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/6.jpg)
Selman Kulac
Gathering sign images
General ideas
Presentation
![Page 7: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/7.jpg)
Zsolt Husz
Sign detection coding
Sign detection ideas
Picture acquisition
Many, many testing
![Page 8: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/8.jpg)
Our goal
Final goal: to detect and identify all traffic sign in arbitrary images
![Page 9: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/9.jpg)
Assumptions
No human interaction No preprocessing of the image Flexible handling of images Image is not rotated by more than 30 degrees Images can contain any number of signs or no signs at all Only daylight images are taken At most ¼ of a sign may be covered No background constrains / limitations
![Page 10: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/10.jpg)
General program idea
Program consists of two separated problems:
Detecting signs on the image
Recognizing detected regions of possible sign locations
![Page 11: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/11.jpg)
Sign detection 1Signs features:
Well defined colors with high saturation They are rather homogenous Sharp contours Known basic shapes Allowed colors:
Red, blue (dominant colors) Yellow Green (very rare) White, black (found mostly inside of signs)
![Page 12: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/12.jpg)
Sign detection 2
Main steps: Edge detection (3 by 3 Sobel) Converting image to HSV color space Reducing number of colors Segmentation relying on the color Marking probable signs with boundary boxes Joining adjacent regions Removing background
![Page 13: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/13.jpg)
Sign detection 3
Regiondatabase
Regionjoining
Borderextraction
Input SobelConversionto grayscale
Regionextension
Colordetection
Conversionto HSV
Output
![Page 14: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/14.jpg)
Sign recognition 1
Input: Picture containing at most one sign (subrange of the original image) with eliminated background Sign templates and names
Output: Sign name in case it is a traffic sign Localization on the image
![Page 15: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/15.jpg)
Sign recognition 2
Tasks: Detecting the shape of a sign
Finding corners if necessary
Transforming the shape (Perspective/rotation Facing/upright)
Color unification
Comparison with templates
![Page 16: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/16.jpg)
Sign recognition 3
Detecting the shape: Building a chain code
Computing angles between vectors
Checking number of the corners
Defining a shape
(triangle,square,circle)
![Page 17: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/17.jpg)
Sign recognition 4
Finding corners: “Charged particles” based approach
Particles run away from each other and locate corners as furthest possible points in the figure
![Page 18: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/18.jpg)
Sign recognition 5
Transforming the sign: Inverse texture mapping according to the corners and shape
![Page 19: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/19.jpg)
Sign recognition 6
Color unification:Simplifying colors depending on similarity
Allowed colors:
Red, green, blue, yellow, white, black, background (pink)
Computing a histogram
![Page 20: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/20.jpg)
Sign recognition 7
Comparison with a template: Normalized histograms are compared resulting in a RMS measure
Raster pictures are compared pixel by pixel
Probability based decision
![Page 21: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/21.jpg)
Results 1
![Page 22: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/22.jpg)
Results 2
![Page 23: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/23.jpg)
Results 3
![Page 24: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/24.jpg)
Achievements
Everything works fine
Every team member is happy
Signs are detected and recognized correctly in most cases
All assumptions are met
Works even in unusual cases (e.g. night pictures)
![Page 25: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/25.jpg)
Future improvements
Better reliability with fast motion blurring
More independency with illumination
Robustness on sign detection (fine-tuning the heuristically adopted constrains)
Better library templates
Speed-ups
Adaptation for a sequence of images
![Page 26: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/26.jpg)
Thank you for your attention!
![Page 27: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/27.jpg)
References
Intel, “Intel Image Processing Library, Reference Manual”, 2000, http://developer.intel.com
Intel, “Open Computer Vision Library, Reference Manual”, 2001, http://developer.intel.com
D. A. Forsyth, J. Ponce, “Computer Vision: A Modern Approach”, Prentice Hall, 2003
George Stockman, Linda G. Shapiro, “Computer Vision”, Prentice Hall, 2001
![Page 28: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/28.jpg)
![Page 29: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/29.jpg)
![Page 30: Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman](https://reader035.vdocuments.net/reader035/viewer/2022062322/56649dba5503460f94aab87d/html5/thumbnails/30.jpg)