vehicle detection in aerial surveillance using dynamic bayesian networks hsu-yung cheng, member,...
DESCRIPTION
Introduction These technologies have a variety of applications, such as military,police, and traffic management. Aerial surveillance is more suitable for monitoring fast-moving targets and covers a much larger spatial area.TRANSCRIPT
![Page 1: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/1.jpg)
Vehicle Detection in Aerial Surveillance Using
Dynamic Bayesian NetworksHsu-Yung Cheng, Member, IEEE, Chih-Chia
Weng, and Yi-Ying ChenIEEE TRANSACTIONS ON IMAGE
PROCESSING, VOL. 21, NO. 4, APRIL 2012
![Page 2: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/2.jpg)
Goal
![Page 3: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/3.jpg)
Introduction
• These technologies have a variety of applications, such as military,police, and traffic management.
• Aerial surveillance is more suitable for monitoring fast-moving targets and covers a much larger spatial area.
![Page 4: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/4.jpg)
Introduction
• Cheng and Butler [8] performed color segmentation via mean-shift algorithm and motion analysis via change detection.
• In [11], the authors proposed a moving-vehicle detection method based on cascade classifiers.
• Choi and Yang [12] proposed a vehicle detection algorithm using the symmetric property of car shapes.
![Page 5: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/5.jpg)
Introduction
![Page 6: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/6.jpg)
Background Color Removal
• quantize the color histogram bins as 16*16*16.
• Colors corresponding to the first eight highest bins are regarded as background colors and removed from the scene.
![Page 7: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/7.jpg)
Feature Extraction:Local Feature Analysis
![Page 8: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/8.jpg)
Feature Extraction:Local Feature Analysis
![Page 9: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/9.jpg)
Feature Extraction:Local Feature Analysis
• After evaluation, is known.
• Use the gradient magnitude G(x,y) of each pixel of moment-preserving.
• Tmax =T ,Tmin=0.1*(Gmax-Gmin) for Canny edge detector.
• Harris detector is for the corners.
![Page 10: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/10.jpg)
Feature Extraction:Color Transform and Color Classification• In [16],they proposed a color domain (u,v)
instead of (R,G,B) to separate vehicle and non-vehicle pixels clearily.
• Use n*m as a block to train SVM model to classify color.
![Page 11: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/11.jpg)
Feature Extraction:Color Transform and Color Classification
![Page 12: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/12.jpg)
Feature Extraction
• We extract five types of features, S,C,E,A and Z for the pixel.
• A=L/W• Z=blue counts at left
![Page 13: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/13.jpg)
Dynamic Bayesian Network
• Use some videos to train the probabilities with people marked ground truth.
• Vt indicates if a pixel belongs to a vehicle.
• P(Vt|St) is defined as the probability that a pixel belongs to a vehicle pixel at time slice given observation St at time Instance t.
![Page 14: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/14.jpg)
Experimental results
![Page 15: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/15.jpg)
Experimental results
![Page 16: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/16.jpg)
Experimental results
![Page 17: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/17.jpg)
Experimental results
![Page 18: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/18.jpg)
Experimental results
![Page 19: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/19.jpg)
Experimental results
![Page 20: Vehicle Detection in Aerial Surveillance Using Dynamic Bayesian Networks Hsu-Yung Cheng, Member, IEEE, Chih-Chia Weng, and Yi-Ying Chen IEEE TRANSACTIONS](https://reader036.vdocuments.net/reader036/viewer/2022062317/5a4d1b0b7f8b9ab05998af0d/html5/thumbnails/20.jpg)
Experimental results