deepdish: multi-object trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3d-printed case:...
TRANSCRIPT
![Page 1: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/1.jpg)
DeepDish: Multi-Object Tracking
With an off-the-shelf Raspberry PiMatthew Danish Justas Brazauskas Rob Bricheno
Ian Lewis Richard Mortier
Cambridge University Department of Computer Science & Technology
Centre for Digitally Built Britain
![Page 2: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/2.jpg)
● Raspberry Pi 4B (4GB RAM)● Standard camera (plus
infrared lights)● Fan SHIM cooling● ~£80 total
● (cool 3D-printed case: extra)
![Page 3: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/3.jpg)
Tracking by detection● Object detection:
○ MobileNet (v1)○ MobileNet (v2)○ YOLOv3
● Feature encoding: DeepSORT (Wojke 2017)○ Trained on Motion Analysis and Re-identification Set (MARS)○ Cosine Distance Metric training○ Combine with Kalman Filter tracking
![Page 4: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/4.jpg)
![Page 5: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/5.jpg)
![Page 6: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/6.jpg)
![Page 7: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/7.jpg)
![Page 8: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/8.jpg)
![Page 9: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/9.jpg)
![Page 10: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/10.jpg)
![Page 11: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/11.jpg)
![Page 12: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/12.jpg)
Scoring methodology● ‘Office’ video and ‘Plaza’ video● Establish ground-truth by hand:
○ Count crossings in each direction, grouped into 10 second intervals○ Subtract one direction from the other○ Forms ‘ground-truth vector’
● Testbed software performed same operation automatically● Score is 1 - cosine distance between test vector and ground-truth
![Page 13: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/13.jpg)
Accuracy results
![Page 14: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/14.jpg)
![Page 15: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/15.jpg)
![Page 16: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/16.jpg)
![Page 17: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/17.jpg)
![Page 18: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/18.jpg)
![Page 19: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/19.jpg)
![Page 20: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/20.jpg)
Other issues● Privacy● Using ‘Edge TPU’ devices● Deployment
![Page 21: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/21.jpg)
AcknowledgmentsThis research forms part of Centre for Digital Built Britain’s work within the Construction Innovation Hub. The funding was provided through the Government’s modern industrial strategy by Innovate UK, part of UK Research and Innovation.
![Page 22: DeepDish: Multi-Object Trackingmrd45/edgesys20/edgesys20_slides.pdf · (cool 3D-printed case: extra) Tracking by detection Object detection: MobileNet (v1) MobileNet (v2) YOLOv3 Feature](https://reader036.vdocuments.net/reader036/viewer/2022062606/601061f5aaf7755cf7724089/html5/thumbnails/22.jpg)
Thank you!