realtime obstacle detection for visually impaired people · realtime obstacle detection for...

1
Realtime Obstacle Detection for Visually Impaired People Advisor(s): Friedrich Fraundorfer, David Schinagl Institute for Computer Graphics and Vision (ICG) Graz University of Technology, Austria Motivation The Walkassist is a smart shoe developed by an aus- trian start-up called Tec-Innovation to enhance visu- ally impaired peoples quality of life. The built-in warn- ing system uses ultrasonic distance sensors to warn users of obstacles like steps, curbs or other people. If an obstacle is detected, the user is alerted using acoustic or vibration signals. In this project we try to support the ultrasonic based system by exploiting additional visual information. A camera based system placed on top of the toe-cap in combination with deep learning methods should be used to detect obstacles and segment the walkable area, respectively. Goals and Tasks The goal of this master’s thesis is to develop a mobile system which is capable to detect the walkable area in realtime. The main parts of this project are: Porting of existing algorithms to a mobile platform like a virtual reality backpack Extend and improve parts of the pipeline (real-time capability) Measuring the distances to the obstacles Visualization of the walkable area and the detected obstacles This master thesis is offered together with Tec- Innovation and will be paid. Deliverables Project files (zip) Documentation (pdf) Presentation (pdf) Prerequisites Python/C++ programming Interest in machine learning GPU programming (optional) Advisor / Contact Friedrich Fraundorfer ([email protected]) David Schinagl ([email protected]) Master Thesis Computer Vision / Aerial Vision

Upload: lamngoc

Post on 02-Apr-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Realtime Obstacle Detection for Visually Impaired People · Realtime Obstacle Detection for Visually Impaired People ... The Walkassist is a smart shoe developed by an aus- ... Realtime

Realtime Obstacle Detection for VisuallyImpaired PeopleAdvisor(s) Friedrich Fraundorfer David SchinaglInstitute for Computer Graphics and Vision (ICG)Graz University of Technology Austria

Motivation

The Walkassist is a smart shoe developed by an aus-trian start-up called Tec-Innovation to enhance visu-ally impaired peoples quality of life The built-in warn-ing system uses ultrasonic distance sensors to warnusers of obstacles like steps curbs or other peopleIf an obstacle is detected the user is alerted usingacoustic or vibration signals In this project we tryto support the ultrasonic based system by exploitingadditional visual information A camera based systemplaced on top of the toe-cap in combination with deeplearning methods should be used to detect obstaclesand segment the walkable area respectively

Goals and Tasks

The goal of this masterrsquos thesis is to develop a mobilesystem which is capable to detect the walkable areain realtimeThe main parts of this project are

Porting of existing algorithms to a mobileplatform like a virtual reality backpackExtend and improve parts of the pipeline(real-time capability)Measuring the distances to the obstaclesVisualization of the walkable area and thedetected obstacles

This master thesis is offered together with Tec-Innovation and will be paid

Deliverables

Project files (zip)Documentation (pdf)Presentation (pdf)

Prerequisites

PythonC++ programmingInterest in machine learningGPU programming (optional)

Advisor Contact

Friedrich Fraundorfer (fraundorfericgtugrazat)David Schinagl (davidschinaglicgtugrazat)

Master Thesis Computer Vision Aerial Vision