driver distraction management using sensor data cloud
TRANSCRIPT
Driver Distrac+on Management Using Sensor Data Cloud
Funded by: Informa0on Society Innova0on Fund (ISIF) Asia, 2013-‐2014
Presented by Dr. Md. Abdur Razzaque
Associate Professor, Dept. of Computer Science and Engineering & Group Leader, Green Networking Research Group, CSE, University of Dhaka
Email: [email protected] Web: hWp://gnr.cse.univdhaka.edu
Contents • Introduc)on to Driver Distrac)on • Driver Distrac)on Types, Trends, and Effects • What can be done to address it? • Death rates around the world due to road accidents • Bangladesh Scenario • Our solu)on methodology • Implementa)ons and benefits • Conclusion
2
Introduc)on
Driver Distrac+on Distracted driving is any ac)vity that could divert a person's aFen)on away from the primary task of driving. All distrac)ons endanger driver, passenger, and vehicle safety.
4
These types of distrac)ons include: Ø Tex)ng Ø Using a cell phone or Smartphone Ø Ea)ng and drinking Ø Talking to passengers Ø Sickness, Tiredness and Micro sleep states Ø Grooming Ø Reading, including maps Ø Using a naviga)on system Ø Watching a video, Adjus)ng a radio, CD player, or MP3 player
Driver Distrac+on Types
5
Driver Distrac+on Trend
6
Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014
Effects of Distracted Driving
7
Young drivers are more risky
Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014 8
Young drivers are more risky
Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014 9
Death Tolls (in USA)
Source: hFp://ar)cles.la)mes.com/2010/sep/24/news/la-‐heb-‐distracted-‐driving-‐20100924 10
Ø Approximately 0.5% increase per year
What can be done?
What can be done about it?
Source: hFp://www.tex)nganddrivingsafety.com/tex)ng-‐and-‐driving-‐stats/ , Accessed on April 12, 2014 12
What can be done about it?
13
Effects of Driver Health Condi+on
Source: Na)onal Highway Traffic Safety Administra)on. Facts and Sta)s)cs. Available from hFp://www.distrac)on.gov/content/get-‐the-‐facts/facts-‐and-‐sta)s)cs.html. Accessed April 2, 2014
14
Death Rates per 100K Vehicles Rank Country Death Rate 1 Namibia 53.4 6 Thailand 42.9 20 Malaysia 34.5 67 China 20.8 77 India 18.7 90 Bangladesh 16.4 107 United States 13.9 109 South Korea 13.7 175 Singapore 5.3 180 United Kingdom 4.8 189 Japan 3.8 192 Maldives 2.4
Source: World Health Organiza)on -‐ 2011 15
Bangladesh Scenario
Bangladesh Scenario • Poor level of study and analysis • Poor measures to mi)gate road accidents • 3000 kilometer-‐long na)onal highways • 100 kilometers path is earmarked as high risk zone for accidents. • 37% of the accidents take place in the na)onal highways and 12% of the accidents occurred in the regional highways • Virtually no measures have been taken to make the highways safe
Source: H.M. Ahsan, M.A. Raihan & M. Rahman, ”A study on car involvement in road traffic accidents in Bangladesh”, 1st Civil Engineering Congress, December 22-‐24, 2011, Dhaka, Bangladesh . 17
Annual Road Fatali+es in BD
Source: 3. ARI database, BUET 18
Death Tolls in BD Road Accidents
We are concerned of every vic)m who has lost their lives in road accidents. But fatali)es include some of the most influen)al persons and celebri)es. Some glimpse of them are… • On October, 1993, Jahanara Kanchan, the wife of a salient actor Ilias Kanchan had been killed in a road crash. • On March, 2007, Manjarul Islam Rana, a na)onal cricketer was killed in a motor bike accident. • On August, 2011, a severe road accident took lives of Mishuk Munier, a prominent producer and Tareq Masud, one the greatest director and film-‐maker along with other three people.
19
Death Tolls in BD Road Accidents…
• On October, 2012, South Asian Games gold-‐winning shooter and na)onal shoo)ng coach Firoz Hossain was killed in a fatal road accident along with his family. • On July 11, 2011, 44 school children were killed in road accident in ChiFagong. • On February 15, 2014, 7 school children were killed and 50 others were injured in a bus accident in Jessore. • Almost every year minibus accidents take several lives of the students of DU, BUET and many other universi)es. • The death toll is so severe in Bangladesh, the newspaper contains several reports on road accidents almost everyday.
20
21
Our Solu)on
Driver Distrac+on Management Using Sensor Data Cloud
Objec+ves
• Design and development of bio-‐signal monitoring system for drivers • Develop driver’s physical movement & driving performance monitoring system • Real-‐)me sensing data collec)on to server system • Develop cloud compu)ng system for processing data and making intelligent decisions • Build user friendly cloud data access interface
23
Sensed Data
• Driver’s drunken status • Blood pressure • Body temperature • Heart rate • Drowsiness/Sleepy status • Talking behavior • Car loca)on and speed • Engine status and control
24
Technologies Used
• Sensors and sensing systems • Embedded systems • Wireless communica)on systems • Cloud Compu)ng systems • Web services • Mobile Applica)ons
25
System Architecture
Alcohol sensor
Camera sensor
Temperature sensor
Embedded Controller System
26
Blood pressure Heart Rate
Contactless Temperature Sensor Module (TMP006)
27
• Working principle This sensor uses a thermopile to absorb the infrared energy emiFed from the object being measured and uses the corresponding change in thermopile voltage to determine the object temperature • Features 1) Sensor Voltage: 7 uV/C 2) Local Temperature: -‐40 C to +125 C 3) Supply Current: 3.7V ~ 5.0V 4) Temp Resolu)on (Max) (bits): 14 5) Interface: I2C,SMBus 6) Remote Sensor Accuracy (Max) (+/-‐ C): 3 7) Local Sensor Accuracy (Max) (+/-‐ C): 1
MQ-‐3 Alcohol level detector sensor
• Opera)ng voltage: DC 3-‐5V • Dual signal output (analog and TTL o/p • High sensi)vity and good selec)vity for ethanol vapor • Long service life and reliable stability • Rapid response and recovery characteris)cs • Size: 32mm x 22mm x 22mm(L * W * H) • Applica)on: For motor vehicle drivers and the other non-‐drinking workers on-‐site inspec)on, also for other places of ethanol vapor detec)on, alcohol detec)on range: 10 ~ 1000ppm.
28
High Defini+on Camera
• Captures frames of images to scru)nize the driver’s lip movements to detect if the driver is talking • We analyze driver’s eye blink rate to detect if the driver is drowsy or looking out of the road
29
Blood Pressure and Heart Rate
• Blip care is a digital blood pressure monitoring device with great precision • It is the world’s first Wi-‐Fi enabled BP monitoring device • Paired with a Smartphone/RPi hotspot it can upload live data to its website
30
Signal Condi+oning and Data Acquisi+on System • Collects and formats the data from sensors • Sends the data to Raspberry PI
31
LCD Out
Level 3 Shiser
Output to Raspberry PI
Input from TEMP and ALCOHOL sensors
Power
Microcontroller
Raspberry PI
32
Wireless Communica+on Systems
• 3G/ HSPA Modem: • We use it to transmit the data to cloud database from Raspberry PI. • We u)lize the faster HSPA technology to ensure beFer connec)vity.
33
System
• Lab experiment at R&D phase:
34
GPS Module
• Loca)on • Speed • Direc)on • Engine Control • SOS Alarm • Area binding
35
System
• The module in real driving:
36
Data Storage and Cloud Services
Data Storage and Cloud Services
• Our Requirements are: • Getng compu)ng facili)es for large amount of sensory data. • Getng secured, available and durable data storage for the collected data. • Getng automated management facili)es of the data storage and compu)ng units.
38
Data Storage and Cloud Services
• We have employed…
Deployment Manager
39
User Interfaces and Web Services
User Interfaces and Web Services • Project website : hFp://driverdistrac)on.gnrbd.net/
41
Login Here
User Interfaces and Web Services • Project website : hFp://driverdistrac)on.gnrbd.net/
42
User Interfaces and Web Services Driver status Dashboard:
43
User Interfaces and Web Services
44
• Car Posi)on and speed
User Interfaces and Web Services
45
• Body Temperature Graph
User Interfaces and Web Services
46
• Body Temperature Graph
User Interfaces and Web Services
47
• Blood pressure graph:
User Interfaces and Web Services
48
• Alcohol graph:
User Interfaces and Web Services
49
• Eye status:
User Interfaces and Web Services
50
• Speaking or not speaking:
User Interfaces and Web Services
51
• Speaking or not speaking:
Mobile Applica)on
Screenshot of User Applica+on
53
Detec+ng drunken driver using Mobile App
54
55
Detec+ng drunken driver using Mobile App
Feasibility
• Technical Feasibility • Further improvements in accuracy, reliability and robustness would make the system technically feasible
• Economic Feasibility • Reasonable CAPEX and OPEX for driver distrac)on management unit • The system would ensure efficient vehicle resource management of a company or organiza)on, and thus it achieves economic benefits for them
• Behavioral Feasibility • Awareness and mo)va)on programs are required to make users understand the effec)veness of the driver distrac)on management unit
56
Prospec+ve Usage of Our System
• Bus companies • Transport pool management for company vehicles • Personal vehicle monitoring • Parental control on young drivers • Precision insurance supports • Driver performance database • Security and threat controls by Police
57
Benefits for Drivers
• In case of emergency, a driver can press the red buFon beneath the dashboard and the owner of the vehicle will be informed through SMS. • Insurance companies won’t be able to deny i n s u r an ce s uppo r t s how ing f a l s e acquisi)ons. • The driver distrac)on management system keeps driving records of a driver, which will help him to find a beFer job in the future.
58
Benefits for Drivers (cont…)
• Our system will provide drivers current health condi)on. As a result, the owners won’t enforce drivers to drive vehicles whenever the driver is physically distracted. • The system will help drivers avoid unexpected legal problems whenever accidents occur and the drivers are not responsible. • Finally, the system will contribute greatly to provide safety of driver’s life and property.
59
Project Team Members
60
Dr. Md. Abdur Razzaque Principal Inves)gator
Muhammad Enamul Hoque Chowdhury, Consultant
Amit Kumar Das Research Assistant
Tamal Adhikary Research Assistant
Md. Nazmus Sakib Miazi Research Assistant
Nusrat Mehajabin Research Assistant
Shuvra Chakrabarty Programmer
Media Coverage
61
Media Coverage
62
Our Projects
Completed Projects: • Design and Development of Precision Agriculture Management Informa0on System in Bangladesh • Funded by: Ministry of Science and Technology (FY: 2012-‐2013), Government of Bangladesh
• Driver Distrac0on Management Using Sensor Data Cloud • Funded by: Informa)on Society Innova)on Fund Asia (2013-‐2014)
• A Rule Based Bengali Stemmer • Funded by: Code Crasers Interna)onal, Dhaka (2013)
Current Project: • Real Time Monitoring of Crop Diseases and Pests Using Image Sensor Network Technology • Funded by: Ministry of Science and Technology (MoST), Government of Bangladesh (FY: 2013-‐2014)
63
Award giving ceremony in 8th IGF at Bali, Indonesia (Oct 2013)
64
Publica+ons
In last two and half years, GNR group has a number of publica)ons • 12 interna)onal journal papers (SCI/SCIE) with good impact factors • Seven IEEE/ACM conference papers • Seven manuscripts are now under review in reputed interna)onal journals and conferences.
The detailed ac0vi0es of the group is available at hWp://gnr.cse.univdhaka.edu
65
Conclusion
• In this work, we have developed a prototype for the proposed solu)on architecture. However, there are addi)onal challenges – • Efficient )mescale determina)on of sensory data collec)on • Ensuring accuracy, product reliability and availability • Deployment of driving performance monitoring sensor devices • Integra)ng all the components into a single product unit that can be delivered to the users • Test deployments of a good number of units in real fields • Fine tuning the hardware and sosware performances • We need more grants/funds to carry out rest of the ac)vi)es
66