adas presentation brahmaiah
TRANSCRIPT
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
Advanced Driver Assistance System
Chemnitz, 04/01/2016
Brahmaiah Takkellapati Technische Universität Chemnitz
RESEARCH SEMINAR
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 2
CONTENTS
Introduction of ADAS. Degree of Automation. Technology Overview. Lane departure warning system. Intelligent Headlamp Control. Parking assistant system. Drowsiness detection system. Adaptive cruise control - Introduction and Principle. - Operations and Block Diagram. - Sensors and Actuators. - Algorithms. Blind spot detection - Introduction. - Sensors and Actuators. - Algorithms. ADAS current Development. Conclusion. References.
Chemnitz, 04/01/2016
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 3Chemnitz, 04/01/2016
Introduction of ADAS
Advanced Driver Assistance System, which aid driver in the driving process and enable safe driving.
ADAS is one of the fatest growing segment in Automotive field.
Introduction• Degree of Automation • … • References
Source: http://www.autobild.de/bilder/technik-mercedes-e-klasse-807290.html#bild1
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
4Chemnitz, 04/01/2016 ADAS
Introduction of ADAS
Why ADAS? European Road Safety Revolution (1990-2010).
Introduction• Degree of Automation • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 5Chemnitz, 04/01/2016
Introduction of ADAS
Why‘s ADAS Interesting? Government/legislative pull. Increase Consumer pull. Automaker needs New features.
Introduction• Degree of Automation • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 6Chemnitz, 04/01/2016
Introduction of ADAS
ADAS Demand-System level:Introduction• Degree of Automation • … • References
Source: http://on-demand.gputechconf.com/gtc/2013/presentations/S3413-Advanced-Driver-Assistance-Systems-ADAS.pdf
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 7Chemnitz, 04/01/2016
Degree of Automation
5 Levels Of Automation:Introduction • Degree of Automation• Technology overwiew • … • References
Source: http://www.infineon.com/dgdl/2015-09-28+ATV+Analyst+Presentation.pdf?fileId=5546d4614fb7fdd10150046b31b2022b
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 8Chemnitz, 04/01/2016
Technology Overview
Parking Assistance
System
Drowsiness detection system
Intelligent Headlamp
Control
Lane Departure Warning System
Adaptive Cruise Control
Blind Spot Detection System
Advanced Driver Assistance System(ADAS)
..... • Degree of Automation • Technology overwiew • LDWS • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 9Chemnitz, 04/01/2016
Lane Departure Warning System(LDWS)
System that Provides the driver with optical or haptical warnings, and protect him from unintended changing lanes.
..... • Degree of Automation • LDWS • IHC … • References
Source: http://www.continental-automotive.com/www/automotive_de_en/themes/commercial_vehicles/chassis_safety/adas/ldw_lks_en.html
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 10Chemnitz, 04/01/2016
Lane Departure Warning System(LDWS)
Sensors: Camera mounted high up in the windshield.
Actuators: Vibrations in the steering wheel or seat. Auditory signals. Visual.
.... • Degree of Automation • LDWS • IHC … • References
Source: http://www.nissan-global.com/EN/TECHNOLOGY/OVERVIEW/ldw.html
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 11Chemnitz, 04/01/2016
Intelligent Headlamp Control(IHC)
Intelligent Headlamp Control enables better vision at night. IHC ensures optimum illumination of the road in all driving suituation.
.... • LDWS • IHC • PAS • … • References
Source: http://www.continental-automotive.com/www/automotive_de_en/themes/commercial_vehicles/chassis_safety/adas/ihc_en.html
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 12Chemnitz, 04/01/2016
Intelligent Headlamp Control(IHC)
Sensors: Imaging sensor.
Source: http://www.conti-online.com/www/industrial_sensors_de_de/themes/mfc_2_de.html
Actuators: High beam state and a low beam state for a vehicle headlamp.
.... • LDWS • IHC • PAS • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
13Chemnitz, 04/01/2016 ADAS
Parking assistant System(PAS)
System that can detect obstacles at the rear of the vehicle, and provide information to the driver regarding the distance.
When an obstacle is detected by the PAS, it will alert the driver by warning buzzer sounds.
... • IHC • PAS • DDS • … • References
Source: http://www.at.ford.com/news/publications/Publications/APA.pdf
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 14Chemnitz, 04/01/2016
Parking assistant System(PAS)
Sensors: Ultrasoninc sensor:- Detects the distance between the vehicle and the
obstacle. Mounted on each sides of the bumper.
Source: http://www.bosch-mobility-solutions.cz/media/db_application/downloads/pdf/comfort_1/en_5/einparkenleichtgemachtparkassistenzsystemevonbosch.pdf
Actuator: Audible alarm (buzzer sounds in stages). Visual alert.
... • IHC • PAS • DDS • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 15Chemnitz, 04/01/2016
Drowsiness Detection System(DDS)
System that assist and warns Drivers to prevent them falling asleep Momentarily.
Driver drowsiness can be determined by following measures: (1) Vehicle based measures. (2) Behavioral measures. (3) Physiological measures.
..... • PAS • DDS • ACC • … • References
Source: https://www.rti.com/whitepapers/Right_Middleware_for_IIoT.pdf
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 16Chemnitz, 04/01/2016
Drowsiness Detection System
Sensors: Steering angle sensor. Position sensor. Camera to detect eyemovements. Camera to detect a changes in lane.
Actuator: Visual and Audible alarms.
.... • PAS • DDS • ACC • … • References
Source: http://nissannews.com/en-US/nissan/usa/releases/video-report-nissan-driver-attention-alert-helps-combat-drowsy-driving-with-innovative-system
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 17Chemnitz, 04/01/2016
Adaptive cruise Control(ACC)
Introduction: Assists the driver to keep a safe distance from preceding vehicle by
controlling the engine, throttle and brake.
...• DDS • ACC • ACC Principle … • References
Source: Prabs, (2010), Adaptive Cruise Control system
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 18Chemnitz, 04/01/2016
ACC-Principle
Working Principle: Works by detecting the distance and Speed of vehicles ahead by radar
sensor. Time taken to transmit and receive is the key principle for distance
measurement. Speed can measured by frequency of the reflected beam by doppler
effect.
... • ACC • ACC Principle • ACC operation • … • References
Source: http://science.howstuffworks.com/science-vs-myth/everyday-myths/doppler-effect2.htm
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
19Chemnitz, 04/01/2016 ADAS
ACC-operation
Working Operations:
Switch on ACC.
Set speed and Distance.
Sensor detects vehicle ahead.
Decelerate to ahead vehicle speed.
Keep Safe distance.
... • ACC Principle • ACC Operations • ACC Block Diagram • … • References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
20Chemnitz, 04/01/2016 ADAS
ACC-operation
Working Operations:... • ACC priciple • ACC Operations • ACC Block Diagram • … • References
Source: https://www.embedded.rwth-aachen.de/lib/exe/fetch.php?media=lehre:sose05:2_20050426_reqsbasics.pdf
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 21Chemnitz, 04/01/2016
ACC-Blockdiagram
Block diagram of ACC:
...•ACC operation• ACC Block diagram • ACC Sensors & Actuators •…• References
Source : Greg Marsden et al. (2000), Towards an understanding of adaptive cruise control
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 22Chemnitz, 04/01/2016
ACC-Sensors & Actuators
Sensors: Three types of Sensors can be used.
Installed behind the grill of the vehicle. Obtain Velocity, angular position and distance.
...•ACC Block Diagram•ACC Sensors & Actuators• ACC Algorithms•…• References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 23Chemnitz, 04/01/2016
ACC-Sensors & Actuators
Lidar sensor: Stands for “Light Detection and Ranging”. Calculates the distance by illuminating the laser and reflecting light. Weather condition restrict its up to 30-40 meter.
...•ACC Block Diagram• ACC Sensors & Actuators•ACC Algorithms•…• References
Source: http://www.directindustry.de/prod/jenoptik-i-defense-civil-systems/product-65823-464586.html
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 24Chemnitz, 04/01/2016
ACC-Sensors & Actuators
Radar Sensor: It operates by radiating energy into free space and detecting echo
signal reflected from an object. It uses Principle of doppler effect. ACC systems are based on 77GHz RADAR sensors. Work in poor weather conditions.
Source: http://www.porscheownersmanuals.com/2011-cayenne-owners-manual/4/160/ACC
...•ACC Block Diagram•ACC Sensors & Actuators•ACC Algorithms•…• References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 25Chemnitz, 04/01/2016
ACC-Sensors & Actuators
Fusion Sensor: Millimeter wave RADAR linked to a stereo type camera.
...•ACC Block Diagram•ACC Sensors & Actuators•ACC Algorithms•…•References
Source : http://studymafia.org/wp-content/uploads/2015/03/mechADAPTIVE-CRUISE-CONTROL-report.pdf
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 26Chemnitz, 04/01/2016
ACC-Sensors & Actuators
Actuators in ACC:
Brake.
Throttle.
Display.
...•ACC Block Diagram•ACC Sensors & Actuators•ACC Algorithms•…•References
Source : Hwisoo Eom and Sang Hun Lee, (12 June 2015), Human-Automation Interaction Design for Adaptive Cruise Control Systems of Ground Vehicles
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 27Chemnitz, 04/01/2016
ACC-Algorithm
ACC Speed Algorithm:...•ACC Sensors & Actuator • ACC Algorithm• BSDS Introduction• … •References
Source: D.Sivaraj, K.R.Radhakrishnan,(2011 ), Design of Automatic Steering Control and Adaptive Cruise Control of Smart Car.
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 28Chemnitz, 04/01/2016
ACC-Algorithm
ACC Speed Algorithm:
PWM_duty = Const_duty+(Ks*(CR - ROT)) where CR= Constant rotation value of the wheel. ROT=Current speed of the car. Ks=speed factor value. Adaptive Speed PWM Table
...•ACC Sensors & Actuator • ACC Algorithm• BSDS Introduction• … •References
Source: D.Sivaraj, K.R.Radhakrishnan,(2011 ), Design of Automatic Steering Control and Adaptive Cruise Control of Smart Car.
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 29Chemnitz, 04/01/2016
ACC-Algorithm
PID based Adaptive cruise control Algorithm:
...•ACC Sensors & Actuators • ACC Algorithm• BSDS Introduction•…•References
Source: M. Ben Swarup, M. Srinivasa Rao, (June 2015 ), Software Safety Simulation and Failure Analysis of Adaptive Cruise Control System
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 30Chemnitz, 04/01/2016
Blind spot detection system(BSDS)
Introduction: Blind spot detection system is device that really essential to monitor
blind spot region while driving vehicle in modern traffic condition.
...•ACC Algorithm• BSDS Introduction• BSDS Sensors & Actuators• …•References
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 31Chemnitz, 04/01/2016
BSDS-Sensors & Actuators
Sensors: Radar based sensors. Vision cameras. Ultrasonic Sensor.
...•BSDS Introduction•BSDS Sensors & Actuators•BSDS Algorithms•…•References
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 32Chemnitz, 04/01/2016
BSDS-Sensors & Actuators
Actuators: Light display on their side-view mirror housings begins to flash. Audible and visible alarm. Steering wheel vibrate.
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
...•BSDS Introduction•BSDS Sensors & Actuators•BSDS Algorithms•…•References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 33Chemnitz, 04/01/2016
BSDS-Algorthims
A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING:
...•BSDS Sensors & Actuators•BSDS Algorthims•Current Development•…•References
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 34Chemnitz, 04/01/2016
BSDS-Algorthims
Indicators in Various condition:
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
...•BSDS Sensors & Actuators•BSDS Algorthims•Current Development•…•References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 35Chemnitz, 04/01/2016
BSDS-Algorthims
Algorithm Flow Chart:
Source: Mohd Ridhuan Bin Selamat, (16 June 2014), A BLIND SPOT DETECTION SYSTEM BASED ON ULTRASONIC SENSING
...•BSDS Sensors & Actuators•BSDS Algorthims•Current Development•…•References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
36Chemnitz, 04/01/2016 ADAS
BSDS-Algorithms
Method to detect objects in vehicle blind spots using cameras:
The system here is divided into three units. Input unit processing unit output unit
Source: C.T. Chen & Y.S. Chen, (Oct. 2009), Real-time approaching vehicle detection in blind-spot area
...•BSDS Sensors & Actuators•BSDS Algorthims•Current Development•…•References
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 37Chemnitz, 04/01/2016
ADAS –Current Development
Autonomous Car:... •BSDS Algoritm • ADAS Current Development • Conclusion • … •Reference
Source: http://www.rdtaxsavers.com/articles/Advanced-Driver-Assistance
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 38Chemnitz, 04/01/2016
Conclusion
Fully autonomous car is probably viable in the foreseen future.
Near by vehicles would be in constant communication with each other and act co-operatively.
It will probably take decades, but car accidents may eventually become rare.
Introdution •...• Conclusion • Reference
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 39Chemnitz, 04/01/2016
Refferences
Adrian Lund, June 18, 2013, Drivers and Driver Assistance Systems. O. Gietelink, J. Ploeg, B. De Schutter and M.Verhaegen, "Development
of advanced driver assistance systems with vehicle hardware-in-the-loop simulations," Vehicle System Dynamics, vol. 44, no. 7, pp. 569-590, July 2006.
Michael Darms, Florian Foelster, Jochen Schmidt, Dominik Froehlich and Alfred Eckert, “Data Fusion Strategies in Advanced Driver
Assistance Systems” , October 2010. J.P. Thalen, “ADAS for the Car of the Future”, April/June 2006. Tariq Jamil, Senior Member IEEE, Member IET,IAENG, “Design and
Implementation of a Parking Helper ”, October 20-22, 2009, San Francisco, USA.
http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=6157099 http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5983821 http://www.erscharter.eu/en/road-safety-in-action https://mycardoeswhat.org/safety-features/lane-departure-warning/
Introduction•... •Conclusion •References•
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 40Chemnitz, 04/01/2016
Refferences
Ying Li and Sharath Pankanti,“Intelligent Headlight Control Using Camera Sensors”, IBM T.J. Watson Research Center, NY, 2009.
Diarmaid O Cualain, “Lane Departure and Obstacle Detection Algorithm for use in an Automotive Environment”, March 2005. S. Paul Sathiyan, S. Suresh Kumar, A. Immanuel Selvakumar, “A
Comprehensive review on Cruise Control for Intelligent Vehicles”, April 2013(IJITEE).
Vandna Saini, Rekha Saini, “Driver Drowsiness Detection System and Techniques: A Review”, 2014. Din-Chang Tseng, Member, IACSIT, Chang-Tao Hsu, and Wei-ShenChen,
“Blind-Spot Vehicle Detection Using Motion and Static Features”, December 2014.
http://www.intel.de/content/dam/www/public/us/en/documents/white-papers/advanced-driver-assistant-system-paper.pdf
http://www.bbc.com/news/uk-15820069 http://time.com/3719270/you-asked-how-do-driverless-cars-work/
Introduction•... •Conclusion •References•
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 41Chemnitz, 04/01/2016
Refferences
https://connect.innovateuk.org/documents/2864009/22346187/JLRADAS_Auto_sense.pdf/d39c5195-64df-4c65-907c-40f9705c8272
http://www.rst.e-technik.tu-dortmund.de/cms/Medienpool/Downloads/Veranstaltungen/Dortmunder_Regelungstechnische_Kolloquien/2008/Vortrag2_08_Gunia.pdf
http://www.continental-automotive.com/www/automotive_de_en/themes/passenger_cars/chassis_safety/adas/
http://www.conti-engineering.de/www/download/engineering_services_de_en/themes/brakes_chassis/download/factsheet_adas_en.pdf
http://www.bosch-mobility-solutions.ru/media/db_application/downloads/pdf/comfort_1/en_5/einparkenleichtgemachtparkassistenzsystemevonbosch.pdf
https://www.embedded.rwth-aachen.de/lib/exe/fetch.php?media=lehre:sose05:2_20050426_reqsbasics.pdf
Introduction•... •Conclusion •References•
Dept. Of Computer EngineeringProf. Dr. Wolfram Hardt
ADAS 42Chemnitz, 04/01/2016
Thank you