comprehensive methodology for evaluating automated driving
Post on 18-Oct-2021
3 Views
Preview:
TRANSCRIPT
www.L3Pilot.eu Twitter@_L3Pilot_ LinkedInL3Pilot
Satu InnamaaVTT Technical Research Centre of Finland Ltd.
Comprehensive methodology for evaluating automated driving in Europe
PS1122 - Comprehensive tools for advancing Automated Driving systems, Virtual ITS European Congress, 9 November 2020
2
CO
VER
LAY
FOU
ND
ATIO
N
9 Nov 2020 ITS European Congress
Research question selection
Theories of impact areas
Descriptions of AD functions
RESEARCH QUESTIONS (3 levels) for all evaluation and impact areas:
• Technical & traffic evaluation: System performance, driving behaviour
• User & acceptance evaluation
• Impact evaluation: Mobility, safety, transport network efficiency, environment
• Socio-economic evaluation
Feasibility in terms of • study design • data logging• evaluation
methods
39 Nov 2020 ITS European Congress
Experimental procedure set-up
Experimental procedures: Participants, test routes, study design (incl. baseline), performing the tests
• Aim: Sufficient commonalities to be able to make harmonised evaluation
Step 1: Description of alternatives
Step 2: Pilot site consultation
• Alternatives• Pros & cons• Minimum requirements
• Support on how to implement the methodology into practice
• Awareness of optimal solution vs. Best practical solution for a pilot study
49 Nov 2020 ITS European Congress
Method for technical and traffic evaluation
59 Nov 2020 ITS European Congress
Method for user & acceptance evaluation
• Pilot site questionnaires, completed by participants testing the ADFs at all pilot sites
• Users impressions on e.g. acceptance, safety and comfort
• International survey, large-scale, representative• Acceptance of ADFs and monitor changes over time
• Video- and vehicle-based data• Frequency of interactions with the ADF, drivers’ posture, their engagement with
non-driving related tasks, and their resumption of control from automation
• Interviews and focus groups to assess drivers’ views of ADFs, simulator & WoZ studies• Situations that cannot be observed or explained by the other methods employed
69 Nov 2020 ITS European Congress
Method for mobility impact assessment
7
Current realised mobility:Travel surveys & travel diary
data Utility-cost model
Scope for mobility impact:
Trips within ODD, those willing to start using L3
ADFs
Mobility impact assessment:
Qualitative impacts, relative change
based on surveys, focus groups,
literature
Research questions answered:
Quality of travel, duration, timing, distance, road type use, mode choice, number
of trips
Scaling up
9 Nov 2020 ITS European Congress
Method for safety impact assessment
89 Nov 2020 ITS European Congress
Method for efficiency & environmental impact assessment
9
Penetration rates,
fleet composition
Mature ADFs
Changes in driving behaviour
/ vehicle operations
Safety IA Mobility IA
Changes due to impact on
incident-induced congestion
Changes due to impacts on
mobility behaviour
Traffic simulationEmissions simulation Other assessment
Estimated changes in travel time and emissions per traffic scenario
Scaling up of efficiency and environmental impacts to EU28
T&T evaluation
9 Nov 2020 ITS European Congress
Method for socio-economic impact assessment
10
Efficiency IA Environmental IA
System costs(in-vehicle
equipment and infrastructure)
Net annual benefits
Safety IA
Impacts on efficiency in travel time
Impacts on environment
in fuel consumption & emissions
Impacts on safety
In number and severity of accidents
Benefit-cost ratio
Overall society Stakeholders
9 Nov 2020 ITS European Congress
Foundation for successful evaluation
• Harmonised approaches across pilot sites, established partnerships between evaluation and pilots
• Smooth data flow from pilots via tools to all evaluation methods
• Multidisciplinary evaluation methodology
• Well-defined and tested evaluation planfor all research questions
119 Nov 2020 ITS European Congress
More information on L3Pilot methodology
Deliverables
• D3.1 From research questions to logging needs (2018)
• D3.2 Experimental procedures (2019)
• D3.3 Evaluation methods (2019)
• D3.4 Evaluation plan (2020)
+ multiple papers
Available for download at https://l3pilot.eu/download/
129 Nov 2020 ITS European Congress
Thank you for your kind attention.
This project has received funding from the European Union’s Horizon 2020research and innovation programme under grant agreement No 723051.
www.L3Pilot.eu Twitter@_L3Pilot_ LinkedInL3Pilot
Satu InnamaaSatu.Innamaa@vtt.fi+358-40-7610717 © L3Pilot project/photographers:
depositphotos/Solomin Viktor, Andrey Popov, leungchopan, fbmadeira, natlit;
Nils Kampendonk; Volkswagen AG; Unsplash/Dawid Zawiła, Samuel
Zeller, NeONBRAND, Brooke Cagle, Axel Antas-Bergkvist, Paul Gilmore,
Depositphotos, Nadine Shaabana on Unsplash, Alessio Lin, Rucksack
Magazine on Unsplash, Kyle Nieberon Unsplash, Flo Pappert on
Unsplash, Roman Koester, Serhat Beyazkaya on Unsplash, Pixnio.com/fr
top related