automated validation of diagnostics in ecus...u let’s look at a ‘simple’ service, such as...

V1.1 | 2019-03-13

CANoe.DiVa Diagnostic Integration and Validation Assistant

Automated validation of diagnostics in ECUs

u Introduction

CANoe.DiVa for Automated Diagnostics Validation

Summary

Agenda

2/22

u Let’s look at a ‘simple’ service, such as “ReadDataByIdentifier”, this has one “good case”, and (at first glance) five context sensitive “bad cases”:

Source: ISO 14229-1:2013

u But consider, e.g. NRC 0x13, this is sent if the request is too long, too short or if too many DIDs are requested!> NRC 0x31 may also be provoked by a number of cases

u So, if we only check that we receive a positive response to a request, how much of the total diagnostic functions do we cover?

Why Might We Want to Automate Validation?

Introduction

3/22

The Mission

Introduction

CANoe.DiVa

data driven diagnostic tests

test generation

reproducible

automated

broad and detailed

test run

documented

4/22

CANoe.DiVa

Introduction

ECU Specification

ECUSystem under

Test

CDD

Test Module

CANoeXML/CAPL

CANoe.DiVaCANdelaStudio

DiagnosticAuthoring Tool

ODX

Configurator

Generator

RuntimeLibrary

ReportAnalyzer

Test Report

CANoeHTML/

XML

CANoeTest Feature Set

5/22

Where might we want to insert faults?

Introduction

Bus access:Communication

Transport protocol (CAN):ISO network layer, parameters, timings, Flow Controls,…

CANoe/CANalyzer

Diagnostic „communication“: Timings, message format, request/ response dependencies

CANoe.DiVa

Diagnostic „exchange“: Supported services and sub-functions, data content, state dependencies,...

CAN LIN FlexRay DoIP K-Line

6/22

Protocols to consider during fault insertion

Introduction

u ISO 14229 Unified Diagnostic Services (UDS): 2006/2013

u ISO 15765 Diagnostics on CAN

u ISO 14230 Keyword Protocol 2000 (KWP)

u ISO 15031/J1979 On Board Diagnostics (OBD)

u ISO 27145 World-wide harmonized OBD (WWH-OBD)

u GMW3110 (including GM Node Verification Procedures)

u Various manufacturer specific test extensions (e.g. for Daimler, GM, VW, FCA, …)

7/22

Automated Tests – Scalability of Automation

Introduction

Diagnostic Console CAPL Browser vTESTStudio CANoe.DiVa

test creation

test execution

n/a editing CAPL tool supported generated

interactive automated automated automated

8/22

Introduction

u CANoe.DiVa for Automated Diagnostics Validation

Summary

Agenda

9/22

Overview

CANoe.DiVa for Automated Diagnostics Validation

u Automated generation of a CANoe test based on a diagnostic specification

u User interface to configure tests

u Generation of a test specification

u Clear and detailed report of test results

u Support of test report analysis

u Requirement traceability

u Extensible test functionality

10/22

Protocol Testing

CANoe.DiVa for Automated Diagnostics Validation

u Diagnostic Message Flow

u Physical, functional addressing and timing

u Diagnostic Protocol Format

u Valid, Combined and Invalid Requests

u Response (single, none, multiple)

u Data Type Checks

u Sessions and Security Levels

u Service execution in the different sessions and security levels

u Session and security state transitions

DiVa ECU

11/22

Application Testing: Diagnostic Parameter

CANoe.DiVa for Automated Diagnostics Validation

u Passive parameter validation against

u Diagnostic values (e.g. read/write)

u Configured data ranges

u Expectation values

u CCP/XCP values

u CANoe System Variables

u Active control of I/Os to validate diagnostic parameter content

u CAN messages using CANoe rest bus simulation

u HW I/Os via VT System channels

u Any I/O using CANoe system variables

12/22

Application Testing: Fault Memory

CANoe.DiVa for Automated Diagnostics Validation

u Provoke network signal failures

u Communication timeouts

u Data consistency failures

u Provoke hardware failures using the VT System:

u Short-circuits (Ground, UBatt, Pins)

u I/O failures (interruption, resistance, voltage)

u Individual error settings

u Any other failures using user scripts

simul.node 2

realnode 1

simul.node 3

13/22

Application Testing

CANoe.DiVa for Automated Diagnostics Validation

CANoe ILECU

System under Test

txMsgTemp

Temp.Sensor

Read

(19,22)

IO

Control

(2F)

control

measure

control

check

CANoe.DiVa

VT System

14/22

Software Download Test

CANoe.DiVa for Automated Diagnostics Validation

Supported Download Tests*

u Valid Flashing

u Overvoltage and under voltage tests

u Cancel data transfer (stop transmission or clamp reset)> Check that valid flashing is possible afterwards

u Flash process-related testing:

u Security Access: Do no Security Access during flash sequence

u Security Access: Send an invalid Key during flash sequence

u Erase Memory: Do not send Erase Memory Routine during flash sequence

u Erase Memory: Cancel after Erase Memory

u Erase Memory: Cancel erasing after X milliseconds

u TransferData: Increment one bit of data during flash sequence (CRC check must fail)

u TransferData: Increment one bit of data during flash sequence (Signature check must fail)

u Fingerprint: Do not send the specified Fingerprint

u Additional flash tests available for selected OEM extensions

* With Vector vFlash

15/22

User Interface

CANoe.DiVa for Automated Diagnostics Validation

16/22

Test Reporting

CANoe.DiVa for Automated Diagnostics Validation

17/22

Test Result Analysis

CANoe.DiVa for Automated Diagnostics Validation

u Compare test runs

u Different Views on the test report

u Result (Pass/Fail)

u Service

u ECU State

u Issue Classification/Comment

u Requirements

u Identify error situations by combining Views

u Comment and classify test results

u Get one-page summary reports

u Forward and archive a complete test report or an excerpt

18/22

Requirements Tracking

CANoe.DiVa for Automated Diagnostics Validation

u Link CANoe.DiVatests with test- or specification requirements (automatically and manually)

u Documentation of requirements within test cases/results via prose, document references or links (e.g. DOORS, html)

u Requirement View for test analysis: In which tests is a requirement verified?

u Requirement Overview to document the verification result

19/22

Introduction

CANoe.DiVa for Automated Diagnostics Validation

u Summary

Agenda

20/22

u Significant savings of time and effort

u Further quality improvement of the ECU Software

u All development stages supported

u Excellent test coverage

u Efficient, generation-based approach

u Automated tests without user interaction

u User-defined tests allow tailoring

u Widely used by OEMs and suppliers already with a proven record of success

u Continuously enhanced features through implementation of customers’ requirements

Benefits

Summary

21/22

© 2019. Vector GB Limited. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V1.1 | 2019-03-13

Author:Iain CunninghamVector UK

For more information about Vectorand our products please visit

www.vector.com