squore kpi platform - vector · 2019-09-13 · squore provides code coverage kpi squore provides a...
TRANSCRIPT
![Page 1: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/1.jpg)
V0.1 | 2019-02-11
Software Analytics Automation for Quality Measurement and Customer/Supplier Reporting
Squore KPI Platform
![Page 2: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/2.jpg)
5
During the project development process, customer and supplier both have expectations and commitments related to all objects of the development cycle.
The Customer expects a product compliant to his requirements and standards
The Supplier is committed to deliver a product respecting quality and time constraints
To achieve these goals, Continuous quality monitoring has to be applied during development.
On the supplier side, it ensures that the delivery meets expected quality levels as the project evolves, thus increasing confidence on the final delivery.
On the customer side, it provides visibility on quality objectives trends, thus providing confidence on the acceptance process.
Introduction
![Page 3: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/3.jpg)
6
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 4: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/4.jpg)
7
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 5: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/5.jpg)
8
Heterogeneity can be found in a project:
In the project structure
Several object types have to be managed: Requirements, Tests, Issues, Source Code …
Across objects
A Test can have different IDs depending on where it is referenced
From the diversity of tools
Requirements can originate from different tools across the organization
Through time
The data model for Tests results can change because of a tool upgrade
Handling heterogeneous objects from the project lifecycle (1)
![Page 6: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/6.jpg)
9
An industrial project monitoring solution should be able to:
Manage objects types from all tool origins
Propose a reconciled view of all objects, and their links
Assess quality on the project and its components
Assist decision maker by relevant indicators and time-based analysis
Be automated, to ensure Continuous Quality
Such a solution should be implemented:
By the supplier, to check project progress during development
By the customer, to monitor project health and completion
Handling heterogeneous objects from the project lifecycle (2)
![Page 7: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/7.jpg)
10
Squore Solution overview
SQUORE
KPI PLATFORM
SUPPLIER CUSTOMER
Automate conversion of complex engineering data into high level KPIs
Provide a Continuous Quality vision
Assess continuous quality/progress
Comment/collaborate with supplier
![Page 8: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/8.jpg)
11
Handling heterogeneous objects from the project lifecycle with Squore
Co
llect
and
O
rgan
ise
Ass
ess
and
A
nal
yse
Mo
nit
or
and
Sh
are
Project monitoringDecision making
CloningISO25010
ISO26262
HIS MISRA
Standard Compliance
Source Tests Tickets Design
DO178
Complexity
Automated Reports
Role-Based
Action Plan
Milestones/Goals
Simulink
Scade
Jira
Mantis
JUnit
CAST/Cover
. . .
CAST/C++
Self descriptiveness
Test Effectiveness
Aggregated Indicators Standards
Monitoring Features
Trend Analysis
. . .. . .
Others
Excel
SAP
. . .
SQUAN
Data
Business
BI
GitLabJenkins
Cont. Integration
Traceability
Reqs.
REQIf
Excel
. . .
Real-time
CorporateKPI
Automate
CorporateStandards
. . .
Rated, Trended
Structured
Raw
Actionable
![Page 9: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/9.jpg)
12
Squore flexibility: Acquiring Data
External data are gathered by Squoreusing the Data Provider technology
An open API makes writing new Data Providers easy
Squore comes out of the box with tens of Data Providers for several tools
![Page 10: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/10.jpg)
13
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 11: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/11.jpg)
14
Ensuring industrial standard compliance (1)
Squore Quality Model turns rawdata into KPI
Example: Squore computes industry proven indicators (MISRA compliance, HIS, Requirement Coverage, Structural Code Coverage…)
![Page 12: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/12.jpg)
15
Ensuring industrial standard compliance (2)
Squore combines data from multiple sourcesIt allows Standard activities assessment
Example: Requirements Completion + ASIL Analysis + Test results ➔Squore detects the list of Compliant components according ASIL
![Page 13: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/13.jpg)
16
Squore flexibility: Tuning the compliance parameters
Squore is aware of multiple standards used in the industry
It is possible to fine-tune the compliance expectations for each standard
Rules from a standard can be excluded, or modified for a specific project, or for all projects from the organization
![Page 14: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/14.jpg)
17
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 15: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/15.jpg)
18
Simplifying Customer/Supplier relationship
SQUORE
KPI PLATFORM
SUPPLIER CUSTOMER
Shared vision of quality
"1 click" Report generation
Collaboration/Comment features
![Page 16: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/16.jpg)
19
Squore flexibility: Adapted rating
Squore comes with a full rating model, taking into account objects from the project lifecycle
A powerful rating descriptive method allows Squore power users to define their own metrics, indicators, alerts, and more
![Page 17: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/17.jpg)
20
Squore flexibility: Relevant dashboards
Squore comes with predefined dashboards, for each kind of user role and object to monitor
A fully graphical editor also allows users to create their own dashboards, depending on their needs
![Page 18: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/18.jpg)
21
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 19: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/19.jpg)
22
Automating proven KPI generation (1)
Time spent on data
Consolidating Analizing
Time spent on data
Process Improvment
Analizing
Consolidating
How do you go from here … … to here?
Focus on data mining
Have multiple visuals, but no goal
Not relying on a proven method
Focus on data meaning
Manipulate relevant indicators
Be confident in your decision-making
![Page 20: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/20.jpg)
23
Automating proven KPI generation (2)
Source
Tests
Tickets
Reqs.
Squore
Platform
Real-time Dashboards
Reliable Industrial KPIs
Efficient Project monitoring
Synchronize
with project data
Automation
![Page 21: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/21.jpg)
24
Handling heterogeneous objects from the project lifecycle
Ensuring industrial standards compliance
Simplifying customer/supplier collaboration
Automating proven KPI generation
Summary
Agenda
![Page 22: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/22.jpg)
26
Squore deployment use case (1)
SUPPLIER: > Product 1 for customer A
> Product 2 for customer B
CUSTOMER B: > Requirement Coverage
SQUORE
KPI PLATFORM
CUSTOMER A: > Code Quality
![Page 23: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/23.jpg)
27
Squore deployment: Cutomer or OEM use case (2)
SQUORE
KPI PLATFORMSUPPLIERS CUSTOMER
![Page 24: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/24.jpg)
28
Automated Static Analysis
Automated Unit Testing
Independent System Testing
Software Stress Testing
Software Failure Mode and Effects Analysis
ECU Software Performance Analysis
Requirements Traceability Matrix
Squore: Overview
![Page 25: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/25.jpg)
29
Squore Analyzer provides quality/complexity metrics
Squore can import SCA results from various tools
Squore can track findings/justifications among software version
Squore can generate a deviation report
Squore: Automated Static Analysis
![Page 26: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/26.jpg)
30
Squore can import Test results from various tools
Squore provides Code Coverage KPI
Squore provides a Test Stability listing (eg, maintained tests)
Squore provides test coverage report
Squore applies a Test Strategy (eg, function to test Vs ASIL)
Squore: Automated Unit Testing
![Page 27: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/27.jpg)
31
Squore can import CANoe and vTestStudio data
Squore provide a Test Effectiveness KPI
KPI are based on any Test types (Functional, Unit Test…)
Possibility to link Requirement and Test outcomes
Squore: Independent Systems Testing
![Page 28: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/28.jpg)
32
Squore provides KPI based on software resources
Possibility to track RAM/ROM, CPU and Stacks
Expected « performance » thresholds can be tuned per project
Squore: ECU Software Performance Analysis
![Page 29: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/29.jpg)
33
Squore can import Requirement from various tools (Doors, Reqtify, Excel…)
Squore tracks requirement’s status and integrity
Squore reconciles links between requirements, tests and tickets
Squore: Requirement Traceability Matrix
![Page 30: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/30.jpg)
35
Recorded Squore Demo Online
![Page 31: Squore KPI Platform - Vector · 2019-09-13 · Squore provides Code Coverage KPI Squore provides a Test Stability listing (eg, maintained tests) Squore provides test coverage report](https://reader033.vdocuments.net/reader033/viewer/2022042113/5e8fd709b4dd2b2b28578f9d/html5/thumbnails/31.jpg)
36 © 2018. Vector Informatik GmbH. All rights reserved. Any distribution or copying is subject to prior written approval by Vector. V0.1 | 2019-02-11
Author:Cyril BenkimounVector Germany
For more information about Vectorand our products please visit
www.vector.com