introduction to sesar maturity...
TRANSCRIPT
Abstract
The purpose of this guidance is to describe the list of SESAR maturity criteria that will be applied to assess the maturity status of the SESAR Solutions in the context of SESAR2020. The maturity criteria address E-OCVM levels V1, V2 and V3 for SESAR ATM Solutions and TRL levels TRL2, TRL4 and TRL6 for SESAR Technological Solutions. The document includes a set of TRL7 related criteria for the scope under the responsibility of the Very Large Demonstrations (VLDs).
The SESAR Maturity Criteria also provides a set of maturity criteria that will be applied to topics under the scope of the Exploratory Research Projects (both fundamental and applied oriented ones) and for the three E-OCVM phases that are the scope of SESAR2020, V1, V2 and V3 phases.
Introduction to SESAR Maturity Criteria
Edition date: 05 October 2018 Edition: 01.01.03
EDITION 01.01.03
2
© – [2018] – SJU
Authoring & Approval
Author(s) of the document
Name Position/Title Date
Alfredo Gomez de Segura Head of Release Management and Validation
28/10/2016
Reviewed by
Name Position/Title Date
Benoit Fonck Chief Development & Delivery 28/10/2016
Approved by
Name Position/Title Date
Benoit Fonck Chief Development & Delivery 28/10/2016
Document History
Edition Date Status Author Justification
00.01.00 18/10/2016 Approved Alfredo Gomez de Segura
Ready for publication
00.01.01 31/01/2017 Approved Alfredo Gomez de Segura
Updated based on the review of maturity criteria by SESAR 2020 members
00.01.02 04/08/2017 Mark Watson Removed embedded Maturity Criteria Excel file, to ensure one Maturity Assessment Tool is the sole reference for Maturity Criteria
01.01.02 16/08/2017 Approved Alfredo Gomez de Segura
Ready for publication
01.01.03 05/10/2018 Mark Watson Maturity assessment tool only available on STELLAR. Updated reference to FAQ.
INTRODUCTION TO SESAR MATURITY CRITERIA
© – [2017] – SJU 3
EDITION 01.01.03
4
© – [2018] – SJU
Table of Contents
1 Introduction ............................................................................................................... 5
1.1 Purpose of the document............................................................................................... 5
1.2 Maturity assessment ..................................................................................................... 5
1.3 How to start? ................................................................................................................ 5
1.4 Glossary of terms ........................................................................................................... 6
1.5 Acronyms and Terminology ........................................................................................... 6
2 SESAR Maturity Criteria.............................................................................................. 8
2.1 List of SESAR Maturity Criteria ....................................................................................... 9
2.2 SESAR Maturity Criteria Threads .................................................................................... 9
2.3 Possible answers to each maturity criteria ................................................................... 10
3 References ............................................................................................................... 11
List of Figures
Figure 1: Gates and phases of the SESAR Solution Development Life Cycle ...................................... 8
List of Tables
Table 1: Possible answers to maturity criteria ................................................................................ 10
INTRODUCTION TO SESAR MATURITY CRITERIA
© – [2017] – SJU 5
1 Introduction
1.1 Purpose of the document
This document includes the list of SESAR maturity criteria that will be applicable to assess the maturity progress of the SESAR Solutions in the context of SESAR 2020, from an early stage of maturity e.g. exploratory research topic up to the transition towards industrialization e.g. scope of demonstration activities.
1.2 Maturity assessment
Maturity assessment analyses results from project activities i.e. concept validation activities to assess the progress of R&D work for a given SESAR Solution through the E-OCVM and TRL scales.
It relies on content and evidences captured in deliverables e.g. SESAR Solution data-pack produced by projects in the frame of SESAR 2020 and/or past R&D activities i.e. SESAR 1.
The maturity assessment consists of checking whether or not the set of SESAR maturity criteria for a given V / TRL maturity Phase are successfully achieved for a SESAR Solution under analysis and is supported by a maturity assessment tool (MAT) provided by the SJU. More than stating if a criterion is achieved or not, the key objective is to ensure that there are documented evidences that support that assessment.
The information related to individual SESAR Solution maturity assessments is collected, baselined and stored in an integrated database. A consolidated Maturity report is generated by the SJU on an annual basis. The maturity baseline is also an input to the Release Strategy report.
SESAR Solution(s) maturity will be assessed, using the SESAR Maturity criteria, at the Maturity Gates. Projects plan SESAR Solution Maturity Gates in accordance with the project progress and in line with the milestones identified in the Grant. When planning their activities, Solution projects have to consider the Programme milestone calendar e.g. delivering in due time the required data packs and scheduling in due time the V3 maturity Gate, the resulting SESAR Solutions are available for the related Release Close out.
However, the SESAR Maturity criteria should be taken into consideration at any time during the SESAR Solution lifecycle. At the beginning of a given V / TRL Phase, understanding the expectations at the end of V / TRL phase e.g. at VALR / TVALR, SPR-INTEROP/OSED level will help the project to produce the VALP / TVALP.
1.3 How to start?
1. What is the reference material I need to consult?
– Introduction to SESAR Maturity Criteria: it is this document that provides as well the SESAR Maturity Criteria;
2. What is the MAT Tool?
– MAT Tool: It is a tool that integrates the SESAR Maturity Criteria and allows performing a maturity assessment per SESAR Solution.
EDITION 01.01.03
6
© – [2018] – SJU
3. How to use the MAT Tool?
– FAQ “How to perform a maturity assessment on STELLAR”.
1.4 Glossary of terms
Term Definition Source of the definition
R&D Need R&D needs state major questions and open issues to be addressed during the development, verification and validation of a SESAR Solution. They justify the need to continue research on a given SESAR Solution, and the definition of validation exercises and validation objectives in following maturity phases.
E-OCVM
….
Table 1: Glossary of terms
1.5 Acronyms and Terminology
Term Definition
ADD Architecture Definition Document
AN Availability Note
ATM Air Traffic Management
ATM MP Air Traffic Management Master Plan
CBA Cost Benefit Analysis
EATMA European ATM Architecture
E-ATMS European Air Traffic Management System
E-OCVM European Operational Concept Validation Methodology
IBP Industrial Based Platform
IRS Interface Requirements Specification
INTEROP Interoperability Requirements
KPA Key Performance Area
KPI Key Performance Indicator
INTRODUCTION TO SESAR MATURITY CRITERIA
© – [2017] – SJU 7
MAT Maturity Assessment Tool
OSED Operational Service and Environment Definition
PIRM Programme Information Reference Model
SESAR Single European Sky ATM Research Programme
SJU SESAR Joint Undertaking (Agency of the European Commission)
SPR Safety and Performance Requirements
SUT System Under Test
SWIM System Wide Information Model
TRL Technology Readiness Level
TS Technical Specification
UC Use Case
VALP Validation Plan
VALR Validation Report
VALS Validation Strategy
V&VI Validation and Verification Infrastructure
Table 2: Acronyms and terminology
EDITION 01.01.03
8
© – [2018] – SJU
2 SESAR Maturity Criteria
The purpose of this guidance is to describe the list of SESAR maturity criteria that will be applied to assess the maturity status of the SESAR Solutions in the context of SESAR2020. The SESAR Maturity Assessment Criteria are based on material from E-OCVM version 3.0 and Technology Readiness Levels provided by Horizon 2020, adapted to the specificities of SESAR 2020 programme.
The maturity criteria address E-OCVM levels V1, V2 and V3 for SESAR ATM Solutions and TRL levels TRL2, TRL4 and TRL6 for SESAR Technological Solutions. The document includes a set of TRL7 related criteria for the scope under the responsibility of the Very Large Demonstrations (VLDs).
The SESAR Maturity Criteria also provides a set of maturity criteria that will be applied to topics under the scope of the Exploratory Research Projects (both fundamental and applied oriented ones) and for the three E-OCVM phases that are the scope of SESAR2020, V1, V2 and V3 phases.
They are intended to be used to measure the progress of:
Topics under the scope of exploratory research projects (both fundamental and applied oriented ones) towards initial maturity levels e.g. TRL1 / TRL2;
SESAR ATM Solutions through E-OCVM levels V1, V2 and V3;
SESAR Technological Solutions through TRL levels TRL2, TRL4 and TRL6;
SESAR solutions under the scope of Very Large Demonstrations (VLDs) projects towards TRL7.
Figure 1: Gates and phases of the SESAR Solution Development Life Cycle
In some cases, and in order to facilitate the understanding of some criteria, maturity criteria have been decomposed in sub-criteria that describe all aspects that need to be considered in order to successfully achieve a given criterion. The answers to sub-criteria are consolidated at criteria level. However, nothing prevent the Solution project to answer directly at criterion level.
Maturity Criteria are built progressively from one maturity level to the following one (links between maturity criteria across maturity levels are also available).
INTRODUCTION TO SESAR MATURITY CRITERIA
© – [2017] – SJU 9
2.1 List of SESAR Maturity Criteria
The SESAR Maturity Criteria applicable to SESAR 2020 projects are implemented in the MAT Tool.
2.2 SESAR Maturity Criteria Threads
The SESAR maturity criteria are organized in 7 threads:
5 threads cover different aspects of the maturity of a SESAR Solution: Operational, System, Performance, Standards & regulations and Transition:
o Operations: This thread relates to the description and detailing of the operational concept and procedural aspects related to a SESAR Solution. It refers to the definition and development of operational scenarios, use cases, operational procedures, roles and responsibilities and the identification of operational, safety and performance requirements;
o Systems: This relates to the description and refinement of the required technology/systems, functional blocks and system enablers to support the SESAR Solution. It refers to the development of interoperability requirements and technical specifications addressing the operational and performance requirements for the SESAR Solution;
o Performance: the thread covers to what extent the performance assessments performed follow the SESAR performance and transversal areas assessment reference material, and the qualitative / quantitative performance benefits and cost associated to the SESAR Solution;
o Standards & Regulations: This thread deals with the identification of standardization and regulatory needs as the SESAR Solution maturity evolves and the contribution to activities under standardization and regulatory bodies on the scope of a given SESAR Solution;
o Transition: This thread analyses, on the one hand, whether or not all aspects required to ensure a transition between maturity levels have been taken into consideration e.g. if recommendations for the next maturity level have been documented. On the other hand, it covers aspects that may have influence on industrialization/deployment decisions at a later stage but are not under the strict scope of the SESAR Solution e.g. need to re-design airspace organization to get benefits from advanced RNP capabilities;
Two additional threads cover aspects that, although not directly related to the maturity of the SESAR Solution, allow to improve the confidence on the evidences provided (Validation) and to ensure the alignment/consistency of the SESAR Solution with the SESAR Programme Framework (Programme).
o Programme: This thread measures to what extent the activities performed on a given SESAR solution fit in the overall SESAR programme;
o Validation: This thread analyses to what extent the validation approach and method taken is consistent with the current and target maturity level for the SESAR Solution
EDITION 01.01.03
10
© – [2018] – SJU
e.g. the Validation techniques selected is adequate to achieve the specific objectives of a given V phase.
2.3 Possible answers to each maturity criteria
There are five possible answers for each maturity criterion:
Possible answers to maturity criteria
Explanation
Not Applicable Related to non-applicable criteria
Note: Not all criteria are applicable to all the SESAR Solutions. For example, if a SESAR Solution is not impacting Human Performance or Security the corresponding criteria can be identified as “Not applicable” provided a justification is given
Not achieved The criterion has not been satisfied for the SESAR Solution under analysis
Partial– Blocking Partially achieved. There are issues that require further work. These remaining issues prevent progress of the SESAR Solution to the next maturity level until they have been addressed. This may include future exercises planned to complete the validation.
Partial– Non Blocking Partially achieved, but the remaining aspects do not prevent progress to the next maturity level. They can be address as part of the activities in the next maturity phase.
Achieved No issues are identified to solve after the exit of the V / TRL-phase – i.e. satisfactorily achieved that V / TRL-phase is completed
Table 3: Possible answers to maturity criteria
The document provides indications about what criteria are more critical per V / TRL phase.
INTRODUCTION TO SESAR MATURITY CRITERIA
© – [2017] – SJU 11
3 References
[1] European Operational Concept Validation Methodology (E-OCVM) - 3.0 [February 2010]
[2] SESAR2020 Project Handbook
[3] H2020 reference material