typhoon simulator record replay de-brief facility (rrdf) · 2020. 11. 30. · tactical map recorded...

Copyright © 2018 BAE SYSTEMS. All rights reserved.BAE SYSTEMS is a registered trademark of BAE Systems plc.(see final slide for restrictions on use)

UNCONTROLLED 1

Duncan PorteousSoftware Team LeaderAir Service – Aircrew Training Simulation SystemsBAE Systems – Air

Typhoon Simulator Record Replay De-brief Facility (RRDF)


UNCONTROLLED

Typhoon Simulator Record Replay De-brief Facility (RRDF)

2

Summary

• Overview of the Typhoon Simulators used to train Air Force pilots

• Debrief capability developed for the RAF Typhoon Simulators

• key requirements

• system design

• technology used

• technical challenges


UNCONTROLLED

Typhoon Simulators

3

• Typhoon Simulators deployed for UK (RAF), Kingdom of Saudi Arabia (RSAF) and Oman (RAFO) supporting aircrew and ground crew training.

• Provides concurrent training capability to Air Force –software updates done to simulators prior to front line aircraft upgrade.

• Provides training activities from cockpit familiarisation, emergency procedural training, engineering training, operational tactical training and mission rehearsal in networked environments.

• Wide area network support for collective training with other distributed simulators (e.g. E3, Type 45) through Air Battle-Space Training Centre (ABTC).

RAF Lossiemouth

RAF Coningsby


UNCONTROLLED

Typhoon Simulators

4

• Range of device types – varying Human Machine Interface – physical cockpit, visual projection system, instructor console.

Avionics Part Task Trainer (APTT)

Emulated Deployable Cockpit Trainer (EDCT)

Enhanced Typhoon Avionics Demonstrator (ETAD+) - Groundcrew


UNCONTROLLED

Typhoon Simulators

5

• All simulator types share common system architecture - combination of rehosted aircraft software and simulated software.

• Approximately 3.6 Million Software Lines of Code.

• Simulates databus interactions of each Line Replaceable Items (LRIs) on the aircraft.

• 372 individual malfunctions simulated.

• Customisable Scenario including weather effects and Computer Generated Forces that provide hostile and friendly entities with which to interact.

• Instructor led training from “Over-the-Shoulder” or remote Operator Station.

• Can be operated in “self-help” mode with entire sim controlled from pilot in cockpit.


UNCONTROLLED

Every sim needs a debrief…

6

Background

• The RAF were debriefing Typhoon pilots using hand-written notes taken during simulated sorties conducted on the Emulated Deployable Cockpit Trainers (EDCTs). These notes were expanded on whiteboards post simulated flight.

• In 2015, the RAF were preparing to include Typhoon in UK deployment to Syria as part of Operation Shader and ability to provide a level of debrief capability as part of combat ready work-up in the simulators would have been advantageous.


UNCONTROLLED 7

A temporary solution for the RAF

• A solution using COTS hardware and software components was rapidly developed and integrated with the existing training simulators allowing delivery of a debrief capability to both RAF bases (Lossiemouth and Coningsby) within 4 months of conception.

• Cockpit displays, Pilot and Instructor audio and the Tactical Map recorded to video file using Bandicam.

• Open Source Media player (VLC) to play back video files – loosely synchronised.

• Easy to operate, low cost.

• No bookmarks for events.

• No interaction with tactical map (recorded video).

Interim Playback Facility


UNCONTROLLED

RRDF System

8

Key Requirements

• “Theatre Style” debrief facility, with text readable up to 5m.

• Record any combination of simulator devices, from simultaneously running but independent missions, to linked (upto 4 simulator) multi-ship scenarios.

• Simultaneous Record and Playback or Live Monitor with audio, video and data synchronised between each simulator.

• Capable of playback from ¼ speed upto x32, forward and backwards.

• Tactical Scenario Viewer range of situational awareness functions.

• Timeline & Event markers (manual and automatic bookmarks).


UNCONTROLLED 9

Video Wall Displays - (6 x 55” UHD 3840 x 2160)

RRDF Theatre Tactical MapHigh Contrast IPS Monitors

• 15.6” portable (tethered) HD touch screen provides single point of control for theatre.

• Recording or device to Live Monitor selection• Video Stream Layout Selection• Individual audio stream volume control/mute• Playback navigation (timeline & event bookmarks)• Tactical Map Management• Recording Management (favourite, delete, archive)

Touchscreen (15.6” HD)

1 display per simulator device


UNCONTROLLED 10

Video Streams

Switch highlighting on change

Primary Displays HOTAS + Cockpit Switches

HUD Symbology + Outside World Generated Image

Background switchable on/off to leave just Symbology

Helmet Mounted Symbology System + Outside World Generated Image

Driven by Head pointing angles from inertia cube

1920 x 1080 @ 60Hz

1920 x 1080 @ 60Hz

2560 x 1440@ 20Hz

2560 x 1440@ 20Hz


UNCONTROLLED 11

Video Streams

Individual Multifunction Head Down Displays

800 x 600 @30Hz

HUD Symbology + Outside World Generated Image (turned off)


UNCONTROLLED

RRDF System Architecture

12

Live Monitor

Real Time

InfrastructureRecorder &

Recorder

Manager

Media

Streamer

Media

PlayerControllerTactical

Map

PostgreSQL

Recorder &

Recorder

Manager

Simulator

Audio &

Video

Data

HLA

HLAAudio &

Video

Data

Media

Streamer

Encode Record Store

Replay

Decode & Display

Stream

Control

Real Time

Infrastructure

• 5 x COTS PCs, 10Gb Ethernet

• Database PC uses NVMe Solid State Drive (SSD) for read/write performance.

• Mechanical drives (Raid 10) for bulk storage.

• Typical recording size for 4 simulators ~95GB / hour

• Utilise dedicated h/w on the GPU to capture and compress an image to a H.264 video stream (RTP).

• Total Data Rate:~215 Mbps

• Media Player that will render the H.264 RTP video streams, including the blending of multiple video streams together.


UNCONTROLLED

RRDF Controller

13

• Interactive Tactical Map is a separate application and provides scenario awareness, with graphical and textual overlays.

• Runs an instance of the Digital Map Generator (DMG) simulation from the simulator, which includes ability to display tactical symbology such as missile engagement zones.

• Desktop Windows Manager (DWM) provides a hardware accelerated repeat of both the tactical map and controls display windows and embeds them in the Theatre controller GUI.

• Touchscreen inputs passed back to Tactical Map application using standard Windows API calls.

Map Controls

Video Wall Monitors

HD Touchscreen

PC

2 x UHD (3840 x 4320)

Tactical Map


UNCONTROLLED

Challenges

14

• Mechanism for encoding and streaming multiple video, audio and data feeds from each simulator – negligible impact on the execution performance of the simulator.

• Recording and playback system – capture and store streams in synchronised manner, sufficient bandwidth high speed playback.

• Present and manage simulator information to the user with a coherent front end interface - integration of a number of systems and applications (different software languages).

• Make / buy trade-off (rare to find COTS products that do exactly what you want).

• Combination of COTS, development to COTS and in-house developed capability.


UNCONTROLLED

Challenges

15

• Tuning of the system to cope with high bandwidth of streams associated with 4 devices, especially during high speed playback.

• Limit system demand to


UNCONTROLLED

Summary

16

• Produced a system that implements a highly responsive and capable record and playback system with just standard COTS hardware and software applications.

• No specialist hardware for encoding and decoding audio/video needed.

• Bandwidth of data streams scalable according to hardware capacity (No. PCs, HD read/write, network capacity).

• Built on typical software applications used for interoperability.

• Readily available tactical scenario viewers & media players can be used.

• Flexible and expandable architecture to support future capability.


UNCONTROLLED

Thank You

17

Restrictions on use:Permission to reproduce any part of this document should be sought from BAE Systems. Permission will usually be given providing the source is Acknowledged and the copyright notice and this notice are reproduced.

typhoon simulator record replay de-brief facility (rrdf) · 2020. 11. 30. · tactical map recorded...

Documents