![Page 1: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/1.jpg)
1
Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke
Aerospace Capability Analysis Joint and Operations Analysis Division
UNCLASSIFIED – Approved for Public Release
![Page 2: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/2.jpg)
2
Outline
Introduction Current Development Hardware Overview App Development Demonstration
UNCLASSIFIED – Approved for Public Release
![Page 3: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/3.jpg)
3
DSTG Structure
Air Capability Analysis
• Aerospace Mathematical Science
• Aerospace Organisation and Management Science
• Aerospace Simulation, Experimentation and Wargaming
• Aerospace Systems Analysis
UNCLASSIFIED – Approved for Public Release
![Page 4: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/4.jpg)
4
Air Combat Analysis Program
Air Combat Analysis – Supporting introduction into service for EA-18G and F-35A – Control of the Air, Strike, Airborne Electronic Attack – Focus on:
• Integration into the wider force • Supporting CONOPS development • Upgrades
F/A-18A/B+ Hornet F/A-18F Super Hornet EA-18G Growler F-35A Lightning II
UNCLASSIFIED – Approved for Public Release
![Page 5: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/5.jpg)
5
UNCLASSIFIED – Approved for Public Release
Constructive simulation environment for multi-ship beyond visual range air combat.
![Page 6: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/6.jpg)
6
The Need for Advanced Visualisation UNCLASSIFIED – Approved for Public Release
![Page 7: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/7.jpg)
7
The Need for Advanced Visualisation UNCLASSIFIED – Approved for Public Release
![Page 8: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/8.jpg)
8
Proof of Concept Developed: November 2014
Augmented Reality Proof of Concept
“Augmented Reality as an Interface to Air Combat Multi-Agent Simulation”, SimTecT: August 2015
UNCLASSIFIED – Approved for Public Release
![Page 9: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/9.jpg)
9
Collaboration Established December 2015
January 2016
February 2016
April 2016
October 2016
UNCLASSIFIED – Approved for Public Release
![Page 10: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/10.jpg)
10
Project Description UNCLASSIFIED – Approved for Public Release
![Page 11: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/11.jpg)
11
Project Description UNCLASSIFIED – Approved for Public Release
![Page 12: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/12.jpg)
12
Project Description UNCLASSIFIED – Approved for Public Release
![Page 13: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/13.jpg)
13
Project Description UNCLASSIFIED – Approved for Public Release
Requirements: - Tool showing impact of decisions - Visualisation of environment - Real time manipulation
Aims: - Inform Defence about AR Tech - Explore how tech may be
applied
![Page 14: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/14.jpg)
14
Microsoft HoloLens UNCLASSIFIED – Approved for Public Release
![Page 15: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/15.jpg)
15
Microsoft HoloLens
Speakers
Vents Adjustable headband
Protective cover
Brightness
Volume
Sensor suite
Waveguides
UNCLASSIFIED – Approved for Public Release
![Page 16: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/16.jpg)
16
Sensors
Inertial Measurement Unit (IMU) accelerometer, gyroscope,
magnetometer
RGB, greyscale cameras positioning, correct IMU drift
HD camera
IR emitters
Ambient light sensor
Microphone array
Depth camera
UNCLASSIFIED – Approved for Public Release
![Page 17: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/17.jpg)
17
Onboard Processing
Intel 32 bit CPU Integrated GPU
2GB RAM
Holographic Processing Unit custom processor for spatial mapping, gestures, speech
recognition
UNCLASSIFIED – Approved for Public Release
![Page 18: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/18.jpg)
18
Display
Waveguides (red, green, blue layers) surface relief grating
‘Light engine’
UNCLASSIFIED – Approved for Public Release
![Page 19: Microsoft HoloLens and Air Combat Simulation · 1 Microsoft HoloLens and Air Combat Simulation Kevin McDonald and Lyndon Benke Aerospace Capability Analysis . Joint and Operations](https://reader030.vdocuments.net/reader030/viewer/2022040121/5ec8ef1016c3d72d3d3aa405/html5/thumbnails/19.jpg)
19
Thank You UNCLASSIFIED – Approved for Public Release