applying gpu technology to combat system integration and...
TRANSCRIPT
Applying GPU Technology to Combat System Integration and Maintenance
Rich RabbitzChris Crouch
No part of this publication may be reproduced or transmitted in any form, or by any
means, electronic or mechanical, including photocopy, recording, or any information
storage and retrieval system, without written permission from Lockheed Martin.
For Official Use Only 2
Lockheed Martin Moorestown, New Jersey
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 3
Surface Navy Innovation Center (SNIC)
Collaboration
Loft
Unclassified
Lab
Equipment
Room
Conference
Room
Classified
Lab
Copyright © 2017 Lockheed Martin Corporation.
Rack of 3
VCAs
24 M6000s
1 P6000
2 M6000
4 K6000
Offsite20 K6000s
20 M6000s
For Official Use Only 4
Conceptual and Detailed DesignREAL Data that the ship is constructed from
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 5
COMITS Software Suite
■ COMITS (OpenGL based)● (Computerized Object Manipulation In Three-dimensional Space)
■ COMITS-Ray
● Physics Based Renderer (PBR)
● Real-time Interaction
● High Quality Video Production
■ COMITS-Ray Cloud
● Photorealistic interactive streaming across the company
intranet
■ COMITS-VR (Virtual Reality)
● OpenGL and Iray
● Real-time OpenGL VR App
● Photorealistic 360 Panorama images
● Photorealistic 360 Panorama movies
■ COMITS-AR (Augmented and Mixed Reality)
● Direct3DCopyright © 2017 Lockheed Martin Corporation.
For Official Use Only 6
COMITS-Ray
COMITS-Ray
Iray SDK
• Accomplished in 2012 via the NVIDIA Iray SDK
• See GTC 2015 talk by Martin-Karl Lefrancois
• Bringing Physical Based Rendering To Your Application
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 7
What is Iray?
■ Physically based push button rendering solution (Path Tracing)
■ Multiple rendering modes for interactive to final frame workflows
■ One unified Material Definition Language (MDL)
■ Cluster and cloud rendering that scales with more GPUs● Scales very well on NVIDIA Visual Computing Appliance (VCA)
Render a video in 2 days vs 1 month (utilizing 3 VCAs)
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 8
COMITS-Ray
■ Physics Based Rendering (PBR)
● A very accurate physics-based simulation of light propagation
through a 3D environment
● How will it look?
• Four factors determine that
GeometryMaterial
Definition
(MDL)
Light
Definition
(MDL)
Comits-Ray
Tone
Mapper
Geometry
Iray
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 9
Virtual Shipyard (22 million triangles)
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 10
Equipment Work Package Videos
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 11
3D Digital Mockup
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 12
Lighting Analysis
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 13
Lighting Analysis
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 14
Lighting Analysis
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 15
Lighting Analysis
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 16
COMITS-Ray Cloud
COMITS-Ray
Cloud
Iray
• Product Visualization Across the Lockheed Martin Internet (LMI)
• Tests Conducted With
• Lockheed Martin Aerospace, Fort Worth, Texas
• Lockheed Martin Space Systems, Littleton, Colorado
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 17
COMITS-Ray Cloud
■ Interactive Streaming in a Chrome Web Browser
● F35 model
● A ship model
Copyright © 2017 Lockheed Martin Corporation.
9.5 million triangles
For Official Use Only 18
COMITS (OpenGL Based)
■ Real-time Point-Cloud Rendering (utilizing P6000)
■ 120 million points with sustained rendering at 60 FPS
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 19
COMITS (OpenGL Based)
■ Real-time Point-Cloud Rendering (utilizing P6000)
■ 120 million points with sustained rendering at 60 FPS
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 20
COMITS (OpenGL Based)
■ Real-time Point-Cloud Rendering (utilizing P6000)
■ 120 million points with sustained rendering at 60 FPS
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 21
COMITS and OptiX Prime
■ Ray Scattering Applications
● Ray cast 60 million rays in a second on M6000
For Official Use Only 22
COMITS-VR
■ Running on NVIDIA P6000 with HTC Vive
● 9.6 million triangles
● 189 – 213 Frames Per Second (FPS) in standalone mode
● 90 FPS sustained with Vive attached
● Plans for further optimizations and visual enhancements
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 23
COMITS-VR
■ 360 Panoramas generated from COMITS-Ray
■ Viewable in Vive, or Oculus
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 24
COMITS-AR
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 25
COMITS-AR
■ COMITS-AR mixed reality demo with HoloLens
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 26
COMITS-AR
■ There are plans to increase geometric complexity with GPUs
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 27
COMITS
■ We are truly leveraging NVIDIA technology to the fullest!
■ Conceptual Design
● Combat Space Arrangements
● Topside Arrangements
● Ergonomics Analysis
● Equipment Loadout Planning and Analysis
● Ship upgrade Planning and Analysis
■ System Readiness
● Crew familiarization
● Maintenance Procedure Review through VR
● Maintenance Procedure Augmentation via AR
■ Help to reduce procurement cost
● Catch problems early in the design cycle
■ Help to reduce Lifecycle cost
● Evolving 3D representation of platform
● Readiness
Copyright © 2017 Lockheed Martin Corporation.
For Official Use Only 28
Acknowledgements
■ The Ship Integration and Test (SI&T) Organization at LM
■ Chris Etgen, Director of SNIC
■ Eric Halpern, Lead Developer of COMITS-Ray
■ Chris Crouch, Lead Developer of COMITS-VR & COMITS-AR
■ Joshua Pacana, Lead Developer of COMITS-GL
■ Brady White, VR content creator
■ NVIDIA
● Craig Fullman
● John Chaney
● Phil Miller
● Martin-Karl Lefrancois
● Robert Menzel
● And many, many others…
■ My mentors
● Dr. Norm Badler, University of Pennsylvania
● Dr. John Weaver, West Chester University
Copyright © 2017 Lockheed Martin Corporation.
Copyright 2017 Lockheed Martin Corporation 29Copyright © 2017 Lockheed Martin Corporation.
Rich Rabbitz
Lockheed Martin RMS
Principal Member of Engineering Staff (PMES)
Ship Integration and TestEmail: [email protected]