applying gpu technology to combat system integration and...

29
Applying GPU Technology to Combat System Integration and Maintenance Rich Rabbitz Chris Crouch No part of this publication may be reproduced or transmitted in any form, or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without written permission from Lockheed Martin.

Upload: others

Post on 18-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

Applying GPU Technology to Combat System Integration and Maintenance

Rich RabbitzChris Crouch

No part of this publication may be reproduced or transmitted in any form, or by any

means, electronic or mechanical, including photocopy, recording, or any information

storage and retrieval system, without written permission from Lockheed Martin.

Page 2: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 2

Lockheed Martin Moorestown, New Jersey

Copyright © 2017 Lockheed Martin Corporation.

Page 3: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 3

Surface Navy Innovation Center (SNIC)

Collaboration

Loft

Unclassified

Lab

Equipment

Room

Conference

Room

Classified

Lab

Copyright © 2017 Lockheed Martin Corporation.

Rack of 3

VCAs

24 M6000s

1 P6000

2 M6000

4 K6000

Offsite20 K6000s

20 M6000s

Page 4: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 4

Conceptual and Detailed DesignREAL Data that the ship is constructed from

Copyright © 2017 Lockheed Martin Corporation.

Page 5: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 5

COMITS Software Suite

■ COMITS (OpenGL based)● (Computerized Object Manipulation In Three-dimensional Space)

■ COMITS-Ray

● Physics Based Renderer (PBR)

● Real-time Interaction

● High Quality Video Production

■ COMITS-Ray Cloud

● Photorealistic interactive streaming across the company

intranet

■ COMITS-VR (Virtual Reality)

● OpenGL and Iray

● Real-time OpenGL VR App

● Photorealistic 360 Panorama images

● Photorealistic 360 Panorama movies

■ COMITS-AR (Augmented and Mixed Reality)

● Direct3DCopyright © 2017 Lockheed Martin Corporation.

Page 6: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 6

COMITS-Ray

COMITS-Ray

Iray SDK

• Accomplished in 2012 via the NVIDIA Iray SDK

• See GTC 2015 talk by Martin-Karl Lefrancois

• Bringing Physical Based Rendering To Your Application

Copyright © 2017 Lockheed Martin Corporation.

Page 7: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 7

What is Iray?

■ Physically based push button rendering solution (Path Tracing)

■ Multiple rendering modes for interactive to final frame workflows

■ One unified Material Definition Language (MDL)

■ Cluster and cloud rendering that scales with more GPUs● Scales very well on NVIDIA Visual Computing Appliance (VCA)

Render a video in 2 days vs 1 month (utilizing 3 VCAs)

Copyright © 2017 Lockheed Martin Corporation.

Page 8: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 8

COMITS-Ray

■ Physics Based Rendering (PBR)

● A very accurate physics-based simulation of light propagation

through a 3D environment

● How will it look?

• Four factors determine that

GeometryMaterial

Definition

(MDL)

Light

Definition

(MDL)

Comits-Ray

Tone

Mapper

Geometry

Iray

Copyright © 2017 Lockheed Martin Corporation.

Page 9: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 9

Virtual Shipyard (22 million triangles)

Copyright © 2017 Lockheed Martin Corporation.

Page 10: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 10

Equipment Work Package Videos

Copyright © 2017 Lockheed Martin Corporation.

Page 11: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 11

3D Digital Mockup

Copyright © 2017 Lockheed Martin Corporation.

Page 12: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 12

Lighting Analysis

Copyright © 2017 Lockheed Martin Corporation.

Page 13: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 13

Lighting Analysis

Copyright © 2017 Lockheed Martin Corporation.

Page 14: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 14

Lighting Analysis

Copyright © 2017 Lockheed Martin Corporation.

Page 15: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 15

Lighting Analysis

Copyright © 2017 Lockheed Martin Corporation.

Page 16: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 16

COMITS-Ray Cloud

COMITS-Ray

Cloud

Iray

• Product Visualization Across the Lockheed Martin Internet (LMI)

• Tests Conducted With

• Lockheed Martin Aerospace, Fort Worth, Texas

• Lockheed Martin Space Systems, Littleton, Colorado

Copyright © 2017 Lockheed Martin Corporation.

Page 17: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 17

COMITS-Ray Cloud

■ Interactive Streaming in a Chrome Web Browser

● F35 model

● A ship model

Copyright © 2017 Lockheed Martin Corporation.

9.5 million triangles

Page 18: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 18

COMITS (OpenGL Based)

■ Real-time Point-Cloud Rendering (utilizing P6000)

■ 120 million points with sustained rendering at 60 FPS

Copyright © 2017 Lockheed Martin Corporation.

Page 19: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 19

COMITS (OpenGL Based)

■ Real-time Point-Cloud Rendering (utilizing P6000)

■ 120 million points with sustained rendering at 60 FPS

Copyright © 2017 Lockheed Martin Corporation.

Page 20: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 20

COMITS (OpenGL Based)

■ Real-time Point-Cloud Rendering (utilizing P6000)

■ 120 million points with sustained rendering at 60 FPS

Copyright © 2017 Lockheed Martin Corporation.

Page 21: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 21

COMITS and OptiX Prime

■ Ray Scattering Applications

● Ray cast 60 million rays in a second on M6000

Page 22: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 22

COMITS-VR

■ Running on NVIDIA P6000 with HTC Vive

● 9.6 million triangles

● 189 – 213 Frames Per Second (FPS) in standalone mode

● 90 FPS sustained with Vive attached

● Plans for further optimizations and visual enhancements

Copyright © 2017 Lockheed Martin Corporation.

Page 23: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 23

COMITS-VR

■ 360 Panoramas generated from COMITS-Ray

■ Viewable in Vive, or Oculus

Copyright © 2017 Lockheed Martin Corporation.

Page 24: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 24

COMITS-AR

Copyright © 2017 Lockheed Martin Corporation.

Page 25: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 25

COMITS-AR

■ COMITS-AR mixed reality demo with HoloLens

Copyright © 2017 Lockheed Martin Corporation.

Page 26: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 26

COMITS-AR

■ There are plans to increase geometric complexity with GPUs

Copyright © 2017 Lockheed Martin Corporation.

Page 27: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 27

COMITS

■ We are truly leveraging NVIDIA technology to the fullest!

■ Conceptual Design

● Combat Space Arrangements

● Topside Arrangements

● Ergonomics Analysis

● Equipment Loadout Planning and Analysis

● Ship upgrade Planning and Analysis

■ System Readiness

● Crew familiarization

● Maintenance Procedure Review through VR

● Maintenance Procedure Augmentation via AR

■ Help to reduce procurement cost

● Catch problems early in the design cycle

■ Help to reduce Lifecycle cost

● Evolving 3D representation of platform

● Readiness

Copyright © 2017 Lockheed Martin Corporation.

Page 28: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

For Official Use Only 28

Acknowledgements

■ The Ship Integration and Test (SI&T) Organization at LM

■ Chris Etgen, Director of SNIC

■ Eric Halpern, Lead Developer of COMITS-Ray

■ Chris Crouch, Lead Developer of COMITS-VR & COMITS-AR

■ Joshua Pacana, Lead Developer of COMITS-GL

■ Brady White, VR content creator

■ NVIDIA

● Craig Fullman

● John Chaney

● Phil Miller

● Martin-Karl Lefrancois

● Robert Menzel

● And many, many others…

■ My mentors

● Dr. Norm Badler, University of Pennsylvania

● Dr. John Weaver, West Chester University

Copyright © 2017 Lockheed Martin Corporation.

Page 29: Applying GPU Technology to Combat System Integration and ...on-demand.gputechconf.com/gtc/2017/presentation/s7351-richard-ra… · Applying GPU Technology to Combat System Integration

Copyright 2017 Lockheed Martin Corporation 29Copyright © 2017 Lockheed Martin Corporation.

Rich Rabbitz

Lockheed Martin RMS

Principal Member of Engineering Staff (PMES)

Ship Integration and TestEmail: [email protected]