vmworld 2013: on the way to gpu virtualization – 3d acceleration in virtual machine
TRANSCRIPT
On the Way to GPU Virtualization –
3D Acceleration in Virtual Machine
Sumit Agarwal, AMD
Yizhong Zhang, VMware
TEX5030
#TEX5030
joint-development with AMD
2 2
Disclaimer
This presentation may contain product features that are currently
under development.
This overview of new technology represents no commitment from
VMware to deliver these features in any generally available
product.
Features are subject to change, and must not be included in
contracts, purchase orders, or sales agreements of any kind.
Technical feasibility and market demand will affect final delivery.
Pricing and packaging for any new technologies or features
discussed or presented have not been determined.
3 3
Agenda
• VMware’s GPU virtualization solution
• AMD’s GPU driver for vSphere
• Demo
• Q & A
4 4
GPU Virtualization Background
Current limitation
• GPU becomes more powerful but low utilization
• HW virtualization is the trend. GPU virtualization is the last issue.
• Passthrough is not perfect
Solution
• Fully GPU virtualization
Benefit
• Remote graphics rendering: VDI, CAD
• End user get graphics acceleration on thin client
• Better GPU utilization
• Save cost
• Allocate resource by user requirement. Easy to upgrade
5 5
3D Rendering as a Service
3D workloads
remote client
3D acceleration center
6 6
Fully virtualization on ESXi – vSGA
SVGA
VMware ESXi
SVGA Driver
3rd party driver
graphics stack
SVGA Driver
SVGA
SW pipeline
SVGA
SVGA Driver
7 7
Gallium 3D
vSGA architecture
VMware Guest Driver
SVGA3D protocol
SVGA Device
SVGA State Tracker GL Backend
Kernel Driver llvmpipe
GPU
Guest
Host
Guest graphics stack
3rd party module
Hypervisor module
Guest module
Virtual device
hardware
OGL Driver
CPU
Application
Software pipeline path Physical GPU path
8 8
Task Worker
Basic data
entry/usage is
central to work
Productivity /
Knowledge Worker
Standard productivity
tools are central to work
Desktop Power User
Some compute
intensive apps, require
3D graphics
performance
Workstation Users
Workstation class
performance for
compute with dedicated
graphics
Image Quality
Interactivity
Cost/Seat
2D / 3D
Virtual Desktop User Segmentation
DirectX 9
Diagnostics
5MP Screens
Oil & Gas
OpenGL 2.1
Many-Monitor (3+)
Aero
1080p
Engineering
++Users per GPU -
Heavy Users
Many Applications Light Users
Fewer Applications
vDGA*
GPU PCI
Passthrough
Heavy Users
Native Driver
vSGA
Virtualized 3D Hardware Graphics Resources
--VRAM ++ VRAM
Soft 3D
Software Rendered
Accelerated 3D
CUDA
Note: * vDGA is not available yet
9 9
Partner engagement
GPU driver
life cycle
Upgrade
or Patch Maintenance/
Upgrade Bug fix
Optimization
New feature
General Available Download from
VMware’s website
Certification run test suite
on Workbench
On board Business value
Legal
Plan
Development Develop tools
documents
consultation
co-debug
10 10
AMD FIREPRO™ Technology Unparalleled Value For Customers
The
RELIABILITY you demand
Unified Drivers
OEM Qualifications
ISV Certifications
The
PERFORMANCE you need
Leading Edge
Performance at Every
Price Point
Windows® & Linux®
AMD Eyefinity technology supports up to six DisplayPort™ monitors on an enabled graphics card. Supported display quantity, type and resolution vary by model and
board design; confirm specifications with manufacturer before purchase. To enable more than two displays, or multiple displays from a single output, additional
hardware such as DisplayPort-ready monitors or DisplayPort 1.2 MST-enabled hubs may be required. Maximum two active adapters supported. See
www.amd.com/eyefinityfaq for full details.
™
The
EDGE you expect
4.2
11 11
AMD FIREPRO™ SERVER GRAPHICS One Product for Multiple Segments
Compute VDI Pro Graphics
Co-processing
Data intensive
Clusters
VDI/Remoting
Data + pixels
Servers
Visualization
Pixel intensive
Desktop/Mobile
Price AMD FirePro™
12 12
AMD GPUs Reference
Features FirePro
S7000
FirePro
W7000
FirePro
S9000
FirePro
W9000
FirePro
S10000
Stream
Processors 1280@950Mhz 1280@950Mhz 1792@900Mhz 2048@975Mhz 3584@850Mhz
Memory 4GB GDDR5 4GB GDDR5 6GB GDDR5 6GB GDDR5 6GB GDDR5
Memory B/W 154GB/s 154GB/s 264GB/s 264GB/s 480GB/s
Bus Interface PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16 PCIe3.0 x16
Form Factor 1 slot FH/FL 1 slot FH/FL 2 slots FH/FL 2 slots FH/FL 2 slots FH/FL
Max Power 150W 150W 225W 274W 375W
ECC No No Yes Yes Yes
API Support
DirectX 11.1, OGL
4.2, OCL 1.2
Yes Yes Yes Yes Yes
Performance
Single Precision 2.4 TFLOPS 2.4 TFLOPS 3.23 TFLOPS 4 .0 TFLOPS 5.91 TFLOPS
Performance
Double Precision 152 GFLOPS 152 GLOPS 806 GFLOPS 1.0 TFLOPS 1.48 TFLOPS
B/W: Bandwidth; FH = Full Height; FL: Full Length; TFLOPS: Tera Floating Point Operations; GFLOPS: Giga Floating Point Operations
13 13
Supported Features - vSGA
Features FirePro
S7000
FirePro
W7000
FirePro
S9000
FirePro
W9000
FirePro
S10000
vSGA
vMotion
OpenGL 2.1 ,
DirectX 9.0c, GLX
Min. ESXi version ESXi 5.5 ESXi 5.5 ESXi 5.5 ESXi 5.5 ESXi 5.5
Min. VMware
View agent
version
5.2 5.2 5.2 5.2 5.2
Min. VMware
View Client
version
5.3* 5.3* 5.3* 5.3* 5.3*
Min. AMD Driver
Version 12.10.3 12.10.3 12.10.3 12.10.3 12.10.3
* - To be released; version number may change
14 14
Packaging, Installation and Support
ESXi AMD graphics driver is developed, qualified and supported by
AMD and certified by VMware
User needs to download AMD graphics driver and updates from
AMD website
Graphics driver issues are reported to VMware and addressed by
AMD
Steps to install AMD graphics driver in vSGA on ESXi host:
• Download AMD graphics driver package from AMD website
• Run commands to install the driver on ESXi host:
• esxcli system maintenanceMode set --enable=true
• esxcli software vib install -v “<location of the driver>”
• esxcli system maintenanceMode set --enable=false
• Reboot the system
15 15
Steps to Use vSGA with AMD GPUs
Prepare the ESXi host with AMD graphics driver
Setup the VM with 3D support
• Expand the Video card and enable 3D support and select Hardware from the
drop down menu
• Update the Total video memory eg. 512MB*
• Can also update the information by editing the vm.vmx file
• mks.enable3d = “TRUE”
• mks.use3dRenderer = “hardware”
• Install VM tools
On ESXi host, run gpuvm to validate whether VM is using
graphics card
* VM version 9 or above required for 512MB memory support
16 16
OpenGL Stack with X and GLX, and EGL
Graphics Application
OpenGL Loader (LibGL and LibEGL)
VMware Host SVGA device and Graphics transport layer
VMware SVGA driver for Guest
Client Side OpenGL AMD
Renderer
AMD GPU CPU
ESX Host
User Space
Guest VM
H/W
Guest VM OS and Runtime libraries
AMD User and Kernel driver interface
VMware VMKernel
AMD Kernel driver
AMD VMKernel Shim
Xorg and supporting libraries
AMD GLX Module
AMD X server driver (DDX) X S
erv
er
X Extension libraries Software Rendering
ESX Host
Kernel Space
17 17
Performance and scalability
Limits Number of
GPUs supported
Number of VMs per
GPU
Performance Consideration
vSGA 4* Variable**
• VM and System configuration
• GPU performance
• Number of VMs running on
single GPU
• GPU memory assigned to
each VM
Soft Rendering versus hardware accelerated rendering
Dedicated graphics versus shared graphics
Workload and applications optimization for vSGA solutions
• *- Number of GPUs limit qualified by AMD; no hard limit imposed by VMware
• **- Depends on type of GPU and GPU memory allocated to VMs
18 18
Looking Forward
Work with VMware in bringing the best graphics experience to end
users
Support forthcoming AMD GPUs and APUs with vSGA
19 19
AMD FIREPRO™ Technology Unparalleled Value For Customers
The
RELIABILITY you demand
Unified Drivers
OEM Qualifications
ISV Certifications
The
PERFORMANCE you need
Leading Edge
Performance at Every
Price Point
Windows® & Linux®
AMD Eyefinity technology supports up to six DisplayPort™ monitors on an enabled graphics card. Supported display quantity, type and resolution vary by model and
board design; confirm specifications with manufacturer before purchase. To enable more than two displays, or multiple displays from a single output, additional
hardware such as DisplayPort-ready monitors or DisplayPort 1.2 MST-enabled hubs may be required. Maximum two active adapters supported. See
www.amd.com/eyefinityfaq for full details.
™
The
EDGE you expect
4.2
20 20
vSGA Demo with AMD graphics card
SW configuration
• ESX5.5 + vSphere client 5.5
HW configuration
• DELL T7600 Workstation - Intel Xeon E5-2630 6c *2;128G Memory(16*8GB
DDR3 1600); 1T 7200rpm HDD;
• GPU: W9000
22 22
Q & A
23 23
TAP Membership Renewal – Great Benefits
• TAP Access membership includes:
New TAP Access NFR Bundle
• Access to NDA Roadmap sessions at VMworld, PEX and Onsite/Online
• VMware Solution Exchange (VSX) and Partner Locator listings
• VMware Ready logo (ISVs)
• Partner University and other resources in Partner Central
• TAP Elite includes all of the above plus:
• 5X the number of licenses in the NFR Bundle
• Unlimited product technical support
• 5 instances of SDK Support
• Services Software Solutions Bundle
• Annual Fees
• TAP Access - $750
• TAP Elite - $7,500
• Send email to [email protected]
24 24
TAP Resources
TAP
• TAP support: 1-866-524-4966
• Email: [email protected]
• Partner Central: http://www.vmware.com/partners/partners.html
TAP Team
• Kristen Edwards – Sr. Alliance Program Manager
• Sheela Toor – Marketing Communication Manager
• Michael Thompson – Alliance Web Application Manager
• Audra Bowcutt –
• Ted Dunn –
• Dalene Bishop – Partner Enablement Manager, TAP
VMware Solution Exchange
• Marketplace support –
• Partner Marketplace @ VMware
booth pod TAP1
THANK YOU
On the Way to GPU Virtualization –
3D Acceleration in Virtual Machine
Sumit Agarwal, AMD
yizhong zhang, VMware
TEX5030
#TEX5030
joint-development with AMD