Virtualization

GPU Virtualization

GPU VIRTUALIZATION FOR EVERY WORKLOAD – FROM VDI TO AI

GPU accelerated computing is on the rise. Enterprises are using AI-based applications to help drive better business decisions, boost productivity, and design better products that get to market faster. NVIDIA virtual GPUs (vGPUs) enable enterprises to efficiently deploy GPUs in the data center to support every workload, from virtual client computing to the most compute-intensive workloads like AI, data science, and high-performance computing (HPC).

WHY NVIDIA VIRTUAL GPUs?

Exceptional User Experienc

Exceptional User Experience

Ultimate user experience with the ability to support both compute and graphics workloads in hypervisor-based virtualization environments.

Predictable Performance

Predictable Performance

Consistent performance and quality of service, both on-premises and in the cloud.

Continuous Innovation

Continuous Innovation

Regular software releases ensure that you stay up to date with the latest features and enhancements.

BEST USER DENSITY

BEST USER DENSITY

Industry’s highest user-density solution with support for up to 32 virtual desktops per physical GPU. Lower TCO with more than eight vGPU profiles for the most flexibility to provision resources to match your users’ needs.

Optimal Management and Monitoring

Optimal Management and Monitoring

True, end-to-end management and monitoring with real-time insight into GPU performance and migration technology, as well as broad partner integrations that enable you to use the tools that you know and trust.

Broadest Support Ecosystem

Broadest Support Ecosystem

Support for all major hypervisors, over 140 certified servers, and an extensive portfolio of professional apps accelerated by GPUs.

INDUSTRY SOLUTIONS

Professionals in every industry are realizing the power of GPU-accelerated virtual desktops and workstations. NVIDIA virtual GPU technology drives increased productivity, manageability, and security across these key industries.

 

Architecture, Engineering, and Construction (AEC)

 

Education

 

Government

 

Manufacturing

 

Energy

 

Media & Entertainment

 

Healthcare

 

Finance

vGPU AND THE NVIDIA QUADRO RTX 8000 AND RTX 6000

AUTHORIZED BY NVIDIA FOR VIRTUAL GPU DATA CENTER DEPLOYMENT

NVIDIA Quadro RTX features such as RT Cores for real-time ray tracing at cinematic quality, Tensor Cores that accelerate AI/DL/ML/MV applications and big data analytics, or AI enhanced design and visualization tools, make NVIDIA Quadro RTX 8000 or RTX 6000 professional graphics boards ideal candidates for implementing virtual GPU (vGPU) capabilities across your organization. Bring the latest Quadro advances in graphics and AI to products ranging from smartphones to tablets and non-Quadro equipped mobile or desktop PCs, with RTX 8000 and RTX 6000-based virtualization solutions.

NVIDIA now authorizes and supports the deployment of NVIDIA® Quadro® RTX 8000 and RTX 6000 professional graphics boards in server chassis for vGPU hardware infrastructure. Either choice offers the same GPU performance, but the RTX 8000 offers an unprecedented 48 GB of GPU memory, while the NVIDIA Quadro RTX 6000 provides 24 GB. Both utilize ultra-fast GDDR6 with optional ECC, and NVLink offers GPU memory pooling for two cards, providing 96 GB or 48 GB respectively, along with performance scaling since GPU core counts are effectively doubled. Since NVLink provides 100 GB/sec of bidirectional communications between two Quadro boards, far in excess of what PCIe provides, NVIDIA Quadro RTX equipped vGPU hardware for data center deployment offers previously unrealizable levels of performance and paradigm shifting capabilities – all with Quadro IT manageability.



SERVER VENDORS OFFERING UP TO 8X RTX 8000 OR RTX 6000 SYSTEMS FOR vGPU DEPLOYMENT

Vendor Server Chassis Supported
ASUS ESC8000G4 | ESC4000 G4/G4S/G4X | E900G4 | RS720-E9-RS-8G
Quanta D528V-2U | D52G 4U | D43J-3U| D43KQ-2U| D43N-5U
Supermicro 4029GP-TRT2 | 7049GP-TR | 1019GP-TT
TYAN FT77D-B7109 | T48T-B7105


SERVER VENDORS OFFERING UP TO 8X RTX 8000 OR RTX 6000 SYSTEMS FOR vGPU DEPLOYMENT

Vendor 1X GPU 2X GPU 4X GPU 8X GPU
CUDA Cores 4608 9216 18432 36864
RT Cores 72 144 288 576
Tensor Cores 576 1152 2304 4608
RTX-OPS 84T 168T 336T 672T
Rays Cast 10 Giga Rays/Sec 20 Giga Rays/Sec 40 Giga Rays/Sec 80 Giga Rays/Sec
Peak FP32 16.3 TFLOPS 32.6 TFLOPS 65.2 TOPS 130.4 TOPS
Peak FP16 32.6 TFLOPS 65.2 TFLOPS 130.4 TFLOPS 260.8 TFLOPS
Peak INT8 206.1 TOPS 412.2 TOPS 824.4 TOPS 260.8 TFLOPS
Deep Learning TFLOPS 130.5 Tensor TFLOPS 261.0 Tensor TFLOPS 522.0 Tensor TFLOPS 1044.0 Tensor TFLOPS
Board Power Consumption 295 W 590 W 1180 W 2360 W
RTX 8000 GPU Memory 48 GB 96 GB 192 GB 384 GB
RTX 6000 GPU Memory 24 GB 48 GB 96 GB 192 GB
NVLink Bandwidth 100 GB/s Bidirectional | Between 2 GPUs


THIS TABLE ILLUSTRATES RTX 8000 vGPU TYPES BY INTENDED CASE, DISPLAY INFORMATION, vGPUs SUPPORTED BY GPU AND BOARD, AND THE REQUIRED BOARD LICENSE EDITION

Virtual GPU Type Use Case GPU Memory (MB) Virtual Display Heads Maximum Resolution per Display Head Maximum vGPUs per GPU Maximum vGPUs per Board Required License Edition
RTX8000-48Q Virtual Workstations 49152 4 4096 x 2160 1 1 Quadro vDWS
RTX8000-24Q Virtual Workstations 24576 4 4096 x 2160 2 2 Quadro vDWS
RTX8000-16Q Virtual Workstations 16384 4 4096 x 2160 3 3 Quadro vDWS
RTX8000-12Q Virtual Workstations 12288 4 4096 x 2160 4 4 Quadro vDWS
RTX8000-8Q Virtual Workstations 8192 4 4096 x 2160 6 6 Quadro vDWS
RTX8000-6Q Virtual Workstations 6144 4 4096 x 2160 8 8 Quadro vDWS
RTX8000-4Q Virtual Workstations 4096 4 4096 x 2160 12 12 Quadro vDWS
RTX8000-3Q Virtual Workstations 3072 4 4096 x 2160 16 16 Quadro vDWS
RTX8000-2Q Virtual Workstations 2048 4 4096 x 2160 24 24 Quadro vDWS
RTX8000-1Q Virtual Workstations 1024 2 4096 x 2160 32 32 Quadro vDWS
RTX8000-48C Virtual Workstations 49152 1 4096 x 2160 1 1 vComputeServer or Quadro vDWS
RTX8000-24C Virtual Workstations 24576 1 4096 x 2160 2 2 vComputeServer or Quadro vDWS
RTX8000-16C Virtual Workstations 16384 1 4096 x 2160 3 3 vComputeServer or Quadro vDWS
RTX8000-12C Virtual Workstations 12288 1 4096 x 2160 4 4 vComputeServer or Quadro vDWS
RTX8000-8C Virtual Workstations 8192 1 4096 x 2160 6 6 vComputeServer or Quadro vDWS
RTX8000-6C Virtual Workstations 6144 1 4096 x 2160 8 8 vComputeServer or Quadro vDWS
RTX8000-4C Virtual Workstations 4096 1 4096 x 2160 12 12 vComputeServer or Quadro vDWS
Note Physical GPUs per board: 1 | C-series virtual GPU Types are supported only since release 9.1


THIS TABLE ILLUSTRATES RTX 6000 vGPU TYPES BY INTENDED CASE, DISPLAY INFORMATION, vGPUs SUPPORTED BY GPU AND BOARD, AND THE REQUIRED BOARD LICENSE EDITION

Virtual GPU Type Use Case GPU Memory (MB) Virtual Display Heads Maximum Resolution per Display Head Maximum vGPUs per GPU Maximum vGPUs per Board Required License Edition
RTX6000-24Q Virtual Workstations 24576 4 4096 x 2160 1 1 Quadro vDWS
RTX6000-12Q Virtual Workstations 12288 4 4096 x 2160 2 2 Quadro vDWS
RTX6000-8Q Virtual Workstations 8192 4 4096 x 2160 3 3 Quadro vDWS
RTX6000-6Q Virtual Workstations 6144 4 4096 x 2160 4 4 Quadro vDWS
RTX6000-4Q Virtual Workstations 4096 4 4096 x 2160 6 6 Quadro vDWS
RTX6000-3Q Virtual Workstations 3072 4 4096 x 2160 8 8 Quadro vDWS
RTX6000-2Q Virtual Workstations 2048 4 4096 x 2160 12 12 Quadro vDWS
RTX6000-1Q Virtual Workstations 1024 2 4096 x 2160 24 24 Quadro vDWS
RTX6000-24C Training Workloads 24576 1 4096 x 2160 1 1 vComputeServer or Quadro vDWS
RTX6000-12C Training Workloads 12288 1 4096 x 2160 2 2 vComputeServer or Quadro vDWS
RTX6000-8C Training Workloads 8192 1 4096 x 2160 3 3 vComputeServer or Quadro vDWS
RTX6000-6C Training Workloads 6144 1 4096 x 2160 4 4 vComputeServer or Quadro vDWS
RTX6000-4C Inference Workloads 4096 1 4096 x 2160 6 6 vComputeServer or Quadro vDWS
Note Physical GPUs per board: 1 | C-series virtual GPU Types are supported only since release 9.1


NVIDIA Quadro RTX 8000 and RTX 6000 powered vGPU solutions are ideal for use cases where virtual workstations are desired or required. Essential NVIDIA software includes Quadro vDWS, CUDA-X AI and OptiX. Hypervisors and other required ISV software are available from leading vendors including Microsoft, VMware and Citrix (among others). For more information on how NVIDIA Quadro RTX 8000 or RTX 6000 professional graphics boards energize and enhance vGPU deployments, contact PNY at gopny@pny.com.