PNY Technologies Inc.
0

NVIDIA

Tensor Cores

Powering the AI and Deep Learning Revolution
Select NVIDIA Quadro Volta architecture, and all NVIDIA Quadro RTX™ series GPUs feature Tensor Cores, a breakthrough technology that provides unprecedented AI performance. Tensor Cores accelerate matrix operations, which are foundational to AI, and perform mixed-precision matrix multiply and accumulate calculations in a single operation. With hundreds of Tensor Cores operating in parallel in one NVIDIA Quadro GPU, this enables massive increases in throughput and efficiency.

Breakthrough

Inference Performance

NVIDIA Quadro RTX Powered by Turing Tensor Cores
NVIDIA Quadro RTX series products introduce NVIDIA Turing Tensor Core technology with multi-precision computing for the world’s most efficient AI inference. Turing Tensor Cores provide a full range of precisions for inferencing, from FP32 to FP16 to INT8, as well as INT4, to provide giant leaps in performance over NVIDIA Pascal GPUs.

Tensor Cores

NVIDIA Quadro RTX RTX

THE MOST ADVANCED

TRAINING AND INFERENCE PLATFORM

NVIDIA Quadro RTX delivers breakthrough performance for deep learning training in FP32, FP16, INT8, INT4, and binary precisions for inference. With up to 500 TeraOPS (TOPS) available (NVIDIA Quadro RTX 8000), Turing delivers the world’s highest inference efficiency at a fraction of the power consumption required by traditional CPUs. NVIDIA Quadro RTX is an ideal solution for scale-out servers at the edge, or inferencing at the edge solutions.

THE WORLD’S HIGHEST

DEEP LEARNING THROUGHPUT

NVIDIA Quadro GV100 Powered by Volta Tensor Cores
Designed specifically for deep learning, the first-generation Tensor Cores in Volta deliver groundbreaking performance with mixed-precision matrix multiply in FP16 and FP32 – up to 12x higher peak teraflops (TFLOPS) for training and 6x higher peak TFLOPS for interence over prior-generation NVIDIA Pascal offerings. This key capability enables Volta to deliver 3x perforance speedups in training and inference over Pascal.

Each of NVIDIA Quadro GV100’s 640 Tensor Cores operates on a 4 x 4 matrix, and their associated data paths are custom-designed to power the world’s fastest floating point compute throughput with high-energy efficiency.

Tensor Cores

A BREAKTHROUGH IN

TRAINING AND INFERENCE

For interence, NVIDIA Quadro GV100 also achieves more than a 3x performance advantage versus the previous generation and is 47x faster than a CPU-based server. Using the NVIDIA Tensor RT Programmable Inference Accelerator, these speedups are due in large part to Tensor Cores accelerating inference work using mixed precision.

Volta is equipped with 640 Tensor Cores, each performing 64 floating-point fused-multiply-add (FMA) operations per clock. That delivers up to 125 TFLOPS for training and inference applications. This means that developers can run deep learning training using a mixed precision of FP16 compute with FP32 accumulate, achieving both a 3x speedup over the previous generation and rapid convergence to a deep neural network’s expected accuracy levels.

This 3x speedup in performance is a key breakthrough of Tensor Core technology. Now, deep learning can appen in mere hours.

Digital Signage
NVIDIA RTX A6000
NVIDIA Quadro RTX 6000
NVIDIA Quadro RTX 5000
NVIDIA Quadro RTX 4000
NVIDIA Quadro GV100
Technologies
NVIDIA RTX Ampere Architecture-Based
NVIDIA Quadro Turing
NVIDIA Quadro Volta
NVIDIA Quadro Pascal™
Tensor Cores
Resources
Data Center Blogs
GPU-Ready App Quick Start Guides
GPU Apps Catalog
Close