NVIDIA H100 NVL

NVIDIA H100 NVL

Unprecedented Performance, Scalability, and Security for Every Data Center

H100 NVL is designed to scale support of Large Language Models in mainstream PCIe-based server systems. With increased raw performance, bigger, faster HBM3 memory and NVLink connectivity via bridges, mainstream systems configured with 8x H100 NVL outperform HGX A100 systems by up to 12X on GPT3-175B LLM throughput.

H100 NVL enables standard mainstream servers to provide high-performance large language model generative AI inference while enabling partners and solution providers the fastest time to market and ease of scale out.