NVIDIA IGX ORIN

Advanced functional safety and security for edge AI.

NVIDIA IGX ORIN™ is an industrial-grade edge AI platform that combines enterprise-level hardware, software, and support. Purpose-built for industrial and medical edge computing, IGX gives organizations the performance, durability, security, and safety they need to take AI to the edge. IGX features programmable safety extensions, commercial OS support, and powerful AI software that let organizations confidently deliver AI safely and securely to support human and machine collaboration.

Key Benefits

High-performance and energy-efficient systems built for low-latency, real-time applications

Built-in functional safety extensions to deliver proactive safety in autonomous environments

End-to-end security with the latest in embedded device security, remote provisioning, and management

Long-term support for both hardware and software support to ensure product longevity

NVIDIA IGX Orin

NVIDIA IGX Orin™ delivers ultra-fast performance in the size and power envelope needed for AI at the edge. With the world's most powerful AI computer for energy-efficient autonomous machines, delivering 275 tera operations per second (TOPS) of AI performance, IGX Orin also includes an NVIDIA^® ConnectX^®-7 smart network interface card (SmartNIC) with 200 gigabits per second (Gb/s) of networking speed. A safety microcontroller unit (sMCU) built into the board makes it possible to program additional safety functions into the IGX software stack.

NVIDIA IGX Orin with NVIDIA RTX A6000
NVIDIA IGX Orin Developer Kit with a custom NVIDIA RTX^™ A6000 delivers unmatched performance for even the most demanding AI at the edge use cases needed for AI at the edge. Models with many more parameters are handled by the 48GB of GDDR6 ECC memory, Tensor Core performance leaps to 309/7 TFLOPS (INT8 is also supported), and a custom VBIOS seamlessly integrates the RTX A6000 into all of the other pre-existing IGX hardware features and capabilities, while ensuring full compatibility with the IGX software stack. ConnectX^®-7 smart network interface card (SmartNIC) with 200 gigabits per second (Gb/s) of networking speed. A safety microcontroller unit (sMCU) built into the board makes it possible to program additional safety functions into the IGX software stack.

NVIDIA IGX + Magic Leap 2 XR Bundle

By integrating Magic Leap 2 with NVIDIA IGX Orin's robust AI computing and Holoscan platform, the NVIDIA IGX + Magic Leap 2 XR Bundle gives developers a full-stack solution for developing AI-enhanced augmented reality applications for the healthcare and manufacturing industries.

Magic Leap 2 is easy to set up, scale, and manage. Customize IX and apps to suit business needs without compromising privacy or control when paired with NVIDIA IGX Orin. Magic Leap 2 Developer Pro Edition enables the development of healthcare apps for use in the OR with the Magic Leap 2 MedTech Edition, as well as apps for use in the manufacturing industry. Sensor data access is OpenXR™-based¹, enabling devs to leverage data from its camera and sensor array in their AI-optimized apps.

¹OpenXR and the OpenXR logo are trademarks of the Khronos Group Inc.

Learn More

NVIDIA IGX Orin Developer Kit

Special pricing is available to Higher Education users and NVIDIA Inception Program participants.

Hardware

NVIDIA Orin™ SoC: up to 248 TOPS CPU: 12- core Arm^® Cortex^®-A78AE v8.2

GPU: NVIDIA Ampere
2048 CUDA Cores
64 Tensor Cores

GPU: AI Performance: Up to 1705 TOPS with optional RTX 6000 Ada tensor core graphics card (Available in April)

Up to 557 TOPS with optional RTX A6000 tensor core graphics card (Available now)

NVIDIA ConnectX^®-7 smart network interface card (SmartNIC)

2x PCIe Gen4 (x16, x8)
Delivers 2x100 GbE for high speed data streaming

Chassis including cooling fan

Power supply unit

Software

Commercial OS with long term support
NVIDIA AI Enterprise software stack
NVIDIA AI software development kits (SDK): Metropolis, Holoscan, ISAAC, Rivermax
Functional Safety and AI Safety
BMC Management

Safety, Performance, and Security for the Edge

Building on lessons learned from autonomous driving, NVIDIA IGX brings powerful, safe, and secure compute, networking, and software capabilities to industrial automation and medical devices. The IGX platform includes drivers for commercial OS, a safety extension package to program safety functions on the system, and long-term enterprise support for the entire stack.

Get High Performance in Industrial-Grade Systems

NVIDIA IGX Orin™ is designed to deliver ultra-fast performance in the size and power envelope needed for the edge. Powered by the world’s most powerful AI computer for energy-efficient autonomous machines with 275 tera operations per second (TOPS) of AI performance, IGX Orin also includes an NVIDIA® ConnectX®-7 smart network interface card (SmartNIC) for precision timing and advanced security.

The platform also includes remote provisioning and management and a built-in functional safety island and safety microcontroller unit (sMCU) that can be programmed through software extensions to deliver proactive safety in autonomous environments. NVIDIA IGX is safe and secure by design.

Rely on Enterprise-Class Software and Long-Term Support

NVIDIA provides 10-year support for the IGX software stack, as well as documentation to support industrial and medical certifications. The core of the IGX stack includes a Linux board support package for the IGX hardware, drivers for supported input/output (IO) devices, NVIDIA AI inference and acceleration libraries, and reference applications. Customer-specific software components and applications can be added at the top of the IGX core stack.

IGX will also include a board management controller (BMC) and software stack for remote system management and software updates, a secure boot controller that provides external root of trust, and a dedicated safety monitor that supports a real-time operating system (RTOS) and built-in safety monitoring software.

IGX Use Cases

Industrial Medical Instrumentation Broadcast

Industrial

NVIDIA IGX transforms your factory into an intelligent space by leveraging insights from all the available sensor data. IGX empowers industrial automation to enhance workplace safety and efficiency. It excels in various applications, including:

Personal Protective Equipment (PPE) Detection: AI models can be trained to monitor and detect the appropriate use of PPE.
Barrier Breaches: AI-enabled cameras and sensors can classify objects and people to identify safety threats and trigger safety measures.
Collision Detection: AI can analyze real-time video and image data to prevent machine-human collisions.
Industrial Inspection: AI models are trained to detect, classify, and remove defective products.
Predictive Maintenance: Through data analysis of the surrounding environment, fault detection, and machine/robot performance, AI anticipates maintenance needs to prevent downtime.
Field Inspection: The combination of image recognition and processing and automated reporting makes field inspections more accurate, safe, and efficient.

Medical

Intelligent machines augment the work of doctors, nurses, and surgeons in smart hospitals, leveraging AI to enable improved patient outcomes. NVIDIA IGX delivers real-time AI at the clinical edge and positions developers to quickly take to market the next generation of AI-enabled medical devices. IGX serves a range of healthcare applications, including:

Ultrasound: AI applications can improve ultrasound accuracy through improved image optimization, analysis, and interpretation. This can help better diagnose conditions such as cancerous tumors or abnormalities during pregnancy.
Endoscopy: AI can help improve the accuracy and speed of imaging interpretation, which reduces the workload of healthcare professionals, as well as diagnosis.
Robotic Surgery: Healthcare innovators are using AI to help surgeons avoid complications by giving real-time visualization of critical physiological structures and functions, like blood flow, that can not be seen with the naked eye. Other leading companies use AI to connect surgeons remotely, so they can collaborate and produce the best possible patient outcome.

Instrumentation

AI revolutionizes device analysis through its integration into software-defined test equipment, including oscilloscopes, protocol analyzers, and signal generators. Oscilloscopes employ AI to analyze waveforms, protocol analyzers decode complex communication protocols in real time, and signal generators create stable signals for testing and calibration. With NVIDIA IGX, these tools now offer unprecedented precision and efficiency.

Device Analysis: AI increased precision and efficiency in software-defined test equipment, such as oscilloscopes, protocol analyzers, and signal generators.

Broadcast

The integration of AI technology within the broadcast media gateway represents a transformative leap in the industry's capabilities. NVIDIA IGX empowers broadcasters to achieve substantial enhancements across multiple facets of their operations. AI elevates the quality of content, whether it's in the form of high-definition video streaming or crystal-clear audio transmission. Additionally, AI-powered algorithms enable more efficient content aggregation, summarization of broadcast video, and transcoding from one video format to another.

Broadcast Media Gateway: AI can help to improve the quality, aggregation, and summarization of broadcast video, as well as transcoding from one video format to another.

IGX Features

Designed for the Edge

IGX offers durability and a compact size suitable for industrial environments with low power consumption. Designed for peak performance in industrial settings, IGX features:

Industrial-grade design, 10-year duty cycle
Lower power consumption (100W)
NVIDIA AI Enterprise support
NVIDIA-Certified OEM servers

IGX has a lower total cost of ownership and superior support. IGX offers 10-year design cycle and support. Traditional enterprise grade platforms have a much shorter life cycle -- typically 3 years or less.

IGX consumes one-quarter of the power of traditional single socket server plus discrete GPU.

Edge-Specific Software

IGX utilizes software development kits (SDKs) and frameworks to guarantee the optimization of applications for edge computing. Key features include:

NVIDIA SDKs (Metropolis, Holoscan)
Commercial OS
Functional safety package

Alternatives do not have an industry/enterprise-grade kernel and OS supported by the software vendor. Since the kernel supports GPU accelerators, it allows NVIDIA SDKs to stack on top of it, supported by NVIDIA AI Enterprise.

IGX also provides a functional safety package, which is fully supported. These are not available on alternatives.

Security

IGX provides robust security, particularly crucial for edge devices located in public areas, as they are more susceptible to both physical and cyber threats. Enhanced security features include:

Edge security features (encrypted memory, hardware root of trust, Trusted Platform Module, error-correcting code).
NVIDIA® ConnectX®-7 smart network interface card (SmartNIC) secures data in and out of the cloud.

Unlike alternatives, IGX has been built to secure data in flight, to and from the cloud, as well as at rest within storage and memory. This could be achieved utilizing discrete parts but would require significant cost and development time.

Low Latency

IGX offers lightning-fast connectivity, ensuring seamless and high-speed connections for efficiently linking devices to the cloud or a data center.

NVIDIA ConnectX-7 SmartNIC delivers 200 gigabits per second (Gb/s) of networking speed, ideal for ingesting high-data-rate sensor inputs.

To achieve the same performance, an alternative would be to acquire a ConnectX-7 SmartNIC and then ensure driver, kernel, and software stack capability. It would also need 10-year support to match IGX Orin.

Data Storage and Processing

IGX enhances compute performance by efficiently processing and storing vast volumes of data, effectively reducing latency. IGX features:

64 gigabytes (GB) embedded multimedia card (eMMC) 5.1 storage, nonvolatile memory express (NVMe), and native SATA controller.

IGX provides industrial-grade storage ideal for edge computing and AI. Alternative platforms would have to develop the same array of storage devices and ensure they were secure. This is already provided with IGX.

Distributed Computing

IGX excels in the coordination of widely dispersed edge devices, allowing them to seamlessly execute even the most intricate and demanding AI tasks. Accelerate distributed computing with:

AI performance of 248 tera operations per second (TOPS)
System on module (SOM)
2,048-core NVIDIA Ampere architecture GPU with 64 Tensor Cores
12-core Arm® Cortex®-A78AE v8.2 CPU

Orchestration

IGX provides accelerated deployment, configuration, and monitoring of edge devices and applications using NVIDIA Fleet Command™:

NVIDIA Fleet Command, the fastest and easiest way to deploy and manage AI at the edge.

Alternatives require development to ensure compatibility between the system and orchestration software providers. Compatibility and long-term support are already provided through IGX and Fleet Command.

Functional Safety

IGX guarantees the safe and dependable operation of systems, particularly as human-machine interactions continue to grow. Ensure functional safety with:

IGX Orin Functional Safety Island (FSI), safety microcontroller unit (MCU), and safety extension package.

Safety certifications are required by many highly regulated industries such as manufacturing, transportation, and medical. IGX Orin features a functional safety package, combining hardware and software to enable safety functions and meet the criteria of safety certifications.

To learn more about developing on IGX or to gain access to your developer kits, complete the NVIDIA IGX developer form below: