Inferensys

Glossary

NVIDIA Confidential Computing

A hardware and firmware security architecture that extends Trusted Execution Environment protections to GPU-accelerated workloads, enabling secure AI training and inference on protected data.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
GPU-Accelerated Trusted Execution

What is NVIDIA Confidential Computing?

A hardware and firmware security architecture that extends Trusted Execution Environment protections to GPU-accelerated workloads, enabling secure AI training and inference on protected data.

NVIDIA Confidential Computing is a hardware-based security architecture that creates a Trusted Execution Environment (TEE) for GPU-accelerated workloads, cryptographically isolating data and models during active computation from the host operating system, hypervisor, and cloud infrastructure provider.

The architecture combines NVIDIA Hopper GPUs with firmware-level attestation to establish a hardware root of trust, ensuring that sensitive AI training data and proprietary model weights remain encrypted in memory and are only decrypted inside the protected GPU enclave during processing.

HARDWARE-BACKED GPU SECURITY

Key Features of NVIDIA Confidential Computing

A hardware and firmware security architecture that extends Trusted Execution Environment protections to GPU-accelerated workloads, enabling secure AI training and inference on protected data.

01

Hardware Root of Trust

Establishes a cryptographically verifiable chain of trust from the GPU firmware to the application. NVIDIA GPUs with confidential computing capabilities integrate a hardware root of trust that validates firmware signatures before execution, ensuring the GPU boots into a known-good state. This immutable foundation underpins all subsequent attestation and encryption operations, preventing firmware tampering and supply chain attacks.

Immutable
Root of Trust
02

GPU Attestation

Enables a remote relying party to cryptographically verify the identity and integrity of the GPU before provisioning sensitive data or model weights. The GPU generates a signed attestation report containing firmware measurements, security configuration, and device identity. This report proves the GPU is genuine, running authorized firmware, and configured with the correct security properties—establishing trust before any confidential workload begins.

03

Encrypted PCIe Communication

Protects data in transit between the CPU and GPU over the PCI Express bus. All data transfers—including model weights, training data, and inference inputs—are transparently encrypted using hardware-accelerated cryptography. This prevents physical bus sniffing attacks and protects against malicious devices on the PCIe fabric, ensuring end-to-end confidentiality from the CPU's Trusted Execution Environment to the GPU.

04

Confidential Virtualization

Extends GPU protection to virtualized environments through NVIDIA's Multi-Instance GPU (MIG) technology combined with confidential computing. Each GPU partition operates as an isolated compute enclave with dedicated memory, cache, and compute resources. This enables cloud providers to offer GPU-accelerated confidential VMs where the hypervisor cannot access guest GPU memory or computation.

05

Secure Page Table Management

Implements hardware-enforced memory isolation through encrypted page tables that map GPU virtual addresses to physical memory. The GPU's memory management unit validates all access requests against these protected page tables, preventing unauthorized memory access from the host, other VMs, or compromised drivers. This ensures that confidential data remains encrypted in GPU memory and is only decrypted inside the secure compute engine.

06

Confidential AI Workloads

Enables end-to-end protection for the full AI lifecycle:

  • Confidential Training: Model weights and training data remain encrypted throughout the training process
  • Confidential Inference: User prompts and model responses are protected from the infrastructure provider
  • Federated Learning: GPU attestation ensures aggregator nodes are genuine before accepting model updates
  • Multi-Party AI: Multiple organizations can collaborate on shared models without exposing proprietary data to each other or the cloud operator
CONFIDENTIAL COMPUTING ON GPUS

Frequently Asked Questions

Clear, technical answers to the most common questions about how NVIDIA extends hardware-based trusted execution to accelerated computing, protecting data and AI models during processing.

NVIDIA Confidential Computing is a hardware and firmware security architecture that extends Trusted Execution Environment (TEE) protections to GPU-accelerated workloads. It creates a hardware-isolated, encrypted region of memory on the GPU where sensitive data and AI models can be processed without exposure to the host operating system, hypervisor, or cloud provider. The architecture works by establishing a hardware root of trust on the GPU that cryptographically attests to its identity and security posture before decrypting any protected data. During computation, all data in GPU memory—including model weights, intermediate activations, and user inputs—remains encrypted, ensuring data-in-use protection for the first time in accelerated computing. This enables secure AI training and inference on protected datasets without requiring application code modifications in many cases, supporting both bare-metal and virtualized environments through Confidential VMs that span both CPU and GPU resources.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.