Inferensys

Glossary

Real-Time Hypervisor

A bare-metal virtualization platform engineered to host both real-time operating systems and general-purpose operating systems on shared silicon without compromising microsecond-level latency for critical tasks.
Developer building agentic RAG system, retrieval pipeline diagram on laptop, technical workspace with notes.
DETERMINISTIC VIRTUALIZATION

What is a Real-Time Hypervisor?

A real-time hypervisor is a bare-metal virtualization layer engineered to concurrently execute hard real-time operating systems (RTOS) and general-purpose operating systems (GPOS) on a single system-on-chip (SoC) while guaranteeing deterministic, microsecond-level interrupt latency for critical control tasks.

A real-time hypervisor is a Type-1 hypervisor that partitions physical hardware resources—CPU cores, cache, memory, and I/O—to enforce strict temporal and spatial isolation between virtual machines (VMs). Unlike enterprise hypervisors that prioritize average throughput, a real-time hypervisor guarantees deterministic scheduling by leveraging techniques like CPU pinning, interrupt passthrough via SR-IOV, and non-uniform memory access (NUMA) awareness to eliminate jitter for the RTOS guest, ensuring a control loop never misses its worst-case execution time (WCET) deadline.

This architecture enables mixed-criticality workload consolidation, where a safety-certified RTOS managing a robotic arm and a Linux instance running an AI inference model share the same silicon without interference. The hypervisor employs a paravirtualized device model or direct device passthrough to minimize virtualization overhead in the data path. This is foundational for software-defined manufacturing, allowing legacy IEC 61131-3 control logic to run unmodified in a Soft PLC VM alongside modern containerized edge applications, all synchronized by Precision Time Protocol (PTP) across Time-Sensitive Networking (TSN).

REAL-TIME HYPERVISOR

Core Architectural Features

A bare-metal virtualization platform engineered to host both real-time operating systems (RTOS) and general-purpose operating systems (GPOS) on shared silicon without compromising microsecond-level latency for critical tasks.

01

Bare-Metal Architecture (Type-1)

A Type-1 hypervisor installs directly onto the physical hardware without an underlying host operating system. This eliminates the overhead and jitter introduced by a general-purpose OS, granting the hypervisor direct control over CPU cores, memory, and I/O devices. By sitting at the hardware level, it enforces strict spatial and temporal isolation between virtual machines (VMs), ensuring a real-time operating system (RTOS) guest can execute deterministic control loops while a general-purpose operating system (GPOS) runs analytics or HMI workloads on adjacent cores without interference.

Type-1
Hypervisor Class
02

CPU Pinning and Cache Partitioning

To guarantee deterministic execution, the hypervisor dedicates specific physical CPU cores exclusively to a single VM through CPU pinning. This prevents the scheduler from migrating real-time threads, eliminating cache misses and translation lookaside buffer (TLB) flushes that cause non-deterministic jitter. Advanced implementations extend this with cache allocation technology (CAT) to partition the last-level cache (LLC), reserving a dedicated cache way for the RTOS. This prevents the GPOS from evicting critical control loop data, ensuring consistent memory access latency measured in single-digit microseconds.

< 10 µs
Max Scheduling Jitter
03

SR-IOV for Direct I/O Access

Single Root I/O Virtualization (SR-IOV) allows a single physical network interface card (NIC) to present itself as multiple independent virtual functions (VFs). The hypervisor assigns these VFs directly to VMs, bypassing the virtual switch in the hypervisor layer entirely. For a real-time VM communicating via EtherCAT or PROFINET IRT, this direct hardware access eliminates the latency and non-determinism of software-based packet forwarding, enabling cycle times down to 31.25 µs for motion control applications.

31.25 µs
Minimum Cycle Time
04

Temporal and Spatial Isolation

The foundational requirement for a mixed-criticality system is absolute isolation. Temporal isolation guarantees that the RTOS VM receives its allocated CPU time slice with microsecond precision, regardless of the GPOS workload. This is enforced through a strict hierarchical scheduler. Spatial isolation prevents any VM from accessing another's memory region, protecting a Safety Integrity Level (SIL) certified control function from corruption by a non-critical Linux application. This allows a single edge server to consolidate what previously required separate physical controllers.

SIL 3
Achievable Safety Level
05

Inter-VM Communication via Shared Memory

While VMs are strictly isolated, high-throughput data exchange is essential for a consolidated system. A real-time hypervisor provides a zero-copy shared memory (ivshmem) mechanism. The RTOS VM writes sensor data to a designated memory region, and the GPOS VM reads it directly without a network stack. This achieves sub-microsecond latency for data handoff, enabling a Linux-based AI inference engine to process real-time telemetry from a virtualized PLC without impacting the control loop's determinism.

< 1 µs
Inter-VM Latency
06

Live Migration for Zero-Downtime Maintenance

In high-availability architectures, a real-time hypervisor enables live migration of a running VM between two physical hosts without stopping the control application. The hypervisor iteratively copies the VM's memory state to the destination while the source continues executing. During the final cutover, the system pauses for a brief, deterministic window—often under 100 milliseconds—to transfer the remaining dirty pages and CPU state. This allows industrial operators to perform hardware maintenance or load balancing without a production line stoppage.

< 100 ms
Cutover Downtime
REAL-TIME HYPERVISOR ESSENTIALS

Frequently Asked Questions

A real-time hypervisor is a bare-metal virtualization platform engineered to host both real-time operating systems (RTOS) and general-purpose operating systems (GPOS) on shared silicon without compromising microsecond-level latency for critical tasks. Below are the most common questions from CTOs and control systems engineers evaluating this technology for industrial control system virtualization.

A real-time hypervisor is a Type-1 hypervisor specifically engineered to guarantee deterministic, bounded latency for time-critical workloads while simultaneously hosting non-real-time operating systems on the same physical hardware. Unlike a standard enterprise hypervisor such as VMware ESXi or KVM, which may introduce unpredictable scheduling jitter due to its fairness-based scheduler, a real-time hypervisor employs a strict priority-based scheduler with temporal isolation mechanisms. This ensures that a Real-Time Operating System (RTOS) virtual machine can preempt a General-Purpose Operating System (GPOS) virtual machine within a guaranteed interrupt latency window, often measured in single-digit microseconds. Key architectural differentiators include direct device assignment via Single Root I/O Virtualization (SR-IOV), CPU pinning to eliminate cache migration noise, and the ability to partition Last-Level Cache (LLC) to prevent the GPOS from evicting the RTOS's critical data. This allows a single industrial PC to consolidate a Soft PLC running a real-time control loop at a 100-microsecond cycle time alongside a Windows-based HMI and a Linux-based edge analytics container without the control loop ever missing a deadline.

REAL-TIME HYPERVISOR APPLICATIONS

Industrial Use Cases

Real-time hypervisors enable the consolidation of mixed-criticality workloads onto a single hardware platform, merging deterministic control with edge analytics. The following use cases demonstrate how this technology transforms industrial automation architectures.

01

Workload Consolidation on the Factory Floor

A real-time hypervisor allows a single industrial PC to simultaneously host a Soft PLC running a real-time operating system for motion control and a general-purpose OS for edge analytics and visualization. This eliminates the need for separate physical controllers and industrial PCs, reducing hardware footprint, cabling complexity, and energy consumption. CPU pinning and SR-IOV ensure that the control workload receives dedicated processor cores and direct I/O access, preventing the analytics workload from introducing jitter into the deterministic control loop.

60-80%
Hardware Footprint Reduction
< 10 µs
Control Jitter
02

Mixed-Criticality Safety Systems

In safety-certified environments, a real-time hypervisor enforces strict temporal and spatial isolation between a Safety Integrity Level (SIL) rated control function and non-critical monitoring tasks. The hypervisor's partitioning guarantees that a fault in the general-purpose OS cannot corrupt the memory or steal the CPU cycles of the safety function. This architecture supports IEC 61508 compliance by providing freedom from interference, allowing a certified safety controller to run alongside a Linux-based HMI on shared silicon without compromising the safety case.

SIL 3
Achievable Safety Level
100%
Spatial Isolation
03

Zero-Downtime Maintenance via Live Migration

High-availability production lines leverage live migration to move a running virtualized PLC instance from a failing or maintenance-bound physical host to a healthy standby server without stopping the control process. The real-time hypervisor preserves the exact execution state, memory contents, and network connections during the transfer. This capability enables predictive maintenance of the compute hardware itself—technicians can service or replace edge servers during production runs without incurring costly line stoppages or losing production state.

0 ms
Control Interruption
99.999%
Uptime Target
04

Virtual Commissioning with Digital Twins

Before physical deployment, a real-time hypervisor hosts the actual production PLC code in a virtual machine connected to a digital twin simulation of the manufacturing cell. This hardware-in-the-loop configuration validates control logic, timing behavior, and exception handling against a high-fidelity virtual model. Engineers can test edge cases and destructive scenarios safely, drastically reducing on-site commissioning time. The same hypervisor image used for virtual commissioning is deployed directly to the factory floor, ensuring binary-identical execution between test and production.

80%
Commissioning Time Reduction
1:1
Test-to-Production Parity
05

Deterministic Edge AI Co-location

A real-time hypervisor partitions a Neural Processing Unit (NPU) and GPU alongside dedicated CPU cores, allowing a vision inspection model running on a Linux VM to share hardware with a deterministic motion controller on an RTOS VM. The hypervisor manages accelerator resource allocation to prevent the AI inference workload from starving the control task of compute cycles. This architecture enables closed-loop quality control where a defect detected by computer vision triggers an immediate, deterministic rejection action from the PLC—all on a single edge node.

< 5 ms
Inspect-to-Actuate Latency
1
Unified Edge Node
06

Software-Defined Networking for Converged OT/IT

A real-time hypervisor hosts a Virtualized Network Function (VNF) such as a TSN-aware industrial switch or OPC UA Pub/Sub broker alongside control workloads. This enables software-defined networking on the factory floor, where traffic shaping and VLAN segmentation are configured programmatically rather than through physical rewiring. The hypervisor guarantees that Time-Sensitive Networking (TSN) schedules are enforced with microsecond precision, ensuring isochronous real-time traffic coexists with best-effort IT data on a single converged Ethernet fabric.

< 1 µs
Synchronization Accuracy
1
Converged Network Fabric
ARCHITECTURAL COMPARISON

Real-Time Hypervisor vs. Standard Hypervisor

A feature-level comparison between a real-time hypervisor engineered for deterministic industrial control and a standard Type-1 hypervisor designed for enterprise data center workloads.

FeatureReal-Time HypervisorStandard Hypervisor

Primary Design Goal

Deterministic, microsecond-latency control

High throughput and resource utilization

Interrupt Latency

< 10 µs guaranteed

50-200 µs typical, unbounded

Scheduling Policy

Strict priority-based preemptive

Fair-share, credit-based scheduler

CPU Pinning Support

Cache Partitioning

Non-Maskable Interrupt Passthrough

Typical Guest OS

RTOS (VxWorks, QNX) + GPOS (Linux, Windows)

GPOS (Linux, Windows Server)

Jitter Under Load

< 5 µs

100 µs

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.