Inferensys

Glossary

Secure Over-the-Air (SOTA) Update

Secure Over-the-Air (SOTA) Update is a process for remotely and securely delivering, authenticating, and installing firmware or software updates to embedded devices in the field, ensuring update integrity and preventing rollback to vulnerable versions.
Modern WeWork hardware lab area with product team collaborating around AI device prototypes, 3D printer in background, dramatic industrial lighting with product sketches on glass walls.
EMBEDDED SECURITY FOR TINYML

What is Secure Over-the-Air (SOTA) Update?

Secure Over-the-Air (SOTA) Update is a critical process for remotely and securely delivering, authenticating, and installing firmware or software updates to embedded devices in the field.

A Secure Over-the-Air (SOTA) Update is a remote firmware management protocol that uses cryptographic signatures and secure communication channels to deliver authenticated software patches to deployed microcontroller devices. Its primary function is to ensure update integrity and authenticity, preventing the installation of malicious or corrupted code. This process is fundamental for maintaining the security posture of Internet of Things (IoT) fleets by patching vulnerabilities without physical recall.

The SOTA pipeline typically involves a secure server, a hardware root of trust on the device (like a Secure Element), and lightweight cryptography for verification. It enforces anti-rollback protection to prevent devices from reverting to vulnerable versions. For TinyML systems, SOTA is essential for deploying updated machine learning models and patching inference engines, ensuring long-term device security and functionality in resource-constrained environments.

ARCHITECTURAL PRIMITIVES

Core Components of a SOTA System

A Secure Over-the-Air (SOTA) update system for microcontroller-based devices is not a single piece of software but a multi-layered architecture. These core components work in concert to ensure updates are delivered, authenticated, and installed without compromising device security or functionality.

02

Secure Bootloader

The immutable, hardware-rooted first piece of code executed on device startup. It establishes the chain of trust for the entire system. Its critical SOTA functions are:

  • Cryptographic Verification: Before jumping to the main application, it validates the digital signature of the firmware using a public key stored in secure hardware (e.g., OTP memory).
  • Boot Rollback Protection: Enforces version counters to prevent downgrading to a firmware with known vulnerabilities.
  • Recovery Mode: Provides a fallback mechanism (e.g., booting from a separate, validated recovery image) if the primary update fails, ensuring the device remains recoverable.
03

Update Client (In-Field Agent)

The software module running on the embedded device that manages the local update process. It operates within the constraints of the microcontroller and is responsible for:

  • Secure Communication: Establishing authenticated TLS/DTLS sessions with the update server.
  • Update Discovery & Download: Polling or listening for available updates and downloading the delta or full image to a staging area (often external flash).
  • Local Verification: Performing a secondary cryptographic verification of the downloaded image against the signed manifest.
  • Update Orchestration: Coordinating with the bootloader to schedule the actual firmware swap, often requiring a device reboot.
04

Cryptographic Primitives & Key Storage

The mathematical foundation for all security guarantees in a SOTA system. This component encompasses:

  • Asymmetric Cryptography (e.g., ECDSA): Used for signing update manifests and verifying them on the device. Elliptic Curve Cryptography (ECC) is preferred for its small key size.
  • Symmetric Cryptography (e.g., AES-GCM): Used for encrypting the firmware image in transit and at rest, providing confidentiality.
  • Secure Key Storage: The most critical element. Private signing keys are kept on the secure server. Public verification keys and device-unique secrets must be stored in hardware-protected storage on the MCU, such as a Secure Element, Trusted Execution Environment (TEE), or provisioned during manufacturing in One-Time-Programmable (OTP) memory.
05

Resilient Update Storage & Atomic Swaps

A hardware and software strategy to guarantee the device remains operational even if an update is interrupted (e.g., power loss). This is typically achieved through a dual-slot (A/B) firmware layout:

  • Slot A: Contains the currently running, active firmware.
  • Slot B: A reserved memory partition (often in external QSPI flash) used as the staging area for the new update.
  • Atomic Swap: The bootloader's pointer is only switched from Slot A to the verified image in Slot B after a complete and successful validation. The old image in Slot A is retained as a fallback, enabling automatic rollback on boot failure. This design ensures an uninterruptible boot process.
06

Integrity Measurement & Attestation

The mechanism that allows a remote server to cryptographically verify the software state of a device. This is crucial for compliance and intrusion detection.

  • Remote Firmware Attestation: The device generates a signed report (attestation) of its currently running firmware version and hash, often using a device-unique private key from a Hardware Security Module (HSM) or Trusted Platform Module (TPM).
  • Runtime Integrity: More advanced systems may extend attestation to critical runtime data and configurations.
  • Trusted Reporting: This allows the management console to identify compromised, tampered, or non-compliant devices in the fleet and take corrective action, such as forcing a secure re-flash.
DEFINITION

How Does a Secure Over-the-Air Update Work?

A Secure Over-the-Air (SOTA) Update is a remote process for delivering, authenticating, and installing firmware or software updates to embedded devices while ensuring update integrity, authenticity, and protection against rollback attacks.

A Secure Over-the-Air (SOTA) Update is a remote process for delivering, authenticating, and installing firmware or software updates to embedded devices while ensuring update integrity, authenticity, and protection against rollback attacks. The process begins with the update server cryptographically signing the new firmware image. This signed payload, often compressed and delivered incrementally as a delta update, is transmitted to the device over a potentially insecure network like cellular or Wi-Fi.

Upon receipt, the device's secure update client, anchored by a Hardware Root of Trust, verifies the digital signature against a trusted public key. It then authenticates the update's origin and checks its integrity before installation. Critical security measures include anti-rollback protection, which uses a monotonic counter to prevent downgrades to vulnerable versions, and often execution within a Trusted Execution Environment (TEE) to safeguard cryptographic operations. Successful installation is confirmed to the server via firmware attestation.

APPLICATION CONTEXTS

SOTA Use Cases in TinyML & IoT

Secure Over-the-Air (SOTA) updates are critical for maintaining the security and functionality of deployed microcontroller fleets. These cards detail the primary use cases where SOTA is essential for TinyML and IoT systems.

01

Security Patch Deployment

The most critical use case for SOTA is the rapid, remote deployment of security patches to fix vulnerabilities in deployed firmware. This is essential for mitigating risks like remote code execution or data exfiltration without physical device recall.

  • Example: Patching a discovered buffer overflow in a BLE stack on millions of smart locks.
  • Mechanism: A cryptographically signed delta update containing only the patched code modules is transmitted, authenticated via a hardware root of trust, and applied.
02

TinyML Model Updates

SOTA enables the iterative improvement of on-device machine learning models after deployment. New models, refined with fresh field data, can be pushed to devices to improve accuracy or adapt to data drift.

  • Example: Updating an audio event detection model on a wildlife monitoring sensor to recognize a new species call.
  • Constraint: Updates must be highly compressed (using quantization or pruning) to fit within the device's constrained flash memory and transmitted over low-bandwidth LPWAN networks like LoRaWAN.
03

Feature Rollouts & A/B Testing

SOTA allows for controlled, phased feature rollouts and A/B testing on edge device fleets. New functionalities can be enabled for a subset of devices to validate performance and stability before a full fleet-wide update.

  • Example: Testing a new energy-saving inference schedule on 10% of a fleet of agricultural soil sensors.
  • Process: Uses device grouping and rollback capabilities to safely test new features. Metrics are reported back via telemetry to inform the rollout decision.
04

Regulatory Compliance & Certification

In regulated industries (medical, automotive, industrial control), SOTA is necessary to maintain regulatory compliance and update device certifications without costly physical servicing.

  • Example: Updating a firmware-based Medical Device Data System to comply with new FDA cybersecurity guidance.
  • Requirement: The SOTA process itself must be validated and auditable, providing a complete chain of custody for the update from build server to device, often leveraging firmware attestation.
05

Bug Fixes & Performance Optimization

Beyond security, SOTA fixes functional bugs and deploys performance optimizations discovered post-deployment. This includes fixes for race conditions, memory leaks, or optimized peripheral drivers.

  • Example: Deploying a fix for a power management bug causing excessive battery drain in a wearable device.
  • Optimization Example: Pushing a new, more efficient DSP kernel for sensor signal processing that reduces CPU load by 15%.
06

Root Certificate & Key Rotation

SOTA manages the lifecycle of cryptographic materials on the device. This includes updating Certificate Authorities (CAs), root of trust certificates, and rotating device attestation keys that may expire or become compromised.

  • Critical Process: Requires a secure boot fallback mechanism and dual-image partitioning to ensure a failed key update does not brick the device.
  • Use Case: Proactively rotating elliptic curve cryptography keys across an IoT fleet in response to improved cryptanalysis.
COMPARISON MATRIX

SOTA vs. Related Update & Security Concepts

This table compares Secure Over-the-Air (SOTA) Update against other core security and update mechanisms used in embedded and TinyML systems, highlighting their primary purpose, scope, and key characteristics.

Feature / ConceptSecure Over-the-Air (SOTA) UpdateSecure BootFirmware AttestationTrusted Execution Environment (TEE)

Primary Purpose

Remotely deliver & install authenticated firmware/software updates.

Verify integrity/authenticity of bootloader & initial firmware at startup.

Remotely prove the integrity & authenticity of currently running firmware.

Provide a hardware-isolated environment for secure code execution & data handling.

Scope of Operation

Full firmware/application lifecycle management post-boot.

Initial boot sequence only (chain of trust establishment).

Runtime state verification; can be performed at any time.

Runtime isolation for specific sensitive applications & data.

Cryptographic Foundation

Authenticated encryption, digital signatures (e.g., ECDSA), hash verification.

Digital signature verification of boot images using a hardware root of trust.

Cryptographic measurement (hash) of firmware signed by a hardware root of trust.

Hardware-enforced memory isolation, secure storage, and attestation capabilities.

Update Mechanism

Delta or full image updates delivered via network, authenticated before installation.

Not an update mechanism; a verification gate for updates installed via other means (e.g., SOTA).

Not an update mechanism; a reporting mechanism for the state resulting from an update.

Not an update mechanism; can host secure applications that may be updated via SOTA.

Defends Against

Malicious update injection, man-in-the-middle attacks, rollback to vulnerable versions.

Execution of unauthorized or tampered boot-time code.

Reporting of compromised or unauthorized firmware state to a remote service.

Privileged software (OS, hypervisor) accessing sensitive code/data.

Hardware Dependency

Requires secure storage for keys, but primarily a software protocol. Enhanced by HSM/PUF.

Mandatory hardware root of trust (e.g., immutable ROM code) for initial verification.

Requires a hardware root of trust to create unforgeable measurements.

Requires specific processor extensions (e.g., ARM TrustZone, Intel SGX).

Typical Interaction

SOTA client on device communicates with remote update server.

Boot ROM verifies first-stage bootloader, which verifies next stage, establishing a chain.

Device generates a signed report (attestation) for a remote verifier.

Normal World OS calls into Secure World to execute trusted functions.

Critical for SOTA?

SECURE OVER-THE-AIR (SOTA) UPDATE

Frequently Asked Questions

Secure Over-the-Air (SOTA) Update is a critical process for remotely and securely delivering, authenticating, and installing firmware or software updates to embedded devices in the field. This FAQ addresses the core mechanisms, security requirements, and implementation challenges specific to TinyML and microcontroller-based systems.

A Secure Over-the-Air (SOTA) Update is a remote software delivery and installation process for embedded devices that cryptographically guarantees the integrity, authenticity, and often the confidentiality of the update, while preventing unauthorized rollbacks to older, potentially vulnerable firmware versions. It is a foundational component of the device lifecycle, enabling bug fixes, security patches, and feature enhancements for deployed microcontroller fleets without physical recall.

For TinyML deployment, a SOTA update pipeline must manage not just the core device firmware but also the deployed machine learning model, its associated inference engine, and any data preprocessing libraries. The process typically involves a secure server, a constrained client on the device, and a robust cryptographic protocol to transfer and validate the update payload before installation.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.