Inferensys

Glossary

Hybrid MPC-HE Protocol

A privacy-preserving computation design pattern that combines the linear-operation efficiency of Homomorphic Encryption with the non-linear evaluation efficiency of Multi-Party Computation to optimize end-to-end encrypted inference latency.
Performance engineer optimizing AI latency on laptop, latency charts visible, technical optimization session.
PRIVACY-PRESERVING COMPUTATION

What is a Hybrid MPC-HE Protocol?

A design pattern combining the linear-operation efficiency of Homomorphic Encryption with the non-linear evaluation efficiency of Multi-Party Computation to optimize end-to-end encrypted inference latency.

A Hybrid MPC-HE Protocol is a cryptographic framework that strategically partitions computation between Homomorphic Encryption (HE) and Multi-Party Computation (MPC) to achieve optimal performance for privacy-preserving machine learning. The protocol leverages HE for efficient linear operations like matrix multiplications and convolutions directly on ciphertext, while delegating non-linear functions such as activation layers to an MPC protocol, avoiding the deep noise budget consumption and high latency of polynomial approximations.

This architecture addresses the core limitation of pure HE inference, where evaluating non-linearities requires costly bootstrapping or imprecise polynomial approximations. By switching to a secret-shared MPC domain for ReLU or MaxPool operations, the hybrid design minimizes the multiplicative depth of the HE circuit. The result is a protocol that achieves lower amortized latency and higher inference accuracy than either primitive alone, making it a practical solution for encrypted inference on complex neural networks.

ARCHITECTURAL PRIMITIVES

Key Features of Hybrid MPC-HE Protocols

Hybrid protocols strategically decompose computation to leverage the arithmetic efficiency of Homomorphic Encryption and the non-linear efficiency of Multi-Party Computation, minimizing end-to-end encrypted inference latency.

01

Linear vs. Non-Linear Decomposition

The protocol partitions a neural network into linear layers (convolutions, matrix multiplications) and non-linear layers (ReLU, MaxPool, Softmax).

  • HE Domain: Linear operations are executed on packed ciphertexts using SIMD operations, achieving high throughput without interaction.
  • MPC Domain: Non-linear functions are evaluated using secret-shared inputs and optimized circuits (e.g., Garbled Circuits or OT-based comparisons), avoiding costly polynomial approximations.
02

Ciphertext-to-Secret-Sharing Conversion

A critical bridging primitive that transitions data between cryptographic domains without decryption.

  • HE-to-MPC: The party holding the HE ciphertext additively secret-shares the plaintext under the encryption and distributes shares to MPC parties, who then interactively remove the HE mask.
  • MPC-to-HE: MPC parties collectively encrypt their output shares under a target public key, combining them homomorphically to produce a single ciphertext for further linear processing.
03

Input Privacy Guarantees

The hybrid model ensures the model owner's weights and the client's input remain private.

  • Client Input: Encrypted under HE and never revealed in plaintext to the model host or MPC parties.
  • Model Weights: Stored as secret shares among non-colluding MPC servers, preventing any single server from reconstructing the proprietary model.
  • Output: Only the designated recipient can decrypt the final result, typically via threshold decryption.
04

Communication-Computation Trade-off

Protocol designers balance local computation against interactive rounds.

  • HE-Heavy Designs: Minimize interaction by performing as many layers as possible under HE, switching to MPC only for deep non-linearities. This reduces bandwidth but increases local compute.
  • MPC-Heavy Designs: Switch to MPC early to leverage efficient bit-wise operations, reducing ciphertext noise management overhead but increasing communication rounds between MPC servers.
  • Optimal Hybrid: Typically places the first few linear layers in HE to compress input dimensionality before the MPC switch.
05

Adversarial Model & Trust Assumptions

Security depends on the non-collusion of distinct parties.

  • Honest-Majority MPC: Assumes a majority of MPC servers follow the protocol, enabling high-throughput secret-sharing schemes.
  • Dishonest-Majority MPC: Tolerates arbitrary corruption but incurs higher overhead; often used when the model owner operates all MPC nodes.
  • HE Assumption: Relies solely on the hardness of lattice problems (e.g., RLWE), independent of the MPC trust model.
06

Protocol Instantiations

Real-world implementations combine specific schemes.

  • Gazelle (CKKS + GMW): Uses packed CKKS for linear layers and a custom GMW-based MPC protocol for ReLU and MaxPool, optimizing for low-latency CNN inference.
  • Delphi (TFHE + ABY): Employs TFHE for initial layers and switches to the ABY framework for mixed arithmetic, boolean, and Yao-based MPC.
  • CHET (CKKS + ABY): A compiler framework that automatically partitions TensorFlow models between CKKS and ABY, optimizing the cut point for minimal latency.
HYBRID MPC-HE PROTOCOLS

Frequently Asked Questions

Clear, technically precise answers to the most common questions about combining Multi-Party Computation and Homomorphic Encryption for privacy-preserving machine learning inference.

A Hybrid MPC-HE Protocol is a cryptographic design pattern that strategically combines Multi-Party Computation (MPC) and Homomorphic Encryption (HE) to execute privacy-preserving computations more efficiently than either primitive alone. The core mechanism leverages a fundamental performance asymmetry: HE is highly efficient for linear operations like matrix multiplications and convolutions, while MPC excels at non-linear operations like ReLU, MaxPool, and division. In a typical hybrid protocol, the model owner encrypts the model weights and sends them to compute parties. The input data owner encrypts their data using HE. The compute parties then perform the linear layers of a neural network directly on the ciphertext using HE's SIMD arithmetic. When a non-linear activation function is encountered, the protocol switches to an MPC phase—often using secret sharing and lookup tables—to evaluate the function. The result is re-encrypted into HE ciphertext for the next linear layer. This alternating execution avoids the prohibitive latency of evaluating deep non-linear circuits in pure HE while eliminating the high communication overhead of performing large matrix multiplications in pure MPC. The protocol's security guarantees hold as long as the underlying HE scheme (typically CKKS or TFHE) and the MPC protocol (often based on replicated secret sharing) remain secure against the defined adversary model.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.