Inferensys

Glossary

Post-Distortion Error

The residual nonlinear distortion measured after applying a predistorter, calculated as the difference between the ideal linear output and the actual amplifier output.
Stylish WeWork-like workspace with hot desks and document wall, professional searching through enterprise knowledge base on a mounted ultrawide display, warm industrial pendants overhead.
RESIDUAL NONLINEARITY METRIC

What is Post-Distortion Error?

The fundamental metric for quantifying the effectiveness of a digital predistortion linearization system.

Post-distortion error is the residual nonlinear distortion signal remaining after a digital predistorter (DPD) has been applied to a power amplifier (PA), calculated as the complex difference between the desired ideal linear output and the actual measured amplifier output. It serves as the primary cost function minimized during coefficient estimation and the definitive metric for validating linearization performance.

Minimizing this error directly reduces spectral regrowth and improves error vector magnitude (EVM). In an indirect learning architecture, the post-distortion error drives the adaptation of the post-distorter model, which is then copied to the predistorter. Persistent post-distortion error indicates model deficiencies, such as underfitting, ill-conditioning during extraction, or uncompensated thermal memory effects.

RESIDUAL NONLINEARITY METRICS

Key Characteristics of Post-Distortion Error

The post-distortion error is the critical feedback signal that quantifies the effectiveness of a digital predistortion (DPD) system. It represents the uncorrected nonlinear artifacts remaining at the power amplifier output after linearization.

01

Definition and Mathematical Formulation

Post-distortion error is the complex-valued difference between the desired ideal linear output and the actual measured amplifier output after predistortion is applied. Mathematically, it is expressed as e(n) = y_ideal(n) - y_measured(n), where y_ideal(n) is the linearly scaled input signal and y_measured(n) is the captured PA output. This error vector is the primary cost function minimized by adaptive DPD algorithms like the Indirect Learning Architecture and Direct Learning Architecture.

02

Spectral Interpretation: Residual Regrowth

In the frequency domain, post-distortion error manifests as residual spectral regrowth in adjacent channels. While a perfect DPD would eliminate all out-of-band emissions, practical systems leave a measurable error floor. Key metrics include:

  • Adjacent Channel Leakage Ratio (ACLR) improvement limits
  • Residual spurious emissions in the transmit noise floor
  • In-band error vector magnitude (EVM) degradation This residual spectrum is the ultimate indicator of linearization quality for regulatory compliance.
03

Time-Domain Error Characteristics

The instantaneous error signal exhibits distinct temporal patterns tied to amplifier physics. Peak error events typically coincide with signal envelope peaks where the PA is driven deep into compression. Memory effects cause error persistence that spans multiple samples, visible as temporal correlation in the error sequence. Analyzing the amplitude-to-amplitude modulation (AM/AM) and amplitude-to-phase modulation (AM/PM) characteristics of the residual error reveals whether the DPD model order is sufficient to capture the PA's nonlinear dynamics.

04

Convergence Monitoring in Adaptive Systems

Post-distortion error serves as the real-time feedback mechanism for adaptive DPD coefficient updates. In Least Mean Squares (LMS) and Recursive Least Squares (RLS) algorithms, the error directly drives coefficient adjustment. Key monitoring behaviors include:

  • Monotonic error power decrease during initial convergence
  • Steady-state error floor indicating the best achievable linearization
  • Error divergence signaling model instability or PA characteristic drift Tracking the error power over time is essential for robust field deployment.
05

Error Sources and Decomposition

Not all post-distortion error originates from PA nonlinearity alone. A comprehensive error budget includes:

  • Modeling residual: Error from insufficient DPD model complexity or order
  • Estimation noise: Coefficient inaccuracies from noisy observation receivers
  • Time misalignment: Residual error from imperfect loop delay estimation
  • IQ impairments: Uncorrected IQ imbalance in the modulator or demodulator
  • Quantization noise: Finite precision effects in the digital predistortion path Isolating these components is critical for targeted system improvement.
06

Normalized Mean Squared Error (NMSE)

NMSE is the standard scalar metric for quantifying post-distortion error magnitude. It normalizes the mean squared error by the reference signal power, expressed in dB. Typical DPD systems target NMSE values below -35 dB to -45 dB for wideband signals. NMSE correlates strongly with ACLR improvement and EVM performance. It is computed over a validation dataset distinct from training data to assess generalization and detect overfitting in the extracted behavioral model.

ERROR METRIC COMPARISON

Post-Distortion Error vs. Related Error Metrics

Comparison of post-distortion error with other key error metrics used in digital predistortion linearization and power amplifier behavioral modeling.

FeaturePost-Distortion ErrorNormalized Mean Squared Error (NMSE)Adjacent Channel Leakage Ratio (ACLR)

Definition

Residual nonlinear distortion measured after applying a predistorter, calculated as the difference between the ideal linear output and the actual amplifier output

Time-domain error between modeled and measured signals normalized by the signal power, expressed in dB

Ratio of power in adjacent frequency channels to power in the main channel, measured in dBc

Domain

Time-domain

Time-domain

Frequency-domain

Primary Use Case

Validating predistorter correction effectiveness and quantifying residual nonlinearity

Evaluating behavioral model accuracy during extraction and validation

Regulatory compliance testing and quantifying spectral regrowth

Typical Target Value

< -50 dBc for commercial base stations

< -40 dB for high-fidelity models

< -45 dBc for 3GPP compliance

Sensitivity to Time Alignment

High

High

Moderate

Captures Memory Effects

Directly Measures Linearization Performance

Computational Complexity

Low

Low

Moderate

POST-DISTORTION ERROR

Frequently Asked Questions

Clarifying the residual nonlinear distortion that remains after digital predistortion is applied, and how it is quantified to validate linearization performance.

Post-distortion error is the residual nonlinear distortion measured at the output of a power amplifier after a digital predistorter has been applied, calculated as the complex difference between the desired ideal linear output signal and the actual measured amplifier output. It represents the uncorrected distortion that the predistorter failed to compensate, serving as the primary cost function minimized during coefficient estimation. Mathematically, it is expressed as e(n) = y_ideal(n) - y_measured(n), where y_ideal is the linearly scaled input and y_measured is the captured PA output. This error signal drives adaptation in both Direct Learning Architecture and Indirect Learning Architecture implementations.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.