Inferensys

Glossary

Least Squares (LS) Estimation

A batch coefficient extraction algorithm that minimizes the sum of squared errors between the power amplifier output and the model's prediction to solve for the optimal predistorter coefficients.
ML engineer running AI model benchmarks, performance charts on multiple screens, late night home office setup.
BATCH COEFFICIENT EXTRACTION

What is Least Squares (LS) Estimation?

The foundational mathematical optimization technique for determining the optimal predistorter coefficients by minimizing the sum of squared errors between observed and modeled data.

Least Squares (LS) Estimation is a batch coefficient extraction algorithm that determines the optimal complex-valued weights for a predistorter model by minimizing the sum of squared differences between the power amplifier's measured output and the model's predicted output. It solves the overdetermined system of linear equations y = Xw by finding the coefficient vector w that minimizes the Euclidean norm of the residual error vector.

In digital predistortion, the LS solution is computed directly via the pseudo-inverse (w = (X^H X)^{-1} X^H y), where X is the basis function matrix constructed from input signal samples and y is the observed PA output. While computationally intensive due to the matrix inversion, LS provides the optimal unbiased estimate under the assumption of white Gaussian noise, making it the gold standard for offline model extraction and the benchmark against which adaptive algorithms like Recursive Least Squares (RLS) are measured.

COEFFICIENT EXTRACTION

Key Characteristics of LS Estimation

The foundational batch algorithm for solving the linear regression problem in digital predistortion, minimizing the squared error between observed and modeled PA output.

01

The Normal Equation Solution

LS estimation solves for the optimal coefficient vector w analytically using the Normal Equation: w = (XᴴX)⁻¹Xᴴy. This computes the projection of the observed output vector y onto the column space of the basis function matrix X. The solution is guaranteed to be the global minimum of the quadratic cost function, assuming XᴴX is invertible.

02

Batch Processing Paradigm

LS estimation operates on a complete captured data block rather than sample-by-sample. This batch nature provides excellent numerical stability for offline model extraction but makes it unsuitable for real-time tracking of rapidly changing PA characteristics. Typical block sizes range from 1,000 to 10,000 samples to capture the statistical distribution of the signal.

03

Numerical Conditioning Requirements

The matrix XᴴX must be well-conditioned for stable inversion. Ill-conditioning arises from highly correlated basis functions, leading to coefficient explosion and poor generalization. Techniques to address this include:

  • Basis function orthogonalization
  • Ridge regression (adding a regularization parameter λ)
  • QR decomposition for direct solving without explicit inversion
04

Indirect Learning Architecture Application

In DPD, LS estimation is most commonly applied in the Indirect Learning Architecture (ILA). The algorithm identifies a postdistorter by swapping the input and output roles: the PA output becomes the model input, and the PA input becomes the desired response. The extracted postdistorter coefficients are then copied directly to the predistorter, assuming the PA inverse is sufficiently accurate.

05

Computational Complexity Profile

The dominant cost is the matrix inversion of XᴴX, which is an (M × M) matrix where M is the number of model coefficients. Complexity scales as O(M³) for direct inversion or O(M²) per iteration for iterative solvers. For a GMP model with 50 coefficients, this is trivial; for a full Volterra series with 500+ coefficients, it becomes a significant computational burden.

06

Relationship to QR Decomposition

For improved numerical stability, LS problems are often solved via QR decomposition rather than the Normal Equation. The basis matrix X is factored into an orthogonal matrix Q and an upper triangular matrix R. The coefficient vector is then found by back-substitution: Rw = Qᴴy. This avoids squaring the condition number, which occurs when forming XᴴX explicitly.

LS ESTIMATION

Frequently Asked Questions

Clear answers to common questions about the mathematical engine behind digital predistortion coefficient extraction.

Least Squares (LS) estimation is a batch coefficient extraction algorithm that determines the optimal predistorter coefficients by minimizing the sum of squared errors between the power amplifier's measured output and the model's predicted output. In DPD systems, LS solves the inverse modeling problem: given a matrix of basis function outputs and a vector of observed PA input signals, it computes the complex-valued coefficient vector that minimizes the Euclidean norm of the error. The solution is obtained analytically via the normal equations w = (X^H X)^{-1} X^H y, where X is the basis function matrix, y is the target signal, and w is the coefficient vector. This closed-form solution makes LS the foundational algorithm for offline model extraction and initial coefficient estimation before adaptive tracking takes over.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.