The condition number of a matrix is a scalar value measuring the maximum ratio of relative error in the output to relative error in the input, quantifying the sensitivity of a linear system to numerical perturbations. A problem with a low condition number is well-conditioned, meaning small input errors produce proportionally small output errors. A high condition number indicates an ill-conditioned problem where tiny input variations—such as measurement noise or floating-point rounding—are catastrophically amplified, yielding unstable or meaningless solutions.
Glossary
Condition Number

What is Condition Number?
The condition number quantifies how sensitive a mathematical function or matrix is to errors in its input, directly impacting the stability of coefficient estimation in adaptive systems.
In digital predistortion, the condition number of the autocorrelation matrix formed from the PA input signal critically determines the reliability of coefficient estimation via least squares. Ill-conditioned matrices arise from highly correlated input samples, causing coefficient drift and overfitting in direct and indirect learning architectures. Mitigation strategies include Tikhonov regularization, which adds a penalty term to artificially lower the condition number, and QR-RLS algorithms, which maintain numerical stability through orthogonal decomposition.
Key Characteristics of Condition Number
The condition number quantifies a matrix's sensitivity to perturbations, directly impacting the stability and convergence of coefficient estimation algorithms in digital predistortion systems.
Definition and Mathematical Basis
The condition number of a matrix A is defined as the product of its norm and the norm of its inverse: κ(A) = ||A|| · ||A⁻¹||. For the spectral norm, it simplifies to the ratio of the largest to smallest singular value: κ(A) = σ_max / σ_min. A condition number of 1 indicates a perfectly conditioned orthogonal matrix, while values approaching infinity signal singularity. In DPD coefficient estimation, the condition number of the data covariance matrix directly determines how much numerical noise is amplified in the solution.
Impact on Coefficient Estimation
A high condition number in the regression matrix causes ill-conditioning, where small measurement noise or quantization errors in the feedback path are dramatically amplified. This leads to:
- Coefficient drift during online adaptation
- Misadjustment in LMS-based algorithms exceeding theoretical limits
- Slow convergence in iterative solvers like RLS
- Overfitting to noise rather than the true PA nonlinearity
In practice, a condition number above 10⁴ often indicates that direct least squares estimation will produce unreliable predistorter coefficients.
Causes in DPD Systems
Several factors elevate the condition number in digital predistortion data matrices:
- Highly correlated basis functions in memory polynomial models, especially when memory depth is over-specified
- Narrowband or single-tone test signals that fail to excite all nonlinear modes, leaving the data matrix rank-deficient
- Oversampling without sufficient signal bandwidth, creating near-linear dependencies between adjacent samples
- Numerical precision limits in fixed-point FPGA implementations that compound rounding errors
Wideband signals like 5G NR with high PAPR naturally improve conditioning by providing richer excitation.
Regularization Techniques
To combat ill-conditioning, regularization adds a penalty term to the cost function:
- Tikhonov Regularization (Ridge Regression): Adds λ||w||² to the least squares objective, where λ is the regularization parameter. This effectively adds λ to the diagonal of the covariance matrix, reducing the condition number.
- Levenberg-Marquardt: Interpolates between Gauss-Newton and gradient descent, automatically adjusting damping to handle ill-conditioned Jacobians.
- Truncated SVD: Discards singular values below a threshold, directly reducing the effective condition number.
Optimal λ selection often uses cross-validation or the L-curve criterion.
Monitoring and Diagnostics
Real-time condition number monitoring serves as a health metric for DPD adaptation loops. A sudden increase may indicate:
- PA aging or thermal drift changing the nonlinear characteristic
- Feedback path degradation introducing excess noise
- Signal statistics change (e.g., traffic load drop reducing excitation)
Engineers often set a threshold (e.g., κ > 10⁶) to trigger fallback to a safe coefficient table or freeze adaptation. The condition number is computed efficiently using the QR decomposition of the data matrix, where it equals the ratio of the largest to smallest diagonal element of R.
Relationship to QR-RLS Stability
The QR-RLS algorithm is explicitly designed to handle ill-conditioned data matrices that would destabilize conventional RLS. By maintaining the Cholesky factor R of the inverse correlation matrix and updating it via Givens rotations, QR-RLS achieves numerical stability even when the condition number exceeds 10¹⁰. This makes it the preferred adaptive filtering method for DPD applications where:
- Fixed-point arithmetic is used in FPGA implementations
- Training signals may have limited spectral richness
- Long-term continuous adaptation is required without periodic reset
The computational cost of QR-RLS is higher than LMS but justified by its robustness to ill-conditioning.
Well-Conditioned vs. Ill-Conditioned Matrices in DPD
Comparative analysis of matrix properties that determine coefficient estimation stability in digital predistortion learning architectures
| Property | Well-Conditioned Matrix | Ill-Conditioned Matrix |
|---|---|---|
Condition Number κ(A) | κ ≈ 1 to 10³ | κ > 10⁶ |
Singular Value Spread | Narrow, gradual decay | Wide, rapid decay to near-zero |
Sensitivity to Input Perturbations | Low: small Δb yields small Δx | High: small Δb yields large Δx |
Coefficient Estimation Accuracy | Stable, reproducible solutions | Unstable, high variance solutions |
QR-RLS Numerical Stability | Maintains orthogonality | Loss of orthogonality risk |
Tikhonov Regularization Required | ||
Typical DPD Occurrence | Narrowband signals, low-order models | Wideband signals, high-order memory polynomials |
Convergence Behavior | Fast, monotonic convergence | Slow, oscillatory or divergent |
Frequently Asked Questions
Understanding the role of the condition number is critical for engineers implementing adaptive digital predistortion. These answers address the most common questions about numerical stability, coefficient estimation, and mitigation strategies.
The condition number is a scalar measure of a matrix's sensitivity to numerical errors during inversion, quantifying how much the solution of a linear system can change in response to small perturbations in the input data. In digital predistortion (DPD), it specifically refers to the conditioning of the autocorrelation matrix formed during least squares estimation of predistorter coefficients. A matrix with a low condition number (close to 1) is considered well-conditioned, meaning the coefficient estimation is stable and robust. A high condition number indicates an ill-conditioned matrix, where tiny measurement noise or quantization errors in the feedback path can be massively amplified, leading to wildly inaccurate or oscillating predistorter coefficients. Mathematically, it is defined as the ratio of the largest singular value to the smallest singular value of the matrix, providing a direct upper bound on the relative error magnification in the computed solution.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
Understanding the condition number is critical for diagnosing and mitigating numerical instability in adaptive predistortion coefficient estimation. The following concepts are directly linked to the behavior and consequences of ill-conditioned matrices in DPD learning architectures.
Tikhonov Regularization
A stabilization technique that adds a penalty term to the least squares cost function to solve ill-posed inverse problems caused by a high condition number. By introducing a small bias, it reduces the variance of the coefficient estimates, preventing wild oscillations in the predistorter response. This is essential for direct learning architectures where the matrix to be inverted is often ill-conditioned.
QR-RLS Algorithm
A numerically robust implementation of the Recursive Least Squares algorithm that uses QR decomposition to solve the least squares problem directly without explicitly computing the inverse of the correlation matrix. This method is inherently stable against ill-conditioned data matrices, making it a preferred choice for real-time, sample-by-sample DPD coefficient updates where numerical precision is paramount.
Coefficient Drift
The gradual deviation of predistorter coefficients from their optimal values over time. A high condition number in the data covariance matrix makes the system highly sensitive to small perturbations, such as thermal noise or quantization errors. This sensitivity accelerates coefficient drift, leading to a slow degradation of adjacent channel power ratio (ACPR) performance without any change in the physical power amplifier.
Overfitting in DPD Models
A modeling failure where the predistorter learns the specific noise characteristics of the training data rather than the true underlying PA nonlinearity. An ill-conditioned estimation problem exacerbates overfitting, as the model fits the high-frequency noise components that dominate the small singular values of the data matrix. This results in excellent training performance but poor generalization to new signal statistics.
Levenberg-Marquardt Optimization
A robust iterative algorithm that interpolates between Gauss-Newton and gradient descent to solve nonlinear least squares problems. It dynamically adjusts a damping parameter to handle the ill-conditioning of the Jacobian matrix. When the condition number is high, the algorithm behaves more like gradient descent to ensure stable convergence during coefficient estimation for complex Volterra-based predistorters.
Model Extraction Techniques
Offline methods for deriving a power amplifier behavioral model from measured input-output data. The accuracy of the extracted model is directly limited by the condition number of the measurement data matrix. Poorly designed excitation signals that do not sufficiently excite all nonlinear modes lead to an ill-conditioned problem, resulting in an unreliable model that fails to capture the true memory effects of the amplifier.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us