The forgetting factor (λ) is a scalar parameter, typically between 0.95 and 1.0, used in recursive algorithms like Recursive Least Squares (RLS) to apply exponential weighting to past data. It multiplies the previous correlation matrix estimate, effectively reducing the influence of older samples on current coefficient estimation by a factor of λ at each iteration.
Glossary
Forgetting Factor

What is Forgetting Factor?
A weighting parameter in recursive algorithms that exponentially discounts older data, enabling the system to track time-varying characteristics in non-stationary environments.
A smaller λ enables faster tracking of time-varying PA characteristics but increases sensitivity to noise, while a value closer to 1.0 provides better steady-state accuracy at the cost of slower adaptation. This trade-off is critical in closed-loop DPD systems where the amplifier's nonlinear behavior drifts due to thermal effects, requiring the forgetting factor to balance convergence rate against estimation variance.
Key Characteristics of the Forgetting Factor
The forgetting factor is a critical scalar parameter in recursive estimation algorithms that exponentially discounts the influence of older observations, enabling the system to track time-varying phenomena in non-stationary environments.
Exponential Weighting Mechanism
The forgetting factor, typically denoted as λ (lambda), applies an exponential decay to historical data in the cost function. Each past error sample is weighted by λ^k, where k is the sample age. This creates a sliding window with an effective memory length of approximately 1/(1-λ) samples. For example, a λ of 0.99 gives an effective memory of ~100 samples, while λ of 0.999 extends this to ~1000 samples. The exponential profile ensures smooth, gradual de-emphasis rather than abrupt truncation.
Tracking vs. Steady-State Trade-off
Selecting the forgetting factor involves a fundamental engineering trade-off:
- Smaller λ (e.g., 0.95): Faster tracking of PA characteristic changes due to temperature drift or aging, but higher steady-state misadjustment and noise sensitivity.
- Larger λ (e.g., 0.999): Lower steady-state error and better noise averaging, but sluggish response to genuine system changes. This directly parallels the learning rate trade-off in gradient-based methods, making λ a critical hyperparameter for closed-loop DPD stability.
Variable Forgetting Factor Strategies
Advanced DPD implementations employ adaptive forgetting factors that dynamically adjust λ based on system conditions:
- Burst detection: Temporarily reduce λ when a sudden PA characteristic change is detected, then restore it for steady-state operation.
- Signal power gating: Increase λ (or freeze adaptation entirely) during low-power or no-transmission periods to prevent noise-driven coefficient drift.
- Gradient-based adjustment: Vary λ proportionally to the magnitude of the error signal, accelerating adaptation when distortion is high. These strategies prevent the wind-up and blow-up phenomena common in fixed-λ implementations.
Numerical Stability Considerations
When λ is very close to 1 (e.g., 0.9999) and the input signal has low excitation, the correlation matrix can become ill-conditioned. The repeated multiplication by λ⁻¹ in the RLS recursion amplifies rounding errors, potentially causing the inverse matrix P(k) to lose positive-definiteness. Mitigation strategies include:
- Adding a regularization parameter δ to the initial P(0) matrix.
- Using square-root RLS formulations based on QR decomposition for superior numerical robustness.
- Implementing periodic re-initialization of the covariance matrix in fixed-point FPGA implementations.
Relationship to Coefficient Freeze Logic
The forgetting factor works in concert with coefficient freeze mechanisms in production DPD systems. When the feedback receiver detects low signal-to-noise ratio or the PA is operating in deep back-off, the adaptation loop is frozen to prevent λ from needlessly discounting valid historical data. Upon resumption of normal operation, the forgetting factor smoothly re-engages, preventing transient spikes in distortion. This gated adaptation is essential for maintaining ACLR compliance during discontinuous transmission scenarios like TDD in 5G NR.
Frequently Asked Questions
Explore the critical role of the forgetting factor in adaptive DPD systems, covering its mathematical foundation, practical tuning, and impact on tracking non-stationary power amplifier behavior.
A forgetting factor (typically denoted as λ, lambda) is a scalar weighting parameter between 0 and 1 that exponentially discounts the influence of older data samples in recursive estimation algorithms. In the context of Recursive Least Squares (RLS) for digital predistortion, it operates by multiplying the existing inverse correlation matrix by 1/λ at each iteration, effectively assigning a weight of λ^(n-i) to a sample that is (n-i) time steps old. This creates a sliding exponential window where recent observations dominate the coefficient estimate. The effective memory of the algorithm is approximately 1/(1-λ) samples. For a system sampling at 100 MHz with λ=0.99, the algorithm's memory spans roughly 100 samples, or 1 microsecond, making it highly responsive to rapid changes in the power amplifier's nonlinear characteristics caused by thermal drift or supply voltage fluctuations.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Forgetting Factor vs. Other Adaptation Parameters
Comparison of the forgetting factor with other key parameters governing convergence, stability, and tracking in online DPD coefficient estimation algorithms.
| Parameter | Forgetting Factor (λ) | Learning Rate (μ) | Regularization (δ) |
|---|---|---|---|
Primary Role | Controls memory depth; discounts past data | Controls step size of coefficient updates | Ensures numerical stability; prevents overfitting |
Algorithm Association | RLS, Weighted Least Squares | LMS, NLMS, SGD | RLS, Ridge Regression, QR-RLS |
Typical Range | 0.95 to 0.9999 | 0.001 to 0.1 | 10⁻⁶ to 10⁻² |
Effect of Increasing Value | Longer memory; slower adaptation to PA drift | Faster convergence; higher steady-state misadjustment | Higher bias; lower variance in ill-conditioned matrices |
Effect of Decreasing Value | Shorter memory; faster tracking of non-stationarity | Slower convergence; lower steady-state error floor | Lower bias; risk of numerical instability |
Directly Addresses | Non-stationary PA behavior and thermal drift | Convergence rate vs. steady-state error trade-off | Ill-conditioned correlation matrix inversion |
Hardware Implementation Cost | Moderate; requires recursive matrix updates | Low; scalar multiplication per tap | Low; scalar addition to diagonal elements |
Failure Mode | Excessive noise sensitivity if too low; lag if too high | Divergence if too high; stall if too low | Biased estimates if too high; singular matrix if too low |
Related Terms
The forgetting factor is a critical parameter within a broader ecosystem of adaptive algorithms and system identification techniques. Understanding its role requires familiarity with the core algorithms it modifies and the architectural contexts in which it operates.
Recursive Least Squares (RLS)
The canonical algorithm where the forgetting factor is most prominently applied. RLS recursively finds coefficients that minimize a weighted linear least squares cost function. The forgetting factor, typically denoted as λ (lambda), exponentially weights past errors, giving more importance to recent samples. This allows RLS to achieve an order of magnitude faster convergence than LMS-based algorithms in non-stationary environments, at the cost of O(N²) computational complexity.
Least Mean Squares (LMS)
A stochastic gradient descent algorithm that serves as the low-complexity alternative to RLS. Unlike RLS, standard LMS does not use an explicit forgetting factor; its inherent tracking ability is governed by a fixed step-size parameter (μ). However, variants like Leaky LMS introduce a leakage factor that is conceptually analogous to a forgetting factor, preventing coefficient drift in poorly conditioned scenarios. LMS is prized for its O(N) complexity and straightforward hardware implementation.
Direct Learning Architecture (DLA)
A closed-loop DPD training architecture where the forgetting factor plays a vital role in the system identification step. DLA requires an identified PA behavioral model to compute the error gradient for predistorter adaptation. When this model is estimated online using RLS, the forgetting factor enables it to track thermal memory effects and PA aging. A poorly chosen λ can cause the internal PA model to diverge from the physical device, leading to catastrophic DPD failure.
Indirect Learning Architecture (ILA)
An alternative DPD architecture that estimates predistorter coefficients by placing a copy of the predistorter in the feedback path. In ILA, the forgetting factor is applied directly to the postdistorter coefficient estimation. Because ILA assumes the PA is invertible and minimizes the error between the predistorter input and postdistorter output, the forgetting factor's role in tracking time-varying PA characteristics is identical to its role in RLS-based system identification.
Correlation Matrix & Ill-Conditioning
The forgetting factor directly influences the condition number of the correlation matrix in RLS. A smaller λ (e.g., 0.95) provides faster tracking but reduces the effective data window, potentially leading to an ill-conditioned matrix when the input signal lacks persistent excitation. This is countered by adding a regularization parameter (δ) to the diagonal of the correlation matrix during initialization. The interplay between λ and δ is critical for numerical stability on fixed-point FPGA implementations.
Convergence Rate vs. Misadjustment
The forgetting factor embodies a fundamental trade-off in adaptive systems. A value close to 1 (e.g., 0.999) averages over a long data history, yielding low steady-state misadjustment but sluggish response to PA behavioral changes. A smaller value (e.g., 0.98) provides rapid convergence to track envelope-dependent nonlinearity shifts but amplifies gradient noise. This trade-off is formally analogous to the learning rate selection problem in stochastic gradient descent.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us