Inferensys

Glossary

Forgetting Factor

A weighting parameter in recursive algorithms like RLS that exponentially discounts older data, enabling the system to track time-varying PA characteristics in non-stationary environments.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
ADAPTIVE FILTERING PARAMETER

What is Forgetting Factor?

A weighting parameter in recursive algorithms that exponentially discounts older data, enabling the system to track time-varying characteristics in non-stationary environments.

The forgetting factor (λ) is a scalar parameter, typically between 0.95 and 1.0, used in recursive algorithms like Recursive Least Squares (RLS) to apply exponential weighting to past data. It multiplies the previous correlation matrix estimate, effectively reducing the influence of older samples on current coefficient estimation by a factor of λ at each iteration.

A smaller λ enables faster tracking of time-varying PA characteristics but increases sensitivity to noise, while a value closer to 1.0 provides better steady-state accuracy at the cost of slower adaptation. This trade-off is critical in closed-loop DPD systems where the amplifier's nonlinear behavior drifts due to thermal effects, requiring the forgetting factor to balance convergence rate against estimation variance.

ADAPTIVE WEIGHTING MECHANISM

Key Characteristics of the Forgetting Factor

The forgetting factor is a critical scalar parameter in recursive estimation algorithms that exponentially discounts the influence of older observations, enabling the system to track time-varying phenomena in non-stationary environments.

01

Exponential Weighting Mechanism

The forgetting factor, typically denoted as λ (lambda), applies an exponential decay to historical data in the cost function. Each past error sample is weighted by λ^k, where k is the sample age. This creates a sliding window with an effective memory length of approximately 1/(1-λ) samples. For example, a λ of 0.99 gives an effective memory of ~100 samples, while λ of 0.999 extends this to ~1000 samples. The exponential profile ensures smooth, gradual de-emphasis rather than abrupt truncation.

0.95–0.999
Typical Range
1/(1-λ)
Effective Memory Length
02

Tracking vs. Steady-State Trade-off

Selecting the forgetting factor involves a fundamental engineering trade-off:

  • Smaller λ (e.g., 0.95): Faster tracking of PA characteristic changes due to temperature drift or aging, but higher steady-state misadjustment and noise sensitivity.
  • Larger λ (e.g., 0.999): Lower steady-state error and better noise averaging, but sluggish response to genuine system changes. This directly parallels the learning rate trade-off in gradient-based methods, making λ a critical hyperparameter for closed-loop DPD stability.
Fast Tracking
λ → 0.95
Low Variance
λ → 0.999
04

Variable Forgetting Factor Strategies

Advanced DPD implementations employ adaptive forgetting factors that dynamically adjust λ based on system conditions:

  • Burst detection: Temporarily reduce λ when a sudden PA characteristic change is detected, then restore it for steady-state operation.
  • Signal power gating: Increase λ (or freeze adaptation entirely) during low-power or no-transmission periods to prevent noise-driven coefficient drift.
  • Gradient-based adjustment: Vary λ proportionally to the magnitude of the error signal, accelerating adaptation when distortion is high. These strategies prevent the wind-up and blow-up phenomena common in fixed-λ implementations.
05

Numerical Stability Considerations

When λ is very close to 1 (e.g., 0.9999) and the input signal has low excitation, the correlation matrix can become ill-conditioned. The repeated multiplication by λ⁻¹ in the RLS recursion amplifies rounding errors, potentially causing the inverse matrix P(k) to lose positive-definiteness. Mitigation strategies include:

  • Adding a regularization parameter δ to the initial P(0) matrix.
  • Using square-root RLS formulations based on QR decomposition for superior numerical robustness.
  • Implementing periodic re-initialization of the covariance matrix in fixed-point FPGA implementations.
QR-RLS
Preferred for FPGA
δ·I
Regularization Term
06

Relationship to Coefficient Freeze Logic

The forgetting factor works in concert with coefficient freeze mechanisms in production DPD systems. When the feedback receiver detects low signal-to-noise ratio or the PA is operating in deep back-off, the adaptation loop is frozen to prevent λ from needlessly discounting valid historical data. Upon resumption of normal operation, the forgetting factor smoothly re-engages, preventing transient spikes in distortion. This gated adaptation is essential for maintaining ACLR compliance during discontinuous transmission scenarios like TDD in 5G NR.

FORGETTING FACTOR DEEP DIVE

Frequently Asked Questions

Explore the critical role of the forgetting factor in adaptive DPD systems, covering its mathematical foundation, practical tuning, and impact on tracking non-stationary power amplifier behavior.

A forgetting factor (typically denoted as λ, lambda) is a scalar weighting parameter between 0 and 1 that exponentially discounts the influence of older data samples in recursive estimation algorithms. In the context of Recursive Least Squares (RLS) for digital predistortion, it operates by multiplying the existing inverse correlation matrix by 1/λ at each iteration, effectively assigning a weight of λ^(n-i) to a sample that is (n-i) time steps old. This creates a sliding exponential window where recent observations dominate the coefficient estimate. The effective memory of the algorithm is approximately 1/(1-λ) samples. For a system sampling at 100 MHz with λ=0.99, the algorithm's memory spans roughly 100 samples, or 1 microsecond, making it highly responsive to rapid changes in the power amplifier's nonlinear characteristics caused by thermal drift or supply voltage fluctuations.

ADAPTATION PARAMETER COMPARISON

Forgetting Factor vs. Other Adaptation Parameters

Comparison of the forgetting factor with other key parameters governing convergence, stability, and tracking in online DPD coefficient estimation algorithms.

ParameterForgetting Factor (λ)Learning Rate (μ)Regularization (δ)

Primary Role

Controls memory depth; discounts past data

Controls step size of coefficient updates

Ensures numerical stability; prevents overfitting

Algorithm Association

RLS, Weighted Least Squares

LMS, NLMS, SGD

RLS, Ridge Regression, QR-RLS

Typical Range

0.95 to 0.9999

0.001 to 0.1

10⁻⁶ to 10⁻²

Effect of Increasing Value

Longer memory; slower adaptation to PA drift

Faster convergence; higher steady-state misadjustment

Higher bias; lower variance in ill-conditioned matrices

Effect of Decreasing Value

Shorter memory; faster tracking of non-stationarity

Slower convergence; lower steady-state error floor

Lower bias; risk of numerical instability

Directly Addresses

Non-stationary PA behavior and thermal drift

Convergence rate vs. steady-state error trade-off

Ill-conditioned correlation matrix inversion

Hardware Implementation Cost

Moderate; requires recursive matrix updates

Low; scalar multiplication per tap

Low; scalar addition to diagonal elements

Failure Mode

Excessive noise sensitivity if too low; lag if too high

Divergence if too high; stall if too low

Biased estimates if too high; singular matrix if too low

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.