Inferensys

Glossary

Memory Depth

The number of past input samples considered in a Volterra or memory polynomial model, determining the temporal span over which memory effects like thermal trapping are captured.
ML engineer managing model versions on laptop, version history visible, technical Git-like workflow.
DEFINITION

What is Memory Depth?

Memory depth defines the temporal span of a behavioral model by specifying the number of past input samples used to predict the current output, capturing the system's dynamic memory effects.

Memory depth is the parameter in a discrete-time Volterra series or memory polynomial model that defines the number of preceding input samples—the lagging envelope terms—considered when calculating the current output. It determines the temporal window over which the model captures dynamic memory effects, such as those caused by thermal trapping and bias network impedance in power amplifiers.

Selecting the optimal memory depth involves a bias-variance tradeoff: insufficient depth fails to capture long-term thermal dynamics, causing underfitting, while excessive depth introduces superfluous coefficients that model noise, leading to overfitting and computational bloat. Techniques like the Akaike Information Criterion and cross-validation are used to balance model fidelity against complexity.

DESIGN PARAMETERS

Key Factors Influencing Memory Depth Selection

Selecting the optimal memory depth for a Volterra or memory polynomial model is a critical trade-off between linearization performance and computational complexity. The following factors dictate the temporal span required to capture power amplifier memory effects.

01

Semiconductor Technology

The physical composition of the transistor dictates the severity of charge trapping and self-heating.

  • Gallium Nitride (GaN): Exhibits significant low-frequency dispersion and gate lag, often requiring deeper memory to model trapping effects.
  • LDMOS: Generally has less severe trapping but still requires modeling of thermal dynamics.
  • CMOS: Highly integrated but suffers from substrate coupling memory.
02

Signal Bandwidth

Wider signal bandwidths demand a longer temporal observation window to resolve the frequency-dependent memory.

  • Narrowband (e.g., 5 MHz): Memory effects span fewer symbol periods; shallow depth suffices.
  • Wideband (e.g., 100 MHz for 5G NR): The inverse of the bandwidth defines the time resolution, requiring more taps to cover the same physical time constant.
  • Carrier Aggregation: Multi-band signals introduce cross-modulation memory requiring extended depth.
03

Bias Network Impedance

The decoupling and matching networks create a frequency-dependent envelope impedance.

  • Low-Frequency Resonance: Baseband impedance interacts with the envelope signal, creating long-term electrical memory.
  • Video Bandwidth (VBW): The VBW of the bias circuit must be wide enough to pass the envelope frequency; insufficient VBW introduces significant memory that must be captured by the model.
  • Decoupling Capacitors: Parasitic inductances in the bias path create resonances that manifest as memory effects.
04

Thermal Time Constants

Dynamic self-heating and cooling of the transistor channel create long-term memory.

  • Junction Temperature: Fluctuates with the instantaneous dissipated power, altering gain and phase.
  • Thermal Capacitance: The thermal mass of the die and package creates low-pass filtering of the temperature response.
  • Sub-millisecond Effects: Surface heating can cause fast thermal transients.
  • Second-range Effects: Package and heat sink dynamics require very deep memory if not compensated separately.
05

Computational Complexity Budget

The number of coefficients scales linearly with memory depth in a memory polynomial, directly impacting hardware resources.

  • FPGA Resources: Deeper memory consumes more DSP slices and Block RAM for delay lines.
  • Coefficient Adaptation: The Least Squares matrix dimension grows with depth, increasing adaptation latency.
  • Real-Time Constraints: The processing latency must remain within the loop delay budget; excessive depth can violate timing closure.
06

Adjacent Channel Leakage Ratio (ACLR) Target

The required linearization performance dictates how accurately memory effects must be canceled.

  • 3GPP Compliance: Stricter ACLR targets (e.g., -45 dBc) often require deeper memory to suppress memory-induced spectral asymmetry.
  • Memoryless vs. Memory DPD: A memoryless DPD corrects AM-AM/AM-PM but leaves memory-induced distortion uncorrected.
  • Diminishing Returns: Beyond a certain depth, adding more taps yields negligible ACLR improvement while significantly increasing power consumption.
MODEL COMPLEXITY COMPARISON

Memory Depth vs. Related Modeling Parameters

Comparison of memory depth with other key parameters that govern Volterra series model complexity and performance for power amplifier behavioral modeling.

ParameterMemory DepthNonlinear OrderKernel Truncation

Definition

Number of past input samples considered in the model

Highest exponent of the input signal in Volterra terms

Maximum order of Volterra kernels retained in the model

Primary Effect

Captures temporal dispersion and thermal trapping

Captures gain compression and harmonic generation

Limits model to specific interaction orders

Typical Range

2 to 10 samples

3 to 9 (odd orders only)

1st to 5th order

Impact on Coefficient Count

Linear multiplier: O(M)

Polynomial growth: O(K)

Exponential reduction when truncated

Overfitting Risk

High when depth exceeds thermal time constants

High when order exceeds amplifier saturation region

Low; truncation reduces degrees of freedom

Selection Criterion

Akaike Information Criterion on validation set

Adjacent channel power ratio improvement

Cross-validation mean squared error

Computational Cost

Increases linearly with depth

Increases combinatorially with order

Decreases as more kernels are pruned

Relationship to Memory Depth

Self-reference

Combined with depth to define total model dimension

Higher-order kernels require proportionally less depth

MEMORY DEPTH IN POWER AMPLIFIER MODELING

Frequently Asked Questions

Addressing common questions about the role of memory depth in Volterra-based digital predistortion, its impact on model complexity, and practical selection strategies for capturing thermal and electrical memory effects in power amplifiers.

Memory depth is the number of past input samples considered in a discrete-time Volterra or memory polynomial model, defining the temporal span over which memory effects are captured. It is denoted by the parameter M and determines how many delayed versions of the input signal—x(n-1), x(n-2), ..., x(n-M)—are included in the model structure. A memory depth of M=0 reduces the model to a memoryless polynomial that only captures static AM-AM and AM-PM distortion. Increasing M allows the model to represent dynamic phenomena such as thermal trapping, bias network impedance effects, and semiconductor charge storage. The total number of coefficients in a full Volterra model grows combinatorially with both memory depth and nonlinear order K, making careful selection critical for real-time implementation.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.