Inferensys

Glossary

Log-Likelihood Ratio (LLR)

The logarithm of the ratio of probabilities that a received bit is a 1 versus a 0, used as a soft-decision input metric for modern channel decoders in MIMO receivers.
Cinematic overhead of a WeWork creative suite room with multiple curved monitors showing AI decision dashboards, executives in casual attire reviewing data, dramatic pendant lighting.
Soft-Decision Metric

What is Log-Likelihood Ratio (LLR)?

The Log-Likelihood Ratio is the fundamental soft-decision input metric for modern channel decoders, quantifying the logarithmic probability that a received bit is a 1 versus a 0.

The Log-Likelihood Ratio (LLR) is defined as the natural logarithm of the ratio of the conditional probability that a transmitted bit b is 1 given the received signal y, to the probability that b is 0 given y. This single signed value provides a soft decision, where the sign indicates the hard decision (positive for 1, negative for 0) and the magnitude represents the confidence or reliability of that decision.

In MIMO receivers, LLRs are generated by the detection algorithm—such as an MMSE or Maximum Likelihood Detection (MLD) block—and fed directly to a soft-input channel decoder like a Turbo or LDPC decoder. This interface is critical because preserving the reliability information in the LLR, rather than making premature hard bit decisions, allows the decoder to achieve significant coding gain and approach the Shannon capacity limit.

SOFT-DECISION METRICS

Key Properties of Log-Likelihood Ratios

The Log-Likelihood Ratio (LLR) is the fundamental soft-input metric for modern iterative decoders. Its algebraic properties directly determine the performance and complexity of MIMO detection algorithms.

01

Magnitude as Reliability

The absolute value of an LLR quantifies the confidence of the decision. A large positive or negative value indicates high certainty.

  • |LLR| ≈ 0: The receiver is completely uncertain; the bit is equally likely to be a 0 or a 1.
  • |LLR| → ∞: Absolute certainty. This occurs in the absence of noise or interference.
  • Sign: The sign alone provides the hard decision (positive for bit 1, negative for bit 0).

This property allows iterative decoders like Belief Propagation to weight messages appropriately, preventing uncertain bits from corrupting the convergence process.

02

Additivity for Independent Events

For statistically independent bits, the combined LLR is simply the sum of the individual LLRs.

  • LLR(b₁, b₂) = LLR(b₁) + LLR(b₂)
  • This linear property is the mathematical foundation for Factor Graph processing.
  • It allows decoders to combine intrinsic channel information with extrinsic information from other decoders without complex probability multiplications.

In MIMO-OFDM systems, this additivity enables the efficient combination of LLRs across different spatial streams and frequency subcarriers before final decoding.

03

Gaussian Channel Assumption

Under Additive White Gaussian Noise (AWGN), the LLR computation simplifies to a linear scaling of the received symbol.

  • LLR ∝ (channel_gain / noise_variance) × received_value
  • The scaling factor is the Channel State Information (CSI) divided by the noise power.
  • This linear relationship is why MMSE and Zero-Forcing receivers can generate LLRs with low computational complexity.

Deviations from this Gaussian assumption, such as non-Gaussian interference or hardware impairments, require more complex LLR computation methods.

04

Symmetry and Consistency

A correctly computed LLR satisfies the consistency condition: the sign of the LLR must match the true transmitted bit on average.

  • Symmetry: The probability density function of LLRs given bit 0 is the mirror image of the PDF given bit 1.
  • LLR = log[ P(y|b=1) / P(y|b=0) ]
  • This symmetry ensures that a decoder's decision rule is unbiased.

Violations of this property, often caused by inaccurate Channel Estimation or residual interference after Successive Interference Cancellation, lead to systematic decoding errors.

05

Max-Log Approximation

Exact LLR computation for MIMO requires summing over an exponentially large set of symbol vectors. The Max-Log approximation reduces this to a simple difference of minimum distances.

  • LLR ≈ (1/No) × [ min|y - Hs₀|² - min|y - Hs₁|² ]
  • This avoids complex exponential and logarithmic operations.
  • It is the standard approach for Maximum Likelihood Detection and Sphere Decoding implementations.

While sub-optimal, the performance loss is typically negligible at high SNR and is compensated for by applying a small scaling factor to the extrinsic LLRs.

06

Extrinsic vs. A Priori LLRs

In iterative Turbo and LDPC decoding, a strict separation between intrinsic and extrinsic information is mandatory.

  • A Priori LLR (La): Prior belief about a bit, fed into a decoder from a previous stage.
  • Extrinsic LLR (Le): The new, independent information generated by the decoder, computed as the difference between the output a posteriori LLR and the input a priori LLR.
  • Le = L_posteriori - La - L_channel

Passing the full a posteriori LLR back would create positive feedback loops and prevent convergence. This subtraction is critical for Successive Interference Cancellation loops in MIMO receivers.

LLR ESSENTIALS

Frequently Asked Questions

Clear, technically precise answers to the most common questions about log-likelihood ratios in MIMO receiver design and soft-decision decoding.

A Log-Likelihood Ratio (LLR) is the natural logarithm of the ratio of the probability that a transmitted bit was a 1 to the probability it was a 0, given the received signal. It is the fundamental soft-decision metric that quantifies the reliability of each bit estimate. For a received symbol y and a bit position b, the LLR is computed as:

code
LLR(b) = ln[ P(b=1 | y) / P(b=0 | y) ]

In a MIMO system with Gaussian noise, this expands to a computationally intensive log-sum of exponentials over all constellation points where the bit is 1 versus all points where it is 0. The sign of the LLR indicates the hard decision (positive for 1, negative for 0), while the magnitude represents the confidence of that decision. A magnitude near zero indicates a highly unreliable bit, which is critical information for modern iterative decoders like turbo and LDPC decoders.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.