Inferensys

Glossary

Empirical Bayes

A statistical framework that estimates the prior distribution of genetic effects directly from the observed GWAS data, enabling adaptive shrinkage of effect size estimates for more robust PRS construction.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
ADAPTIVE SHRINKAGE FRAMEWORK

What is Empirical Bayes?

Empirical Bayes is a statistical framework that estimates the prior distribution of genetic effects directly from observed GWAS data, enabling adaptive shrinkage of effect size estimates for more robust PRS construction.

Empirical Bayes is a hierarchical modeling approach that treats the prior distribution of variant effect sizes as an unknown quantity to be estimated from the data itself, rather than specified subjectively. In polygenic risk score modeling, this framework leverages the massive parallel structure of GWAS summary statistics to infer the underlying genetic architecture—the distribution of true causal effects—directly from the observed association signals across millions of SNPs.

By estimating the prior empirically, methods like LDpred2 and PRS-CS apply adaptive shrinkage: variants with noisy, imprecise estimates are aggressively shrunk toward zero, while those with strong, consistent signals retain larger posterior effect sizes. This data-driven regularization corrects for the winner's curse and improves predictive accuracy in independent target samples compared to rigid clumping and thresholding approaches.

Adaptive Shrinkage

Key Features of Empirical Bayes in Genomics

Empirical Bayes provides a powerful framework for estimating the prior distribution of genetic effects directly from observed GWAS data, enabling more robust and accurate polygenic risk scores.

01

Adaptive Shrinkage of Effect Sizes

Unlike rigid thresholding methods, Empirical Bayes adaptively shrinks variant effect estimates based on the overall signal distribution. Variants with noisy, outsized effects are pulled toward zero, while robust signals are preserved. This reduces the Winner's Curse bias inherent in standard GWAS discovery, producing more realistic effect sizes for PRS construction.

02

Estimating the Prior from the Data

The core innovation is bypassing subjective prior specification. The framework treats the prior distribution of SNP effects as an unknown parameter to be estimated directly from the GWAS summary statistics. Common assumptions include:

  • A point-normal mixture: a fraction of null variants and a fraction of causal variants with effects drawn from a normal distribution.
  • A continuous shrinkage prior, such as the horseshoe or Strawderman-Berger, allowing for a flexible spectrum of effect sizes.
03

LDpred2: A Bayesian PRS Workhorse

LDpred2 is a widely adopted Empirical Bayes method for PRS. It models genetic architecture using a point-normal mixture prior and employs a Gibbs sampler to compute posterior mean effect sizes. The algorithm accounts for linkage disequilibrium (LD) by using a reference panel, effectively disentangling the causal signal from correlated neighboring variants without relying on arbitrary clumping thresholds.

04

PRS-CS: Continuous Shrinkage Priors

PRS-CS applies continuous shrinkage priors with a global-local scale parameterization. This allows each variant to have its own shrinkage factor, placing a high density near zero for null effects while maintaining heavy tails to accommodate large causal effects. The method operates directly on GWAS summary statistics and an external LD reference panel, making it computationally efficient for biobank-scale data.

05

Contrast with Clumping and Thresholding

Standard C+T methods use hard p-value cutoffs and LD-based pruning, which discards information and creates discontinuous risk profiles. Empirical Bayes provides a probabilistic alternative:

  • All variants are retained in the model.
  • Effect sizes are weighted by their posterior probability of being causal.
  • This often yields higher variance explained (R²) and better cross-ancestry portability than heuristic selection methods.
06

Modeling Genetic Architecture Complexity

Empirical Bayes flexibly accommodates diverse genetic architectures. The inferred prior hyperparameters—such as the polygenicity (fraction of causal variants) and heritability—provide direct insight into the trait's underlying biology. This contrasts with methods that assume a uniform, infinitesimal architecture, and allows the model to adapt whether a trait is highly polygenic or driven by a few large-effect loci.

METHODOLOGICAL COMPARISON

Empirical Bayes vs. Alternative PRS Methods

A feature-level comparison of Empirical Bayes approaches against standard Clumping and Thresholding and other Bayesian shrinkage methods for polygenic risk score construction.

FeatureEmpirical BayesClumping + ThresholdingFull Bayesian (MCMC)

Prior Specification

Estimated directly from GWAS summary statistics

None (hard threshold applied)

Requires explicit user-specified prior distributions

Effect Size Shrinkage

Adaptive, data-driven shrinkage

No shrinkage; variants either included or excluded

Full posterior distribution via sampling

Handles LD

Computational Speed

Minutes to hours

Seconds to minutes

Hours to days

Modeling Genetic Architecture

Infers polygenicity and effect size distribution

Assumes sparse architecture via p-value cutoff

Explicitly models mixture of causal and null variants

Uncertainty Quantification

Posterior variance available analytically

Full posterior credible intervals

Requires Individual-Level Data

Typical Predictive Accuracy Gain Over C+T

5-15% relative improvement in R²

Baseline

5-20% relative improvement in R²

EMPIRICAL BAYES IN PRS

Frequently Asked Questions

Clear, technically precise answers to the most common questions about applying Empirical Bayes frameworks to polygenic risk score modeling and genomic effect size estimation.

Empirical Bayes is a statistical framework that estimates the prior distribution of genetic effect sizes directly from the observed GWAS data, rather than specifying it subjectively. In PRS modeling, it works by treating the true effect sizes of all SNPs as random variables drawn from an unknown prior distribution. The method first estimates this prior—often a mixture of a point mass at zero and a continuous distribution for non-null effects—from the millions of marginal summary statistics. It then computes posterior mean effect sizes by applying adaptive shrinkage: variants with noisy, imprecise estimates are shrunk more aggressively toward zero, while those with strong statistical signals retain larger magnitudes. This data-driven shrinkage is the core mechanism that distinguishes Empirical Bayes methods like LDpred2 and PRS-CS from simpler clumping-and-thresholding approaches, producing more robust and portable polygenic scores.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.