The Wilcoxon Rank Sum Test, also known as the Mann-Whitney U test, is a non-parametric statistical hypothesis test that evaluates whether two independent samples were drawn from populations with the same continuous distribution. Unlike the t-test, it does not assume a Gaussian distribution of the data, making it robust for analyzing highly skewed or zero-inflated single-cell RNA-seq expression values.
Glossary
Wilcoxon Rank Sum Test

What is Wilcoxon Rank Sum Test?
A non-parametric hypothesis test used to determine if two independent samples originate from populations with the same distribution, without assuming normality.
The test works by pooling all observations from both groups, ranking them from smallest to largest, and then comparing the sum of ranks between the two conditions. A significant result indicates a stochastic dominance shift in the distribution, often interpreted as a difference in median expression. In differential expression analysis, it is frequently used as a default method in tools like Seurat to identify marker genes without relying on parametric assumptions about count distributions.
Wilcoxon Rank Sum vs. Parametric Tests
Key distinctions between the non-parametric Wilcoxon Rank Sum Test and parametric alternatives like the t-test in differential expression analysis contexts.
| Feature | Wilcoxon Rank Sum | t-test | DESeq2 Wald Test |
|---|---|---|---|
Data distribution assumption | None (distribution-free) | Normal (Gaussian) | Negative Binomial |
Input data type | Ranks or continuous values | Continuous (log-normalized) | Raw integer counts |
Handles overdispersion | |||
Robust to outliers | |||
Statistical power with small n | Lower than parametric | High if normality holds | Moderate (borrows via shrinkage) |
Typical single-cell application | Pseudobulk or default Seurat method | Rarely used directly | Pseudobulk aggregation |
Primary output | U statistic and p-value | t statistic and p-value | Log2 fold change and adjusted p-value |
Effect size metric | Rank-biserial correlation | Cohen's d | Shrunken log2 fold change |
Key Statistical Properties
The Wilcoxon Rank Sum Test (Mann-Whitney U Test) is a non-parametric alternative to the two-sample t-test, evaluating whether two independent samples originate from the same population by comparing the ranks of observations rather than their raw values.
Rank-Based Null Hypothesis
The test evaluates the stochastic equality between two groups. The null hypothesis (H₀) states that a randomly selected value from population A has an equal probability of being greater or less than a randomly selected value from population B. Formally: P(X > Y) = P(Y > X). This is distinct from testing equality of medians unless the distributions are identical in shape. Rejecting H₀ indicates one group tends to produce larger values—a concept known as stochastic dominance.
Distribution-Free Assumptions
Unlike parametric tests, the Wilcoxon test does not assume a specific data distribution (e.g., normality). The core assumptions are:
- Independence: Observations within and between groups are independent.
- Ordinal Scale: The variable is continuous or at least ordinal, allowing meaningful ranking.
- Shape: For testing medians specifically, the two distributions must have the same shape and variance. Without this, the test remains valid for stochastic dominance but not for median shift. This robustness makes it a default choice in single-cell RNA-seq where zero-inflated negative binomial data violates normality assumptions.
U-Statistic Calculation
The test statistic U quantifies the degree of separation between groups. The procedure:
- Pool and Rank: Combine all N = n₁ + n₂ observations and assign ranks from 1 to N, handling ties with mid-ranks.
- Sum Ranks: Calculate R₁, the sum of ranks for group 1.
- Compute U₁: U₁ = R₁ - n₁(n₁ + 1) / 2. The smaller of U₁ and U₂ is compared against a critical value. For large samples, a z-approximation using the mean and variance of U under H₀ provides the p-value. The effect size is often reported as the rank-biserial correlation.
Handling Ties in Genomic Data
High-throughput expression data frequently contains ties—identical values across conditions, especially for lowly expressed or undetected genes. The standard Wilcoxon test adjusts the variance of the U statistic downward to account for ties, preventing an inflated Type I error rate. The correction factor involves:
- tⱼ: The number of observations tied at rank j.
- Variance Adjustment: Var(U) is reduced by a term proportional to Σ(tⱼ³ - tⱼ). In extreme cases with massive zero-inflation, specialized methods like the two-part hurdle model or the Wilcoxon test on the positive counts only may be more appropriate.
Application in Single-Cell Differential Expression
In single-cell analysis, the Wilcoxon Rank Sum Test is a popular default method in tools like Seurat (FindMarkers function). Its advantages in this context:
- Robustness to Outliers: Ranks limit the influence of extreme expression values.
- Zero-Inflation Tolerance: Does not assume a parametric count distribution.
- Computational Speed: Rank-based calculations are fast for large cell-by-gene matrices. However, it treats each cell as an independent replicate, potentially inflating significance in pseudoreplication scenarios. The pseudobulk approach aggregates cells by sample first, then applies the test, to address this.
Effect Size: Rank-Biserial Correlation
Statistical significance alone is insufficient for biomarker selection; effect size quantifies the magnitude of difference. The rank-biserial correlation (r) is the recommended effect size for the Wilcoxon test:
- Formula: r = 1 - (2U) / (n₁n₂)
- Interpretation: r ranges from -1 to +1, where 0 indicates complete overlap and ±1 indicates perfect separation. Benchmarks: small (|r| ≈ 0.1), medium (|r| ≈ 0.3), large (|r| ≈ 0.5).
- Relationship to AUC: r is mathematically equivalent to 2 × AUC - 1, where AUC is the area under the receiver operating characteristic curve, directly linking it to classifier performance.
Frequently Asked Questions
Clear, technically precise answers to the most common questions about applying the Wilcoxon Rank Sum Test in single-cell differential expression and biomarker discovery workflows.
The Wilcoxon Rank Sum Test, also known as the Mann-Whitney U test, is a non-parametric statistical hypothesis test that determines whether two independent samples originate from populations with the same distribution. It works by pooling all observations from both groups, ranking them from smallest to largest, and then comparing the sum of ranks between the groups. Unlike parametric alternatives such as the t-test, it does not assume a normal distribution of the data, making it robust for the zero-inflated and overdispersed count distributions typical in single-cell RNA-seq experiments. The null hypothesis states that a randomly selected value from one population is equally likely to be greater or less than a randomly selected value from the other population. The test statistic U is calculated based on rank sums, and a p-value is derived to assess statistical significance.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
Core concepts and comparative methods essential for understanding the application and interpretation of the Wilcoxon Rank Sum Test in differential gene expression analysis.
Non-Parametric vs. Parametric Tests
The fundamental distinction driving test selection in genomics:
- Parametric tests (e.g., t-test, ANOVA) assume data are drawn from a specific distribution, typically a normal distribution, and estimate population parameters like the mean and variance.
- Non-parametric tests (e.g., Wilcoxon Rank Sum) operate on ranked data and test hypotheses about the distribution's shape or location without distributional assumptions.
- Key advantage: The Wilcoxon test is robust to outliers and heavy-tailed distributions common in single-cell RNA-seq data, where a few cells may exhibit extreme expression values.
- Trade-off: When data are truly normal, parametric tests have slightly higher statistical power.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us