Inferensys

Glossary

Causal Fairness

An approach to defining fairness using structural causal models to distinguish between discriminatory path-specific effects and legitimate, non-discriminatory influences on a decision.
ML engineer managing model training cluster on laptop, GPU utilization visible, technical deep learning setup.
DEFINITION

What is Causal Fairness?

Causal fairness is an approach to defining and achieving algorithmic fairness using structural causal models to distinguish between discriminatory and legitimate influences on a decision.

Causal fairness is a framework for defining algorithmic fairness that uses structural causal models (SCMs) to formally distinguish between discriminatory path-specific effects and legitimate, non-discriminatory influences on a model's decision. Unlike purely statistical definitions, it reasons about the mechanisms by which a protected attribute influences an outcome, rather than merely observing correlations in the data.

A key concept is the fairness graph, which encodes assumptions about causal relationships between variables. This allows practitioners to isolate and remove the unfair causal pathways—such as the direct effect of race on a hiring decision—while preserving the influence of mediating variables that reflect genuine qualification, like education or experience. This provides a more nuanced and legally defensible standard than metrics like statistical parity.

STRUCTURAL FRAMEWORK

Key Characteristics of Causal Fairness

Causal fairness moves beyond observational parity to distinguish discriminatory pathways from legitimate influences using structural causal models.

01

Structural Causal Models (SCMs)

The mathematical foundation of causal fairness. An SCM is a triple (U, V, F) representing exogenous background variables, endogenous observed variables, and structural equations that define causal mechanisms. Unlike purely statistical approaches, SCMs encode cause-effect relationships as directed acyclic graphs, enabling the formal distinction between correlation and causation. This allows auditors to isolate the specific pathways through which a protected attribute influences a decision.

02

Path-Specific Counterfactuals

The core mechanism for causal fairness evaluation. This technique computes what a decision would have been had a protected attribute been different along only unfair causal pathways, while holding legitimate pathways constant. For example, in university admissions, an applicant's race might influence their access to test preparation resources (potentially unfair) but also their lived experience (potentially fair context). Path-specific counterfactuals isolate the discriminatory effect from the legitimate signal.

03

Resolving Simpson's Paradox

Causal fairness directly addresses statistical paradoxes that confound observational metrics. Simpson's Paradox occurs when a trend appears in several groups of data but disappears or reverses when the groups are combined. For instance, a university may show no gender bias overall, but exhibit significant bias within each department. Causal graphs explicitly model the confounding variable (department choice) and its relationship to both gender and admission, preventing misleading fairness conclusions drawn from aggregated data.

04

No Resolving Variable Criterion

A specific causal fairness test proposed by Kilbertus et al. (2017). A predictor satisfies this criterion if it does not use any descendant of the protected attribute in the causal graph that is also a proxy for that attribute. For example, if 'zip code' is a descendant of 'race' in the causal graph and serves as a proxy for it, a fair model must not use zip code in its decision function. This formalizes the legal concept of disparate impact through causal reasoning.

05

Counterfactual Fairness Definition

A rigorous definition stating that a decision is fair if it would remain the same in the closest possible world where an individual belonged to a different demographic group, given all other causally relevant factors. Formally: P(Ŷ_{A←a} = y | X=x, A=a) = P(Ŷ_{A←a'} = y | X=x, A=a). This requires computing three-step abduction-action-prediction counterfactuals, making it computationally intensive but philosophically robust for high-stakes decisions.

06

Fairness Map Visualization

A diagnostic tool for causal fairness analysis. A fairness map plots the direct, indirect, and spurious effects of a protected attribute on a decision outcome. - Direct effect: The attribute's influence not mediated by any other variable - Indirect effect: Influence through mediating variables - Spurious effect: Non-causal association due to confounding This decomposition allows governance teams to visually identify which causal channels require mitigation.

CAUSAL FAIRNESS EXPLAINED

Frequently Asked Questions

Clear, technically precise answers to the most common questions about using structural causal models to define and enforce algorithmic fairness.

Causal fairness is a framework for defining algorithmic fairness using structural causal models (SCMs) to distinguish between discriminatory and legitimate influences on a decision. Unlike statistical fairness metrics—such as demographic parity or equalized odds—which only observe correlations between predictions and protected attributes, causal fairness explicitly models the data-generating process. This allows practitioners to separate path-specific effects: a causal pathway representing the direct effect of a protected attribute (like race) on a decision is flagged as discriminatory, while an indirect pathway through a mediating variable (like job-relevant qualifications) may be deemed legitimate. The core advantage is that causal definitions avoid the fairness gerrymandering and proxy discrimination pitfalls that plague purely associational metrics, providing a more robust, context-aware definition of unjust treatment.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.