Inferensys

Glossary

Individual Fairness

Individual fairness is a machine learning constraint requiring that a model produces similar predictions for similar individuals, as defined by a task-specific distance metric.
ML engineer managing model training cluster on laptop, GPU utilization visible, technical deep learning setup.
DEFINITION

What is Individual Fairness?

Individual fairness is a principle in algorithmic ethics requiring that a model produces similar predictions for similar individuals, as measured by a task-specific distance metric.

Individual fairness is a fairness criterion formalized by Dwork et al. that mandates a model treat any two individuals who are similar with respect to a specific task similarly. Unlike group fairness, which compares statistical parity across protected groups, this approach operates at the instance level, requiring a Lipschitz condition where the distance between predictions is bounded by the distance between inputs.

The core challenge lies in defining the appropriate task-specific similarity metric. This metric must capture the ground truth of what makes two individuals equivalent for the decision at hand, often requiring domain expertise. A closely related causal implementation is counterfactual fairness, which compares an individual's prediction to their prediction in a counterfactual world where only a sensitive attribute was altered.

THE DUDLEY PRINCIPLE

Key Characteristics of Individual Fairness

Individual fairness formalizes the ethical intuition that a model should treat similar individuals similarly, as defined by a task-specific metric. This principle, distinct from group fairness, focuses on the consistent treatment of every single person relative to their peers.

FAIRNESS PARADIGM COMPARISON

Individual Fairness vs. Group Fairness

A technical comparison of the two primary philosophical and mathematical frameworks for defining and enforcing algorithmic fairness in machine learning systems.

FeatureIndividual FairnessGroup Fairness

Core Principle

Similar individuals receive similar predictions

Protected groups receive equal statistical outcomes

Formal Definition

D(f(x_i), f(x_j)) ≤ d(x_i, x_j)

P(ŷ=1|A=a) = P(ŷ=1|A=b)

Granularity

Instance-level (pairwise)

Aggregate-level (cohort)

Requires Sensitive Attributes

Primary Metric

Lipschitz continuity constraint

Demographic parity, equalized odds

Handles Intersectionality

Counterfactual Link

Direct: compares individual to counterfactual self

Indirect: compares group-level counterfactual distributions

Data Requirement

Task-specific similarity metric

Labeled sensitive attribute data

INDIVIDUAL FAIRNESS

Frequently Asked Questions

Explore the core concepts of individual fairness, a principle ensuring that machine learning models treat similar individuals similarly, often operationalized through counterfactual logic.

Individual fairness is a foundational principle in algorithmic fairness that requires a model to produce similar predictions for individuals who are similar with respect to a specific task. Unlike group fairness, which compares statistical metrics across protected demographic groups, individual fairness operates at the instance level. It is formally defined by the Lipschitz condition: for any two individuals x and y, the difference in their predictions should be bounded by their distance according to a task-specific similarity metric d(x, y). This ensures that two applicants with nearly identical qualifications receive nearly identical credit decisions, regardless of their group membership. The primary challenge lies in defining the correct similarity metric that captures the ground truth of 'sameness' for the specific business context, often requiring domain expertise and causal reasoning.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.