Counterfactual Reasoning

Counterfactuals are unit-level or individual-level queries. They concern specific instances (e.g., a single patient, transaction, or system event), not just population averages. This makes them powerful for personalized explanations and recourse.

• Distinction: Contrasts with average treatment effects, which are population-level. A counterfactual explains why this specific patient had a heart attack, not the average risk factor.
• Challenge: Requires more detailed causal assumptions and data to infer properties of specific units.
• Use Case: Algorithmic recourse provides actionable recommendations to individuals (e.g., 'To get your loan approved, you would need to increase your income by $5,000').

Valid counterfactual reasoning is impossible without an underlying causal model—a formal representation of how variables influence each other. This model provides the 'laws' needed to simulate alternative scenarios.

• Model Types: Typically uses Structural Causal Models (SCMs) with structural equations and a causal graph.
• Necessity: Statistical correlations alone are insufficient; they cannot support interventions. The model encodes domain knowledge about mechanisms.
• Inference: Given the model and observed data, counterfactuals are computed, often using algorithms like the three-step process (abduction, action, prediction) within the Pearl Causal Hierarchy.

Computing a counterfactual is a three-step process where abduction is the critical first step. Before simulating a change, the system must infer the unobserved background conditions (latent variables) specific to the instance being considered.

1. Abduction: Use the observed evidence to infer the probable state of latent variables (e.g., an individual's hidden resilience or skill). This tailors the model to the unit.
2. Action: Perform the intervention (the 'do-operator') on the causal model.
3. Prediction: Simulate the new outcome in the modified model.

• This process tightly couples counterfactual reasoning with abductive reasoning and Bayesian abduction.

Useful counterfactual explanations in AI emphasize minimal and plausible changes to the factual world. A 'minimal' change alters the fewest possible features to flip the outcome. A 'plausible' change respects real-world constraints and data distributions.

• Minimality: Seeks the smallest intervention needed. This aligns with the principle of a parsimonious explanation.
• Plausibility: Ensures the suggested change could realistically occur (e.g., 'increase age by 5 years' is implausible, but 'complete a training course' is plausible).
• Optimization: In counterfactual explanation generation, this is often framed as an optimization problem balancing proximity to the original instance with achieving the desired outcome.

Do-calculus is a set of three inference rules developed by Judea Pearl for deriving causal effects from a combination of observational data and a causal graph. It enables the transition from seeing to doing.

• Primary Purpose: To compute interventional probabilities (P(y | do(x))) that predict the effect of an action.
• Relation to Counterfactuals: Provides the interventional logic that is a prerequisite for answering more complex counterfactual questions. It answers 'what if we do X?' before addressing 'what if we had done X?'
• Application: Used in causal inference to deconfound estimates and identify valid adjustment sets.

Interventional inference is the process of predicting the effects of specific actions or interventions within a causal model. It answers 'what if we do X?' questions, which concern future actions.

• Key Operator: Uses the do-operator: do(X = x) to represent forcing a variable to a value.
• Contrast with Counterfactuals: Interventional queries are about forward-looking policy. Counterfactual queries are about backward-looking explanation of a specific, already-observed instance.
• Example: 'If we increase the advertising budget (do), what will happen to sales?' vs. a counterfactual: 'Given that sales were low, what would have happened if we had increased the budget?'

A contrastive explanation directly answers a 'why P rather than Q?' question. It identifies the causal factors that made the observed event P occur instead of a contrasting, expected event Q.

• Structure: Explicitly contrasts the actual world with a close possible world.
• Link to Counterfactuals: A form of counterfactual reasoning focused on a specific, meaningful contrast. It generates a relevant counterfactual (the Q) to explain the fact (P).
• Use Case: In model interpretability: 'Why was the loan rejected rather than approved?' The explanation cites the factors that, if changed, would have led to the approved (Q) outcome.

Abductive reasoning, or inference to the best explanation, seeks the simplest and most likely cause for a set of observations. It is a primary mode of diagnostic and scientific reasoning.

• Process: From observed data, generate and rank plausible explanatory hypotheses.
• Synergy with Counterfactuals: Counterfactual reasoning is often used to test or refine abductive hypotheses. For a hypothesized cause C, one asks: 'If C had not occurred, would the effect E still have been observed?'
• Unified View: Abduction proposes 'what might have caused this?', while counterfactual analysis evaluates 'how necessary/sufficient was that cause?'