Inferensys

Glossary

Causal Discovery

The data-driven process of inferring causal structures and directed dependencies directly from observational data, typically outputting a graph representing causal relationships.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
DATA-DRIVEN CAUSAL STRUCTURE LEARNING

What is Causal Discovery?

Causal discovery is the algorithmic process of inferring cause-and-effect relationships directly from observational data, typically outputting a graphical model like a Directed Acyclic Graph (DAG).

Causal discovery is the data-driven process of inferring causal structures and directed dependencies directly from observational data, typically outputting a graph representing causal relationships. Unlike pure predictive modeling, it seeks to distinguish genuine causation from mere correlation by leveraging statistical asymmetries and conditional independence tests without relying exclusively on randomized controlled trials.

Algorithms such as the PC algorithm and LiNGAM systematically search for causal skeletons by testing for conditional independence between variables, orienting edges to satisfy graphical criteria like the Markov condition. In financial markets, causal discovery helps quantitative researchers identify true drivers of asset returns, separating spurious associations from actionable causal signals in high-dimensional, non-experimental datasets.

CAUSAL DISCOVERY

Core Algorithmic Approaches

The primary families of algorithms used to infer causal structures directly from observational financial data, moving beyond correlation to map directed dependencies.

01

Constraint-Based Methods

These algorithms use conditional independence tests to prune edges between variables. They systematically test whether two variables are independent given a conditioning set of other variables. If independence is found, the edge is removed.

  • PC Algorithm: The foundational method; starts with a fully connected graph and iteratively removes edges.
  • FCI Algorithm: An extension that handles latent confounders, outputting a Partial Ancestral Graph (PAG).
  • Key Test: Often relies on Fisher's Z-test for partial correlation in Gaussian data.
  • Limitation: Sensitive to the order of testing and errors in independence tests can cascade.
PC Algorithm
Foundational Method
PAG
Output with Latent Variables
02

Score-Based Methods

These methods search over the space of possible Directed Acyclic Graphs (DAGs) and assign a score to each, optimizing for the graph that best fits the data according to a specific criterion. They treat causal discovery as a combinatorial optimization problem.

  • Greedy Equivalence Search (GES): A two-phase greedy search that adds and then removes edges to optimize a score like the Bayesian Information Criterion (BIC).
  • Scoring Functions: Common scores include BIC, Akaike Information Criterion (AIC), and Bayesian Dirichlet equivalence score.
  • Advantage: Directly optimizes for model fit, often more robust to small sample errors than constraint-based tests.
  • Challenge: The search space of DAGs grows super-exponentially, making exhaustive search infeasible.
BIC
Common Scoring Function
Super-Exponential
DAG Search Space Growth
03

Functional Causal Models (FCMs)

FCMs exploit asymmetries in the data-generating process to break Markov equivalence and identify the direction of causation. They assume the effect is a function of the cause plus independent noise.

  • LiNGAM: Assumes linear relationships and non-Gaussian noise. The non-Gaussianity allows for identifying the full causal order, not just an equivalence class.
  • Additive Noise Models (ANM): Assumes the noise is additive and independent of the cause. Tests for independence of the residual from the hypothesized cause to infer direction.
  • Post-Nonlinear Models: A more flexible class where the cause is nonlinearly transformed before adding noise, applicable to complex financial relationships.
  • Key Insight: If the model is correctly specified, these methods can distinguish X → Y from Y → X without intervention.
LiNGAM
Linear Non-Gaussian Model
ANM
Additive Noise Model
04

Hybrid Methods

Hybrid approaches combine the computational efficiency of constraint-based methods with the statistical robustness of score-based methods to achieve a better balance of speed and accuracy.

  • Max-Min Hill-Climbing (MMHC): First uses a constraint-based local discovery phase (Max-Min Parents and Children) to build a skeleton, then applies a score-based Bayesian hill-climbing search to orient edges.
  • GFCI: A hybrid that combines the GES score-based approach with the FCI constraint-based algorithm to handle latent confounders efficiently.
  • Benefit: Reduces the search space for the score-based phase, making the algorithm tractable for high-dimensional financial datasets with dozens of variables.
  • Application: Well-suited for discovering causal relationships among a large set of macroeconomic indicators and asset returns.
MMHC
Max-Min Hill-Climbing
GFCI
Handles Latent Confounders
05

Gradient-Based Discovery

A modern approach that formulates causal discovery as a continuous optimization problem over an adjacency matrix, enabling the use of powerful gradient descent techniques and GPU acceleration.

  • NOTEARS: Introduces a smooth, differentiable acyclicity constraint, transforming the combinatorial DAG search into a continuous constrained optimization problem solvable with standard optimizers like L-BFGS.
  • DAG-GNN: Uses a graph neural network to model the functional relationships and a variational autoencoder framework to learn the causal graph.
  • Advantage: Scales efficiently to thousands of variables and can be integrated with deep learning architectures for nonlinear causal discovery.
  • Financial Use Case: Discovering causal networks among hundreds of stock returns in a high-dimensional portfolio.
NOTEARS
Differentiable Acyclicity
GPU-Accelerated
Scalable to 1000s of Variables
METHODOLOGY COMPARISON

Causal Discovery vs. Related Methodologies

A feature-level comparison of data-driven causal discovery against traditional econometric causal inference and standard predictive machine learning.

FeatureCausal DiscoveryEconometric InferencePredictive ML

Primary Goal

Infer causal graph structure from data

Estimate treatment effect size

Minimize prediction error

Requires Pre-Specified DAG

Handles High-Dimensional Data

Output Type

Directed graph (adjacency matrix)

Coefficient or ATE estimate

Point forecast or classification

Assumption Framework

Causal Markov Condition, Faithfulness

Exogeneity, No Omitted Variables

IID data, Stationarity

Confounding Robustness

Detects latent confounders (FCI)

Requires IV or adjustment set

Spurious correlations retained

Typical Algorithm

PC, GES, LiNGAM

2SLS, DiD, Double ML

XGBoost, LSTM, Transformer

CAUSAL DISCOVERY

Frequently Asked Questions

Clear, technically precise answers to the most common questions about inferring causal structures directly from observational financial data.

Causal discovery is the data-driven process of inferring causal structures and directed dependencies directly from observational data, typically outputting a Directed Acyclic Graph (DAG) representing causal relationships. Unlike causal inference, which tests a pre-specified causal hypothesis (e.g., "Does X cause Y?"), causal discovery algorithms search for the entire causal graph without prior assumptions about variable ordering. In quantitative finance, this means letting the algorithm determine whether order flow causes volatility or volatility causes order flow, rather than imposing a structural model a priori. The output is a graph where nodes represent market variables and directed edges represent direct causal effects, containing no feedback loops. This distinction is critical: causal inference estimates the magnitude of a known effect, while causal discovery identifies which effects exist in the first place.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.