Causal discovery is the data-driven process of inferring causal structures and directed dependencies directly from observational data, typically outputting a graph representing causal relationships. Unlike pure predictive modeling, it seeks to distinguish genuine causation from mere correlation by leveraging statistical asymmetries and conditional independence tests without relying exclusively on randomized controlled trials.
Glossary
Causal Discovery

What is Causal Discovery?
Causal discovery is the algorithmic process of inferring cause-and-effect relationships directly from observational data, typically outputting a graphical model like a Directed Acyclic Graph (DAG).
Algorithms such as the PC algorithm and LiNGAM systematically search for causal skeletons by testing for conditional independence between variables, orienting edges to satisfy graphical criteria like the Markov condition. In financial markets, causal discovery helps quantitative researchers identify true drivers of asset returns, separating spurious associations from actionable causal signals in high-dimensional, non-experimental datasets.
Core Algorithmic Approaches
The primary families of algorithms used to infer causal structures directly from observational financial data, moving beyond correlation to map directed dependencies.
Constraint-Based Methods
These algorithms use conditional independence tests to prune edges between variables. They systematically test whether two variables are independent given a conditioning set of other variables. If independence is found, the edge is removed.
- PC Algorithm: The foundational method; starts with a fully connected graph and iteratively removes edges.
- FCI Algorithm: An extension that handles latent confounders, outputting a Partial Ancestral Graph (PAG).
- Key Test: Often relies on Fisher's Z-test for partial correlation in Gaussian data.
- Limitation: Sensitive to the order of testing and errors in independence tests can cascade.
Score-Based Methods
These methods search over the space of possible Directed Acyclic Graphs (DAGs) and assign a score to each, optimizing for the graph that best fits the data according to a specific criterion. They treat causal discovery as a combinatorial optimization problem.
- Greedy Equivalence Search (GES): A two-phase greedy search that adds and then removes edges to optimize a score like the Bayesian Information Criterion (BIC).
- Scoring Functions: Common scores include BIC, Akaike Information Criterion (AIC), and Bayesian Dirichlet equivalence score.
- Advantage: Directly optimizes for model fit, often more robust to small sample errors than constraint-based tests.
- Challenge: The search space of DAGs grows super-exponentially, making exhaustive search infeasible.
Functional Causal Models (FCMs)
FCMs exploit asymmetries in the data-generating process to break Markov equivalence and identify the direction of causation. They assume the effect is a function of the cause plus independent noise.
- LiNGAM: Assumes linear relationships and non-Gaussian noise. The non-Gaussianity allows for identifying the full causal order, not just an equivalence class.
- Additive Noise Models (ANM): Assumes the noise is additive and independent of the cause. Tests for independence of the residual from the hypothesized cause to infer direction.
- Post-Nonlinear Models: A more flexible class where the cause is nonlinearly transformed before adding noise, applicable to complex financial relationships.
- Key Insight: If the model is correctly specified, these methods can distinguish
X → YfromY → Xwithout intervention.
Hybrid Methods
Hybrid approaches combine the computational efficiency of constraint-based methods with the statistical robustness of score-based methods to achieve a better balance of speed and accuracy.
- Max-Min Hill-Climbing (MMHC): First uses a constraint-based local discovery phase (Max-Min Parents and Children) to build a skeleton, then applies a score-based Bayesian hill-climbing search to orient edges.
- GFCI: A hybrid that combines the GES score-based approach with the FCI constraint-based algorithm to handle latent confounders efficiently.
- Benefit: Reduces the search space for the score-based phase, making the algorithm tractable for high-dimensional financial datasets with dozens of variables.
- Application: Well-suited for discovering causal relationships among a large set of macroeconomic indicators and asset returns.
Gradient-Based Discovery
A modern approach that formulates causal discovery as a continuous optimization problem over an adjacency matrix, enabling the use of powerful gradient descent techniques and GPU acceleration.
- NOTEARS: Introduces a smooth, differentiable acyclicity constraint, transforming the combinatorial DAG search into a continuous constrained optimization problem solvable with standard optimizers like L-BFGS.
- DAG-GNN: Uses a graph neural network to model the functional relationships and a variational autoencoder framework to learn the causal graph.
- Advantage: Scales efficiently to thousands of variables and can be integrated with deep learning architectures for nonlinear causal discovery.
- Financial Use Case: Discovering causal networks among hundreds of stock returns in a high-dimensional portfolio.
Causal Discovery vs. Related Methodologies
A feature-level comparison of data-driven causal discovery against traditional econometric causal inference and standard predictive machine learning.
| Feature | Causal Discovery | Econometric Inference | Predictive ML |
|---|---|---|---|
Primary Goal | Infer causal graph structure from data | Estimate treatment effect size | Minimize prediction error |
Requires Pre-Specified DAG | |||
Handles High-Dimensional Data | |||
Output Type | Directed graph (adjacency matrix) | Coefficient or ATE estimate | Point forecast or classification |
Assumption Framework | Causal Markov Condition, Faithfulness | Exogeneity, No Omitted Variables | IID data, Stationarity |
Confounding Robustness | Detects latent confounders (FCI) | Requires IV or adjustment set | Spurious correlations retained |
Typical Algorithm | PC, GES, LiNGAM | 2SLS, DiD, Double ML | XGBoost, LSTM, Transformer |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Frequently Asked Questions
Clear, technically precise answers to the most common questions about inferring causal structures directly from observational financial data.
Causal discovery is the data-driven process of inferring causal structures and directed dependencies directly from observational data, typically outputting a Directed Acyclic Graph (DAG) representing causal relationships. Unlike causal inference, which tests a pre-specified causal hypothesis (e.g., "Does X cause Y?"), causal discovery algorithms search for the entire causal graph without prior assumptions about variable ordering. In quantitative finance, this means letting the algorithm determine whether order flow causes volatility or volatility causes order flow, rather than imposing a structural model a priori. The output is a graph where nodes represent market variables and directed edges represent direct causal effects, containing no feedback loops. This distinction is critical: causal inference estimates the magnitude of a known effect, while causal discovery identifies which effects exist in the first place.
Related Terms
Mastering causal discovery requires understanding its statistical foundations, graphical representations, and validation techniques. These related concepts form the essential toolkit for distinguishing genuine causal mechanisms from spurious correlations in financial data.
Directed Acyclic Graph (DAG)
The fundamental graphical output of causal discovery algorithms. A DAG represents variables as nodes and direct causal effects as directed edges (arrows), with the strict constraint that no path loops back to its origin.
- Encodes conditional independence relationships
- Forms the basis for the Markov property: a node is independent of its non-descendants given its parents
- Common algorithms: PC algorithm, GES, LiNGAM
- In finance: maps causal channels between macroeconomic indicators and asset returns
Granger Causality
A statistical hypothesis test determining whether one time series is useful in forecasting another. A variable X 'Granger-causes' Y if past values of X contain information that helps predict Y beyond the information in past values of Y alone.
- Key assumption: causes must precede effects in time
- Does not prove true structural causality—only predictive utility
- Critical for lead-lag analysis in high-frequency trading
- Limitation: fails under contemporaneous causation or unobserved confounding
Transfer Entropy
A non-parametric, information-theoretic measure of directed information flow between two stochastic processes. It quantifies the reduction in uncertainty about the future of Y given the past of X, beyond Y's own past.
- Based on Shannon entropy and Kullback-Leibler divergence
- Captures non-linear dependencies that linear Granger tests miss
- No assumption about functional form or distribution
- Applied in finance to detect information flow between market venues during price discovery
Backdoor Criterion
A graphical rule for identifying which variables must be conditioned on to isolate a causal effect. It blocks all spurious, non-causal paths (backdoor paths) between a treatment and outcome while preserving genuine causal pathways.
- Requires a known or hypothesized DAG structure
- Determines the minimal sufficient adjustment set
- Prevents collider bias and M-bias from incorrect conditioning
- Essential for translating discovered graphs into valid causal estimates
Confounding Variable
An extraneous variable that influences both the treatment and the outcome, creating a spurious association that distorts the true causal effect. Unmeasured confounding is the primary threat to causal discovery from observational data.
- Creates non-causal correlation between variables
- Causal discovery algorithms attempt to detect latent confounders
- In markets: volatility regimes often confound the relationship between order flow and price impact
- FCI and RFCI algorithms can model unobserved confounders
Stationarity
A fundamental property where a stochastic process has constant statistical moments (mean, variance, autocorrelation) over time. Most causal discovery methods assume stationarity, making it a critical preprocessing check for financial time series.
- Non-stationary data produces spurious causal links
- Tests: Augmented Dickey-Fuller, KPSS, Phillips-Perron
- Solutions: differencing, cointegration modeling, regime-switching frameworks
- Violation is common in markets due to structural breaks and volatility clustering

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us