GraphSVX is a post-hoc, model-agnostic explainer that applies the game-theoretic Shapley value concept to Graph Neural Networks (GNNs). It uniquely constructs coalitions of both nodes and node features to compute their marginal contributions to a specific prediction, providing a unified explanation that captures structural importance and feature relevance simultaneously.
Glossary
GraphSVX

What is GraphSVX?
GraphSVX is a post-hoc explainability method that decomposes Graph Neural Network predictions by computing Shapley values on joint coalitions of nodes and features, delivering both structural and feature-level explanations.
By leveraging a linear approximation of Shapley values, GraphSVX efficiently estimates importance scores without exhaustive computation. This dual-focus approach enables practitioners to identify not only which nodes in a graph's neighborhood drove a decision but also which specific attributes of those nodes were most influential, offering a granular audit trail for molecular property prediction or social network analysis.
Key Features of GraphSVX
GraphSVX is a post-hoc explainer that decomposes GNN predictions using Shapley values on a coalition of nodes and features, providing both structural and feature-level explanations.
Joint Node and Feature Explanations
GraphSVX uniquely computes Shapley values jointly over nodes and features, providing a unified importance score. Unlike methods that explain structure or features in isolation, it captures the interaction effect where a node's importance is conditional on its features. This yields a holistic explanation that identifies both the critical nodes in the graph and the specific feature dimensions driving the prediction.
Efficient Coalition Sampling
Exact Shapley value computation is exponential in complexity. GraphSVX employs Monte Carlo sampling over the power set of nodes and features to approximate values efficiently. It uses a weighted least squares optimization to estimate Shapley values from a manageable number of model evaluations, making it practical for large graphs without sacrificing the theoretical guarantees of the Shapley framework.
Model-Agnostic Architecture
GraphSVX operates as a post-hoc, model-agnostic explainer. It treats the GNN as a black box, requiring only the ability to query predictions on masked input graphs. This means it can explain any GNN architecture—GCN, GAT, GraphSAGE, or GIN—without access to internal weights or gradients. The same explainer works across different models, simplifying the interpretability stack.
Multi-Level Explanation Granularity
The framework supports explanations at multiple resolutions:
- Node-level: Which nodes contributed most to a specific node's prediction?
- Feature-level: Which input features were most influential?
- Global-level: Aggregate explanations to understand overall model behavior across the dataset. This flexibility allows engineers to debug individual predictions or audit systemic biases.
Fairness-Aware Feature Grouping
GraphSVX allows features to be grouped into semantically meaningful coalitions before computing Shapley values. For example, demographic features can be treated as a single coalition to measure their collective impact. This grouping mechanism is essential for algorithmic fairness auditing, enabling practitioners to quantify the influence of protected attributes on GNN predictions in social network or credit graph applications.
Theoretical Grounding in Game Theory
GraphSVX inherits the strong axiomatic properties of Shapley values from cooperative game theory:
- Efficiency: Importance scores sum to the prediction difference from the baseline.
- Symmetry: Identical contributions receive identical scores.
- Dummy: Irrelevant features or nodes receive zero importance.
- Additivity: Explanations are consistent across ensemble models. These guarantees make explanations legally defensible for regulated industries.
Frequently Asked Questions
Common questions about how GraphSVX computes Shapley values on graph-structured data to provide both structural and feature-level explanations for GNN predictions.
GraphSVX is a post-hoc explainability method for Graph Neural Networks that jointly explains node classifications by computing Shapley values on a coalition of nodes and features. It decomposes a GNN prediction into the marginal contribution of each node in the computational graph and each feature dimension in the node's feature vector. The method constructs a weighted linear regression model over sampled coalitions, where each coalition is a subset of nodes and features. By evaluating the GNN's output on these masked coalitions, GraphSVX efficiently approximates exact Shapley values without requiring an exponential number of model evaluations. The result is a dual explanation: a structural explanation identifying which neighboring nodes were most influential, and a feature explanation revealing which input dimensions drove the prediction. This unified approach addresses the limitation of earlier methods like GNNExplainer, which required separate optimization for structure and feature explanations.
GraphSVX vs. Other GNN Explainers
A feature-level comparison of GraphSVX against GNNExplainer and SubgraphX for post-hoc GNN interpretability.
| Feature | GraphSVX | GNNExplainer | SubgraphX |
|---|---|---|---|
Explanation Granularity | Node and feature jointly | Node and feature jointly | Subgraph structures |
Theoretical Foundation | Shapley values (game theory) | Mutual information maximization | Shapley values (Monte Carlo) |
Provides Feature Importance | |||
Provides Structural Importance | |||
Handles Multi-Relational Graphs | |||
Global Explanation Mode | |||
Faithfulness (Fidelity+) | 0.85-0.92 | 0.78-0.85 | 0.88-0.94 |
Computational Complexity | O(2^N) with sampling | O(N^2) per node | O(MCTS iterations) |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
Core concepts for understanding how GraphSVX decomposes GNN predictions into structural and feature-level explanations.
Shapley Values on Graphs
The game-theoretic foundation of GraphSVX. Shapley values compute each node or feature's marginal contribution to a GNN prediction by averaging its impact across all possible coalitions. GraphSVX extends this by jointly considering node coalitions and feature coalitions to produce a unified importance score.
- Satisfies efficiency, symmetry, and additivity axioms
- Guarantees fair credit distribution among graph components
- Computationally approximated via Monte Carlo sampling in GraphSVX
Faithfulness Metric
The primary evaluation criterion for GraphSVX explanations. Faithfulness measures how accurately an explanation reflects the GNN's true reasoning by computing the drop in prediction score when the most important nodes or features are removed.
- Higher drop = more faithful explanation
- GraphSVX optimizes for fidelity by selecting coalitions that preserve prediction behavior
- Contrasts with stability metrics that measure explanation consistency under input perturbations
GNNExplainer
A model-agnostic baseline that GraphSVX improves upon. GNNExplainer identifies a compact subgraph and feature subset maximizing mutual information with the prediction. Unlike GraphSVX, it does not provide Shapley-based importance scores or handle joint node-feature coalitions.
- Uses continuous relaxation of discrete masks
- Produces a single explanatory subgraph
- GraphSVX adds uncertainty quantification via Shapley value variance
Perturbation Analysis
The experimental methodology used to validate GraphSVX explanations. By systematically removing or masking the top-k nodes and features identified by the explainer, researchers measure the prediction degradation curve.
- Positive perturbation: removing important components causes sharp accuracy drop
- Negative perturbation: removing unimportant components has minimal effect
- GraphSVX demonstrates steeper degradation than baselines, indicating higher explanation quality
Counterfactual Subgraphs
The minimal structural changes that would flip a GNN's prediction. While GraphSVX provides additive feature attribution, counterfactual methods identify edge deletions or node removals that produce a different outcome.
- Complements GraphSVX by offering actionable recourse
- CF-GNNExplainer finds the smallest edge set to delete
- Combined with Shapley values, enables both why this prediction and what would change it explanations
Graph Information Bottleneck
A theoretical principle underlying explanation quality. The GIB compresses an input graph into a minimal subgraph that retains maximal mutual information about the label, discarding irrelevant structure.
- GraphSVX approximates this by selecting high-contribution coalitions
- Related methods like GSAT and GraphMask learn stochastic attention to identify bottlenecks
- Provides theoretical justification for why smaller, faithful explanations are superior

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us