Inferensys

Glossary

Feature Interaction Strength

A measure of the degree to which the effect of one feature on a model's prediction depends on the value of another feature, quantified using metrics like the H-statistic to identify non-additive behavior.
Data engineer managing feature store on laptop, feature definitions visible, casual data engineering session.
DEFINITION

What is Feature Interaction Strength?

A quantitative measure of the degree to which the effect of one feature on a model's prediction depends on the value of another feature, capturing non-additive joint behavior.

Feature Interaction Strength quantifies the non-additive, combined effect of two or more features on a model's output, where the impact of one feature is conditional on the value of another. This is formally measured using metrics like the Friedman's H-statistic, which compares the variance of the joint partial dependence function against the sum of individual marginal effects. A strength of zero indicates purely additive behavior, while higher values signal significant interaction.

In explainable fraud detection, identifying strong interactions is critical because isolated features like transaction amount or location may appear benign, yet their combination triggers a high anomaly score. Unlike global feature importance, interaction strength reveals the conditional logic learned by the model, enabling compliance officers to audit why specific feature combinations drive blocking decisions and ensuring the model's reasoning aligns with domain expertise.

NON-ADDITIVE BEHAVIOR

Key Characteristics of Feature Interaction Strength

Feature interaction strength quantifies the degree to which the combined effect of two or more features on a model's prediction deviates from the sum of their individual effects. Understanding these interactions is critical for identifying complex fraud patterns that simple additive models miss.

01

The H-Statistic (Friedman's H)

A global, model-agnostic metric that measures the proportion of variance in a model's predictions explained by interactions between features. A value of 0 indicates a purely additive model with no interactions, while a value approaching 1 signifies that the prediction function is dominated by interaction effects. For a pair of features (j, k), the H-statistic quantifies how much of the joint effect cannot be explained by the sum of their individual partial dependence functions. In fraud detection, a high H-statistic between transaction_amount and time_since_last_transaction reveals that large transactions are only suspicious when they occur shortly after a previous one.

0 to 1
Interaction Strength Range
02

Partial Dependence Discrepancy

A diagnostic method that compares the two-dimensional partial dependence plot (PDP) of a feature pair against the sum of their individual one-dimensional PDPs. If the joint PDP surface is not flat—meaning it cannot be decomposed into additive components—an interaction is present. For example, the joint PDP of device_age and account_age might show a sharp spike in fraud probability only when both features are low, a multiplicative effect invisible in univariate analysis. This visual decomposition helps compliance officers understand why a model flags specific combinations of attributes.

2D vs 1D
Additive Decomposition
03

SHAP Interaction Values

An extension of SHAP (SHapley Additive exPlanations) that decomposes a prediction into main effects and pairwise interaction effects. The SHAP interaction value for features i and j represents the additional contribution that arises from their combination, beyond what each contributes independently. This is computed using the Shapley interaction index from cooperative game theory. In an explainable fraud detection workflow, these values can be visualized as a matrix, revealing that ip_country and shipping_country have a strong negative interaction when they match but a strong positive interaction when they diverge.

Pairwise
Interaction Granularity
04

Gradient-Based Interaction Detection

For differentiable models like neural networks, the interaction strength between two input features can be estimated by computing the second-order partial derivative of the model's output with respect to those features. A large, consistent second derivative indicates that the effect of one feature is highly dependent on the value of the other. This method is computationally efficient for deep learning fraud models and can be integrated directly into the training loop for real-time monitoring. Integrated Hessians extends this concept by accumulating second-order gradients along a path from a baseline to the input.

∂²f/∂xᵢ∂xⱼ
Second-Order Derivative
05

GUIDE (Generalized Unbiased Interaction Detection)

A statistical algorithm designed to detect interaction effects in regression and classification trees without the selection bias that plagues standard methods like CART. GUIDE uses chi-squared tests on residuals to determine if a feature's effect on the target is modified by another feature before making a split. This is particularly valuable in financial fraud modeling where categorical features like merchant_category_code and card_present_flag often interact. GUIDE provides unbiased, interpretable interaction rules that can be directly translated into investigation procedures.

Unbiased
Selection Property
06

Accumulated Local Effects (ALE) Interaction

Unlike PDPs, ALE plots correctly handle correlated features by calculating differences in predictions over conditional distributions. The second-order ALE plot visualizes the joint effect of two features after accounting for their individual main effects. If the second-order ALE surface shows significant variation, a strong interaction is present. This is crucial in fraud detection where features like transaction_frequency and average_transaction_value are often highly correlated, and standard PDP-based interaction measures would produce biased estimates due to extrapolation into unrealistic feature regions.

Correlation-Robust
Key Advantage
INTERPRETABILITY METRICS

Frequently Asked Questions

Explore the quantitative measures used to identify and validate non-additive relationships between features in fraud detection models, ensuring that complex interaction effects are surfaced, understood, and governed.

Feature Interaction Strength is a measure of the degree to which the effect of one feature on a model's prediction depends on the value of another feature, quantifying non-additive behavior. It is most commonly quantified using the Friedman's H-statistic, which compares the variance of the partial dependence function of the joint feature distribution to the sum of the variances of the individual marginal distributions. An H-statistic of 0 indicates a purely additive relationship where features contribute independently, while a value significantly greater than 0 reveals a strong interaction effect. For example, in fraud detection, a high interaction strength between transaction_amount and account_age would indicate that large transactions are only risky for very new accounts, a pattern a purely additive model would miss.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.