Inferensys

Glossary

TF-MoDISco

Transcription Factor Motif Discovery from Importance Scores, an algorithm that clusters high-importance genomic subsequences identified by interpretability methods to extract consolidated, non-redundant sequence motifs.
Strategy consultant facilitating AI use case discovery workshop, sticky notes on glass wall, casual corporate meeting.
MOTIF DISCOVERY ALGORITHM

What is TF-MoDISco?

TF-MoDISco (Transcription Factor Motif Discovery from Importance Scores) is a post-hoc interpretability algorithm that clusters high-importance genomic subsequences identified by deep learning models to extract consolidated, non-redundant sequence motifs.

TF-MoDISco operates on per-nucleotide importance scores generated by feature attribution methods like DeepLIFT or Integrated Gradients. It identifies contiguous spans of high-importance bases, termed seqlets, and groups them using a two-stage clustering procedure based on sequence similarity and importance score pattern similarity. This process collapses thousands of redundant, overlapping subsequences into a small set of representative motifs that capture the distinct binding preferences learned by the model.

The algorithm outputs position weight matrices (PWMs) and contribution weight matrices (CWMs) for each discovered motif, along with aggregated importance score tracks. By separating the what (sequence preference) from the where (importance pattern), TF-MoDISco reveals not only the binding motif itself but also the syntactic rules—such as spacing and flanking nucleotide preferences—that the neural network has implicitly internalized during training.

MOTIF DISCOVERY

Key Features of TF-MoDISco

TF-MoDISco extracts consolidated, non-redundant sequence motifs from genomic importance scores by clustering high-attribution subsequences and identifying recurring patterns.

01

Importance Score Clustering

TF-MoDISco operates on per-nucleotide importance scores generated by interpretability methods like DeepLIFT or Integrated Gradients. It identifies contiguous genomic subsequences with high attribution scores and clusters them using affinity propagation based on sequence similarity, ensuring that redundant motifs are merged into a single, representative pattern.

02

Seqlet Discovery

The algorithm defines seqlets—short, high-importance genomic subsequences—as the fundamental unit of analysis. Each seqlet is aligned and trimmed to the region of maximal contribution, converting raw importance maps into a manageable set of discrete, biologically meaningful elements for downstream clustering.

03

Non-Redundant Motif Extraction

Unlike raw importance score visualization, TF-MoDISco applies hierarchical clustering and trimming heuristics to collapse highly similar seqlets into a single consolidated motif. This produces a compact, non-redundant set of Position Weight Matrices (PWMs) that represent the distinct binding preferences learned by the model.

04

Multi-Resolution Analysis

TF-MoDISco discovers motifs at multiple levels of resolution:

  • Core motifs: The minimal, highest-information content binding site
  • Extended motifs: Flanking sequences that contribute to binding specificity
  • Motif syntax: Combinations of motifs that co-occur in specific spatial arrangements This hierarchical view captures both local and composite regulatory grammar.
05

Model-Agnostic Design

TF-MoDISco is architecture-agnostic and can be applied to any deep learning model that produces per-nucleotide importance scores, including:

  • Convolutional networks like DeepBind and BPNet
  • Transformer models like Enformer
  • Recurrent architectures This flexibility makes it a universal post-hoc interpretability tool for genomic deep learning.
06

Statistical Validation

Each discovered motif is accompanied by a significance score derived from the number of supporting seqlets and their information content. TF-MoDISco also generates sequence logos and aggregated importance tracks that visualize the positional contribution of each nucleotide, enabling researchers to distinguish true binding signals from noise.

TF-MoDISco

Frequently Asked Questions

Answers to common questions about Transcription Factor Motif Discovery from Importance Scores, the algorithm that transforms neural network attribution maps into consolidated, non-redundant sequence motifs.

TF-MoDISco (Transcription Factor Motif Discovery from Importance Scores) is a computational algorithm that extracts consolidated, non-redundant sequence motifs from the per-nucleotide importance scores generated by deep learning model interpretability methods. The algorithm operates in three sequential phases: importance score computation using methods like DeepLIFT or Integrated Gradients on genomic sequences, seqlet extraction where high-importance contiguous subsequences are identified and cropped from the input, and motif clustering where these seqlets are grouped by sequence similarity and importance patterns using affinity propagation or density-based clustering. The output is a set of position weight matrices (PWMs) representing distinct, biologically meaningful transcription factor binding motifs, each associated with the specific genomic regions that contributed to the model's predictions. Unlike traditional motif discovery tools that operate on raw sequence alignments, TF-MoDISco directly leverages the learned representations of a trained neural network, making it particularly effective for interpreting models like DeepBind, BPNet, and Enformer.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.