Treatment Type Classification is an NLP task that automatically categorizes how a citing case legally treats a cited authority, assigning labels such as overruled, distinguished, followed, or criticized to each citation instance. It moves beyond simple citation sentiment analysis to identify specific judicial actions that directly impact precedential weight.
Glossary
Treatment Type Classification

What is Treatment Type Classification?
Treatment Type Classification is a specialized natural language processing task that automatically categorizes the legal relationship between a citing case and a cited authority.
This classification is foundational for accurate authority propagation in citation graphs. By distinguishing a case that merely cites background context from one that explicitly invalidates a prior holding, systems can compute precise authority scores and power reliable Shepardizing automation. Modern approaches often fine-tune legal embedding models on annotated citation contexts to capture the nuanced rhetorical signals judges use.
Core Characteristics of Treatment Type Classification
Treatment type classification is a fine-grained NLP task that automatically determines the legal effect a citing case has on a cited authority. It assigns categorical labels to each citation instance, transforming unstructured judicial text into structured, computable signals for authority graph analysis.
Taxonomy of Treatment Labels
A controlled vocabulary of categorical signals assigned to each citation instance. Standard labels include:
- Overruled: The cited authority's holding is expressly invalidated.
- Distinguished: The court finds material factual or legal differences, declining to apply the precedent.
- Followed: The court adopts and applies the cited reasoning.
- Criticized: The court questions the soundness of the cited decision without overruling it.
- Harmonized: The court reconciles an apparent conflict between authorities.
- Limited: The scope of the cited authority is explicitly narrowed.
Classification Granularity Levels
Treatment classification operates at multiple levels of specificity:
- Binary Polarity: Simple positive vs. negative treatment detection.
- Multi-Class Categorization: Assignment to one of 6-12 discrete treatment types.
- Fine-Grained Subtype Analysis: Distinguishing between 'expressly overruled' and 'impliedly overruled'.
- Multi-Label Classification: A single citation may simultaneously 'follow' a case for one proposition while 'distinguishing' it on another point.
- Span-Level Annotation: Pinpointing the exact textual segment within a citing opinion that conveys the treatment signal.
Feature Engineering for Classification
Key linguistic and structural features used by models to predict treatment:
- Citational Context Window: The surrounding sentences and paragraphs where the citation string appears.
- Discourse Markers: Explicit signals like 'we decline to follow,' 'the dissent criticizes,' or 'as the court correctly held.'
- Court Hierarchy Delta: The relative jurisdictional level between citing and cited courts.
- Temporal Distance: The time elapsed between the cited and citing decisions.
- Subsequent Treatment History: The existing treatment signals from other citing cases in the graph.
Model Architectures
Modern approaches leverage domain-specific language models:
- Fine-Tuned Legal Encoders: Models like Legal-BERT or CaseLaw-BERT fine-tuned on annotated treatment datasets.
- Graph Neural Networks (GNNs): Architectures that incorporate both the textual context and the structural position of the citation within the broader authority graph.
- Multi-Task Learning: Jointly training on treatment classification, citation intent, and citation sentiment to leverage shared representations.
- Few-Shot Prompting: Using large language models with carefully engineered prompts containing exemplar citation contexts and their treatment labels.
Downstream Applications
Accurate treatment classification is foundational for:
- Shepardizing Automation: Replacing manual citator review with real-time, algorithmic validity checks.
- Authority Score Computation: Weighting citation graph edges by treatment polarity to compute nuanced precedential influence scores.
- Overruling Event Detection: Triggering alerts when a seminal case receives a negative treatment signal from a higher court.
- Precedent Chain Integrity: Ensuring that automated reasoning chains do not rely on authorities that have been subsequently criticized or overruled.
Evaluation Metrics and Benchmarks
Rigorous evaluation requires legal expertise:
- Cohen's Kappa: Measures inter-annotator agreement between human legal experts, establishing the task's ceiling.
- Macro F1-Score: Evaluates performance across all treatment classes, critical for handling imbalanced label distributions where 'followed' dominates.
- Confusion Matrix Analysis: Identifies systematic model errors, such as confusing 'criticized' with 'distinguished'.
- Blind Citator Comparison: Benchmarking model output against the treatment signals assigned by commercial citator services like Shepard's or KeyCite.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Frequently Asked Questions
Explore the core concepts behind the automated categorization of judicial citation intent, a critical NLP task for maintaining accurate legal authority graphs and precedent intelligence systems.
Treatment Type Classification is a specialized natural language processing (NLP) task that automatically categorizes how a citing legal case treats a cited authority. For every citation instance in a judicial opinion, the system assigns a discrete label—such as 'overruled,' 'distinguished,' 'followed,' 'criticized,' or 'cited'—based on the semantic context surrounding the reference. This goes beyond simple citation counting to determine the qualitative nature of the relationship. The task is typically framed as a fine-grained text classification problem, where a model analyzes the textual span around a citation marker to infer the citing judge's rhetorical intent and legal action toward the precedent. Accurate classification is foundational for building dynamic authority graphs that reflect the true precedential weight of a case, enabling downstream tasks like Shepardizing automation and precedent influence scoring.
Related Terms
Core concepts for building computational systems that map and traverse legal authority graphs.
Citation Graph
A directed network structure where nodes represent legal cases or statutes and edges represent citation relationships. This forms the foundational data structure for computational precedent analysis.
- Directed edges capture the flow of authority from citing case to cited case
- Node attributes include court level, jurisdiction, and date
- Edge attributes can encode treatment type and sentiment
- Serves as the input graph for authority propagation algorithms like PageRank variants
Shepardizing
The process of using a citator service to trace a legal authority's subsequent treatment history. This determines whether a case remains good law and has not been overruled, criticized, or otherwise negatively treated.
- Originates from Shepard's Citations, first published in 1873
- Modern computational Shepardizing uses treatment type classification to automate signal assignment
- Critical for negative treatment detection and overruling detection
- Outputs inform precedential weight calculations in authority graphs
Authority Propagation
A graph algorithm that iteratively distributes precedential influence scores across a citation network. Often implemented using PageRank variants, it identifies the most legally significant nodes.
- Weighted edges incorporate citation sentiment and treatment signals
- Jurisdictional filtering constrains propagation to legally relevant courts
- Outputs feed into authority score and precedent influence score metrics
- Enables seminal case detection by surfacing high-centrality origin nodes
Citation Intent Classification
A fine-grained NLP task that determines the rhetorical purpose of a citation instance. Goes beyond binary sentiment to classify whether a case is cited for legal support, factual analogy, background context, or critical disagreement.
- Distinct from treatment type classification, which focuses on legal effect
- Uses transformer-based models fine-tuned on annotated legal corpora
- Enables richer edge typing in heterogeneous graphs
- Improves accuracy of citation recommendation and graph-based reranking
Graph Neural Network (GNN)
A deep learning architecture designed to operate directly on graph-structured data. In legal AI, GNNs learn node embeddings that capture both a case's intrinsic features and its citation neighborhood structure.
- Message passing aggregates information from neighboring nodes
- Used for link prediction to forecast future citations
- Enables community detection to identify doctrinal clusters
- Applied to case outcome prediction by encoding precedent relationships
Temporal Citation Analysis
The study of citation patterns over time to model how legal authority evolves, ages, or gains influence. Incorporates timestamps into graph models to detect trends like precedent aging and citation cascades.
- Citation cascades trace the propagation of a seminal decision through time
- Precedent aging models the decay of authority for older decisions
- Enables detection of emerging doctrinal shifts before they become explicit
- Critical for accurate stare decisis modeling in dynamic legal landscapes

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us