Atomic Fact Decomposition is a method for evaluating summary faithfulness by segmenting a generated text into a list of minimal, self-contained factual assertions—each representing a single, verifiable piece of information. These indivisible 'atomic facts' are then individually checked against the source document to determine if they are supported, contradicted, or unverifiable, providing a fine-grained precision metric for hallucination detection.
Glossary
Atomic Fact Decomposition

What is Atomic Fact Decomposition?
A granular evaluation method that breaks generated text into minimal, self-contained factual claims for individual verification against a source document.
This technique moves beyond surface-level n-gram overlap metrics like ROUGE by assessing factual consistency at the semantic level. By requiring each atomic unit to be verified, the method creates a rigorous audit trail for source attribution, enabling developers to precisely quantify a model's hallucination rate and identify specific failure modes in legal abstractive summarization systems where factual integrity is paramount.
Key Characteristics
The core operational principles that define how a generated summary is systematically dismantled into verifiable, atomic units of truth.
Minimal Self-Contained Units
Each decomposed fact must be a standalone assertion that can be verified as true or false without requiring context from other sentences. This prevents dependency chains where one error cascades.
- Single Predicate Rule: One subject-predicate-object relationship per atom
- No Anaphora: Pronouns and implicit references are resolved to explicit named entities
- Example: 'The court ruled on March 3, 2024' is atomic; 'It was decided then' is not
Binary Verification Protocol
Every atomic fact is individually checked against the source document using a Natural Language Inference (NLI) model. The result is a strict binary classification with no partial credit.
- Entailment: The source text logically supports the fact
- Contradiction: The source text directly refutes the fact
- Neutral: The source text does not mention or confirm the fact (treated as a hallucination)
- Hallucination Rate Formula: Contradictions + Neutrals / Total Atoms
Granularity Trade-Off
The level of decomposition directly impacts evaluation precision. Over-decomposition creates noise; under-decomposition masks errors within complex statements.
- Coarse-Grained: Sentence-level decomposition risks accepting compound falsehoods
- Fine-Grained: Clause-level decomposition catches subtle misattributions
- Optimal Balance: Decompose to the smallest unit that still expresses a complete proposition
- Legal Example: 'The plaintiff, who filed on Tuesday, sought damages' becomes two atoms: (1) plaintiff filed Tuesday, (2) plaintiff sought damages
Entity Grounding
All entities referenced in atomic facts must be resolved to their canonical forms in the source text. This prevents evaluation failures caused by surface-form variation.
- Coreference Resolution: 'The company,' 'it,' and 'Acme Corp' are normalized to a single entity ID
- Date Normalization: 'Last Tuesday' becomes an absolute date based on document metadata
- Named Entity Linking: Parties, judges, and statutes are linked to a knowledge base for cross-document consistency
Source Attribution Mapping
Each atomic fact retains a pointer to its precise origin in the generated summary and the source document. This creates a full audit trail for every claim.
- Summary Span: Character-level index of where the fact was expressed in the summary
- Source Span: Paragraph or line citation in the original document used for verification
- Confidence Score: The NLI model's probability score for the entailment classification
- Utility: Enables targeted human review of only the facts flagged as unsupported
Completeness vs. Conciseness
Atomic decomposition evaluates faithfulness, not coverage. A summary can be perfectly faithful (all atoms entailed) yet incomplete (missing key source facts).
- Faithfulness: All stated facts are true (measured by atomic decomposition)
- Completeness: All important source facts are included (measured by recall-oriented metrics)
- Trade-off: Increasing completeness often introduces hallucination risk
- Combined Metric: F1 score balancing ROUGE recall against atomic fact precision
Frequently Asked Questions
Explore the core concepts behind evaluating summary faithfulness by breaking down generated text into minimal, verifiable claims. These answers target the most common technical queries about this critical evaluation methodology.
Atomic fact decomposition is a faithfulness evaluation method that breaks a generated summary into a list of minimal, self-contained factual claims—each representing a single, indivisible piece of information. The process works by parsing the summary text and segmenting it into discrete propositions that can be independently verified against the source document. For example, the sentence "The court ruled on Tuesday that the patent was invalid due to prior art" decomposes into three atoms: (1) a ruling occurred, (2) the ruling date was Tuesday, and (3) the patent was invalidated because of prior art. Each atom is then checked against the source using a Natural Language Inference (NLI) model, which classifies it as "entailed," "contradicted," or "neutral." The final hallucination rate is calculated as the proportion of atoms that are not directly supported by the source text, providing a granular, interpretable metric for summary quality.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
Core concepts for assessing the factual integrity of generated summaries through decomposition and source alignment.
Factual Consistency
The degree to which a generated summary accurately reflects the stated facts of the source document without contradiction or fabrication. In the context of Atomic Fact Decomposition, consistency is measured by verifying each atomic claim against the source.
- Binary Verification: Each atom is either supported or not
- Contradiction Detection: Identifies atoms that directly oppose source statements
- Hallucination Flagging: Catches fabricated details not present in the original
Natural Language Inference (NLI)
A task where a model determines if a hypothesis is entailed by, contradicts, or is neutral to a given premise. NLI serves as the computational engine behind atomic fact verification.
- Entailment: The source text logically supports the atomic claim
- Contradiction: The source text directly refutes the atomic claim
- Neutral: The source text provides insufficient information to confirm or deny
Used in benchmarks like SummaC and ANLI to automate faithfulness scoring.
Source Attribution
The technique of explicitly linking each factual statement in a generated summary back to its precise location in the source document. Atomic Fact Decomposition enables granular attribution by isolating individual claims.
- Span-Level Grounding: Maps atoms to specific sentence ranges
- Multi-Source Fusion: Tracks atoms synthesized from multiple passages
- Unattributed Detection: Flags atoms lacking any source support for human review
Critical for legal applications where citation integrity is non-negotiable.
Hallucination Rate
A metric quantifying the frequency at which a language model generates factually incorrect or unverifiable information. Atomic Fact Decomposition provides a fine-grained measurement by counting unsupported atoms.
- Atom-Level Precision: Measures hallucination at the claim level, not sentence level
- Extrinsic vs. Intrinsic: Distinguishes source-contradicting from world-knowledge fabrications
- Benchmarking: Used in FActScore and similar evaluation frameworks
A summary may be fluent but have a high hallucination rate if many atoms fail verification.
Cross-Document Alignment
The task of identifying and linking semantically related passages that discuss the same event or fact across a collection of distinct documents. When decomposing a multi-document summary, atoms must be verified against potentially multiple sources.
- Redundancy Detection: Identifies atoms repeated across sources
- Conflict Resolution: Surfaces atoms where sources disagree on facts
- Temporal Alignment: Ensures atoms reflect the correct chronological version of events
Essential for Multi-Document Fusion tasks where summaries synthesize information from case law collections.
Coreference Resolution
The NLP task of identifying all linguistic expressions that refer to the same real-world entity. This preprocessing step is critical before atomic fact decomposition to ensure atoms are self-contained.
- Entity Normalization: Replaces pronouns with named entities in atoms
- Cross-Sentence Linking: Resolves references spanning sentence boundaries
- Legal Specificity: Handles complex party designations common in contracts and rulings
Without resolution, an atom like "He breached the contract" becomes unverifiable without knowing who "He" refers to.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us