This prompt is for fact-checkers, editorial teams, and verification engineers who need to determine whether a quoted or paraphrased statement distorts the original speaker's intended meaning. It goes beyond literal word matching to assess semantic drift, context-stripping, and intent misrepresentation. Use this prompt when you have a source statement and a reported version, and you need a structured, evidence-grounded distortion analysis with a calibrated severity label. This is not a simple string-comparison tool; it requires the model to reason about communicative intent, qualifying context, and the pragmatic effect of wording changes.
Prompt
Meaning Distortion Analysis Prompt

When to Use This Prompt
Defines the specific job, ideal user, required inputs, and critical boundaries for the Meaning Distortion Analysis Prompt.
The ideal user has both the original source material and the attributed statement ready for comparison. Required inputs include the full original statement with surrounding context, the reported quote or paraphrase, and any relevant metadata such as speaker identity, date, and publication venue. The prompt is designed for high-stakes editorial workflows where a false negative (missing a real distortion) can cause public harm and a false positive (flagging an accurate paraphrase) can damage credibility. It is not suitable for real-time chat moderation, automated content flagging without human review, or cases where the original source is unavailable or heavily redacted.
Do not use this prompt when you only need a simple string similarity check, when the source material is too fragmentary to establish intent, or when the reported statement is an acknowledged opinion paraphrase rather than a factual attribution. For those cases, use the Quote-to-Source Comparison Prompt for literal alignment or the Paraphrase Fidelity Scoring Prompt for calibrated fidelity scores. After running this analysis, route outputs with a distortion severity of 'High' or 'Critical' to human review and log all results for audit trails. The next section provides the copy-ready prompt template you can adapt and deploy.
Use Case Fit
Where the Meaning Distortion Analysis Prompt works, where it fails, and what you must provide before running it in production.
Good Fit: Editorial Quote Review
Use when: An editor needs to verify that a quoted or paraphrased statement in a draft article faithfully represents the original speaker's position. Guardrail: Always provide the full original source context, not just the extracted quote, to prevent the model from missing context-stripping distortion.
Bad Fit: Real-Time Moderation
Avoid when: Latency budgets are under 500ms or when the model must make publish/block decisions without human review. Meaning distortion requires comparative reasoning over potentially long source documents. Guardrail: Route to asynchronous verification queues with human-in-the-loop for final publication decisions.
Required Inputs
Must provide: The attributed quote or paraphrase, the full original source text with surrounding context, and the speaker's name. Guardrail: Missing source context is the top cause of false negatives. Reject jobs where the original source is unavailable rather than guessing at meaning from partial evidence.
Operational Risk: Subjectivity Drift
Risk: Different reviewers may disagree on whether a paraphrase crosses the line from acceptable summary to distortion. The model's judgment can drift across runs without calibration. Guardrail: Use a calibration set of pre-graded examples in the prompt and track distortion category distributions over time. Escalate borderline cases to human review with the model's evidence attached.
Operational Risk: Speaker Intent Overreach
Risk: The model may claim to know what the speaker 'really meant' beyond what the source text supports, introducing its own interpretation. Guardrail: Constrain the output to compare the quote against the source text only. Prohibit language about unstated intentions. Flag any output that invents motivations not present in the provided evidence.
Not a Replacement for Legal Review
Avoid when: The distortion analysis will be used in defamation, libel, or legal dispute contexts without attorney review. Guardrail: This prompt is an editorial assistance tool, not a legal instrument. Any output used in legal proceedings must be reviewed by qualified counsel. Document the AI-assisted nature of the analysis in audit trails.
Copy-Ready Prompt Template
A production-ready system prompt for detecting and categorizing meaning distortion in quoted or paraphrased statements.
This prompt template is designed to be pasted directly into your system instructions for a Meaning Distortion Analysis task. It instructs the model to compare a provided statement against its original source material, identify whether the meaning has been distorted, and output a structured JSON report. The template uses square-bracket placeholders for all dynamic inputs, making it straightforward to integrate into an automated verification pipeline. Before using this prompt, ensure you have the original source text and the attributed statement ready to inject into the [SOURCE_TEXT] and [ATTRIBUTED_STATEMENT] placeholders, respectively.
textYou are a Meaning Distortion Analyzer. Your task is to compare an attributed statement against its original source text and determine if the statement distorts the speaker's original position. ## Input Data - **Source Text:** [SOURCE_TEXT] - **Attributed Statement:** [ATTRIBUTED_STATEMENT] ## Analysis Instructions 1. **Identify the Core Claim:** Extract the central factual or positional claim from the Attributed Statement. 2. **Locate Source Evidence:** Find the specific passage(s) in the Source Text that correspond to the claim. If no corresponding passage exists, note this as a potential fabrication. 3. **Compare Meaning:** Analyze whether the Attributed Statement preserves the original meaning, intent, and context of the Source Text. Look for: - **Context-Stripping:** Removal of surrounding qualifications or conditions that change the meaning. - **Cherry-Picking:** Selecting a partial quote that omits contradictory or balancing material. - **Paraphrase Drift:** A rephrasing that introduces a different connotation or factual implication. - **Fabrication:** A statement with no grounding in the source text. - **Literal Accuracy, Intent Distortion:** A technically accurate quote that, through framing, misrepresents the speaker's overall position. 4. **Categorize Distortion:** Assign one of the following labels: - `none`: The statement faithfully represents the source's meaning. - `minor_drift`: A slight, non-substantive shift in emphasis or wording. - `significant_distortion`: A clear change in meaning, omission of a key qualification, or misleading framing. - `fabrication`: The statement is entirely unsupported by the source. 5. **Explain Your Reasoning:** Provide a concise, evidence-grounded explanation for your categorization, quoting the relevant parts of the Source Text and Attributed Statement. ## Output Format You must respond with a single, valid JSON object conforming to this schema: { "distortion_category": "none" | "minor_drift" | "significant_distortion" | "fabrication", "source_evidence": "Excerpt from the source text that is most relevant to the claim.", "meaning_comparison": { "original_meaning": "A neutral summary of the source text's position.", "attributed_meaning": "A neutral summary of the attributed statement's position.", "key_difference": "A concise description of the semantic gap, if any. Null if category is 'none'." }, "explanation": "A step-by-step rationale for the distortion category, citing specific text.", "confidence_score": 0.0-1.0 } ## Constraints - Base your analysis strictly on the provided Source Text and Attributed Statement. Do not use outside knowledge. - If the Source Text is insufficient to verify the statement, set the `distortion_category` to `fabrication` and explain why. - The `confidence_score` must reflect your certainty in the assessment based on the available evidence.
To adapt this template for your application, replace the [SOURCE_TEXT] and [ATTRIBUTED_STATEMENT] placeholders with live data before each API call. The JSON output schema is designed for direct parsing by downstream systems, such as a CMS or a human review queue. For high-stakes editorial workflows, you should route any output with a distortion_category of significant_distortion or fabrication, or a confidence_score below 0.9, to a human reviewer for final confirmation. The meaning_comparison object provides a clear, auditable summary of the AI's logic, which is essential for building trust and enabling rapid human adjudication.
Prompt Variables
Each placeholder required by the Meaning Distortion Analysis Prompt, its purpose, a concrete example, and actionable validation rules for production harnesses.
| Placeholder | Purpose | Example | Validation Notes |
|---|---|---|---|
[ORIGINAL_STATEMENT] | The verbatim text from the original speaker or source material, including surrounding context. | "We are seeing strong growth in enterprise accounts, though our SMB segment remains flat." | Required. Must be a non-empty string. Validate length > 20 characters to ensure sufficient context is provided. Null or truncated input should trigger a retry or human escalation. |
[ATTRIBUTED_QUOTE_OR_PARAPHRASE] | The quoted or paraphrased version being evaluated for distortion against the original statement. | "The CEO reported strong growth across all business segments." | Required. Must be a non-empty string. Validate that the input is not identical to [ORIGINAL_STATEMENT]; if identical, bypass distortion analysis and return a 'verbatim match' status. |
[SPEAKER_IDENTITY] | The name, title, and relevant affiliation of the original speaker to ground the analysis in authority and context. | "Jane Smith, Chief Revenue Officer, Acme Corp" | Required. Must be a non-empty string. Validate format contains at least a name. If null, the model should still proceed but flag a 'missing speaker context' warning in the output. |
[DOMAIN_CONTEXT] | The subject area, industry, or situational context in which the original statement was made to calibrate interpretation. | "Q3 2024 Earnings Call, Technology Sector" | Optional. If provided, validate as a non-empty string. If null, the model must note that domain-specific nuance may be missed. Accepts freeform text or a controlled vocabulary tag. |
[DISTORTION_CATEGORIES] | A predefined list of distortion types the model must choose from to ensure consistent labeling across a batch. | ["context_stripping", "meaning_inversion", "overgeneralization", "cherry_picking", "fabrication"] | Required. Must be a valid JSON array of strings. Validate against a master taxonomy. If the model selects a category not in this list, flag the output for human review. |
[CALIBRATION_EXAMPLES] | A set of few-shot examples with known distortion grades to anchor the model's judgment and reduce variance. | [{"original": "...", "attributed": "...", "label": "meaning_inversion", "rationale": "..."}] | Required. Must be a valid JSON array with at least 3 objects. Validate each object has 'original', 'attributed', and 'label' fields. If the model's output deviates significantly from these anchors, log a calibration drift warning. |
[OUTPUT_SCHEMA] | The strict JSON schema the model must use for its response, defining the structure for the distortion label, comparison, and evidence. | {"type": "object", "properties": {"distortion_label": {"type": "string"}, "meaning_comparison": {"type": "string"}, "evidence": {"type": "string"}}, "required": ["distortion_label", "meaning_comparison", "evidence"]} | Required. Must be a valid JSON Schema object. Post-generation, validate the model's raw output against this schema. A schema validation failure should trigger a repair or retry loop, not a silent fallback. |
Implementation Harness Notes
How to wire the Meaning Distortion Analysis Prompt into a production verification pipeline with validation, retries, and human review routing.
The Meaning Distortion Analysis Prompt is designed to operate as a single step within a larger quote-verification pipeline. It expects a structured input containing the original source excerpt, the quoted or paraphrased statement under review, and any surrounding context from both the source and the derivative work. The prompt returns a distortion category label, a before-and-after meaning comparison, and an evidence-grounded explanation. To use this in production, you must wrap the prompt in an application harness that validates the output schema, enforces confidence thresholds, and routes ambiguous cases to human review.
Start by defining a strict JSON schema for the model's output. The schema should include fields for distortion_category (an enum of labels such as NO_DISTORTION, CONTEXT_STRIPPING, SELECTIVE_QUOTING, MEANING_INVERSION, FABRICATION_RISK, and AMBIGUOUS), a meaning_comparison object with original_intent and distorted_intent strings, an explanation string, and a confidence_score between 0.0 and 1.0. After the model responds, run a validator that checks for schema compliance, enum membership, and score range. If validation fails, retry the prompt once with the validation error appended to the model's context as a correction hint. If the second attempt also fails, log the failure and escalate the item to a human review queue with the raw output attached. For high-stakes domains such as legal or medical content, require human approval on any output where confidence_score is below 0.85 or the distortion_category is AMBIGUOUS or FABRICATION_RISK.
Model choice matters here. Use a model with strong instruction-following and structured output capabilities, such as GPT-4o, Claude 3.5 Sonnet, or Gemini 1.5 Pro. Avoid smaller or older models that may collapse the distortion categories or produce unparseable explanations. If you are processing batches of quotes, implement a queue-based architecture with asynchronous workers. Each worker should log the input, output, validation result, retry count, and final disposition to an observability store. This trace data is essential for calibrating the confidence_score threshold over time and for auditing decisions. Do not treat this prompt as a standalone fact-checker; it is a comparison engine that depends on accurate source material being provided. If your pipeline includes a retrieval step, ensure the source text passed to this prompt is the full, unredacted original, not a summary or snippet, because context-stripping detection requires the surrounding material to be present.
Expected Output Contract
Defines the structure, types, and validation rules for the model response. Use this contract to build a post-processing validator that rejects malformed outputs before they reach downstream systems.
| Field or Element | Type or Format | Required | Validation Rule |
|---|---|---|---|
distortion_category | enum: ["meaning_inversion", "context_stripping", "selective_emphasis", "false_equivalence", "fabricated_implication", "no_distortion"] | Must match exactly one of the defined enum values. Reject any response with an unrecognized category string. | |
original_meaning_summary | string (<= 280 characters) | Must be a non-empty string that does not repeat the [ORIGINAL_STATEMENT] verbatim. Length must be between 10 and 280 characters. Reject if it contains only whitespace or placeholder text like 'N/A'. | |
distorted_meaning_summary | string (<= 280 characters) | Must be a non-empty string that does not repeat the [QUOTED_OR_PARAPHRASED_TEXT] verbatim. Length must be between 10 and 280 characters. If distortion_category is 'no_distortion', this field must exactly equal original_meaning_summary. | |
distortion_explanation | string (<= 500 characters) | Must reference specific elements from both [ORIGINAL_STATEMENT] and [QUOTED_OR_PARAPHRASED_TEXT]. Reject if the explanation is generic or fails to cite at least one concrete difference in wording, omission, or framing. | |
evidence_excerpts | array of objects with fields: {excerpt_text: string, source_location: string} | Array must contain 1-3 objects. Each excerpt_text must be a substring matchable in [ORIGINAL_SOURCE_CONTEXT] using a case-insensitive contains check. source_location must be a non-empty string (e.g., 'paragraph 3', 'lines 12-14'). Reject if no excerpt can be located in the source context. | |
distortion_severity | enum: ["critical", "significant", "minor", "none"] | Must be 'critical' if distortion_category is 'meaning_inversion' or 'fabricated_implication'. Must be 'none' if distortion_category is 'no_distortion'. Reject any response that violates this mapping. | |
confidence_score | number (0.0 to 1.0) | Must be a float between 0.0 and 1.0 inclusive. If confidence_score < 0.7, the response must include at least 2 evidence_excerpts. Reject if confidence_score is 1.0 and distortion_severity is 'critical' without at least 2 evidence_excerpts. | |
requires_human_review | boolean | Must be true if distortion_severity is 'critical' or confidence_score < 0.6. Must be false if distortion_category is 'no_distortion' and confidence_score >= 0.9. Reject any response that violates this rule. |
Common Failure Modes
Meaning distortion analysis is a high-stakes, subjective task. These are the most common failure modes observed when deploying this prompt in production editorial and verification pipelines, along with practical mitigations.
Calibration Drift Across Reviewers
What to watch: The model's severity grading (e.g., 'minor distortion' vs. 'major distortion') drifts over a batch of evaluations or fails to align with your editorial team's standards. This leads to inconsistent enforcement and reviewer fatigue. Guardrail: Include a calibration set of 3-5 pre-scored examples in the prompt context before the target quote. Run a weekly inter-rater reliability check between the model's scores and a human editor on a holdout set.
Confusing Editing with Distortion
What to watch: The prompt flags standard editorial cleanup (removing filler words, correcting grammar in a transcript) as 'context-stripping' or 'meaning distortion.' This generates false positives that waste reviewer time. Guardrail: Add explicit negative examples in the few-shot prompt that distinguish between benign editing for clarity and malicious removal of qualifying context. Define a 'de minimis' threshold for grammatical corrections.
Ignoring the Speaker's Intent
What to watch: The analysis focuses on strict lexical overlap and misses the speaker's broader argumentative intent. A paraphrase might be lexically different but faithfully represent the point, and the model incorrectly flags it as a distortion. Guardrail: Structure the output to require a separate 'Intent Preservation' score in addition to a 'Semantic Similarity' score. Use chain-of-thought prompting to force the model to articulate the speaker's original intent before comparing the paraphrase.
Over-Reliance on a Single Source Snippet
What to watch: The model is given a short source paragraph to verify a quote, but the speaker's full position is nuanced across a longer document. The model declares a distortion because the immediate context doesn't match, missing a clarifying statement two paragraphs later. Guardrail: Always pair this prompt with a retrieval step that provides a wider context window (e.g., the full section of the document). Instruct the model to explicitly state the scope of source material it considered in its analysis.
False Negative on Implicit Distortion
What to watch: The model fails to flag a distortion created by a change in tone or emphasis, not just words. For example, changing a hesitant, conditional statement into a bold, declarative one. Guardrail: Add a specific distortion category for 'Tone and Certainty Shift' in the output schema. Include few-shot examples where the words are similar but the modal verbs (e.g., 'might' vs. 'will') or qualifiers are altered, changing the force of the claim.
Output Schema Drift on Complex Cases
What to watch: On borderline or highly complex distortions, the model abandons the strict JSON output schema and reverts to a long, unstructured paragraph of analysis, breaking the automated pipeline. Guardrail: Use a two-pass approach. The first pass generates the structured JSON. A second, validator pass checks for schema compliance. If the first pass fails, a retry prompt explicitly forbids unstructured text and instructs the model to use the 'explanation' field for all nuance.
Evaluation Rubric
Score each dimension on a 1-5 scale before shipping the Meaning Distortion Analysis Prompt. Use this rubric to calibrate human reviewers and to configure LLM-as-judge evaluation gates.
| Criterion | Pass Standard | Failure Signal | Test Method |
|---|---|---|---|
Distortion Category Accuracy | Assigned category matches the gold-label category from the calibration set in at least 90% of cases | Model selects a milder category for severe distortion or misclassifies benign paraphrase as distortion | Run against 50-example calibration set with pre-labeled distortion categories; measure exact-match accuracy |
Meaning Delta Fidelity | Before-and-after meaning comparison captures the specific semantic shift without introducing new claims not present in either text | Meaning delta is vague, omits the key semantic change, or hallucinates differences not supported by the source pair | Pairwise human review of meaning delta against source and paraphrase; flag hallucinations and omissions |
Evidence Grounding | Every distortion claim in the explanation cites a specific text span from both the original source and the paraphrased version | Explanation contains unsupported assertions about speaker intent or uses phrases like 'clearly' or 'obviously' without textual evidence | Parse explanation for citation markers; verify each marker resolves to an actual span in the input texts |
Severity Calibration | Severity score is within ±1 of the gold-label severity on a 1-5 scale for at least 85% of calibration examples | Model assigns severity 5 to minor omissions or severity 1 to context-stripping that reverses meaning | Compute mean absolute error against gold severity labels; flag examples with error >1 for review |
Context-Stripping Detection | Prompt correctly identifies when surrounding context was removed in a way that changes meaning, and specifies what was removed | Prompt treats all ellipsis or truncation as distortion without assessing whether meaning changed, or misses context-stripping that reverses intent | Test with 20 pairs where half contain meaning-altering context removal and half contain benign truncation; measure precision and recall |
Abstention Behavior | Prompt returns abstention flag when inputs are identical, when no distortion is present, or when source material is insufficient to judge | Prompt fabricates distortion categories for identical texts or confidently labels distortion when source context is missing | Test with identical-text pairs, no-distortion pairs, and truncated-source pairs; verify abstention flag is true for all three |
Output Schema Compliance | Output matches the defined JSON schema with all required fields present and no extra fields | Output is missing required fields, contains malformed JSON, or includes commentary outside the schema | Validate output against JSON Schema using a programmatic validator; reject any output that fails validation |
Retry Recovery | On schema validation failure, retry prompt with error context produces compliant output in at most 2 retries | Retry loop exceeds 3 attempts without producing valid output, or retry output repeats the same schema violation | Simulate 10 schema failures; measure retry success rate within 2 attempts and log failure patterns |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Adapt This Prompt
How to adapt
Start with the base prompt and a small calibration set of 10-15 quote pairs with known distortion labels. Remove the strict JSON output schema initially and ask for a structured text explanation. Focus on getting the distortion category labels right before enforcing format.
Prompt modification
Replace the [OUTPUT_SCHEMA] placeholder with: "Return your analysis as a clear text explanation with sections for Distortion Category, Meaning Before, Meaning After, and Evidence."
Watch for
- The model conflating 'minor rephrasing' with 'meaning distortion'
- Over-flagging when the paraphrase is actually faithful
- Inconsistent category labels across similar cases
- Missing the distinction between context-stripping and selective quoting

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us