Inferensys

Prompt

Meaning Distortion Analysis Prompt

A practical prompt playbook for using the Meaning Distortion Analysis Prompt in production fact-checking and editorial verification workflows.
Developer doing prompt engineering on laptop, prompt variations visible on screen, casual coding session.
PROMPT PLAYBOOK

When to Use This Prompt

Defines the specific job, ideal user, required inputs, and critical boundaries for the Meaning Distortion Analysis Prompt.

This prompt is for fact-checkers, editorial teams, and verification engineers who need to determine whether a quoted or paraphrased statement distorts the original speaker's intended meaning. It goes beyond literal word matching to assess semantic drift, context-stripping, and intent misrepresentation. Use this prompt when you have a source statement and a reported version, and you need a structured, evidence-grounded distortion analysis with a calibrated severity label. This is not a simple string-comparison tool; it requires the model to reason about communicative intent, qualifying context, and the pragmatic effect of wording changes.

The ideal user has both the original source material and the attributed statement ready for comparison. Required inputs include the full original statement with surrounding context, the reported quote or paraphrase, and any relevant metadata such as speaker identity, date, and publication venue. The prompt is designed for high-stakes editorial workflows where a false negative (missing a real distortion) can cause public harm and a false positive (flagging an accurate paraphrase) can damage credibility. It is not suitable for real-time chat moderation, automated content flagging without human review, or cases where the original source is unavailable or heavily redacted.

Do not use this prompt when you only need a simple string similarity check, when the source material is too fragmentary to establish intent, or when the reported statement is an acknowledged opinion paraphrase rather than a factual attribution. For those cases, use the Quote-to-Source Comparison Prompt for literal alignment or the Paraphrase Fidelity Scoring Prompt for calibrated fidelity scores. After running this analysis, route outputs with a distortion severity of 'High' or 'Critical' to human review and log all results for audit trails. The next section provides the copy-ready prompt template you can adapt and deploy.

PRACTICAL GUARDRAILS

Use Case Fit

Where the Meaning Distortion Analysis Prompt works, where it fails, and what you must provide before running it in production.

01

Good Fit: Editorial Quote Review

Use when: An editor needs to verify that a quoted or paraphrased statement in a draft article faithfully represents the original speaker's position. Guardrail: Always provide the full original source context, not just the extracted quote, to prevent the model from missing context-stripping distortion.

02

Bad Fit: Real-Time Moderation

Avoid when: Latency budgets are under 500ms or when the model must make publish/block decisions without human review. Meaning distortion requires comparative reasoning over potentially long source documents. Guardrail: Route to asynchronous verification queues with human-in-the-loop for final publication decisions.

03

Required Inputs

Must provide: The attributed quote or paraphrase, the full original source text with surrounding context, and the speaker's name. Guardrail: Missing source context is the top cause of false negatives. Reject jobs where the original source is unavailable rather than guessing at meaning from partial evidence.

04

Operational Risk: Subjectivity Drift

Risk: Different reviewers may disagree on whether a paraphrase crosses the line from acceptable summary to distortion. The model's judgment can drift across runs without calibration. Guardrail: Use a calibration set of pre-graded examples in the prompt and track distortion category distributions over time. Escalate borderline cases to human review with the model's evidence attached.

05

Operational Risk: Speaker Intent Overreach

Risk: The model may claim to know what the speaker 'really meant' beyond what the source text supports, introducing its own interpretation. Guardrail: Constrain the output to compare the quote against the source text only. Prohibit language about unstated intentions. Flag any output that invents motivations not present in the provided evidence.

06

Not a Replacement for Legal Review

Avoid when: The distortion analysis will be used in defamation, libel, or legal dispute contexts without attorney review. Guardrail: This prompt is an editorial assistance tool, not a legal instrument. Any output used in legal proceedings must be reviewed by qualified counsel. Document the AI-assisted nature of the analysis in audit trails.

PROMPT PLAYBOOK

Copy-Ready Prompt Template

A production-ready system prompt for detecting and categorizing meaning distortion in quoted or paraphrased statements.

This prompt template is designed to be pasted directly into your system instructions for a Meaning Distortion Analysis task. It instructs the model to compare a provided statement against its original source material, identify whether the meaning has been distorted, and output a structured JSON report. The template uses square-bracket placeholders for all dynamic inputs, making it straightforward to integrate into an automated verification pipeline. Before using this prompt, ensure you have the original source text and the attributed statement ready to inject into the [SOURCE_TEXT] and [ATTRIBUTED_STATEMENT] placeholders, respectively.

text
You are a Meaning Distortion Analyzer. Your task is to compare an attributed statement against its original source text and determine if the statement distorts the speaker's original position.

## Input Data
- **Source Text:** [SOURCE_TEXT]
- **Attributed Statement:** [ATTRIBUTED_STATEMENT]

## Analysis Instructions
1.  **Identify the Core Claim:** Extract the central factual or positional claim from the Attributed Statement.
2.  **Locate Source Evidence:** Find the specific passage(s) in the Source Text that correspond to the claim. If no corresponding passage exists, note this as a potential fabrication.
3.  **Compare Meaning:** Analyze whether the Attributed Statement preserves the original meaning, intent, and context of the Source Text. Look for:
    - **Context-Stripping:** Removal of surrounding qualifications or conditions that change the meaning.
    - **Cherry-Picking:** Selecting a partial quote that omits contradictory or balancing material.
    - **Paraphrase Drift:** A rephrasing that introduces a different connotation or factual implication.
    - **Fabrication:** A statement with no grounding in the source text.
    - **Literal Accuracy, Intent Distortion:** A technically accurate quote that, through framing, misrepresents the speaker's overall position.
4.  **Categorize Distortion:** Assign one of the following labels:
    - `none`: The statement faithfully represents the source's meaning.
    - `minor_drift`: A slight, non-substantive shift in emphasis or wording.
    - `significant_distortion`: A clear change in meaning, omission of a key qualification, or misleading framing.
    - `fabrication`: The statement is entirely unsupported by the source.
5.  **Explain Your Reasoning:** Provide a concise, evidence-grounded explanation for your categorization, quoting the relevant parts of the Source Text and Attributed Statement.

## Output Format
You must respond with a single, valid JSON object conforming to this schema:
{
  "distortion_category": "none" | "minor_drift" | "significant_distortion" | "fabrication",
  "source_evidence": "Excerpt from the source text that is most relevant to the claim.",
  "meaning_comparison": {
    "original_meaning": "A neutral summary of the source text's position.",
    "attributed_meaning": "A neutral summary of the attributed statement's position.",
    "key_difference": "A concise description of the semantic gap, if any. Null if category is 'none'."
  },
  "explanation": "A step-by-step rationale for the distortion category, citing specific text.",
  "confidence_score": 0.0-1.0
}

## Constraints
- Base your analysis strictly on the provided Source Text and Attributed Statement. Do not use outside knowledge.
- If the Source Text is insufficient to verify the statement, set the `distortion_category` to `fabrication` and explain why.
- The `confidence_score` must reflect your certainty in the assessment based on the available evidence.

To adapt this template for your application, replace the [SOURCE_TEXT] and [ATTRIBUTED_STATEMENT] placeholders with live data before each API call. The JSON output schema is designed for direct parsing by downstream systems, such as a CMS or a human review queue. For high-stakes editorial workflows, you should route any output with a distortion_category of significant_distortion or fabrication, or a confidence_score below 0.9, to a human reviewer for final confirmation. The meaning_comparison object provides a clear, auditable summary of the AI's logic, which is essential for building trust and enabling rapid human adjudication.

IMPLEMENTATION TABLE

Prompt Variables

Each placeholder required by the Meaning Distortion Analysis Prompt, its purpose, a concrete example, and actionable validation rules for production harnesses.

PlaceholderPurposeExampleValidation Notes

[ORIGINAL_STATEMENT]

The verbatim text from the original speaker or source material, including surrounding context.

"We are seeing strong growth in enterprise accounts, though our SMB segment remains flat."

Required. Must be a non-empty string. Validate length > 20 characters to ensure sufficient context is provided. Null or truncated input should trigger a retry or human escalation.

[ATTRIBUTED_QUOTE_OR_PARAPHRASE]

The quoted or paraphrased version being evaluated for distortion against the original statement.

"The CEO reported strong growth across all business segments."

Required. Must be a non-empty string. Validate that the input is not identical to [ORIGINAL_STATEMENT]; if identical, bypass distortion analysis and return a 'verbatim match' status.

[SPEAKER_IDENTITY]

The name, title, and relevant affiliation of the original speaker to ground the analysis in authority and context.

"Jane Smith, Chief Revenue Officer, Acme Corp"

Required. Must be a non-empty string. Validate format contains at least a name. If null, the model should still proceed but flag a 'missing speaker context' warning in the output.

[DOMAIN_CONTEXT]

The subject area, industry, or situational context in which the original statement was made to calibrate interpretation.

"Q3 2024 Earnings Call, Technology Sector"

Optional. If provided, validate as a non-empty string. If null, the model must note that domain-specific nuance may be missed. Accepts freeform text or a controlled vocabulary tag.

[DISTORTION_CATEGORIES]

A predefined list of distortion types the model must choose from to ensure consistent labeling across a batch.

["context_stripping", "meaning_inversion", "overgeneralization", "cherry_picking", "fabrication"]

Required. Must be a valid JSON array of strings. Validate against a master taxonomy. If the model selects a category not in this list, flag the output for human review.

[CALIBRATION_EXAMPLES]

A set of few-shot examples with known distortion grades to anchor the model's judgment and reduce variance.

[{"original": "...", "attributed": "...", "label": "meaning_inversion", "rationale": "..."}]

Required. Must be a valid JSON array with at least 3 objects. Validate each object has 'original', 'attributed', and 'label' fields. If the model's output deviates significantly from these anchors, log a calibration drift warning.

[OUTPUT_SCHEMA]

The strict JSON schema the model must use for its response, defining the structure for the distortion label, comparison, and evidence.

{"type": "object", "properties": {"distortion_label": {"type": "string"}, "meaning_comparison": {"type": "string"}, "evidence": {"type": "string"}}, "required": ["distortion_label", "meaning_comparison", "evidence"]}

Required. Must be a valid JSON Schema object. Post-generation, validate the model's raw output against this schema. A schema validation failure should trigger a repair or retry loop, not a silent fallback.

PROMPT PLAYBOOK

Implementation Harness Notes

How to wire the Meaning Distortion Analysis Prompt into a production verification pipeline with validation, retries, and human review routing.

The Meaning Distortion Analysis Prompt is designed to operate as a single step within a larger quote-verification pipeline. It expects a structured input containing the original source excerpt, the quoted or paraphrased statement under review, and any surrounding context from both the source and the derivative work. The prompt returns a distortion category label, a before-and-after meaning comparison, and an evidence-grounded explanation. To use this in production, you must wrap the prompt in an application harness that validates the output schema, enforces confidence thresholds, and routes ambiguous cases to human review.

Start by defining a strict JSON schema for the model's output. The schema should include fields for distortion_category (an enum of labels such as NO_DISTORTION, CONTEXT_STRIPPING, SELECTIVE_QUOTING, MEANING_INVERSION, FABRICATION_RISK, and AMBIGUOUS), a meaning_comparison object with original_intent and distorted_intent strings, an explanation string, and a confidence_score between 0.0 and 1.0. After the model responds, run a validator that checks for schema compliance, enum membership, and score range. If validation fails, retry the prompt once with the validation error appended to the model's context as a correction hint. If the second attempt also fails, log the failure and escalate the item to a human review queue with the raw output attached. For high-stakes domains such as legal or medical content, require human approval on any output where confidence_score is below 0.85 or the distortion_category is AMBIGUOUS or FABRICATION_RISK.

Model choice matters here. Use a model with strong instruction-following and structured output capabilities, such as GPT-4o, Claude 3.5 Sonnet, or Gemini 1.5 Pro. Avoid smaller or older models that may collapse the distortion categories or produce unparseable explanations. If you are processing batches of quotes, implement a queue-based architecture with asynchronous workers. Each worker should log the input, output, validation result, retry count, and final disposition to an observability store. This trace data is essential for calibrating the confidence_score threshold over time and for auditing decisions. Do not treat this prompt as a standalone fact-checker; it is a comparison engine that depends on accurate source material being provided. If your pipeline includes a retrieval step, ensure the source text passed to this prompt is the full, unredacted original, not a summary or snippet, because context-stripping detection requires the surrounding material to be present.

IMPLEMENTATION TABLE

Expected Output Contract

Defines the structure, types, and validation rules for the model response. Use this contract to build a post-processing validator that rejects malformed outputs before they reach downstream systems.

Field or ElementType or FormatRequiredValidation Rule

distortion_category

enum: ["meaning_inversion", "context_stripping", "selective_emphasis", "false_equivalence", "fabricated_implication", "no_distortion"]

Must match exactly one of the defined enum values. Reject any response with an unrecognized category string.

original_meaning_summary

string (<= 280 characters)

Must be a non-empty string that does not repeat the [ORIGINAL_STATEMENT] verbatim. Length must be between 10 and 280 characters. Reject if it contains only whitespace or placeholder text like 'N/A'.

distorted_meaning_summary

string (<= 280 characters)

Must be a non-empty string that does not repeat the [QUOTED_OR_PARAPHRASED_TEXT] verbatim. Length must be between 10 and 280 characters. If distortion_category is 'no_distortion', this field must exactly equal original_meaning_summary.

distortion_explanation

string (<= 500 characters)

Must reference specific elements from both [ORIGINAL_STATEMENT] and [QUOTED_OR_PARAPHRASED_TEXT]. Reject if the explanation is generic or fails to cite at least one concrete difference in wording, omission, or framing.

evidence_excerpts

array of objects with fields: {excerpt_text: string, source_location: string}

Array must contain 1-3 objects. Each excerpt_text must be a substring matchable in [ORIGINAL_SOURCE_CONTEXT] using a case-insensitive contains check. source_location must be a non-empty string (e.g., 'paragraph 3', 'lines 12-14'). Reject if no excerpt can be located in the source context.

distortion_severity

enum: ["critical", "significant", "minor", "none"]

Must be 'critical' if distortion_category is 'meaning_inversion' or 'fabricated_implication'. Must be 'none' if distortion_category is 'no_distortion'. Reject any response that violates this mapping.

confidence_score

number (0.0 to 1.0)

Must be a float between 0.0 and 1.0 inclusive. If confidence_score < 0.7, the response must include at least 2 evidence_excerpts. Reject if confidence_score is 1.0 and distortion_severity is 'critical' without at least 2 evidence_excerpts.

requires_human_review

boolean

Must be true if distortion_severity is 'critical' or confidence_score < 0.6. Must be false if distortion_category is 'no_distortion' and confidence_score >= 0.9. Reject any response that violates this rule.

PRACTICAL GUARDRAILS

Common Failure Modes

Meaning distortion analysis is a high-stakes, subjective task. These are the most common failure modes observed when deploying this prompt in production editorial and verification pipelines, along with practical mitigations.

01

Calibration Drift Across Reviewers

What to watch: The model's severity grading (e.g., 'minor distortion' vs. 'major distortion') drifts over a batch of evaluations or fails to align with your editorial team's standards. This leads to inconsistent enforcement and reviewer fatigue. Guardrail: Include a calibration set of 3-5 pre-scored examples in the prompt context before the target quote. Run a weekly inter-rater reliability check between the model's scores and a human editor on a holdout set.

02

Confusing Editing with Distortion

What to watch: The prompt flags standard editorial cleanup (removing filler words, correcting grammar in a transcript) as 'context-stripping' or 'meaning distortion.' This generates false positives that waste reviewer time. Guardrail: Add explicit negative examples in the few-shot prompt that distinguish between benign editing for clarity and malicious removal of qualifying context. Define a 'de minimis' threshold for grammatical corrections.

03

Ignoring the Speaker's Intent

What to watch: The analysis focuses on strict lexical overlap and misses the speaker's broader argumentative intent. A paraphrase might be lexically different but faithfully represent the point, and the model incorrectly flags it as a distortion. Guardrail: Structure the output to require a separate 'Intent Preservation' score in addition to a 'Semantic Similarity' score. Use chain-of-thought prompting to force the model to articulate the speaker's original intent before comparing the paraphrase.

04

Over-Reliance on a Single Source Snippet

What to watch: The model is given a short source paragraph to verify a quote, but the speaker's full position is nuanced across a longer document. The model declares a distortion because the immediate context doesn't match, missing a clarifying statement two paragraphs later. Guardrail: Always pair this prompt with a retrieval step that provides a wider context window (e.g., the full section of the document). Instruct the model to explicitly state the scope of source material it considered in its analysis.

05

False Negative on Implicit Distortion

What to watch: The model fails to flag a distortion created by a change in tone or emphasis, not just words. For example, changing a hesitant, conditional statement into a bold, declarative one. Guardrail: Add a specific distortion category for 'Tone and Certainty Shift' in the output schema. Include few-shot examples where the words are similar but the modal verbs (e.g., 'might' vs. 'will') or qualifiers are altered, changing the force of the claim.

06

Output Schema Drift on Complex Cases

What to watch: On borderline or highly complex distortions, the model abandons the strict JSON output schema and reverts to a long, unstructured paragraph of analysis, breaking the automated pipeline. Guardrail: Use a two-pass approach. The first pass generates the structured JSON. A second, validator pass checks for schema compliance. If the first pass fails, a retry prompt explicitly forbids unstructured text and instructs the model to use the 'explanation' field for all nuance.

IMPLEMENTATION TABLE

Evaluation Rubric

Score each dimension on a 1-5 scale before shipping the Meaning Distortion Analysis Prompt. Use this rubric to calibrate human reviewers and to configure LLM-as-judge evaluation gates.

CriterionPass StandardFailure SignalTest Method

Distortion Category Accuracy

Assigned category matches the gold-label category from the calibration set in at least 90% of cases

Model selects a milder category for severe distortion or misclassifies benign paraphrase as distortion

Run against 50-example calibration set with pre-labeled distortion categories; measure exact-match accuracy

Meaning Delta Fidelity

Before-and-after meaning comparison captures the specific semantic shift without introducing new claims not present in either text

Meaning delta is vague, omits the key semantic change, or hallucinates differences not supported by the source pair

Pairwise human review of meaning delta against source and paraphrase; flag hallucinations and omissions

Evidence Grounding

Every distortion claim in the explanation cites a specific text span from both the original source and the paraphrased version

Explanation contains unsupported assertions about speaker intent or uses phrases like 'clearly' or 'obviously' without textual evidence

Parse explanation for citation markers; verify each marker resolves to an actual span in the input texts

Severity Calibration

Severity score is within ±1 of the gold-label severity on a 1-5 scale for at least 85% of calibration examples

Model assigns severity 5 to minor omissions or severity 1 to context-stripping that reverses meaning

Compute mean absolute error against gold severity labels; flag examples with error >1 for review

Context-Stripping Detection

Prompt correctly identifies when surrounding context was removed in a way that changes meaning, and specifies what was removed

Prompt treats all ellipsis or truncation as distortion without assessing whether meaning changed, or misses context-stripping that reverses intent

Test with 20 pairs where half contain meaning-altering context removal and half contain benign truncation; measure precision and recall

Abstention Behavior

Prompt returns abstention flag when inputs are identical, when no distortion is present, or when source material is insufficient to judge

Prompt fabricates distortion categories for identical texts or confidently labels distortion when source context is missing

Test with identical-text pairs, no-distortion pairs, and truncated-source pairs; verify abstention flag is true for all three

Output Schema Compliance

Output matches the defined JSON schema with all required fields present and no extra fields

Output is missing required fields, contains malformed JSON, or includes commentary outside the schema

Validate output against JSON Schema using a programmatic validator; reject any output that fails validation

Retry Recovery

On schema validation failure, retry prompt with error context produces compliant output in at most 2 retries

Retry loop exceeds 3 attempts without producing valid output, or retry output repeats the same schema violation

Simulate 10 schema failures; measure retry success rate within 2 attempts and log failure patterns

ADAPTATION OPTIONS

Adapt This Prompt

How to adapt

Start with the base prompt and a small calibration set of 10-15 quote pairs with known distortion labels. Remove the strict JSON output schema initially and ask for a structured text explanation. Focus on getting the distortion category labels right before enforcing format.

Prompt modification

Replace the [OUTPUT_SCHEMA] placeholder with: "Return your analysis as a clear text explanation with sections for Distortion Category, Meaning Before, Meaning After, and Evidence."

Watch for

  • The model conflating 'minor rephrasing' with 'meaning distortion'
  • Over-flagging when the paraphrase is actually faithful
  • Inconsistent category labels across similar cases
  • Missing the distinction between context-stripping and selective quoting
Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.