Use this prompt when you need to produce a structured, defensible record explaining why a specific source was trusted or excluded during a fact-checking or evidence-gathering workflow. The primary job-to-be-done is generating a per-source authority document that captures credibility indicators, domain relevance, recency, and potential bias, creating an audit trail for source selection decisions. The ideal user is a verification engineer, compliance analyst, or AI pipeline builder who must justify source choices to auditors, regulators, or downstream reviewers. This prompt is essential when source authority directly impacts claim verdicts and when the rationale for trusting one source over another must be explicit and traceable.
Prompt
Source Authority Documentation Prompt

When to Use This Prompt
Define the job, reader, and constraints for the Source Authority Documentation Prompt.
This prompt requires several concrete inputs to function correctly. You must provide the source identifier and content, the claim or domain context for relevance assessment, and any known credibility signals such as author credentials, publication reputation, and peer-review status. The output is a structured authority record, typically in JSON, containing fields for authority level, credibility indicators, domain relevance score, recency assessment, bias flags, and a justification narrative. The prompt is designed to be wired into a verification pipeline where source authority records are stored alongside claim verdicts, enabling downstream audit queries like 'show me the authority justification for every source used in this batch.'
Do not use this prompt for real-time, low-latency applications where source authority is already pre-computed and cached. It is not a replacement for a static source whitelist or blocklist, nor is it designed for consumer-grade content moderation. The prompt is most effective when source authority is contested, when multiple sources conflict, or when an auditor requires a documented rationale. Avoid using it for sources where authority is self-evident and uncontested, as the overhead of generating a full record outweighs the benefit. For high-risk domains like healthcare or legal, always pair the output with human review and ensure the authority justification references specific, verifiable evidence rather than relying solely on model-generated reputation summaries.
Use Case Fit
Where the Source Authority Documentation Prompt works and where it introduces risk. Use these cards to decide if this prompt fits your verification workflow before wiring it into production.
Good Fit: Pre-Verification Source Vetting
Use when: you need to document why a source was trusted or excluded before using it as evidence in a fact-checking pipeline. Guardrail: Run this prompt during source ingestion, not after claims are already matched. Authority records should be immutable for the audit trail.
Bad Fit: Real-Time News Verification
Avoid when: latency requirements are under 500ms or the source is a breaking news article with no established reputation history. Guardrail: This prompt requires structured reasoning about credibility indicators, recency, and domain relevance. For real-time triage, use a lightweight classification router instead.
Required Inputs: Source Metadata and Claim Domain
Risk: Running this prompt without source publication date, author credentials, or the claim domain produces vague authority assessments. Guardrail: Require [SOURCE_METADATA], [CLAIM_DOMAIN], and [PUBLICATION_DATE] as mandatory inputs. Reject the prompt run if any field is null.
Operational Risk: Authority Drift Across Sources
Risk: The model may apply inconsistent credibility standards across sources in a batch, undermining audit defensibility. Guardrail: Include a [CREDIBILITY_RUBRIC] with explicit criteria for authoritativeness, recency thresholds, and domain relevance. Run eval checks for inter-source consistency.
Operational Risk: Bias Detection False Positives
Risk: The bias-detection check may flag legitimate domain expertise as bias (e.g., a climate scientist on climate topics). Guardrail: Require human review for any source flagged with high bias confidence. Log the bias-detection rationale separately from the authority score so reviewers can override without losing traceability.
Escalation Trigger: Unknown or Contested Sources
Risk: The model may hallucinate credibility indicators for sources it has no training data about, or fail to recognize contested authority in specialized domains. Guardrail: Add an [UNKNOWN_SOURCE_ESCALATION] rule: if the model cannot ground its authority assessment in provided metadata, route to a human reviewer with a structured handoff packet.
Copy-Ready Prompt Template
A reusable prompt template for generating a per-source authority record with credibility indicators, domain relevance, and recency assessment.
This prompt template is designed to be copied directly into your verification pipeline. It instructs the model to produce a structured authority record for a single source, documenting why it was trusted or excluded for a specific claim. The output is a JSON object suitable for ingestion into an audit trail or evidence database. All dynamic inputs are represented as square-bracket placeholders, which your application must resolve before sending the request to the model.
textYou are a source authority documentation specialist. Your task is to evaluate a single source and produce a structured authority record. You must be objective, evidence-based, and conservative in your assessments. Do not invent information. If a field cannot be determined from the provided context, mark it as null or 'UNKNOWN'. ## INPUT - Source Content: [SOURCE_CONTENT] - Source Metadata: [SOURCE_METADATA] - Claim Being Verified: [CLAIM_TEXT] - Verification Domain: [DOMAIN] - Current Date: [CURRENT_DATE] ## OUTPUT SCHEMA Return a single JSON object conforming to this structure: { "source_identifier": "string", "authority_assessment": { "credibility_rating": "HIGH" | "MEDIUM" | "LOW" | "UNKNOWN", "domain_relevance": "DIRECT" | "INDIRECT" | "NONE" | "UNKNOWN", "recency_assessment": { "publication_date": "string | null", "is_current_for_claim": "YES" | "NO" | "UNKNOWN", "recency_justification": "string" }, "authority_justification": "string", "bias_indicators": ["string"], "exclusion_risk": "HIGH" | "MEDIUM" | "LOW" }, "trust_decision": { "verdict": "TRUSTED" | "EXCLUDED" | "CONDITIONAL", "rationale": "string", "conditions_if_conditional": "string | null" } } ## CONSTRAINTS - Base all assessments strictly on the provided source content and metadata. - If the source is anonymous, lacks a publication date, or has no identifiable author, reflect this in the credibility rating and justification. - For bias indicators, list specific, observable signals (e.g., 'funding source conflict', 'one-sided language', 'lacks opposing viewpoints'). Do not speculate. - A source should be marked EXCLUDED if it is irrelevant, demonstrably false, or so biased that it cannot contribute reliable evidence. - A source should be marked CONDITIONAL if it can be used with caveats (e.g., 'use only for factual data, ignore editorial opinion'). ## EXAMPLES [FEW_SHOT_EXAMPLES] ## RISK LEVEL [RISK_LEVEL]
To adapt this template, replace each placeholder with data from your application context. [SOURCE_CONTENT] should contain the full text or a representative excerpt of the source. [SOURCE_METADATA] should include any available information like author, publisher, URL, and publication date. [FEW_SHOT_EXAMPLES] is critical for calibration; provide 2-3 examples showing the correct assessment for sources similar to those in your domain. If the [RISK_LEVEL] is HIGH, your implementation harness should route the output for human review before the trust decision is finalized. For production use, validate the output JSON against the schema and log any instances where credibility_rating is UNKNOWN or exclusion_risk is HIGH for operational review.
Prompt Variables
Required inputs for the Source Authority Documentation Prompt. Each placeholder must be populated before the prompt is sent to the model. Missing or malformed inputs are the most common cause of unreliable authority records.
| Placeholder | Purpose | Example | Validation Notes |
|---|---|---|---|
[SOURCE_CONTENT] | Full text or structured representation of the source being evaluated for authority | A complete news article, research paper abstract, or documentation page | Required. Must be non-empty string. Truncation beyond model context window must be flagged. Null or whitespace-only input should abort before model call. |
[SOURCE_METADATA] | Provenance metadata: publication date, author, publisher, URL, and document type | {"published": "2024-11-15", "author": "Jane Doe, PhD", "publisher": "National Institute of Standards and Technology", "url": "https://nist.gov/example", "type": "technical_report"} | Required. Must be valid JSON object. Missing publication date triggers recency-unknown flag in output. Missing author or publisher triggers authority-unknown flag. Schema validation before prompt assembly. |
[CLAIM_DOMAIN] | The subject domain of the claim this source is being evaluated to support or refute | Clinical trial results for cardiovascular drugs | Required. Must be non-empty string. Used to assess domain relevance. Generic values like 'science' reduce authority assessment precision. Domain taxonomy match recommended. |
[EVIDENCE_STANDARD] | The required standard of evidence for the verification context | Peer-reviewed primary source required; preprints insufficient | Required. Must be non-empty string. Drives authority threshold calibration. Acceptable values should be drawn from a controlled vocabulary: 'peer_reviewed_required', 'expert_consensus', 'regulatory_filing', 'journalistic_standard', 'internal_documentation'. |
[RECENCY_THRESHOLD] | Maximum acceptable age of the source in months for the given domain | 24 | Required. Must be positive integer or null. Null means recency not applicable. Values over 120 should trigger a review warning. Domain-specific defaults should be configured in application layer, not hardcoded in prompt. |
[PRIOR_AUTHORITY_RECORDS] | Previously evaluated authority records for the same source or related sources, used for consistency checks | [{"source_id": "src-001", "authority_score": 0.85, "evaluation_date": "2024-10-01"}] | Optional. Must be valid JSON array or null. When present, prompt should compare new evaluation against prior records and flag significant score drift. Empty array is valid and means no prior records exist. |
[BIAS_CHECK_DIMENSIONS] | Specific bias dimensions to evaluate for this source and domain | ["funding_source_conflict", "political_affiliation", "methodological_selection_bias"] | Required. Must be non-empty JSON array of strings. Values should come from a predefined bias taxonomy. Empty array triggers bias-detection-skipped flag. Unknown dimensions should be logged but not rejected. |
Implementation Harness Notes
How to wire the Source Authority Documentation prompt into a verification application with validation, retries, and audit-ready logging.
The Source Authority Documentation prompt is designed to be called once per source that a verification pipeline intends to use as evidence. It should not be called inline during claim matching; instead, it runs as a pre-processing step that builds a structured authority record before evidence is weighted. In a production pipeline, this prompt typically sits between source discovery (where candidate URLs or documents are identified) and evidence matching (where claims are paired with sources). The output is a machine-readable authority record that downstream components can use to decide whether to trust, deprecate, or escalate a source. Wire this prompt as a synchronous API call with a strict timeout, because authority assessment is a blocking dependency for evidence quality scoring.
The application harness should enforce a JSON output schema with required fields: source_id, authority_level (enum: high, medium, low, rejected), credibility_indicators (array of objects with indicator and evidence), domain_relevance (object with relevant_domains and justification), recency_assessment (object with publication_date, cutoff_relevance, and stale_after), bias_detection (object with detected_biases and mitigation_notes), and exclusion_risk (boolean with reason). Validate the output against this schema immediately after model response. If validation fails, retry once with the validation error message appended to the prompt as a correction instruction. If the second attempt also fails, log the failure and route the source to a human-review queue rather than silently accepting a malformed record. For high-stakes domains such as healthcare or legal verification, require human approval on any source where authority_level is low or rejected before the source is excluded from evidence matching. Log every authority assessment with the model version, prompt version, timestamp, and raw output for audit trail completeness.
Model choice matters here. Use a model with strong instruction-following and structured output capabilities, such as GPT-4o, Claude 3.5 Sonnet, or Gemini 1.5 Pro. Avoid smaller or older models that may collapse the structured schema or skip bias-detection fields. If you are processing a large batch of sources, implement a concurrency cap and cost-tracking per source, because authority assessment is a fixed per-source cost that multiplies quickly. Do not use this prompt inside a tight retrieval loop where latency is critical; instead, pre-compute authority records and store them in a cache keyed by source URL or document hash, with a TTL based on the stale_after field. When a source's authority record expires, re-run the prompt rather than silently using stale credibility data. The next step after implementation is to build eval checks that measure whether the prompt consistently detects known low-authority sources and correctly flags domain mismatch, so that your verification pipeline does not quietly degrade when source quality drops.
Expected Output Contract
Validate the structured JSON output from the Source Authority Documentation Prompt. Each field must conform to the type, requirement, and validation rule specified below before the record is accepted into the evidence store.
| Field or Element | Type or Format | Required | Validation Rule |
|---|---|---|---|
source_id | string (slug) | Must match pattern ^[a-z0-9-]+$ and be unique within the batch | |
source_title | string | Non-empty, max 500 characters; must not be a URL or raw file path | |
source_uri | string (URI) | If present, must pass RFC 3986 absolute URI validation; null allowed | |
authority_score | number (0.0-1.0) | Must be a float between 0.0 and 1.0 inclusive; parse as float and check range | |
authority_justification | string | Non-empty, min 50 characters; must reference at least one credibility indicator from the prompt's [CREDIBILITY_INDICATORS] list | |
domain_relevance | string (enum) | Must match one of: 'primary', 'secondary', 'tangential', 'irrelevant'; case-sensitive enum check | |
recency_assessment | object | Must contain 'publication_date' (ISO 8601 or null) and 'recency_verdict' (enum: 'current', 'outdated', 'unknown'); validate sub-schema | |
bias_detection_flags | array of strings | If present, each string must match an entry in the prompt's [BIAS_INDICATORS] list; empty array allowed; null allowed | |
exclusion_decision | object | Must contain 'excluded' (boolean) and 'exclusion_reason' (string if excluded=true, null if excluded=false); validate conditional null constraint |
Common Failure Modes
Source authority documentation prompts fail in predictable ways—usually because the model confuses recency with authority, accepts self-asserted credibility, or skips domain relevance checks. These cards cover the most common failure patterns and how to guard against them before the output reaches a reviewer or audit trail.
Recency Confused with Authority
What to watch: The model treats a recently published source as authoritative even when the publisher lacks domain expertise, peer review, or editorial standards. A 2024 blog post from an unknown author gets weighted above a 2020 peer-reviewed paper. Guardrail: Add an explicit instruction to separate recency assessment from authority assessment. Require the prompt to score recency and authority as independent dimensions, then flag any source that scores high on recency but low on authority.
Self-Asserted Credibility Accepted Uncritically
What to watch: The model accepts an organization's own claims about its authority—mission statements, 'About Us' pages, self-awarded credentials—without external verification. A think tank describes itself as 'non-partisan' and the model repeats that label without checking funding sources or external ratings. Guardrail: Require the prompt to distinguish between self-asserted authority signals and externally verifiable ones. Add a field for 'self-claimed vs. externally validated' and instruct the model to flag sources where authority claims cannot be independently confirmed.
Domain Relevance Skipped for Well-Known Sources
What to watch: The model assumes a source authoritative in one domain transfers authority to an unrelated domain. A respected medical journal is cited as authoritative for economic policy claims, or a top-tier newspaper's editorial section is treated as equivalent to its investigative reporting. Guardrail: Add a mandatory domain-relevance check that asks: 'Is this source authoritative for this specific claim type?' Require the output to include a domain-match justification, not just a general authority score. Flag sources where domain relevance is weak even if general reputation is strong.
Bias Detection Limited to Obvious Partisanship
What to watch: The model flags only overt political bias while missing commercial bias, funding bias, selection bias, or confirmation bias. A study funded by a pharmaceutical company passes bias checks because it doesn't mention politics. Guardrail: Expand bias detection beyond political orientation. Add structured checks for funding source influence, commercial interest, sample selection bias, and citation cherry-picking. Require the prompt to ask: 'What might this source gain from this claim being true?'
Missing or Fabricated Authority Indicators
What to watch: When the model cannot find clear authority signals for a source, it may invent plausible-sounding credentials or overstate weak signals. A source with no identifiable author gets described as 'industry-recognized' without evidence. Guardrail: Require explicit 'unknown' or 'insufficient data' markers when authority indicators cannot be verified. Add a mandatory field for 'evidence basis for authority assessment' and instruct the model to leave authority scores empty rather than guess. Validate outputs for fabricated credentials.
Single-Source Authority Overgeneralization
What to watch: The model evaluates a source's authority in isolation without considering whether the claim requires corroboration from multiple independent sources. A single authoritative source is treated as sufficient even for claims that demand cross-verification. Guardrail: Add a corroboration requirement based on claim risk level. For high-stakes or disputed claims, require the prompt to note whether multiple independent authoritative sources exist. Flag claims supported by only one source, regardless of that source's authority score.
Evaluation Rubric
Use this rubric to test the Source Authority Documentation Prompt before integrating it into a verification pipeline. Each criterion targets a specific failure mode common to source authority assessment.
| Criterion | Pass Standard | Failure Signal | Test Method |
|---|---|---|---|
Schema Compliance | Output is valid JSON matching the [OUTPUT_SCHEMA] exactly with no extra or missing fields. | JSON parse error, missing required fields, or extra unexpected keys. | Automated schema validation against the expected JSON Schema definition. |
Authority Justification Completeness | Every source in the output includes a non-empty authority-justification field that references specific credibility indicators. | Authority-justification field is null, empty string, or contains only generic statements like 'it is a good source'. | Regex check for non-empty string; LLM-as-judge check for presence of specific indicator references. |
Bias Detection Coverage | The bias-detection field is populated for every source and identifies at least one potential bias dimension when applicable. | Bias-detection field is null, 'none', or 'not applicable' for a source with known domain affiliation. | Spot-check with a set of known biased sources; verify the field is never null. |
Recency Assessment Accuracy | The recency-assessment field correctly categorizes the source relative to the claim's temporal requirements. | A source from 2015 is marked as 'current' for a claim about 2024 events, or the field is missing. | Test with date-anchored claims and sources with known publication dates; check categorization logic. |
Domain Relevance Grounding | The domain-relevance field explicitly connects the source's expertise area to the claim's domain. | Domain-relevance contains only a score without explanation, or mismatches the source's actual domain. | LLM-as-judge evaluation comparing the stated relevance to the source's known domain from a ground-truth dataset. |
Exclusion Rationale Clarity | Any source listed in the excluded-sources section includes a specific, non-generic reason for exclusion. | Exclusion reason is 'not relevant' without further detail, or the excluded-sources section is missing when sources were provided. | Check that every entry in excluded-sources has a reason string longer than 20 characters and containing a specific factor. |
Confidence Score Calibration | The confidence-score is an integer between 0 and 100 and correlates with the strength of the authority justification. | Confidence-score is 100 for a source with noted bias and low recency, or is outside the 0-100 range. | Boundary check for 0-100 integer; correlation check using a small labeled dataset with expected confidence ranges. |
Hallucinated Source Detection | Output does not fabricate source names, URLs, or credibility indicators not present in the [INPUT] context. | A source name or URL appears in the output that was not provided in the input context. | Diff check between input source identifiers and output source identifiers; flag any additions. |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Adapt This Prompt
How to adapt
Start with the base prompt and a single source document. Remove strict schema requirements initially. Focus on getting a readable authority assessment with credibility indicators, domain relevance, and recency notes. Use a simple markdown output format instead of JSON.
codeAnalyze the following source for authority on [DOMAIN]. Source: [SOURCE_DOCUMENT] Provide: - Credibility indicators - Domain relevance - Recency assessment - Bias flags
Watch for
- Missing bias detection when the source appears authoritative on surface
- Overly generous recency assessments for undated content
- No distinction between primary and secondary authority

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us