This prompt is designed for clinical decision support teams who need to synthesize answers from retrieved medical literature, clinical guidelines, and trial data. The primary job-to-be-done is generating an evidence-graded answer that clearly separates guideline recommendations from individual study findings, includes study design notes, and assigns a confidence level to each claim. The ideal user is an AI engineer or clinical informaticist building a RAG system for healthcare professionals, where the system must produce auditable, source-grounded answers that a clinician can quickly verify. The required context is a set of retrieved passages from a trusted medical knowledge base, such as PubMed abstracts, clinical practice guidelines, or institutional protocols.
Prompt
Clinical Evidence Synthesis Prompt for RAG

When to Use This Prompt
Define the job, ideal user, required context, and constraints for the Clinical Evidence Synthesis Prompt for RAG.
Do not use this prompt when the system is making patient-specific care recommendations without a human in the loop. It is not suitable for generating differential diagnoses, treatment plans, or medication orders that will be acted upon without physician review. The prompt is also inappropriate when the retrieved context contains only low-quality evidence, such as single case reports or non-peer-reviewed preprints, without explicit flagging of that limitation. If the input question requires multi-step clinical reasoning across unretrieved documents, a multi-hop RAG architecture with decomposition should be used instead. The prompt assumes that retrieval has already occurred and that the evidence is relevant; it does not perform its own search or evidence ranking.
Before implementing this prompt, ensure your pipeline includes a retrieval step that returns full citation metadata (authors, journal, publication date, study type) alongside the passage text. The prompt's value comes from its ability to structure that metadata into a graded evidence synthesis. If your retrieval system cannot supply study design or publication date, the prompt's output quality will degrade significantly. After generation, every output must pass through a human review stage for any patient-facing use. Plan to implement automated evaluation checks for citation hallucination, confidence level consistency, and separation of guideline versus study evidence. If the system will operate in a HIPAA-regulated environment, ensure that the prompt's output format does not inadvertently include or reconstruct protected health information from the retrieved context.
Use Case Fit
Where the Clinical Evidence Synthesis Prompt works, where it fails, and the operational preconditions required before deployment.
Good Fit: Guideline-Aware Synthesis
Use when: you need to answer clinical questions by synthesizing multiple retrieved studies and practice guidelines into a single, graded response. Guardrail: The prompt must explicitly separate guideline recommendations (with strength-of-recommendation tags) from individual study findings to prevent conflation of evidence hierarchies.
Bad Fit: Patient-Specific Decisions
Avoid when: the output directly dictates a treatment plan for an individual patient without a clinician in the loop. Guardrail: The system must refuse to generate prescriptive instructions and instead frame all output as 'information retrieval for clinical consideration,' requiring human review before any patient-specific action.
Required Inputs: Structured Evidence Chunks
Risk: The model hallucinates study details if the retrieval step fails or returns noisy text. Guardrail: The prompt requires pre-chunked evidence with explicit metadata (study type, publication date, sample size). If metadata is missing, the model must flag the evidence gap rather than invent plausible study designs.
Operational Risk: Temporal Staleness
Risk: The model synthesizes outdated guidelines without warning, presenting old evidence as current standard of care. Guardrail: The prompt must enforce a strict instruction to weight recency and explicitly flag the publication year of every cited source. If the most recent evidence is older than a configurable threshold, the model must emit a staleness warning.
Operational Risk: Confidence Overstatement
Risk: The model presents weak observational data with the same certainty as a randomized controlled trial. Guardrail: The prompt must enforce a strict evidence-grading taxonomy (e.g., Level I-V) and require the model to downgrade language certainty for lower-quality study designs. Eval checks should scan for unqualified superlatives.
Bad Fit: Real-Time Adverse Event Monitoring
Avoid when: the system must detect safety signals from streaming pharmacovigilance data. Guardrail: This prompt is designed for retrospective synthesis, not real-time signal detection. Using it for live safety monitoring risks missing temporal patterns. A separate streaming anomaly detection pipeline is required.
Copy-Ready Prompt Template
A reusable prompt for synthesizing clinical evidence from retrieved medical literature and guidelines, with square-bracket placeholders for your RAG pipeline.
This prompt template is designed to be wired directly into a clinical RAG system. It accepts retrieved context from your retrieval pipeline, a clinical question, and optional constraints, then produces a structured evidence synthesis with explicit grading, study design notes, and a clear separation between guideline recommendations and individual study findings. The template uses square-bracket placeholders that your application must populate before sending the request to the model. Every placeholder is a required integration point—do not ship this prompt with unresolved brackets.
textYou are a clinical evidence synthesis assistant. Your job is to answer a clinical question using ONLY the retrieved context provided below. You must not introduce external knowledge, fabricate citations, or provide medical advice. Your output must be structured, evidence-graded, and suitable for review by a qualified clinician. ## INPUT Clinical Question: [CLINICAL_QUESTION] Retrieved Context: [RETRIEVED_CONTEXT] ## CONSTRAINTS - Answer ONLY from the retrieved context. If the context is insufficient, state that explicitly. - Do not speculate, extrapolate, or fill gaps with general medical knowledge. - Separate guideline recommendations from individual study findings. - For each claim, note the study design (e.g., RCT, meta-analysis, cohort study, case series, guideline). - Assign a confidence level (High, Moderate, Low, Very Low) based on evidence quality and consistency. - Flag any conflicts between sources. - If the question implies a patient-specific decision, include a mandatory disclaimer that this synthesis is not clinical advice and requires independent clinical judgment. - [ADDITIONAL_CONSTRAINTS] ## OUTPUT SCHEMA Return a JSON object with the following structure: { "clinical_question": "string", "evidence_summary": "string (narrative synthesis, 2-4 paragraphs)", "guideline_recommendations": [ { "recommendation": "string", "source": "string (guideline name, issuing body, year)", "strength_of_recommendation": "string (Strong, Moderate, Weak, Conditional)", "confidence": "string (High, Moderate, Low, Very Low)" } ], "individual_study_findings": [ { "finding": "string", "study_design": "string", "source": "string (author, year, journal or trial ID)", "sample_size": "string or null", "confidence": "string (High, Moderate, Low, Very Low)", "limitations": "string or null" } ], "source_conflicts": [ { "conflict_description": "string", "sources_involved": ["string"], "resolution_note": "string (how the conflict was handled in synthesis)" } ], "evidence_gaps": ["string (questions the retrieved context cannot answer)"], "overall_confidence": "string (High, Moderate, Low, Very Low)", "disclaimer": "string (mandatory patient-specific decision warning)" } ## EXAMPLES [FEW_SHOT_EXAMPLES] ## INSTRUCTIONS 1. Read the clinical question and all retrieved context carefully. 2. Identify guideline recommendations first, then individual study findings. 3. Grade evidence using study design hierarchy and internal validity signals present in the context. 4. Note any conflicts between sources and how you resolved them in synthesis. 5. List specific questions the retrieved context cannot answer under evidence_gaps. 6. If confidence is Low or Very Low, explain why in the evidence_summary. 7. Always include the disclaimer for patient-specific questions.
Adaptation guidance: Replace [CLINICAL_QUESTION] with the user's query. Populate [RETRIEVED_CONTEXT] with the top-k chunks from your retrieval pipeline—include source metadata (author, year, journal, study design) in each chunk so the model can grade evidence accurately. Use [ADDITIONAL_CONSTRAINTS] to inject domain-specific rules (e.g., 'Only use evidence from the last 5 years' or 'Prioritize Cochrane reviews'). Provide 1-3 [FEW_SHOT_EXAMPLES] showing ideal input-output pairs for your specific clinical domain. Before deploying, run this prompt through your eval suite to verify citation accuracy, confidence calibration, and conflict detection. Always route outputs flagged as Low or Very Low confidence to a human review queue.
Prompt Variables
Placeholders required by the Clinical Evidence Synthesis Prompt. Each variable must be populated before the prompt is assembled and sent to the model. Validation notes describe how to check that the variable is correctly formed and safe to use.
| Placeholder | Purpose | Example | Validation Notes |
|---|---|---|---|
[CLINICAL_QUESTION] | The user's clinical question to be answered from retrieved evidence | In adults with type 2 diabetes, does SGLT2 inhibitor therapy reduce heart failure hospitalization compared to DPP-4 inhibitors? | Must be a complete question with population, intervention, comparator, outcome elements. Reject empty or non-clinical questions. Max 500 chars. |
[RETRIEVED_EVIDENCE] | Array of evidence passages retrieved from medical literature, guidelines, or knowledge bases | [{"source_id": "pmid_12345", "title": "EMPA-REG OUTCOME", "text": "...", "pub_date": "2015-09-17", "study_type": "RCT"}] | Must be valid JSON array with source_id, text, and study_type fields. Reject if empty or if text fields are null. Validate study_type against controlled vocabulary. |
[EVIDENCE_GRADING_SCHEMA] | The grading system to apply to evidence (GRADE, Oxford CEBM, custom) | GRADE | Must match one of: GRADE, OXFORD_CEBM, CUSTOM. If CUSTOM, require [CUSTOM_GRADING_RULES] to be provided. Reject unknown values. |
[CUSTOM_GRADING_RULES] | User-defined evidence grading rules when EVIDENCE_GRADING_SCHEMA is CUSTOM | Level A: consistent RCTs. Level B: inconsistent or limited RCTs. Level C: observational studies only. | Required only if EVIDENCE_GRADING_SCHEMA is CUSTOM. Must contain at least 2 grading levels with definitions. Max 1000 chars. |
[OUTPUT_SECTIONS] | Ordered list of sections the answer must contain | ["summary", "evidence_synthesis", "guideline_recommendations", "study_details", "confidence_assessment", "limitations"] | Must be a JSON array of valid section names. Reject if summary or confidence_assessment is missing. Validate against allowed section names. |
[CONFIDENCE_THRESHOLD] | Minimum confidence level required to generate an answer; below this the system should abstain | 0.7 | Must be a float between 0.0 and 1.0. If confidence is below threshold, the prompt should trigger abstention logic instead of answer generation. |
[HUMAN_REVIEW_REQUIRED] | Flag indicating whether the output requires human review before use | Must be boolean. If true, the generated answer must be routed to a review queue and not surfaced directly to end users. If false, log the decision with rationale. |
Common Failure Modes
Clinical evidence synthesis is high-stakes. These are the most common failure modes when generating answers from medical literature and guidelines, along with practical mitigations to deploy before production.
Evidence-Grade Inflation
What to watch: The model upgrades weak evidence (case reports, expert opinion) to sound like strong evidence (RCTs, meta-analyses) by using authoritative language without the underlying study design to support it. Guardrail: Require explicit evidence-grade labels (e.g., 'Level 1: Systematic Review', 'Level 4: Case Series') in the output schema and validate that the grade matches the cited study type before surfacing the answer.
Guideline vs. Study Conflation
What to watch: The model blends a single-study finding into what reads like a clinical practice guideline recommendation, erasing the distinction between broad consensus and an individual research result. Guardrail: Enforce a strict output section split: 'Guideline Recommendations' must cite a recognized guideline body and version; 'Individual Study Findings' must include sample size, study design, and explicit caveats about generalizability.
Temporal Evidence Drift
What to watch: The model synthesizes an answer from a mix of current and outdated studies without surfacing publication dates, making a 2012 finding appear equally valid as a 2024 finding. This is especially dangerous when guidelines have been superseded. Guardrail: Include publication year in every citation and add a 'Recency Check' instruction: 'If any cited source is older than [CUTOFF_YEAR], explicitly note its age and flag whether more recent evidence may supersede it.'
Patient-Specific Overgeneralization
What to watch: The model applies population-level evidence to a specific patient scenario without surfacing exclusion criteria, comorbidity gaps, or demographic mismatches between the study population and the patient in question. Guardrail: Add a mandatory 'Applicability Assessment' field that compares the patient context to the study population characteristics and flags mismatches. Require human review before any patient-specific answer is surfaced.
Confidence Without Calibration
What to watch: The model expresses high confidence in answers even when the underlying evidence is sparse, conflicting, or low-quality. Phrases like 'the evidence clearly shows' appear regardless of evidential strength. Guardrail: Require a structured 'Confidence Level' field (High/Moderate/Low/Insufficient) tied to explicit criteria: number of sources, study design quality, consistency across sources, and recency. Validate that 'High' confidence requires multiple concordant high-quality sources.
Missing Negative Evidence
What to watch: The model reports what the evidence supports but omits what the evidence does not support or where evidence is absent—creating a falsely complete picture by silence on gaps. Guardrail: Add an 'Evidence Gaps' section to the output schema that explicitly lists: questions the retrieved context could not answer, outcomes not studied, populations excluded, and areas where no guideline consensus exists.
Evaluation Rubric
Use this rubric to test the clinical evidence synthesis prompt before shipping. Each criterion targets a known failure mode in medical RAG. Run these checks on a golden dataset of 20-50 clinical questions with known evidence.
| Criterion | Pass Standard | Failure Signal | Test Method |
|---|---|---|---|
Evidence Grounding | Every clinical claim maps to a retrieved source passage | Claim appears without a citation or the cited passage does not support the claim | Automated NLI check: for each sentence with a citation, verify entailment score > 0.7 against the cited passage |
Study Design Attribution | Study type (RCT, meta-analysis, cohort, case report) is stated for each cited source | Citation present but study design missing or incorrectly labeled (e.g., RCT called a guideline) | Regex match for study design terms; spot-check 10% of outputs against source metadata |
Guideline vs. Individual Study Separation | Guideline recommendations are explicitly labeled and not conflated with single-study findings | Output presents a single-study result as a guideline recommendation or vice versa | LLM-as-judge check: prompt a second model to classify each recommendation as guideline-derived or study-derived; flag mismatches |
Confidence Level Calibration | Confidence level (High/Moderate/Low/Very Low) matches the evidence hierarchy | High confidence assigned to a case report or low confidence assigned to a meta-analysis without justification | Rule-based check: map study design to minimum confidence floor; flag violations for human review |
Uncertainty Disclosure | Limitations, population differences, and evidence gaps are stated when present | Output presents findings as universally applicable without noting sample size, population, or conflict limitations | Keyword check for limitation terms (limited, small sample, not generalizable, conflict); absence triggers a review flag |
Abstention Trigger | Prompt refuses to answer or returns empty clinical claims when retrieved evidence is insufficient | Output fabricates clinical guidance when retrieval returns low-relevance or empty context | Test with 5 empty-context queries and 5 low-relevance queries; pass if abstention rate is 100% for empty and > 80% for low-relevance |
Citation Format Consistency | All citations follow the specified format (Author, Year, Journal abbreviation or PMID) | Citations appear as bare URLs, incomplete references, or hallucinated PMIDs | Regex validation against expected citation pattern; cross-check PMIDs against PubMed API for existence |
Human Review Flagging | Output includes a mandatory human-review disclaimer for patient-specific decisions | Disclaimer missing or output implies the answer constitutes medical advice | String match for required disclaimer text; fail if absent in any output |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Adapt This Prompt
How to adapt
Start with the base prompt and a single PDF of clinical guidelines. Use a frontier model (GPT-4o, Claude 3.5 Sonnet) with default temperature. Remove strict schema enforcement initially—accept markdown output with manual review. Focus on getting evidence grading and study design notes right before adding structured JSON.
Simplify the prompt by removing [EVIDENCE_GRADE_RUBRIC] and [CONFLICT_RESOLUTION_RULES] placeholders. Replace with inline instructions: "Rate confidence as High, Moderate, or Low based on study design and recency."
Watch for
- Model conflating guideline recommendations with individual study findings
- Missing study design labels (RCT, meta-analysis, observational)
- Overconfident language when evidence is weak or contradictory
- No separation between statistically significant and clinically significant findings

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us