Inferensys

Prompt

Engineering Failure Analysis Claim Verification Prompt Template

A practical prompt playbook for reliability and root cause analysis teams using AI to verify causal claims in incident reports against failure data, design specs, and operational logs. Separates established causes from hypotheses with evidence sufficiency scoring.
Developer doing prompt engineering on laptop, prompt variations visible on screen, casual coding session.
PROMPT PLAYBOOK

When to Use This Prompt

A practical guide to deploying the Engineering Failure Analysis Claim Verification prompt for reliability engineers and incident investigators who need to validate causal claims against structured evidence.

This prompt is designed for reliability engineers, failure analysis teams, and incident investigators who need to verify causal claims in post-incident reports. Use it when you have an incident report containing assertions about what caused a failure and you need to check those claims against structured evidence such as telemetry logs, design specifications, material test data, and maintenance records. The prompt separates claims that are directly supported by evidence from those that remain hypotheses, assigns an evidence sufficiency score to each causal claim, and flags contradictions between the report narrative and the source data. This is not a root cause analysis generator. It verifies claims that have already been made, making it suitable for peer review of incident reports, regulatory submission checks, and internal engineering review workflows where traceability from claim to evidence is required.

The ideal user is someone who already has a written incident report and a collection of structured evidence sources. You should not use this prompt to generate root cause hypotheses from raw data, to replace a formal failure mode and effects analysis (FMEA), or to make final determinations about liability or regulatory compliance without human review. The prompt works best when evidence is well-organized and claims are stated explicitly. If the incident report uses vague language like 'the component likely failed due to fatigue,' the prompt will flag this as a hypothesis rather than a verified claim. For high-risk domains such as aerospace, medical devices, or structural engineering, always route outputs through a qualified engineer for final sign-off. The evidence sufficiency scores are decision-support tools, not certifications of correctness.

Before using this prompt, prepare your inputs carefully. Gather the incident report text, any supporting evidence documents, and a clear output schema that defines how you want claims, evidence matches, scores, and contradictions structured. The prompt template uses square-bracket placeholders for [INCIDENT_REPORT], [EVIDENCE_DOCUMENTS], [OUTPUT_SCHEMA], and [CONSTRAINTS]. You can adapt the constraints section to match your organization's evidence standards, such as requiring timestamp correlation within a specific tolerance window or mandating that material test data must come from certified labs. After running the prompt, validate the output against your schema, check for missing claims, and route any claims with low evidence sufficiency scores to a human reviewer. The next section provides the full prompt template you can copy and adapt.

PRACTICAL GUARDRAILS

Use Case Fit

Where this prompt works and where it does not. Engineering failure analysis demands causal rigor, evidence sufficiency scoring, and clear separation of established causes from hypotheses.

01

Good Fit: Structured Post-Incident Reviews

Use when: your team has completed an incident investigation with collected failure data, design specs, and operational logs. The prompt excels at verifying causal claims in structured postmortems. Guardrail: provide all source materials upfront; the prompt cannot infer missing evidence.

02

Bad Fit: Real-Time Incident Response

Avoid when: the incident is still active and data is incomplete. The prompt requires a stable evidence set to score causal claims. Guardrail: use this prompt during the analysis phase, not during live triage. Escalate active incidents to on-call runbooks.

03

Required Inputs: Evidence-Rich Source Pack

What you need: failure data (logs, metrics, traces), design specifications, operational procedures, and the incident report containing causal claims. Guardrail: missing any of these inputs degrades evidence sufficiency scoring. Validate input completeness before invoking the prompt.

04

Operational Risk: Over-Confident Causal Attribution

What to watch: the model may present hypotheses as established causes when evidence is weak or circumstantial. Guardrail: always require evidence sufficiency scores per claim and route low-confidence findings to human review before finalizing the postmortem.

05

Domain Boundary: Physical vs. Software Failures

What to watch: the prompt is designed for physical engineering failures (mechanical, structural, electrical). Software-only incidents may lack the design spec and physical evidence the prompt expects. Guardrail: adapt the evidence schema for software incidents or use a software-specific root cause analysis prompt.

06

Regulatory Sensitivity: Safety-Critical Systems

What to watch: in regulated industries (aerospace, medical devices, nuclear), causal claims have legal and safety implications. Guardrail: all AI-assisted verification outputs must be reviewed by a qualified engineer. The prompt output is a draft analysis aid, not a final determination.

PROMPT PLAYBOOK

Copy-Ready Prompt Template

A copy-ready prompt for verifying causal claims in engineering failure analysis reports against evidence sources.

This prompt template is designed for reliability and root cause analysis teams who need to verify causal claims in incident reports. It separates established causes from hypotheses and scores the sufficiency of evidence for each claim. The template uses square-bracket placeholders that you must replace with your specific incident report content, evidence sources, and output requirements before use.

code
You are an engineering failure analysis verifier. Your task is to examine causal claims in an incident report and verify them against provided evidence sources.

## INPUT

### INCIDENT REPORT
[INCIDENT_REPORT]

### EVIDENCE SOURCES
[EVIDENCE_SOURCES]

### OUTPUT SCHEMA
[OUTPUT_SCHEMA]

### CONSTRAINTS
[CONSTRAINTS]

## INSTRUCTIONS

1. Extract every distinct causal claim from the incident report. A causal claim asserts that a specific factor, event, or condition caused or contributed to the failure.

2. For each causal claim, determine its verification status using only the provided evidence sources:
   - **ESTABLISHED**: The claim is directly supported by evidence in the sources.
   - **HYPOTHESIS**: The claim is plausible but lacks sufficient evidence in the provided sources.
   - **CONTRADICTED**: The claim is contradicted by evidence in the sources.
   - **UNSUPPORTED**: The claim cannot be evaluated because relevant evidence is missing from the sources.

3. For each claim, provide:
   - The exact claim text from the report.
   - The verification status.
   - An evidence sufficiency score from 1 (no evidence) to 5 (conclusive evidence).
   - Specific citations to evidence sources that support or contradict the claim.
   - A brief explanation of the reasoning.

4. If multiple causes are presented as a chain, evaluate each link separately and note dependencies.

5. Flag any claims that rely on assumptions not present in the evidence sources.

6. Do not introduce causal theories not present in the incident report.

7. If [RISK_LEVEL] is "high", include a human-review recommendation for any claim scored below 3.

## OUTPUT FORMAT

Return a JSON object with the following structure:
{
  "claims": [
    {
      "claim_text": "string",
      "verification_status": "ESTABLISHED | HYPOTHESIS | CONTRADICTED | UNSUPPORTED",
      "evidence_sufficiency_score": 1-5,
      "evidence_citations": ["string"],
      "reasoning": "string",
      "dependencies": ["string"] | null,
      "human_review_recommended": true | false
    }
  ],
  "summary": {
    "total_claims": number,
    "established_count": number,
    "hypothesis_count": number,
    "contradicted_count": number,
    "unsupported_count": number,
    "overall_confidence": "HIGH | MEDIUM | LOW"
  }
}

To adapt this template, replace [INCIDENT_REPORT] with the full text of the failure analysis or post-incident review. Replace [EVIDENCE_SOURCES] with clearly labeled source documents such as failure data logs, design specifications, operational records, maintenance histories, and test results. Define [OUTPUT_SCHEMA] if you need additional fields beyond the default structure, such as severity classifications or subsystem tags. Set [CONSTRAINTS] to specify domain-specific rules, such as acceptable tolerance windows for numerical claims or required evidence types for particular failure modes. Set [RISK_LEVEL] to "high" for safety-critical systems where unverified claims require mandatory human review before any downstream action. Always validate the output JSON against your schema before ingesting it into incident management or reliability workflows.

IMPLEMENTATION TABLE

Prompt Variables

Inputs the Engineering Failure Analysis Claim Verification prompt needs to work reliably. Validate each before sending.

PlaceholderPurposeExampleValidation Notes

[INCIDENT_REPORT]

Full text of the incident report containing causal claims to verify

Postmortem: US-East-1 outage on 2025-03-15. Root cause identified as database connection pool exhaustion due to misconfigured connection timeout.

Required. Must be non-empty string. Check for minimum 50 characters to ensure sufficient context. Reject if only a title or one-liner.

[FAILURE_DATA]

Structured failure data including timelines, metrics, error logs, and sensor readings

{"timestamp": "2025-03-15T14:32:00Z", "error_rate": 0.47, "latency_p99_ms": 8500, "connection_pool_active": 0, "connection_pool_pending": 1247}

Required. Must be valid JSON or structured text. Validate presence of timestamp field and at least one quantitative measurement. Null allowed if no telemetry exists, but flag for human review.

[DESIGN_SPECS]

Relevant design specifications, architecture diagrams, or intended system behavior documentation

Connection pool configuration: max_connections=100, timeout_ms=30000, retry_policy=exponential_backoff. Load balancer health check interval: 5s.

Required. Must be non-empty. Validate that specs reference components mentioned in incident report. If specs are missing for a claimed component, mark as evidence gap.

[OPERATIONAL_LOGS]

Operational logs from the incident window including deployment records, config changes, and runbooks executed

Mar 15 14:28:03 UTC: Deployed config change PR #4521 (connection_timeout: 30000 -> 3000). Mar 15 14:29:17 UTC: Health checks failing on 3 of 8 nodes.

Required. Must include timestamps within incident window. Validate log format consistency. If logs are incomplete or truncated, set logs_completeness flag to partial and note in output.

[CAUSAL_CLAIMS]

Pre-extracted causal claims from the incident report to verify individually

["Connection timeout misconfiguration caused pool exhaustion", "Health check failures were a downstream symptom not a cause", "Rollback of config change resolved the incident"]

Optional. If provided, must be a JSON array of strings. If omitted, prompt will extract claims from [INCIDENT_REPORT]. Validate each claim is a complete sentence with a causal assertion.

[EVIDENCE_STANDARD]

Required evidence standard for claim acceptance: preponderance, clear-and-convincing, or beyond-reasonable-doubt

clear-and-convincing

Required. Must be one of: preponderance, clear-and-convincing, beyond-reasonable-doubt. Default to clear-and-convincing if not specified. Affects evidence sufficiency scoring thresholds.

[OUTPUT_SCHEMA]

Expected output structure for claim verification results

{"claim": "string", "verdict": "established|hypothesis|unsupported|contradicted", "evidence_sufficiency": 0.0-1.0, "supporting_evidence": [], "contradicting_evidence": [], "missing_evidence_gaps": [], "confidence": 0.0-1.0}

Required. Must be valid JSON Schema or example structure. Validate that schema includes fields for verdict, evidence, and confidence. Reject schemas without evidence tracking fields.

[CONSTRAINTS]

Operational constraints for the verification: time budget, evidence access limits, or domain-specific rules

Do not speculate beyond provided data. Mark any claim requiring vendor logs as unverifiable. Time budget: 30 seconds per claim.

Optional. If provided, parse for actionable constraints. Validate that constraints are specific and testable. If constraints conflict with evidence standard, flag for human resolution before running verification.

PROMPT PLAYBOOK

Implementation Harness Notes

How to wire the Engineering Failure Analysis Claim Verification prompt into a production reliability workflow with validation, retries, and human review gates.

The Engineering Failure Analysis Claim Verification prompt is designed to operate as a structured evidence processor within a larger incident review pipeline, not as a standalone chat interface. The prompt expects a specific set of inputs—an incident report, design specifications, operational logs, and a list of extracted causal claims—and returns a structured JSON output with evidence sufficiency scoring for each claim. To integrate this into an application, you should build a harness that pre-processes these inputs, calls the model, validates the output against a strict schema, and routes low-confidence or contradictory results to a human reliability engineer for final adjudication. The model is acting as an analytical assistant, not an authority; its output is a recommendation for review, not a published root cause determination.

Input Assembly and Pre-processing: Before calling the prompt, your application must assemble the [INCIDENT_REPORT], [DESIGN_SPECS], [OPERATIONAL_LOGS], and [CAUSAL_CLAIMS] placeholders. The [CAUSAL_CLAIMS] list should be pre-extracted from the incident report using a separate claim extraction prompt or a deterministic parser. Each claim must be a single, atomic causal assertion (e.g., 'The O-ring failed due to low-temperature embrittlement'). The [OPERATIONAL_LOGS] should be trimmed to a relevant time window around the incident to stay within context limits. For long design specs, use a retrieval step (RAG) to pull only the sections relevant to the failed component or system. Model choice: Use a model with strong reasoning and structured output capabilities (e.g., GPT-4o, Claude 3.5 Sonnet) and set temperature=0 for deterministic, repeatable analysis. Tool use: If your logs or specs are in a database, provide a tool for the model to query specific parameters (e.g., get_sensor_data(device_id, time_range)) rather than dumping raw logs into the context window. This reduces noise and hallucination risk.

Output Validation and Retry Logic: The prompt template requests a specific JSON output schema with fields like claim_id, evidence_items, sufficiency_score, and established_cause. Your application must validate this output against a strict schema immediately after the model responds. If validation fails (missing fields, wrong types, scores out of range), implement a retry recovery loop: feed the validation error message back to the model along with the original prompt and ask it to correct the output. Limit retries to 2-3 attempts before escalating to a human. Critical validation checks: (1) Every evidence_item must include a source_reference that points to a specific section of the provided documents or a specific log entry timestamp. Reject any evidence that lacks a traceable source. (2) sufficiency_score must be an integer between 1 and 5. (3) The established_cause boolean must be consistent with the score—a score of 4 or 5 should generally map to true, while 1-3 should map to false. Flag inconsistencies for human review. Logging: Log every model input, output, validation result, and retry attempt for auditability. This is critical for safety-sensitive failure analysis where decisions may be reviewed by regulators or in post-incident inquiries.

Human Review Routing and Escalation: Not all claims can or should be auto-verified. Your harness should implement a triage threshold: claims with a sufficiency_score of 3 or below, or claims where the model flags contradictory evidence, must be routed to a human reliability engineer. Package the model's analysis, the relevant source excerpts, and the original claim into a review queue. The human reviewer should be able to confirm, override, or request additional evidence. Their final determination should be logged as the authoritative result. What to avoid: Do not treat the model's output as the final root cause determination in any safety-critical system. Do not skip the evidence-source validation step—models can hallucinate plausible-sounding but non-existent log entries or spec details. Do not run this prompt without a human-in-the-loop gate for high-severity incidents (e.g., incidents involving safety, regulatory impact, or significant financial loss). The prompt is a force multiplier for experienced engineers, not a replacement for engineering judgment.

IMPLEMENTATION TABLE

Expected Output Contract

Defines the required structure, types, and validation rules for the verification output. Use this contract to build a parser, validator, and schema for the model response before it enters downstream systems.

Field or ElementType or FormatRequiredValidation Rule

verification_id

string (UUID v4)

Must match regex for UUID v4. Reject if missing or malformed.

claim_id

string

Must match the [CLAIM_ID] from the input. Reject on mismatch.

claim_text

string

Must be a non-empty string. Truncate if over 500 chars and log a warning.

verification_status

enum: [VERIFIED, REFUTED, UNVERIFIABLE, HYPOTHESIS, INCONCLUSIVE]

Must be one of the five allowed enum values. Reject any other string.

evidence_sufficiency_score

number (0.0 to 1.0)

Must be a float between 0.0 and 1.0 inclusive. Reject if out of range or non-numeric.

causal_chain_analysis

array of objects

Must be a non-empty array. Each object must contain 'step' (string), 'evidence' (string or null), and 'confidence' (number 0.0-1.0). Reject if array is empty.

contradicting_evidence

array of strings or null

If present, must be an array of non-empty strings. If no contradictions exist, value must be null, not an empty array.

human_review_required

boolean

Must be true if evidence_sufficiency_score < [CONFIDENCE_THRESHOLD] or if verification_status is UNVERIFIABLE or INCONCLUSIVE. Log a warning if this rule is violated.

PRACTICAL GUARDRAILS

Common Failure Modes

Engineering failure analysis prompts break in predictable ways when causal claims, evidence, and uncertainty are not tightly constrained. These cards cover the most frequent production failure modes and how to prevent them.

01

Causal Overstatement

What to watch: The model elevates a correlation or contributing factor into a definitive root cause without sufficient evidence. This is the most dangerous failure mode in incident analysis because it can misdirect remediation efforts. Guardrail: Require the prompt to classify each causal claim as 'Established Cause,' 'Probable Cause,' 'Contributing Factor,' or 'Hypothesis' with a mandatory evidence sufficiency score. Reject any output that uses definitive causal language for claims scored below a threshold.

02

Temporal Confusion

What to watch: The model misorders events in the failure timeline, placing effects before causes or conflating concurrent events as causal. This is common when timestamps are sparse, timezone-ambiguous, or logged at different granularities. Guardrail: Require the prompt to output an explicit chronological event sequence with timestamps before any causal reasoning. Add a validation step that checks for temporal ordering violations and flags events with ambiguous or missing timestamps for human review.

03

Evidence Hallucination

What to watch: The model fabricates supporting evidence, such as citing log entries, sensor readings, or design spec sections that do not exist in the provided source material. This is especially risky when the prompt includes technical jargon that the model can generate fluently but without grounding. Guardrail: Require every evidence citation to include a direct quote or excerpt from the provided source material. Add a post-processing check that verifies each cited reference string appears verbatim in the input documents. Flag any citation that cannot be matched.

04

Single-Cause Fallacy

What to watch: The model converges on a single root cause and ignores or downplays contributing factors, systemic conditions, and interacting failure modes. Real engineering failures are rarely monocausal, but models tend to produce clean narratives. Guardrail: Structure the prompt to require at least one systemic contributing factor and one human/organizational factor in addition to any technical root cause. Use a required output field for 'Interacting Failure Modes' that must be populated even if the primary cause seems sufficient.

05

Domain Terminology Drift

What to watch: The model uses engineering terms like 'fatigue failure,' 'thermal runaway,' or 'cascading failure' loosely or incorrectly, applying them to situations that do not meet the technical definition. This undermines trust with domain experts. Guardrail: Include a terminology constraint in the prompt that requires the model to state the precise definition of any specialized failure mode term before applying it. Add a domain glossary as part of the prompt context and instruct the model to flag any claim where the observed evidence does not fully satisfy the definitional criteria.

06

Missing Uncertainty Quantification

What to watch: The model presents all findings with uniform confidence, failing to distinguish between claims backed by multiple corroborating data sources and claims supported by a single ambiguous log line. This flattens the risk surface and prevents effective triage. Guardrail: Require a structured confidence score for every causal claim with explicit rationale tied to evidence quantity, source reliability, and contradiction presence. Set a threshold below which claims are automatically routed to human review with the evidence package attached.

IMPLEMENTATION TABLE

Evaluation Rubric

Criteria for testing the quality of claim verification outputs before deploying the Engineering Failure Analysis Claim Verification Prompt Template to production. Use this rubric to evaluate model responses against golden datasets and edge cases.

CriterionPass StandardFailure SignalTest Method

Causal Claim Extraction Completeness

All causal claims in [INCIDENT_REPORT] are extracted with no false positives

Missing a stated causal claim or extracting a non-causal statement as a claim

Compare extracted claims against a human-annotated golden set; require recall ≥ 0.95

Evidence Source Grounding

Each claim is matched to at least one specific section of [FAILURE_DATA], [DESIGN_SPECS], or [OPERATIONAL_LOGS]

Claim marked as 'supported' but citation points to irrelevant or non-existent source section

Parse output citations; verify each citation resolves to a valid source section ID and contains supporting text

Causal Classification Accuracy

Each claim is correctly classified as Established Cause, Probable Cause, Hypothesis, or Unsupported

Hypothesis classified as Established Cause without sufficient evidence; Unsupported claim classified as Probable Cause

Run against a labeled test set with known ground-truth classifications; require F1 ≥ 0.85 per class

Evidence Sufficiency Score Calibration

Score of 4-5 only assigned when multiple independent evidence sources corroborate the claim; score of 1-2 assigned when evidence is absent or contradictory

Score of 5 assigned to a claim with a single weak source; score of 1 assigned to a claim with strong corroborating evidence

Check score distribution against evidence count and source authority in golden dataset; require Spearman correlation ≥ 0.8

Contradiction Detection

All contradictory evidence across sources is flagged with source pairs and contradiction description

Two sources state opposing failure modes but output reports no contradiction

Inject known contradictions into test sources; require contradiction detection recall ≥ 0.90

Uncertainty Language Discipline

Hypothesis and Unsupported claims use qualifying language (may, possibly, insufficient evidence); Established Cause claims use definitive language only when evidence threshold is met

Established Cause claim uses hedging language; Hypothesis claim uses definitive causal language

Regex check for forbidden patterns per classification; manual spot-check 20 random outputs for tone consistency

Output Schema Compliance

Output is valid JSON matching [OUTPUT_SCHEMA] with all required fields present and correctly typed

Missing required field; evidence_sources is empty array on a supported claim; confidence_score is a string instead of number

Validate output against JSON Schema; reject any output that fails schema validation

Human Review Routing Accuracy

Claims with evidence_sufficiency_score ≤ 2 or contradictory evidence are routed to human_review: true with complete review_packet

High-risk claim with score of 1 routed as human_review: false; review_packet missing source excerpts

Check routing decision against score and contradiction presence; require routing recall ≥ 0.95 for high-risk claims

ADAPTATION OPTIONS

Adapt This Prompt

How to adapt

Use the base prompt with a single incident report and a small set of design specs or logs. Focus on getting the causal claim extraction and evidence sufficiency scoring structure right before adding complex retrieval or multi-source correlation. Keep the output schema simple: a list of claims with status (established/hypothesis/unverified) and a short evidence_summary.

Watch for

  • The model conflating correlated events with causal relationships
  • Missing the distinction between 'root cause' and 'contributing factor'
  • Overconfident language when evidence is circumstantial
  • Output drift from the defined status enum values
Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.