Inferensys

Prompt

Health Check Endpoint Design Audit Prompt

A practical prompt playbook for using the Health Check Endpoint Design Audit Prompt in production AI workflows to review probe depth, dependency ordering, timeout configuration, and false-positive risks.
Risk analyst performing AI risk assessment on laptop, risk matrices visible, casual office risk session.
PROMPT PLAYBOOK

When to Use This Prompt

Understand the job-to-be-done, the ideal user, required inputs, and the boundaries where this design-time audit prompt should not be applied.

This prompt is for platform engineers and SREs who need to audit the design of health check endpoints—liveness, readiness, and startup probes—before they ship to production. It is not a generic code review prompt. The job-to-be-done is a structured, pre-deployment design audit that identifies shallow checks, missing dependency ordering, misconfigured timeouts, and false-positive risks. These defects, if left undetected, can cause cascading failures during partial outages or slow-start rejections during deployments. The prompt assumes you have a probe specification, a dependency graph, or a configuration snippet to analyze. Use it during design review, as part of a pre-deployment checklist, or when preparing resilience tests.

To use this prompt effectively, you must provide concrete design artifacts. The required input includes a description of the service's runtime dependencies (databases, caches, upstream APIs, message brokers), the current or proposed probe configurations (endpoint paths, HTTP methods, timeout values, interval and threshold settings), and the expected startup sequence. The prompt produces a structured audit report that flags specific risks: a liveness probe that only checks if the process is running without verifying internal state, a readiness probe that returns 200 OK before the database connection pool is initialized, or a startup probe timeout that is shorter than the actual warm-up duration. Each finding includes a severity rating and a concrete remediation recommendation.

Do not use this prompt for runtime incident diagnosis. If a service is already failing in production, this design-time audit will not help you triage the active incident. Instead, use an operational incident or runbook prompt from the resilience pillar. Similarly, do not use this prompt as a substitute for load testing or chaos engineering; it audits the static configuration, not the dynamic behavior under stress. Finally, this prompt is not a general code quality reviewer—it focuses narrowly on health check endpoint design and its interaction with orchestration systems like Kubernetes, Nomad, or ECS. If you need a broader resilience review, combine this prompt with the circuit breaker, retry policy, or graceful degradation prompts in the same content group.

PRACTICAL GUARDRAILS

Use Case Fit

Where this prompt works and where it does not. Use these cards to decide if the Health Check Endpoint Design Audit Prompt is the right tool for your current review.

01

Good Fit: Pre-Production Probe Review

Use when: You are designing or modifying liveness, readiness, and startup probes for Kubernetes or similar orchestration platforms before deployment. Guardrail: Run the audit against your probe configuration YAML and deployment specs to catch cascading failure risks and timeout misconfigurations before they reach production.

02

Bad Fit: Runtime Incident Diagnosis

Avoid when: You are actively troubleshooting a production outage and need root cause analysis. This prompt audits static design, not live system behavior. Guardrail: Use observability and incident response prompts for active triage. Reserve this audit for design reviews and postmortem improvement cycles.

03

Required Input: Probe Configuration and Dependency Map

What to watch: Running this prompt without actual probe definitions, timeout values, and a dependency graph produces generic advice that misses specific failure modes. Guardrail: Provide the exact health check endpoint code, probe YAML, and an ordered list of service dependencies. The audit quality scales directly with input specificity.

04

Operational Risk: False-Positive Healthy Signals

What to watch: Health checks that report healthy when critical dependencies are degraded create a dangerous false sense of safety. Guardrail: The prompt explicitly audits for shallow checks that only verify process liveness. It flags endpoints that don't validate database connectivity, upstream service reachability, or internal state consistency.

05

Operational Risk: Cascading Probe Failures

What to watch: Overly aggressive readiness probes that depend on multiple downstream services can cause cascading restarts when one dependency blips. Guardrail: The audit evaluates probe dependency ordering and recommends independent liveness checks with degraded readiness signals to prevent restart storms across your service mesh.

06

Operational Risk: Slow-Start and Cold-Start Gaps

What to watch: Startup probes with insufficient initial delay or failure thresholds kill instances before they finish initializing, especially during scale-out events. Guardrail: The prompt validates startup probe timing against actual initialization duration, connection pool warm-up, and cache hydration to prevent premature termination.

PROMPT PLAYBOOK

Copy-Ready Prompt Template

A copy-ready prompt template for auditing health check endpoint designs, with placeholders for probe configuration, dependency maps, and platform context.

This prompt template is designed to be pasted directly into your AI workflow. It expects you to provide a detailed description of your health check endpoint design, including liveness, readiness, and startup probe configurations, a dependency map of your services, and the platform context in which these checks run. The model will then produce a structured audit identifying risks such as false positives, cascading failures, and slow-start scenarios. Before using this prompt, ensure you have documented your probe configurations and understand your service's critical dependencies.

text
You are an SRE architect auditing health check endpoint designs for resilience gaps. Your task is to review the provided probe configuration, dependency map, and platform context to produce a structured audit.

## INPUT
[PROBE_CONFIGURATION]
[DEPENDENCY_MAP]
[PLATFORM_CONTEXT]

## AUDIT CRITERIA
Analyze the input against the following criteria:
1.  **Check Depth:** Do liveness checks verify only the application process, or do they inadvertently test dependencies? Do readiness checks include all critical downstream and upstream dependencies? Do startup checks wait for all necessary resources (e.g., cache warm-up, DB migration) before marking the pod as ready?
2.  **Dependency Ordering:** Is there a risk of a dependency loop or a cascading failure where a readiness check on Service A depends on Service B, whose readiness check depends on Service A? Identify any missing or misordered dependencies.
3.  **Timeout and Interval Configuration:** Are the `timeoutSeconds`, `periodSeconds`, `failureThreshold`, and `successThreshold` values appropriate for the dependency's latency profile? Flag configurations where a slow-starting dependency could cause a probe timeout and a premature restart loop.
4.  **False-Positive Risks:** Identify scenarios where a probe could report a false positive (e.g., a liveness check that only verifies a local file exists) or a false negative (e.g., a readiness check that fails because a non-critical cache is temporarily unavailable).
5.  **Cascading Failure Analysis:** Model a scenario where a critical downstream dependency fails. Trace how the failure would propagate through the readiness checks of dependent services, potentially causing a system-wide restart storm.

## OUTPUT_SCHEMA
Return a JSON object with the following structure. Do not include any text outside the JSON object.
{
  "audit_summary": "A one-sentence summary of the overall health check design's resilience.",
  "findings": [
    {
      "severity": "CRITICAL | HIGH | MEDIUM | LOW",
      "category": "Check Depth | Dependency Ordering | Timeout Configuration | False Positive Risk | Cascading Failure",
      "affected_component": "The specific probe or service name.",
      "description": "A clear, concise description of the finding.",
      "risk": "The operational risk if this finding is not addressed.",
      "recommendation": "A specific, actionable recommendation to fix the issue."
    }
  ],
  "dependency_graph_analysis": {
    "cycles_detected": ["List of any dependency cycles found, e.g., 'Service A -> Service B -> Service A'"],
    "single_points_of_failure": ["List of dependencies that, if they fail, would cause a cascading readiness failure across multiple services."]
  },
  "slow_start_risk_assessment": "An assessment of the risk that a service with a long initialization time will be killed by Kubernetes during startup due to probe configuration."
}

## CONSTRAINTS
- Base your analysis strictly on the provided [PROBE_CONFIGURATION], [DEPENDENCY_MAP], and [PLATFORM_CONTEXT]. Do not invent dependencies or configurations.
- If the input lacks sufficient detail to assess a criterion, note it as an 'UNKNOWN' risk with a recommendation to gather more information.
- Prioritize findings that could lead to production outages or restart storms.

To adapt this template, replace the [PROBE_CONFIGURATION], [DEPENDENCY_MAP], and [PLATFORM_CONTEXT] placeholders with your specific data. The [PROBE_CONFIGURATION] should be a detailed YAML or JSON snippet of your Kubernetes probes or equivalent health check definitions. The [DEPENDENCY_MAP] should be a clear list or diagram description of how your services call each other. The [PLATFORM_CONTEXT] should describe the orchestration platform (e.g., Kubernetes, Nomad) and any relevant operational constraints. The output is a structured JSON object, making it suitable for direct ingestion into a dashboard or a secondary automated remediation workflow. For high-risk environments, always have a senior engineer review the AI-generated audit before implementing any changes.

IMPLEMENTATION TABLE

Prompt Variables

Inputs the Health Check Endpoint Design Audit Prompt needs to produce a reliable audit. Each placeholder must be populated with concrete values before the prompt is executed. Validation notes describe how to confirm the input is correct before the audit runs.

PlaceholderPurposeExampleValidation Notes

[SERVICE_NAME]

Identifies the service under audit so the model can scope findings and recommendations.

payment-gateway

Must match the service name in the deployment manifest or service registry. Null not allowed. Validate with a string match against the canonical service catalog.

[PROBE_CONFIGURATION]

Contains the raw liveness, readiness, and startup probe definitions to be audited.

livenessProbe: { httpGet: { path: /healthz, port: 8080 }, initialDelaySeconds: 15, periodSeconds: 10 }

Must be valid YAML or JSON conforming to the Kubernetes probe spec schema. Parse check required. If the source is a Helm chart or Terraform, extract and normalize before insertion.

[DEPENDENCY_MAP]

Lists all downstream services and infrastructure the service depends on, used to audit dependency ordering in readiness checks.

{ database: { type: postgres, endpoint: db-primary:5432 }, cache: { type: redis, endpoint: redis-cluster:6379 } }

Must be a valid JSON object where each key is a dependency name and each value contains at least a type and endpoint. Null allowed if the service has no dependencies. Validate by cross-referencing the service's network policy and outbound connection logs.

[TIMEOUT_BUDGET]

Specifies the end-to-end timeout budget for the service's request path, used to evaluate probe timeout alignment.

totalRequestTimeout: 30s, downstreamTimeout: 5s per dependency

Must include a total request timeout value in seconds or milliseconds. Parse check for numeric value. Validate against the service's SLA or SLO document. Null not allowed.

[STARTUP_SEQUENCE]

Describes the expected cold-start and warm-start behavior of the service, used to audit startup probe and initial delay settings.

coldStart: 45s (DB connection pool warmup + config load), warmStart: 5s

Must be a structured description with timing estimates. Null allowed if the service has no distinct startup phases. Validate against load test data or historical deployment metrics.

[DEPLOYMENT_PLATFORM]

Specifies the orchestration platform and version, used to interpret probe semantics correctly.

Kubernetes 1.29, AWS EKS

Must match a known platform identifier. Validate against the cluster info or deployment pipeline configuration. Null not allowed. Acceptable values include Kubernetes, Nomad, ECS, or Docker Compose with version.

[KNOWN_INCIDENTS]

Provides a list of past health-check-related incidents, used to check if the current design would prevent recurrence.

[{ incident: INC-451, date: 2024-11-03, summary: Readiness probe passed before DB connection pool was ready, causing 503 spikes }]

Must be a valid JSON array of incident objects, each with at least an identifier and summary. Null allowed if no prior incidents exist. Validate by querying the incident management system for health-check-related tickets.

[OUTPUT_SCHEMA]

Defines the expected structure of the audit report, ensuring the model output can be parsed by downstream tooling.

{ findings: [{ severity: high|medium|low, category: string, description: string, recommendation: string }], overallRisk: high|medium|low }

Must be a valid JSON Schema or example object. Validate with a schema parser before passing to the prompt. The downstream harness will validate the model's output against this schema.

PROMPT PLAYBOOK

Implementation Harness Notes

How to wire the health check audit prompt into an application or CI/CD workflow with validation, retries, and human review gates.

The Health Check Endpoint Design Audit Prompt is designed to run as a pre-production design review gate, not as a runtime health check itself. Integrate it into pull request workflows, architecture review pipelines, or SRE design review checklists. The prompt expects a structured description of your health check configuration—including probe types, dependency graphs, timeout values, and failure thresholds—and returns an audit with prioritized findings. Wire it so that the prompt runs when a service definition, Helm chart, or infrastructure-as-code module containing health check configurations is modified.

Validation and retries: Parse the model's output against a lightweight JSON schema that enforces the expected structure: findings (array of objects with severity, category, description, affected_probe, and recommendation fields) and summary (object with risk_level and critical_findings_count). If the output fails schema validation, retry once with the validation error appended to the prompt as a correction hint. If the second attempt also fails, route to a human reviewer with the raw output and validation errors attached. Model choice: Use a model with strong reasoning capabilities (GPT-4o, Claude 3.5 Sonnet, or equivalent) because the audit requires cross-referencing probe dependencies, timeout budgets, and cascading failure scenarios. Avoid smaller or faster models that may miss subtle false-positive risks in readiness probe configurations.

Logging and traceability: Store each audit result with the commit SHA, service name, timestamp, model version, and prompt version. This creates an audit trail for compliance reviews and lets you compare findings across service versions. Human review gate: For any finding with severity: critical—such as missing liveness probes, circular probe dependencies, or timeout configurations that guarantee false positives under load—require human acknowledgment before the PR can merge. For lower-severity findings, you can auto-approve but surface them in the PR comment thread. Tool use and RAG: If your health check configurations are spread across multiple repositories or configuration stores, use a retrieval step before the prompt to gather all relevant probe definitions, dependency maps, and deployment descriptors. Feed the retrieved context into the [INPUT] placeholder as structured YAML or JSON. Do not rely on the model to recall your organization's specific probe conventions or naming patterns—supply them in the prompt's [CONTEXT] section.

What to avoid: Do not run this prompt as a runtime health check—it is a design audit, not a monitoring tool. Do not skip the human review gate for critical findings; probe misconfiguration can cause cascading pod restarts, traffic blackholing, and failed rollouts. Do not use the audit output to automatically modify health check configurations without human approval. Finally, test the prompt against known failure scenarios (slow-start dependencies, circular probe chains, missing startup probes for stateful services) before deploying it as a required CI gate. Start with advisory mode and graduate to blocking only after you've measured false-positive and false-negative rates against human-reviewed baselines.

IMPLEMENTATION TABLE

Expected Output Contract

Fields, types, and validation rules for the health check audit response. Use this contract to parse, validate, and route the model output before it reaches downstream systems or human reviewers.

Field or ElementType or FormatRequiredValidation Rule

audit_id

string (uuid)

Must parse as valid UUID v4. Reject on format mismatch.

probe_type

enum: liveness | readiness | startup

Must match exactly one of the three allowed values. Case-sensitive.

endpoint_path

string (URL path)

Must start with '/' and contain only valid path characters. Reject if empty or contains query string.

check_depth

enum: shallow | deep

Must be 'shallow' or 'deep'. Null not allowed. Reject on any other value.

dependency_ordering

array of strings

Each string must match a known dependency name from [DEPENDENCY_LIST]. Empty array allowed only if no dependencies exist.

timeout_config_ms

integer

Must be positive integer between 100 and 60000. Reject on zero, negative, or non-integer values.

false_positive_risks

array of objects

Each object must contain 'risk_description' (string, non-empty) and 'severity' (enum: low | medium | high | critical). Reject if array contains malformed objects.

cascading_failure_scenarios

array of objects

If present, each object must contain 'trigger_condition' (string), 'affected_probes' (array of strings matching probe names), and 'estimated_blast_radius' (string). Null allowed.

PRACTICAL GUARDRAILS

Common Failure Modes

When auditing health check endpoints with an LLM, these are the most common failure modes that produce dangerous false confidence or unnecessary alerts. Each card explains what breaks and how to prevent it.

01

Shallow Check Passes as Healthy

What to watch: The model accepts a health check that only verifies the process is running, ignoring dependency health, connection pool exhaustion, or stale state. The endpoint returns 200 while the service is effectively dead. Guardrail: Require the prompt to enumerate all dependencies and classify each check as liveness (process alive), readiness (ready for traffic), or startup (initialization complete). Add eval assertions that reject audits missing dependency-level checks.

02

Timeout Configuration Blindness

What to watch: The audit misses mismatched timeouts between health check probes and actual dependency calls. A probe with a 1-second timeout may report healthy while the real dependency call blocks for 30 seconds. Guardrail: Include explicit timeout comparison in the prompt template. Require the output to flag any probe timeout that exceeds or equals the dependency's configured timeout. Add a harness test with deliberately mismatched timeout values.

03

Cascading Probe Failure Ignored

What to watch: The model treats each health check in isolation and fails to detect that a single dependency failure will cascade through multiple readiness probes, triggering premature pod termination across services. Guardrail: Add a dependency graph analysis step to the prompt. Require the audit to identify shared dependencies and calculate the blast radius of a single dependency failure. Validate with a test scenario where one database outage affects five services.

04

False-Positive Readiness During Startup

What to watch: The audit approves a readiness probe that returns healthy before connection pools are warmed, caches are populated, or schema migrations complete. Traffic arrives before the service can handle it. Guardrail: Require the prompt to distinguish startup probes from readiness probes explicitly. Add eval criteria that flag any readiness check lacking a startup gate for connection pool initialization, cache warming, or migration completion.

05

Missing Slow-Start and Warm-Up Logic

What to watch: The audit overlooks the absence of gradual traffic ramp-up after a cold start. A newly started instance receives full traffic load immediately, causing request timeouts and retry storms before it stabilizes. Guardrail: Include a slow-start assessment dimension in the prompt. Require the audit to check for load-shedding, request throttling, or gradual endpoint registration during the warm-up window. Test with a cold-start simulation scenario.

06

Health Check Endpoint Becomes Attack Surface

What to watch: The audit ignores security considerations. A health endpoint that exposes internal dependency status, version numbers, or configuration details becomes a reconnaissance target. Guardrail: Add a security review dimension to the prompt template. Require the audit to flag any health check response that leaks internal topology, dependency hostnames, version strings, or configuration values. Validate with a test case containing exposed internal details.

IMPLEMENTATION TABLE

Evaluation Rubric

Use this rubric to test the Health Check Endpoint Design Audit Prompt output before integrating it into a CI pipeline or design review gate. Each criterion targets a known failure mode in health check design.

CriterionPass StandardFailure SignalTest Method

Check Depth Classification

Every endpoint is classified as Liveness, Readiness, or Startup with a clear rationale

Output omits classification for one or more endpoints or uses generic labels like 'health check' without distinction

Parse output JSON; assert each endpoint object has a non-null check_type field matching enum ['liveness', 'readiness', 'startup']

Dependency Ordering Audit

Dependency check order is explicitly listed and matches the actual call graph described in [SYSTEM_DESIGN_DOC]

Dependencies are listed in alphabetical order or an order that contradicts the documented initialization sequence

Extract dependency list; compare against a manually verified dependency graph from [SYSTEM_DESIGN_DOC]; flag any ordering mismatch

Timeout Configuration Assessment

Every external dependency check includes a specific timeout value and a justification for that value

Timeout values are missing, set to 0, or use a single default value across all dependencies without justification

Scan output for timeout fields; assert numeric value > 0 for each external check; assert presence of non-empty timeout_rationale string

False-Positive Risk Identification

At least one specific false-positive scenario is identified per endpoint with a concrete trigger condition

Output claims 'no false-positive risks' without analysis or lists only generic risks like 'network blip' without endpoint-specific context

Count false-positive scenarios per endpoint; assert count >= 1; assert each scenario references a specific check implementation detail from [HEALTH_CHECK_CODE]

Cascading Failure Detection

Output identifies at least one cascading failure path where a readiness probe failure could cause a wider outage

Cascading failure section is empty, or describes only direct dependency failures without propagation analysis

Search output for 'cascading' keyword; assert presence of at least one propagation chain with source, intermediate, and impact nodes

Slow-Start Scenario Coverage

Startup probe configuration accounts for cold-start duration of all dependencies and includes a warm-up grace period

Startup probe initialDelaySeconds is set lower than the documented cold-start time of the slowest dependency

Compare output initialDelaySeconds value against documented cold-start benchmarks in [DEPENDENCY_LATENCY_DATA]; assert delay >= slowest dependency cold-start time

Remediation Guidance Specificity

Each identified risk includes a concrete, actionable remediation step tied to a specific configuration or code change

Remediation steps are vague (e.g., 'increase timeout') without target values or reference to specific configuration keys

For each risk item, assert remediation field contains a specific parameter name and a suggested value or range; reject generic advice

Output Schema Compliance

Output is valid JSON matching the [OUTPUT_SCHEMA] with all required fields present and correctly typed

Output is missing required fields, contains extra untyped fields, or uses wrong types (e.g., string instead of integer for timeout values)

Validate output against [OUTPUT_SCHEMA] using a JSON Schema validator; assert no validation errors; assert no additional properties beyond schema allowance

ADAPTATION OPTIONS

Adapt This Prompt

How to adapt

Use the base prompt with a single probe type and lighter validation. Replace the full audit schema with a simple checklist output. Focus on one endpoint at a time.

code
Review the health check endpoint at [ENDPOINT_URL]. Check liveness only.
Return a bullet list of findings with severity (low/medium/high).

Watch for

  • Missing dependency-order analysis when reviewing single endpoints in isolation
  • Overly broad instructions that produce prose instead of structured findings
  • No timeout or false-positive checks without explicit prompting
Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.