This prompt is designed for SRE, platform engineering, and operations teams who need to independently verify a specific SLA compliance claim against raw telemetry data. The core job-to-be-done is not continuous monitoring, but rather a targeted audit of a claim that has already been made—whether by a vendor, an internal service team, or an automated reporting system. The ideal user is an engineer or technical lead who has access to the underlying metrics database (e.g., Prometheus, Datadog, CloudWatch) and needs to confirm that a reported 99.95% uptime, a p99 latency of 200ms, or a remaining error budget of 80% is consistent with the raw data and the SLA's precise definitions.
Prompt
SLA and Performance Metric Verification Prompt

When to Use This Prompt
Defines the verification job, ideal user, required inputs, and clear boundaries for when this prompt should and should not be applied.
Use this prompt when you have a specific, quantitative claim to verify and can provide the raw telemetry data, the exact SLA definition, and the measurement period. It is particularly valuable during incident postmortems to validate a vendor's root cause analysis, in quarterly reliability reviews to independently confirm internal reporting, and during contract renewal negotiations to audit a vendor's historical compliance. The prompt works by systematically checking three critical failure points: measurement window alignment (does the claim cover the correct time range?), exclusion rule application (were planned maintenance windows or specific error types correctly excluded per the SLA?), and metric definition consistency (is 'uptime' calculated from the load balancer, the application health check, or the synthetic probe?). The output is a structured compliance verdict with a clear pass/fail/determination and a detailed explanation of any discrepancies found.
Do not use this prompt as a replacement for a live monitoring dashboard or an alerting system. It is a point-in-time verification tool, not a real-time observability solution. It is also not suitable for generating an SLA report from scratch; it verifies an existing claim, it does not perform the initial calculation. The prompt requires the user to provide the raw data and the SLA text; it cannot query your metrics backend directly. If you cannot provide the raw data, or if the SLA definition is ambiguous and cannot be resolved, the prompt will return an 'Indeterminate' verdict rather than a guess. The next step after reading this section is to gather the three required inputs—the claim, the raw data, and the SLA text—and then proceed to the prompt template to begin the verification.
Use Case Fit
Where the SLA and Performance Metric Verification Prompt works, where it fails, and what you must provide before running it in production.
Good Fit: Structured Telemetry with Known Baselines
Use when: you have structured telemetry data (Prometheus, Datadog, CloudWatch) with defined SLA windows and known exclusion rules. The prompt excels at comparing reported metrics against raw time-series data and flagging discrepancies in measurement window selection. Guardrail: pre-process raw telemetry into a consistent tabular format with explicit timestamps, value columns, and metadata tags before passing to the prompt.
Bad Fit: Real-Time Alerting or Streaming Data
Avoid when: you need sub-second latency, streaming anomaly detection, or direct alert firing. This prompt is designed for post-hoc verification of reported metrics, not real-time operational monitoring. Guardrail: use this prompt in batch verification pipelines or incident postmortem workflows, not in hot-path alerting systems. Pair with a streaming rules engine for real-time needs.
Required Inputs: Raw Data, SLA Definitions, and Exclusion Rules
What you must provide: raw telemetry data for the measurement period, the formal SLA definition (target percentage, measurement window, allowed downtime), documented exclusion rules (planned maintenance, data gaps), and the reported metric you are verifying. Guardrail: missing any of these inputs forces the model to guess, producing unreliable compliance assessments. Build a pre-flight input validator that blocks execution if required fields are absent.
Operational Risk: Metric Definition Gaming
What to watch: teams may adjust measurement points, exclusion windows, or aggregation methods to make metrics appear compliant. The prompt can detect these patterns but only if you provide raw data alongside the reported metric. Guardrail: always compare the reported metric against independently queried raw telemetry, not against a pre-aggregated summary. Include explicit instructions to flag measurement point shifts and exclusion rule changes between periods.
Operational Risk: Calendar and Timezone Misalignment
What to watch: SLA windows defined in business hours, UTC, or local time can produce false non-compliance flags when timezone conversion is mishandled. The prompt may misinterpret boundary conditions. Guardrail: normalize all timestamps to a single timezone before passing data to the prompt. Include explicit timezone metadata in the input schema and add a validation step that checks for boundary-off-by-one errors in window calculations.
When to Escalate: Ambiguous Exclusion Justifications
What to watch: exclusion rules that are vaguely documented (e.g., 'planned maintenance' without timestamps) create compliance gray zones. The prompt cannot adjudicate whether an exclusion was legitimate without clear criteria. Guardrail: route any verification result where exclusion legitimacy is ambiguous to a human SRE reviewer. Include the raw telemetry, the exclusion rule text, and the prompt's flagged concerns in the review packet.
Copy-Ready Prompt Template
A copy-ready prompt for verifying SLA and performance metric claims against provided telemetry data, producing a structured compliance assessment.
This prompt template is designed to be pasted directly into your AI workflow. It instructs the model to act as an SRE auditor, comparing a specific performance claim against a provided telemetry dataset. The prompt forces the model to check measurement windows, apply exclusion rules, and identify common gaming tactics before issuing a compliance verdict. Replace the square-bracket placeholders with your specific claim, raw telemetry data, and SLA definitions to make it operational.
markdownYou are an SRE auditor. Your task is to verify a performance metric claim against provided telemetry data and produce a structured SLA compliance assessment. # CLAIM TO VERIFY [SLA_CLAIM_TEXT] # TELEMETRY DATA (JSON) ```json [TELEMETRY_DATA_JSON]
SLA DEFINITIONS & CONSTRAINTS
- Measurement Window: [MEASUREMENT_WINDOW]
- SLO Target: [SLO_TARGET_PERCENT]
- Exclusion Rules: [EXCLUSION_RULES]
- Metric Definition: [METRIC_DEFINITION]
VERIFICATION STEPS
- Parse the telemetry data and identify the metric specified in the claim.
- Filter the data to the exact measurement window defined in the SLA. Flag any data points outside this window.
- Apply the exclusion rules precisely. Document which data points were excluded and why.
- Calculate the actual performance metric over the valid, non-excluded data points.
- Compare the calculated metric against the claimed metric and the SLO target.
- Check for the following gaming patterns and flag any detected:
- Window Shopping: Selecting a non-standard or overly narrow measurement window to improve results.
- Exclusion Abuse: Applying exclusion rules too broadly or inventing new ones to remove unfavorable data.
- Metric Mismatch: Using a different calculation method (e.g., average vs. median) than the SLA definition.
- Data Sampling: Only providing a favorable subset of the full telemetry data.
OUTPUT SCHEMA
Return a single valid JSON object with the following structure. Do not include any text outside the JSON. { "claim_verified": boolean, "calculated_metric": number, "slo_compliant": boolean, "verification_details": { "data_points_total": number, "data_points_excluded": number, "exclusion_reasons": [string], "measurement_window_used": string, "window_anomalies": [string] }, "gaming_flags": [ { "type": string, "severity": "LOW" | "MEDIUM" | "HIGH", "description": string } ], "overall_assessment": string }
To adapt this template, start by replacing [SLA_CLAIM_TEXT] with the exact wording of the claim you are auditing, such as "Our service maintained 99.95% uptime for Q3." The [TELEMETRY_DATA_JSON] placeholder should be replaced with a structured JSON array of your monitoring data, including timestamps and metric values. Crucially, the [EXCLUSION_RULES] and [METRIC_DEFINITION] placeholders must be filled with the precise, unambiguous definitions from your SLA contract; vague rules here will lead to unreliable verification. For high-stakes compliance reporting, always route the final JSON output to a human for approval before it is published or used in a customer-facing report.
Prompt Variables
Each placeholder must be populated for the prompt to produce reliable SLA and performance metric verification output.
| Placeholder | Purpose | Example | Validation Notes |
|---|---|---|---|
[SLA_DEFINITION] | The formal SLA clause specifying the metric, target, measurement window, and exclusion rules | Service X API latency: 99th percentile < 200ms per calendar month, excluding planned maintenance windows | Parse check: must contain metric name, target value, unit, measurement window, and exclusion rules. Reject if any component missing |
[TELEMETRY_DATA] | Raw or aggregated telemetry records covering the measurement window with timestamps and metric values | JSON array of {timestamp, latency_ms, status_code, endpoint} for 2025-01-01 to 2025-01-31 | Schema check: must include timestamp field, metric value field, and any dimension fields referenced in SLA. Null values allowed only if exclusion rules specify handling |
[MEASUREMENT_WINDOW] | The exact time period under evaluation with start and end timestamps | 2025-01-01T00:00:00Z to 2025-01-31T23:59:59Z | Parse check: must be ISO 8601 range. Validate that telemetry data timestamps fall within this window. Reject if window exceeds SLA-defined period |
[EXCLUSION_RULES] | Specific conditions under which data points should be excluded from SLA calculation | Exclude: status_code=503 during planned_maintenance=true; Exclude: latency_ms where synthetic_probe=true | Parse check: each rule must specify field, operator, and value. Test that exclusion logic is deterministic and reversible. Flag if exclusion removes more than 5% of data points |
[METRIC_AGGREGATION_METHOD] | The calculation method for the SLA metric as defined in the SLA document | 99th percentile of latency_ms across all non-excluded requests within the measurement window | Parse check: must specify aggregation function, target field, and scope. Validate that method matches SLA_DEFINITION exactly. Reject if method is ambiguous or conflicts with SLA text |
[COMPLIANCE_THRESHOLD] | The numeric target value and comparison operator that defines SLA compliance | p99 latency < 200ms | Parse check: must include operator and numeric value with unit. Validate unit consistency with TELEMETRY_DATA. Reject if threshold is missing operator or unit |
[OUTPUT_SCHEMA] | The expected structure for the verification result including compliance status, calculated value, and evidence | See output contract: {compliance_status, calculated_value, target_value, measurement_window, excluded_count, total_count, gap_to_target, evidence_summary} | Schema check: validate that all required fields are present and typed correctly. Reject if compliance_status is not one of [compliant, non_compliant, insufficient_data] |
Implementation Harness Notes
How to wire the SLA verification prompt into a production SRE workflow with validation, retries, and human review.
This prompt is designed to be a single step inside a larger SRE verification pipeline. It should not be exposed directly to end users or called without pre-processing. The harness is responsible for assembling the prompt's inputs from telemetry sources, enforcing the output schema, and deciding what happens after the model returns a result. The model's job is to reason about SLA compliance given structured data; the harness's job is to ensure that reasoning is grounded, reproducible, and safe to act on.
The implementation flow starts with data assembly. Before calling the model, the harness must query your observability platform (e.g., Datadog, Prometheus, Grafana) for the exact metric, measurement window, and exclusion rules specified in the SLA document. These values populate the [METRIC_DEFINITION], [MEASUREMENT_WINDOW], [TELEMETRY_DATA], and [EXCLUSION_RULES] placeholders. The [SLA_TARGET] should be pulled from a committed SLO definition, not from the model's memory. After the model returns its assessment, validate the output against a strict JSON schema that requires fields like compliance_status, measured_value, exclusion_events_applied, and assessment_confidence. Reject any response that is missing required fields or contains values outside expected enums (e.g., compliance_status must be one of compliant, non_compliant, or indeterminate).
Retry logic should be conservative. If validation fails, retry once with the same prompt and a stronger schema reminder appended. If the second attempt also fails, log the raw response and escalate to a human on-call channel with a pre-formatted summary. Do not retry more than twice for the same input. For high-severity SLA breaches (e.g., a customer-facing uptime SLO violation), always require human confirmation before sending an external status update or triggering an incident. The model's assessment_confidence field can be used as a routing signal: confidence below 0.85 should route to human review even if the output schema is valid. Log every invocation with the prompt version, model ID, input hash, output, and reviewer decision to build an audit trail for postmortems and prompt improvement.
Model choice matters here. Use a model with strong reasoning capabilities and reliable JSON mode (e.g., GPT-4o, Claude 3.5 Sonnet). Avoid smaller or older models that may hallucinate metric calculations or misapply exclusion rules. Set temperature to 0 to maximize determinism. If your SLA verification runs on a schedule (e.g., weekly compliance reporting), pre-compute the telemetry aggregates and cache the prompt inputs to avoid drift between runs. Do not pass raw log streams directly into the prompt; the harness should pre-aggregate and format the data into the structure expected by the [TELEMETRY_DATA] placeholder.
The most common production failure mode is metric definition gaming, where the measured value is technically correct but calculated over a window or with exclusions that misrepresent actual user experience. The prompt includes an eval step for this, but the harness should add a second layer of defense: compare the model's measured_value against a simple, independently calculated baseline (e.g., a raw Prometheus query for the same metric without exclusions). If the gap exceeds a configurable threshold, flag the result for review regardless of the model's compliance determination. This dual-check pattern catches cases where the model correctly applies the rules but the rules themselves are misleading.
Expected Output Contract
Fields, types, and validation rules for the JSON response returned by the SLA and Performance Metric Verification Prompt. Use this contract to parse, validate, and route the model output in your verification pipeline.
| Field or Element | Type or Format | Required | Validation Rule |
|---|---|---|---|
verification_id | string (UUID v4) | Must match regex ^[0-9a-f]{8}-[0-9a-f]{4}-4[0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$ | |
claim_summary | string | Non-empty, max 500 characters. Must contain the asserted metric value and target from the input claim | |
measurement_window | object | Must contain start_date (ISO 8601) and end_date (ISO 8601). end_date must be after start_date. Window must match the claim's stated period | |
exclusion_rules_applied | array of strings | Each element must be a non-empty string naming an exclusion rule. If no exclusions apply, array must contain exactly one element: 'none' | |
observed_value | number or null | Must be a finite number if data is available. Set to null only when telemetry data is missing or the metric cannot be computed. If present, must include unit in observed_unit | |
observed_unit | string or null | Required when observed_value is not null. Must match one of the accepted unit strings: 'percent', 'milliseconds', 'requests_per_second', 'count', 'ratio'. Set to null when observed_value is null | |
sla_target | number | Must be a positive finite number extracted from the claim. Must include target_unit and target_comparison_operator | |
target_unit | string | Must match observed_unit when both are present. Accepted values: 'percent', 'milliseconds', 'requests_per_second', 'count', 'ratio' | |
target_comparison_operator | string | Must be one of: 'less_than', 'less_than_or_equal', 'greater_than', 'greater_than_or_equal', 'equal'. Extracted from claim language | |
compliance_status | string | Must be one of: 'compliant', 'non_compliant', 'indeterminate'. Use 'indeterminate' when observed_value is null, exclusion rules prevent calculation, or measurement window is incomplete | |
measurement_point_count | integer | Must be a non-negative integer representing the number of data points used. Set to 0 when no data is available | |
measurement_point_source | string | Must be one of: 'prometheus', 'datadog', 'cloudwatch', 'grafana', 'custom_api', 'provided_context'. Identifies the telemetry source used | |
gaming_risk_flags | array of strings | Each element must be one of: 'cherry_picked_window', 'exclusion_rule_abuse', 'measurement_point_gaming', 'aggregation_method_gaming', 'baseline_shift', 'none'. Array must contain 'none' if no risks detected | |
gaming_risk_explanation | string or null | Required when gaming_risk_flags contains values other than 'none'. Must explain each flag with specific evidence from the measurement configuration. Set to null when no risks detected | |
evidence_references | array of objects | Each object must contain source (string, non-empty) and data_point_count (integer, non-negative). Array must not be empty unless observed_value is null and compliance_status is 'indeterminate' | |
human_review_required | boolean | Must be true when compliance_status is 'indeterminate', gaming_risk_flags contains values other than 'none', or observed_value is within 5% of the SLA threshold. Otherwise false | |
review_reason | string or null | Required when human_review_required is true. Must state the specific reason for escalation. Set to null when human_review_required is false |
Common Failure Modes
SLA and performance metric verification fails in predictable ways. These are the most common production failure modes and how to guard against them before they reach a dashboard or report.
Measurement Window Manipulation
What to watch: The prompt accepts a reported uptime of 99.99% without verifying that the measurement window excludes planned maintenance, uses a trailing favorable period, or starts after a known outage. Guardrail: Require the prompt to extract and validate the exact start time, end time, and any exclusion windows. Cross-check against an explicit allowed-exclusion policy. If the window definition is missing, flag the claim as unverifiable.
Metric Definition Gaming
What to watch: The prompt treats 'latency' as interchangeable across p50, p99, and average, or accepts 'error rate' without confirming whether timeouts count as errors. Guardrail: Force the prompt to map the claimed metric to a precise technical definition including percentile, aggregation function, and error classification rules. If the source data and the claim use different definitions, flag a mismatch rather than comparing numbers directly.
SLO vs SLA Confusion
What to watch: The prompt verifies a 99.9% uptime claim against an internal SLO target of 99.9% and reports compliance, but the customer-facing SLA guarantees 99.95% with financial penalties. Guardrail: Include a required field in the output schema that distinguishes between the measured value, the internal SLO threshold, and the contractual SLA threshold. Flag any claim that compares against the wrong target.
Telemetry Source Selection Bias
What to watch: The prompt verifies latency claims using only load-balancer metrics while ignoring application-server metrics that show higher latency. The claim passes verification but misrepresents user experience. Guardrail: Require the prompt to list all available telemetry sources, note which were used for verification, and flag gaps. If client-side or end-to-end probes are missing, downgrade the confidence score and recommend additional data.
Aggregation Masking Outage Impact
What to watch: A 30-minute total outage is averaged into a monthly 99.9% uptime claim. The prompt verifies the aggregate number and reports compliance without surfacing the outage duration or user impact. Guardrail: Add an output requirement for maximum single-outage duration and number of distinct incidents in the measurement window. If any single incident exceeds a defined severity threshold, flag it regardless of aggregate compliance.
Exclusion Rule Creep
What to watch: The prompt accepts a claim that excludes 'scheduled maintenance,' 'third-party failures,' 'DNS issues,' and 'client-side errors,' leaving only a narrow slice of traffic that shows perfect performance. Guardrail: Include a pre-defined allowlist of acceptable exclusions in the system prompt. Require the model to enumerate every exclusion applied and compare against the allowlist. Flag any exclusion not on the list and require human review before accepting the claim.
Evaluation Rubric
Use this rubric to test the prompt's output quality before shipping. Each criterion targets a specific failure mode in SLA and performance metric verification. Run these checks against a golden dataset of known-good and known-bad telemetry-to-claim pairs.
| Criterion | Pass Standard | Failure Signal | Test Method |
|---|---|---|---|
Metric Definition Gaming Detection | Flags when the reported metric uses a non-standard formula, excludes relevant failure modes, or cherry-picks measurement windows. | Output accepts a 99.9% uptime claim that excludes planned maintenance without flagging the exclusion. | Inject claims with known definitional gaming (e.g., 'error rate' excluding 5xx codes). Assert the output contains a definitional flag. |
Measurement Window Validation | Confirms the measurement period aligns with the claim's stated or implied window. Flags mismatches between claim period and data range. | Output verifies a '99.99% monthly uptime' claim using only a 7-day rolling window without noting the discrepancy. | Provide telemetry for a partial window. Assert the output identifies the window mismatch and requests or notes the missing data. |
Exclusion Rule Transparency Check | Identifies and lists all exclusion rules applied to the SLA calculation (e.g., planned maintenance, force majeure). | Output reports a compliant SLA without surfacing that 4 hours of downtime were excluded under a broad maintenance window. | Feed telemetry with annotated exclusion events. Assert the output enumerates each exclusion rule and its duration. |
Error Budget Consumption Accuracy | Correctly calculates error budget consumption against the defined SLO and remaining budget. | Output miscalculates remaining error budget due to incorrect time-slice arithmetic or unit confusion (minutes vs seconds). | Provide a known error budget scenario with a pre-calculated ground truth. Assert the output's remaining budget matches within a 1% tolerance. |
Latency Percentile Correctness | Correctly computes and reports the specified latency percentile (e.g., p99, p99.9) from raw telemetry, not averages. | Output reports an average latency when the SLA specifies a p99 latency target. | Supply a distribution of latency values. Assert the output's p99 calculation matches a reference implementation and explicitly labels the percentile. |
Throughput Normalization Check | Normalizes throughput claims to a standard unit (e.g., requests per second) and flags claims that use ambiguous or shifting units. | Output compares a peak throughput claim against an average throughput baseline without noting the unit or aggregation difference. | Inject claims with mixed units (RPM vs RPS). Assert the output normalizes both to a common unit before comparison and notes the conversion. |
Violation Root Cause Correlation | Correlates SLA violations with specific deployment events, infrastructure changes, or incident records when provided. | Output lists a violation timestamp without linking it to a provided deployment event that occurred 2 minutes prior. | Provide telemetry with a violation spike and a time-aligned change log. Assert the output hypothesizes a correlation and cites both timestamps. |
Composite SLA Aggregation Logic | Correctly aggregates multiple component SLAs into a composite SLA using the documented dependency model (serial, parallel). | Output averages the uptime of three serial components instead of multiplying them to get the composite uptime. | Provide uptime values for components in a known topology. Assert the composite SLA calculation matches the correct mathematical aggregation. |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Adapt This Prompt
How to adapt
Start with the base prompt and a single SLA document or metric definition. Use a frontier model (GPT-4o, Claude 3.5 Sonnet) with no additional tooling. Feed in the raw telemetry summary and the SLA text as [SLA_DOCUMENT] and [TELEMETRY_DATA]. Accept the model's structured output without schema enforcement beyond what the prompt requests.
Watch for
- The model inventing metric definitions when the SLA text is ambiguous
- Missing exclusion window logic (maintenance periods, known outages)
- Measurement window mismatches between SLA definition and telemetry data
- Overly confident compliance assessments when data is incomplete

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us