Inferensys

Prompt

Observability Vendor Lock-In Risk Analysis Prompt

A practical prompt playbook for architects and SREs evaluating the risk of vendor lock-in within their observability stack. Produces a structured risk analysis covering data export, proprietary query languages, agent coupling, and migration cost.
Risk analyst performing AI risk assessment on laptop, risk matrices visible, casual office risk session.
PROMPT PLAYBOOK

When to Use This Prompt

Understand the specific job this prompt performs, the context it requires, and the scenarios where it should not be applied.

This playbook is for architects and platform engineers who need a structured, evidence-based analysis of the risks associated with a specific observability vendor. Use it before signing a multi-year contract, during a build-vs-buy decision, or as part of a regular architecture review. The prompt forces the model to act as a skeptical architect, evaluating the vendor across multiple lock-in vectors and producing a scored risk report. It is designed to be used with vendor documentation, current architecture diagrams, and your organization's specific portability requirements as input context.

The prompt is most effective when you can provide concrete, source-grounded context. This includes the vendor's official documentation on data export APIs, the query language specification, agent installation and configuration methods, and your own organization's architectural standards or multi-cloud strategy. Without this context, the model will generate a generic analysis that lacks the specificity needed for a real procurement or architectural decision. The output is a scored risk report, not a binary yes/no answer, which means you must be prepared to interpret the scores and trade-offs within your own risk tolerance.

Do not use this prompt when you lack access to vendor documentation or when the decision is purely about pricing. This prompt analyzes technical lock-in, not total cost of ownership. It is also not a substitute for a legal review of contract terms, data processing agreements, or SLA commitments. If your organization has no intention of ever migrating away from a vendor, the lock-in analysis is still valuable for understanding operational risk, but the migration cost vector will carry less weight. After running this analysis, the next step is to feed the scored report into a broader architecture decision record that weighs the lock-in risk against the vendor's functional benefits and your team's operational capacity.

PRACTICAL GUARDRAILS

Use Case Fit

Where this prompt works and where it does not. Use these cards to decide if the Observability Vendor Lock-In Risk Analysis Prompt fits your current architecture review.

01

Good Fit: Strategic Vendor Evaluation

Use when: you are evaluating a new observability vendor or renewing an existing contract and need a structured risk analysis before committing. Guardrail: The prompt is designed for pre-decision analysis, not post-migration forensics. Run it before procurement, not after.

02

Bad Fit: Real-Time Migration Execution

Avoid when: you are in the middle of an active migration and need step-by-step technical runbooks. Guardrail: This prompt produces a risk analysis document, not an execution plan. Pair it with a separate migration runbook prompt for implementation steps.

03

Required Inputs: Architecture Artifacts

What to watch: The prompt requires current observability architecture docs, agent configurations, and data pipeline diagrams to produce a meaningful analysis. Guardrail: If you lack documentation, run an architecture discovery prompt first. Garbage in, garbage out applies here.

04

Operational Risk: Overconfidence in Analysis

What to watch: The model may produce confident-sounding migration cost estimates or compatibility claims without real benchmarking data. Guardrail: Treat all cost and effort estimates as hypotheses requiring engineering validation. Never use raw model output as a budget line item.

05

Scope Boundary: Single Vendor Focus

What to watch: The prompt analyzes one vendor's lock-in risk at a time. Running it sequentially for multiple vendors without cross-comparison can miss relative risk differences. Guardrail: After individual analyses, use a trade-off comparison prompt to rank vendors side by side on portability criteria.

06

Compliance Surface: Export and Data Residency

What to watch: The prompt covers data export difficulty but may not surface jurisdiction-specific data residency risks unless explicitly instructed. Guardrail: Add a [REGULATORY_CONTEXT] input field specifying GDPR, SOC2, HIPAA, or other applicable frameworks to force compliance-aware analysis.

PROMPT PLAYBOOK

Copy-Ready Prompt Template

A reusable prompt with square-bracket placeholders for analyzing observability vendor lock-in risk. Copy this into your AI harness and replace the variables.

This prompt template is designed to produce a structured risk analysis for an observability vendor dependency. It forces the model to evaluate lock-in across multiple dimensions—data export, proprietary query languages, agent coupling, and migration cost—rather than producing a generic summary. The template uses square-bracket placeholders that you must replace with your specific vendor, architecture, and constraints before execution. The output is a risk register with severity ratings, likelihood assessments, and mitigation recommendations, suitable for an architecture decision record or vendor review packet.

text
You are an observability architect evaluating vendor lock-in risk for [VENDOR_NAME] within [ORGANIZATION_CONTEXT].

## INPUT
- Current observability stack: [CURRENT_STACK_DESCRIPTION]
- Services instrumented: [SERVICE_LIST_AND_COUNT]
- Data types collected: [LOGS_METRICS_TRACES_PROFILES_EVENTS]
- Contract terms: [CONTRACT_DURATION_AND_EXIT_CLAUSES]
- Compliance requirements: [REGULATORY_FRAMEWORKS]
- Multi-cloud strategy: [MULTI_CLOUD_POSITION]
- Open standards adoption: [OPENTELEMETRY_PROMQL_OTHER_STANDARDS]

## ANALYSIS DIMENSIONS
For each dimension below, assess lock-in severity (Low/Medium/High/Critical), likelihood of causing migration pain (1-5), and provide evidence from the input.

1. **Data Export Difficulty**: Can raw telemetry data be exported in standard formats? Are there rate limits, format restrictions, or egress fees?
2. **Proprietary Query Language Coupling**: How much of the query, dashboard, and alert logic depends on vendor-specific languages (e.g., proprietary query syntax, non-standard functions)?
3. **Agent and Collector Coupling**: Are agents or collectors tightly coupled to the vendor's backend? Can they be swapped for OpenTelemetry collectors without rewriting instrumentation?
4. **API and Integration Lock-In**: Do critical integrations (incident management, CI/CD, chatops) depend on vendor-specific APIs or webhook formats?
5. **Migration Cost Estimate**: Rough order-of-magnitude estimate for migrating to [ALTERNATIVE_SOLUTION] in engineering-weeks, including retooling dashboards, alerts, and runbooks.
6. **Vendor Stability and Roadmap Risk**: Assess the vendor's financial stability, recent leadership changes, acquisition history, and product deprecation patterns.
7. **Skills and Team Dependency**: How specialized is the operational knowledge required for this vendor? What is the market availability of engineers with this expertise?

## CONSTRAINTS
- Base all assessments on evidence provided in the input. If evidence is missing for a dimension, flag it as "Insufficient Data" and state what information would be needed.
- Do not speculate about the vendor's future beyond what can be reasonably inferred from documented patterns.
- For migration cost estimates, provide a range (best-case to worst-case) and list the key assumptions.
- If [REGULATORY_FRAMEWORKS] includes GDPR, SOC2, or HIPAA, add a dedicated section on data residency and audit evidence portability.

## OUTPUT SCHEMA
Return a JSON object with this structure:
{
  "vendor_assessment": {
    "vendor_name": "string",
    "assessment_date": "string",
    "overall_lock_in_rating": "Low|Medium|High|Critical",
    "summary": "string (2-3 sentence executive summary)"
  },
  "dimensions": [
    {
      "name": "string",
      "severity": "Low|Medium|High|Critical",
      "likelihood": 1-5,
      "evidence": "string (specific facts from input)",
      "data_gaps": ["string (missing information needed for full assessment)"],
      "mitigation": "string (actionable recommendation)"
    }
  ],
  "migration_cost_estimate": {
    "target_alternative": "string",
    "best_case_weeks": number,
    "worst_case_weeks": number,
    "key_assumptions": ["string"],
    "largest_cost_driver": "string"
  },
  "regulatory_considerations": {
    "applicable_frameworks": ["string"],
    "data_residency_risk": "string",
    "audit_evidence_portability": "string"
  },
  "recommended_actions": [
    {
      "action": "string",
      "priority": "P0|P1|P2",
      "effort_weeks": number,
      "reduces_lock_in_dimension": "string"
    }
  ],
  "decision_readiness": "Ready for decision|Needs more data|Escalate for legal review"
}

## RISK_LEVEL
[HIGH] - This analysis may influence significant procurement decisions. Flag any dimension rated Critical with a recommendation for human review before the output is used in a decision memo.

To adapt this template, replace each square-bracket placeholder with concrete data from your environment. The [ORGANIZATION_CONTEXT] should include your company size, industry, and any recent vendor consolidation initiatives. The [CURRENT_STACK_DESCRIPTION] should name specific products and versions. If you lack data for a placeholder, replace it with "Unknown—requires discovery" rather than guessing; the model will flag those gaps in the output. After generation, validate the JSON output against the schema before feeding it into your decision workflow. For high-stakes vendor evaluations, route the output to a human architect for review before it reaches procurement or leadership.

IMPLEMENTATION TABLE

Prompt Variables

Required and optional inputs for the Observability Vendor Lock-In Risk Analysis Prompt. Each placeholder must be populated before execution. Validation notes describe how to verify the input is sufficient for a reliable analysis.

PlaceholderPurposeExampleValidation Notes

[VENDOR_NAME]

Identifies the observability vendor under analysis

Datadog

Must be a single vendor name. If comparing multiple vendors, run the prompt once per vendor.

[VENDOR_PRODUCT_SCOPE]

Lists the specific products or services in use from this vendor

APM, Logs, Infrastructure Monitoring, RUM

Must be a concrete list. Avoid vague terms like 'full platform'. Incomplete scope leads to incomplete migration cost estimates.

[CURRENT_CONTRACT_TERMS]

Describes contract duration, renewal terms, and pricing model

Annual commit, 3-year term, per-host pricing with 15% annual uplift cap

Include term length and pricing model. If unknown, use 'Unknown - flagged for legal review'. Null allowed but reduces analysis accuracy.

[INTEGRATION_POINTS]

Lists all systems, services, and code locations where vendor agents, SDKs, or APIs are embedded

Kubernetes DaemonSets, 12 Java services via auto-instrumentation, 4 Python services via manual SDK, Terraform provider for dashboards

Must be a specific inventory. Vague input produces vague lock-in assessment. Run a codebase search for vendor imports before populating.

[DATA_TYPES_STORED]

Describes what telemetry data is stored in the vendor's systems

Traces (30-day retention), logs (90-day retention, 2TB/day), metrics (13-month retention), dashboards (200+), alerts (85 rules)

Include retention periods and approximate volume. Missing data types lead to incomplete export feasibility analysis.

[OPEN_STANDARDS_SUPPORT]

Documents which open standards the vendor supports for ingestion and export

OTLP ingest supported, OTLP export not supported, Prometheus remote read not supported, logs export via S3 archive only

Check vendor documentation and test export paths. Claimed support often differs from operational support. Use 'Verified' or 'Claimed but untested' tags.

[MIGRATION_TARGET_CANDIDATES]

Lists alternative vendors or open-source stacks under consideration for comparison

Grafana Cloud, self-hosted Grafana + Mimir + Tempo + Loki

Optional but recommended. Without targets, the prompt produces a general risk assessment rather than a comparative migration analysis. Null allowed.

[REGULATORY_REQUIREMENTS]

Specifies any compliance frameworks that constrain data residency, retention, or access

SOC2 Type II, GDPR (EU data residency required), HIPAA (BAA required)

Include only requirements that apply to telemetry data. Null allowed if no specific regulatory constraints exist.

PROMPT PLAYBOOK

Implementation Harness Notes

How to wire the Observability Vendor Lock-In Risk Analysis Prompt into an application or review workflow with validation, retries, and human approval gates.

This prompt is designed to be called programmatically as part of an architecture review pipeline, not as a one-off chat interaction. The application layer should collect the required inputs—vendor name, current stack details, contract terms, and integration surface—from a structured form, a configuration repository, or an internal architecture catalog. Before calling the model, validate that all required placeholders are populated and that the [CONTRACT_TERMS] field includes actual data export clauses, not just a summary. Missing inputs should block execution and return a clear error to the user rather than allowing the model to hallucinate contract details.

Wrap the prompt call in a retry harness with at most three attempts. The primary failure mode is a malformed JSON output that fails schema validation. Define a strict JSON schema for the expected output—including required fields like lock_in_score, migration_cost_estimate, data_export_assessment, and portability_recommendations—and validate the model response against it before presenting results. On validation failure, append the schema errors to the retry prompt as [VALIDATION_ERRORS] and request a corrected output. If the third attempt still fails, log the raw response and escalate for human review rather than silently accepting a partial analysis. This is a high-stakes architectural decision prompt; incorrect or incomplete output can lead to costly vendor entrenchment.

Model choice matters here. Use a model with strong structured output capabilities and a context window large enough to hold the full prompt plus any vendor documentation excerpts you include in [VENDOR_DOCUMENTATION]. If you are embedding this in a CI/CD pipeline or an architecture review board workflow, store every prompt version, input hash, and validated output in an audit log. This creates an evidence trail for future vendor migration decisions. For regulated environments, add a mandatory human approval step after successful validation: the analysis should be reviewed by an architect or engineering lead before it becomes part of an official architecture decision record. Do not treat this prompt's output as a final decision—it is a structured risk assessment that informs, but does not replace, engineering judgment.

IMPLEMENTATION TABLE

Expected Output Contract

Defines the JSON structure, types, and validation rules for the observability vendor lock-in risk analysis. Use this contract to parse, validate, and integrate the model's output into downstream risk dashboards or decision workflows.

Field or ElementType or FormatRequiredValidation Rule

risk_assessment_id

string (UUID v4)

Must match regex pattern for UUID v4. Reject if missing or malformed.

vendor_name

string

Must be a non-empty string matching the [VENDOR_NAME] input. Case-insensitive comparison required.

analysis_timestamp

string (ISO 8601)

Must parse as a valid ISO 8601 datetime. Reject if date is in the future or unparseable.

overall_risk_score

string (enum)

Must be one of: 'low', 'medium', 'high', 'critical'. Reject any other value.

risk_factors

array of objects

Must be a non-empty array. Each object must contain 'factor_name' (string), 'risk_level' (enum: low/medium/high/critical), and 'rationale' (string).

migration_cost_estimate

object

Must contain 'engineering_weeks' (integer >= 0), 'infrastructure_cost_usd' (number >= 0), and 'confidence' (enum: low/medium/high).

open_standards_compliance

object

Must contain 'opentelemetry_support' (boolean), 'promql_compatible' (boolean), and 'standard_sql_support' (boolean). Null values not allowed.

proprietary_lock_in_points

array of strings

Each string must be a non-empty description of a specific lock-in mechanism. Reject if array is empty when overall_risk_score is 'high' or 'critical'.

PRACTICAL GUARDRAILS

Common Failure Modes

What breaks first when analyzing observability vendor lock-in and how to guard against it.

01

Superficial API Compatibility Analysis

What to watch: The model treats API surface similarity as evidence of portability, ignoring proprietary query languages, agent protocols, and semantic differences. Guardrail: Require the prompt to analyze data-plane and control-plane APIs separately, with explicit comparison of query language expressiveness and migration tooling maturity.

02

Ignoring Data Export Friction

What to watch: The analysis underestimates export costs, rate limits, format degradation, and historical data volume. Guardrail: Add a mandatory section on egress pricing, API throttling, and format fidelity loss during bulk export. Require concrete volume estimates, not qualitative descriptions.

03

Overlooking Agent and SDK Coupling

What to watch: The model focuses on backend storage lock-in while missing tight coupling in instrumentation agents, SDKs, and auto-instrumentation that embed vendor-specific context propagation. Guardrail: Include a dedicated analysis step for agent replacement cost, language coverage gaps, and OpenTelemetry compatibility of each agent.

04

Migration Cost Underestimation

What to watch: The analysis treats migration as a one-time engineering cost, ignoring dual-run periods, team retraining, dashboard rebuilds, and alert logic rewrites. Guardrail: Require a phased migration timeline with parallel-run duration estimates and a rollback plan. Flag any analysis that omits operational continuity costs.

05

Proprietary Feature Dependency Blindness

What to watch: The model fails to identify which dashboards, alerts, and SLOs depend on vendor-proprietary features that have no open-standard equivalent. Guardrail: Add a dependency inventory step that maps each observability artifact to its underlying data source and query engine, flagging proprietary dependencies.

06

Multi-Cloud Portability Assumption

What to watch: The analysis assumes multi-cloud deployment automatically solves lock-in, ignoring that each cloud's native observability service creates its own lock-in surface. Guardrail: Require separate lock-in scoring for each cloud provider's observability stack and a cross-cloud portability matrix for each signal type.

IMPLEMENTATION TABLE

Evaluation Rubric

Use this rubric to test the quality of the vendor lock-in risk analysis before integrating it into an architecture review pipeline. Each criterion targets a specific failure mode common to vendor dependency assessments.

CriterionPass StandardFailure SignalTest Method

Data Export Difficulty Assessment

Analysis identifies specific export APIs, formats, rate limits, and egress costs for each data type (logs, metrics, traces).

Output contains only generic statements like 'data export is possible' without naming concrete mechanisms or constraints.

Manual review: check for presence of API names, format identifiers, and cost references in the export section.

Proprietary Query Language Risk

Analysis flags any proprietary query language and maps its features to standard alternatives (SQL, PromQL, etc.).

Output fails to mention the query language or dismisses it as 'similar to SQL' without detailing gaps.

Schema check: confirm [QUERY_LANGUAGE] placeholder is resolved and a feature comparison table exists.

Agent Coupling Depth

Analysis details agent deployment modes (DaemonSet, sidecar, library), configuration surface, and upgrade coupling with the vendor backend.

Output only discusses agent installation without analyzing the tightness of the agent-to-backend version dependency.

Assertion test: verify the output contains a coupling rating (e.g., tight/moderate/loose) with justification.

Migration Cost Estimation

Analysis provides a rough order-of-magnitude cost estimate broken down by engineering time, data transfer, and dual-run overhead.

Output states migration cost is 'high' or 'low' without any breakdown or basis for the estimate.

Parse check: confirm the output contains at least three cost line items with numeric ranges or T-shirt sizes.

Open Standards Compatibility

Analysis evaluates support for OpenTelemetry, Prometheus exposition format, W3C Trace Context, and other relevant standards.

Output claims 'supports open standards' without verifying which signals and versions are actually compatible.

Schema check: confirm a standards compatibility matrix is present with explicit support levels (full/partial/none).

Multi-Cloud Portability

Analysis assesses whether the vendor solution can run across AWS, Azure, and GCP with equivalent functionality.

Output assumes multi-cloud support based on marketing claims without analyzing region parity or feature gaps.

Manual review: check for cloud-specific limitations documented in the portability section.

Contractual Lock-In Indicators

Analysis identifies minimum commit terms, auto-renewal clauses, data retention policies after termination, and price increase caps.

Output focuses only on technical lock-in and ignores contractual terms that create commercial dependency.

Checklist test: verify at least four contractual dimensions are addressed in the analysis.

Alternative Vendor Comparison

Analysis names at least two alternative vendors and compares migration complexity to each.

Output evaluates the current vendor in isolation without benchmarking against alternatives.

Count test: confirm at least two named alternatives with distinct migration complexity assessments.

ADAPTATION OPTIONS

Adapt This Prompt

How to adapt

Use the base prompt with a single vendor and lighter evidence requirements. Replace [VENDOR_DOCUMENTATION] with a single datasheet or pricing page. Accept qualitative risk ratings (Low/Medium/High) without requiring migration cost estimates or multi-cloud portability scores.

Watch for

  • Overly broad instructions producing generic "vendor lock-in is bad" output without specific technical coupling points
  • Missing structured output schema leading to narrative prose instead of actionable risk items
  • No validation that the model actually identified proprietary query languages, agent formats, or export limitations
Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.