This playbook is for architects and platform engineers who need a structured, evidence-based analysis of the risks associated with a specific observability vendor. Use it before signing a multi-year contract, during a build-vs-buy decision, or as part of a regular architecture review. The prompt forces the model to act as a skeptical architect, evaluating the vendor across multiple lock-in vectors and producing a scored risk report. It is designed to be used with vendor documentation, current architecture diagrams, and your organization's specific portability requirements as input context.
Prompt
Observability Vendor Lock-In Risk Analysis Prompt

When to Use This Prompt
Understand the specific job this prompt performs, the context it requires, and the scenarios where it should not be applied.
The prompt is most effective when you can provide concrete, source-grounded context. This includes the vendor's official documentation on data export APIs, the query language specification, agent installation and configuration methods, and your own organization's architectural standards or multi-cloud strategy. Without this context, the model will generate a generic analysis that lacks the specificity needed for a real procurement or architectural decision. The output is a scored risk report, not a binary yes/no answer, which means you must be prepared to interpret the scores and trade-offs within your own risk tolerance.
Do not use this prompt when you lack access to vendor documentation or when the decision is purely about pricing. This prompt analyzes technical lock-in, not total cost of ownership. It is also not a substitute for a legal review of contract terms, data processing agreements, or SLA commitments. If your organization has no intention of ever migrating away from a vendor, the lock-in analysis is still valuable for understanding operational risk, but the migration cost vector will carry less weight. After running this analysis, the next step is to feed the scored report into a broader architecture decision record that weighs the lock-in risk against the vendor's functional benefits and your team's operational capacity.
Use Case Fit
Where this prompt works and where it does not. Use these cards to decide if the Observability Vendor Lock-In Risk Analysis Prompt fits your current architecture review.
Good Fit: Strategic Vendor Evaluation
Use when: you are evaluating a new observability vendor or renewing an existing contract and need a structured risk analysis before committing. Guardrail: The prompt is designed for pre-decision analysis, not post-migration forensics. Run it before procurement, not after.
Bad Fit: Real-Time Migration Execution
Avoid when: you are in the middle of an active migration and need step-by-step technical runbooks. Guardrail: This prompt produces a risk analysis document, not an execution plan. Pair it with a separate migration runbook prompt for implementation steps.
Required Inputs: Architecture Artifacts
What to watch: The prompt requires current observability architecture docs, agent configurations, and data pipeline diagrams to produce a meaningful analysis. Guardrail: If you lack documentation, run an architecture discovery prompt first. Garbage in, garbage out applies here.
Operational Risk: Overconfidence in Analysis
What to watch: The model may produce confident-sounding migration cost estimates or compatibility claims without real benchmarking data. Guardrail: Treat all cost and effort estimates as hypotheses requiring engineering validation. Never use raw model output as a budget line item.
Scope Boundary: Single Vendor Focus
What to watch: The prompt analyzes one vendor's lock-in risk at a time. Running it sequentially for multiple vendors without cross-comparison can miss relative risk differences. Guardrail: After individual analyses, use a trade-off comparison prompt to rank vendors side by side on portability criteria.
Compliance Surface: Export and Data Residency
What to watch: The prompt covers data export difficulty but may not surface jurisdiction-specific data residency risks unless explicitly instructed. Guardrail: Add a [REGULATORY_CONTEXT] input field specifying GDPR, SOC2, HIPAA, or other applicable frameworks to force compliance-aware analysis.
Copy-Ready Prompt Template
A reusable prompt with square-bracket placeholders for analyzing observability vendor lock-in risk. Copy this into your AI harness and replace the variables.
This prompt template is designed to produce a structured risk analysis for an observability vendor dependency. It forces the model to evaluate lock-in across multiple dimensions—data export, proprietary query languages, agent coupling, and migration cost—rather than producing a generic summary. The template uses square-bracket placeholders that you must replace with your specific vendor, architecture, and constraints before execution. The output is a risk register with severity ratings, likelihood assessments, and mitigation recommendations, suitable for an architecture decision record or vendor review packet.
textYou are an observability architect evaluating vendor lock-in risk for [VENDOR_NAME] within [ORGANIZATION_CONTEXT]. ## INPUT - Current observability stack: [CURRENT_STACK_DESCRIPTION] - Services instrumented: [SERVICE_LIST_AND_COUNT] - Data types collected: [LOGS_METRICS_TRACES_PROFILES_EVENTS] - Contract terms: [CONTRACT_DURATION_AND_EXIT_CLAUSES] - Compliance requirements: [REGULATORY_FRAMEWORKS] - Multi-cloud strategy: [MULTI_CLOUD_POSITION] - Open standards adoption: [OPENTELEMETRY_PROMQL_OTHER_STANDARDS] ## ANALYSIS DIMENSIONS For each dimension below, assess lock-in severity (Low/Medium/High/Critical), likelihood of causing migration pain (1-5), and provide evidence from the input. 1. **Data Export Difficulty**: Can raw telemetry data be exported in standard formats? Are there rate limits, format restrictions, or egress fees? 2. **Proprietary Query Language Coupling**: How much of the query, dashboard, and alert logic depends on vendor-specific languages (e.g., proprietary query syntax, non-standard functions)? 3. **Agent and Collector Coupling**: Are agents or collectors tightly coupled to the vendor's backend? Can they be swapped for OpenTelemetry collectors without rewriting instrumentation? 4. **API and Integration Lock-In**: Do critical integrations (incident management, CI/CD, chatops) depend on vendor-specific APIs or webhook formats? 5. **Migration Cost Estimate**: Rough order-of-magnitude estimate for migrating to [ALTERNATIVE_SOLUTION] in engineering-weeks, including retooling dashboards, alerts, and runbooks. 6. **Vendor Stability and Roadmap Risk**: Assess the vendor's financial stability, recent leadership changes, acquisition history, and product deprecation patterns. 7. **Skills and Team Dependency**: How specialized is the operational knowledge required for this vendor? What is the market availability of engineers with this expertise? ## CONSTRAINTS - Base all assessments on evidence provided in the input. If evidence is missing for a dimension, flag it as "Insufficient Data" and state what information would be needed. - Do not speculate about the vendor's future beyond what can be reasonably inferred from documented patterns. - For migration cost estimates, provide a range (best-case to worst-case) and list the key assumptions. - If [REGULATORY_FRAMEWORKS] includes GDPR, SOC2, or HIPAA, add a dedicated section on data residency and audit evidence portability. ## OUTPUT SCHEMA Return a JSON object with this structure: { "vendor_assessment": { "vendor_name": "string", "assessment_date": "string", "overall_lock_in_rating": "Low|Medium|High|Critical", "summary": "string (2-3 sentence executive summary)" }, "dimensions": [ { "name": "string", "severity": "Low|Medium|High|Critical", "likelihood": 1-5, "evidence": "string (specific facts from input)", "data_gaps": ["string (missing information needed for full assessment)"], "mitigation": "string (actionable recommendation)" } ], "migration_cost_estimate": { "target_alternative": "string", "best_case_weeks": number, "worst_case_weeks": number, "key_assumptions": ["string"], "largest_cost_driver": "string" }, "regulatory_considerations": { "applicable_frameworks": ["string"], "data_residency_risk": "string", "audit_evidence_portability": "string" }, "recommended_actions": [ { "action": "string", "priority": "P0|P1|P2", "effort_weeks": number, "reduces_lock_in_dimension": "string" } ], "decision_readiness": "Ready for decision|Needs more data|Escalate for legal review" } ## RISK_LEVEL [HIGH] - This analysis may influence significant procurement decisions. Flag any dimension rated Critical with a recommendation for human review before the output is used in a decision memo.
To adapt this template, replace each square-bracket placeholder with concrete data from your environment. The [ORGANIZATION_CONTEXT] should include your company size, industry, and any recent vendor consolidation initiatives. The [CURRENT_STACK_DESCRIPTION] should name specific products and versions. If you lack data for a placeholder, replace it with "Unknown—requires discovery" rather than guessing; the model will flag those gaps in the output. After generation, validate the JSON output against the schema before feeding it into your decision workflow. For high-stakes vendor evaluations, route the output to a human architect for review before it reaches procurement or leadership.
Prompt Variables
Required and optional inputs for the Observability Vendor Lock-In Risk Analysis Prompt. Each placeholder must be populated before execution. Validation notes describe how to verify the input is sufficient for a reliable analysis.
| Placeholder | Purpose | Example | Validation Notes |
|---|---|---|---|
[VENDOR_NAME] | Identifies the observability vendor under analysis | Datadog | Must be a single vendor name. If comparing multiple vendors, run the prompt once per vendor. |
[VENDOR_PRODUCT_SCOPE] | Lists the specific products or services in use from this vendor | APM, Logs, Infrastructure Monitoring, RUM | Must be a concrete list. Avoid vague terms like 'full platform'. Incomplete scope leads to incomplete migration cost estimates. |
[CURRENT_CONTRACT_TERMS] | Describes contract duration, renewal terms, and pricing model | Annual commit, 3-year term, per-host pricing with 15% annual uplift cap | Include term length and pricing model. If unknown, use 'Unknown - flagged for legal review'. Null allowed but reduces analysis accuracy. |
[INTEGRATION_POINTS] | Lists all systems, services, and code locations where vendor agents, SDKs, or APIs are embedded | Kubernetes DaemonSets, 12 Java services via auto-instrumentation, 4 Python services via manual SDK, Terraform provider for dashboards | Must be a specific inventory. Vague input produces vague lock-in assessment. Run a codebase search for vendor imports before populating. |
[DATA_TYPES_STORED] | Describes what telemetry data is stored in the vendor's systems | Traces (30-day retention), logs (90-day retention, 2TB/day), metrics (13-month retention), dashboards (200+), alerts (85 rules) | Include retention periods and approximate volume. Missing data types lead to incomplete export feasibility analysis. |
[OPEN_STANDARDS_SUPPORT] | Documents which open standards the vendor supports for ingestion and export | OTLP ingest supported, OTLP export not supported, Prometheus remote read not supported, logs export via S3 archive only | Check vendor documentation and test export paths. Claimed support often differs from operational support. Use 'Verified' or 'Claimed but untested' tags. |
[MIGRATION_TARGET_CANDIDATES] | Lists alternative vendors or open-source stacks under consideration for comparison | Grafana Cloud, self-hosted Grafana + Mimir + Tempo + Loki | Optional but recommended. Without targets, the prompt produces a general risk assessment rather than a comparative migration analysis. Null allowed. |
[REGULATORY_REQUIREMENTS] | Specifies any compliance frameworks that constrain data residency, retention, or access | SOC2 Type II, GDPR (EU data residency required), HIPAA (BAA required) | Include only requirements that apply to telemetry data. Null allowed if no specific regulatory constraints exist. |
Implementation Harness Notes
How to wire the Observability Vendor Lock-In Risk Analysis Prompt into an application or review workflow with validation, retries, and human approval gates.
This prompt is designed to be called programmatically as part of an architecture review pipeline, not as a one-off chat interaction. The application layer should collect the required inputs—vendor name, current stack details, contract terms, and integration surface—from a structured form, a configuration repository, or an internal architecture catalog. Before calling the model, validate that all required placeholders are populated and that the [CONTRACT_TERMS] field includes actual data export clauses, not just a summary. Missing inputs should block execution and return a clear error to the user rather than allowing the model to hallucinate contract details.
Wrap the prompt call in a retry harness with at most three attempts. The primary failure mode is a malformed JSON output that fails schema validation. Define a strict JSON schema for the expected output—including required fields like lock_in_score, migration_cost_estimate, data_export_assessment, and portability_recommendations—and validate the model response against it before presenting results. On validation failure, append the schema errors to the retry prompt as [VALIDATION_ERRORS] and request a corrected output. If the third attempt still fails, log the raw response and escalate for human review rather than silently accepting a partial analysis. This is a high-stakes architectural decision prompt; incorrect or incomplete output can lead to costly vendor entrenchment.
Model choice matters here. Use a model with strong structured output capabilities and a context window large enough to hold the full prompt plus any vendor documentation excerpts you include in [VENDOR_DOCUMENTATION]. If you are embedding this in a CI/CD pipeline or an architecture review board workflow, store every prompt version, input hash, and validated output in an audit log. This creates an evidence trail for future vendor migration decisions. For regulated environments, add a mandatory human approval step after successful validation: the analysis should be reviewed by an architect or engineering lead before it becomes part of an official architecture decision record. Do not treat this prompt's output as a final decision—it is a structured risk assessment that informs, but does not replace, engineering judgment.
Expected Output Contract
Defines the JSON structure, types, and validation rules for the observability vendor lock-in risk analysis. Use this contract to parse, validate, and integrate the model's output into downstream risk dashboards or decision workflows.
| Field or Element | Type or Format | Required | Validation Rule |
|---|---|---|---|
risk_assessment_id | string (UUID v4) | Must match regex pattern for UUID v4. Reject if missing or malformed. | |
vendor_name | string | Must be a non-empty string matching the [VENDOR_NAME] input. Case-insensitive comparison required. | |
analysis_timestamp | string (ISO 8601) | Must parse as a valid ISO 8601 datetime. Reject if date is in the future or unparseable. | |
overall_risk_score | string (enum) | Must be one of: 'low', 'medium', 'high', 'critical'. Reject any other value. | |
risk_factors | array of objects | Must be a non-empty array. Each object must contain 'factor_name' (string), 'risk_level' (enum: low/medium/high/critical), and 'rationale' (string). | |
migration_cost_estimate | object | Must contain 'engineering_weeks' (integer >= 0), 'infrastructure_cost_usd' (number >= 0), and 'confidence' (enum: low/medium/high). | |
open_standards_compliance | object | Must contain 'opentelemetry_support' (boolean), 'promql_compatible' (boolean), and 'standard_sql_support' (boolean). Null values not allowed. | |
proprietary_lock_in_points | array of strings | Each string must be a non-empty description of a specific lock-in mechanism. Reject if array is empty when overall_risk_score is 'high' or 'critical'. |
Common Failure Modes
What breaks first when analyzing observability vendor lock-in and how to guard against it.
Superficial API Compatibility Analysis
What to watch: The model treats API surface similarity as evidence of portability, ignoring proprietary query languages, agent protocols, and semantic differences. Guardrail: Require the prompt to analyze data-plane and control-plane APIs separately, with explicit comparison of query language expressiveness and migration tooling maturity.
Ignoring Data Export Friction
What to watch: The analysis underestimates export costs, rate limits, format degradation, and historical data volume. Guardrail: Add a mandatory section on egress pricing, API throttling, and format fidelity loss during bulk export. Require concrete volume estimates, not qualitative descriptions.
Overlooking Agent and SDK Coupling
What to watch: The model focuses on backend storage lock-in while missing tight coupling in instrumentation agents, SDKs, and auto-instrumentation that embed vendor-specific context propagation. Guardrail: Include a dedicated analysis step for agent replacement cost, language coverage gaps, and OpenTelemetry compatibility of each agent.
Migration Cost Underestimation
What to watch: The analysis treats migration as a one-time engineering cost, ignoring dual-run periods, team retraining, dashboard rebuilds, and alert logic rewrites. Guardrail: Require a phased migration timeline with parallel-run duration estimates and a rollback plan. Flag any analysis that omits operational continuity costs.
Proprietary Feature Dependency Blindness
What to watch: The model fails to identify which dashboards, alerts, and SLOs depend on vendor-proprietary features that have no open-standard equivalent. Guardrail: Add a dependency inventory step that maps each observability artifact to its underlying data source and query engine, flagging proprietary dependencies.
Multi-Cloud Portability Assumption
What to watch: The analysis assumes multi-cloud deployment automatically solves lock-in, ignoring that each cloud's native observability service creates its own lock-in surface. Guardrail: Require separate lock-in scoring for each cloud provider's observability stack and a cross-cloud portability matrix for each signal type.
Evaluation Rubric
Use this rubric to test the quality of the vendor lock-in risk analysis before integrating it into an architecture review pipeline. Each criterion targets a specific failure mode common to vendor dependency assessments.
| Criterion | Pass Standard | Failure Signal | Test Method |
|---|---|---|---|
Data Export Difficulty Assessment | Analysis identifies specific export APIs, formats, rate limits, and egress costs for each data type (logs, metrics, traces). | Output contains only generic statements like 'data export is possible' without naming concrete mechanisms or constraints. | Manual review: check for presence of API names, format identifiers, and cost references in the export section. |
Proprietary Query Language Risk | Analysis flags any proprietary query language and maps its features to standard alternatives (SQL, PromQL, etc.). | Output fails to mention the query language or dismisses it as 'similar to SQL' without detailing gaps. | Schema check: confirm [QUERY_LANGUAGE] placeholder is resolved and a feature comparison table exists. |
Agent Coupling Depth | Analysis details agent deployment modes (DaemonSet, sidecar, library), configuration surface, and upgrade coupling with the vendor backend. | Output only discusses agent installation without analyzing the tightness of the agent-to-backend version dependency. | Assertion test: verify the output contains a coupling rating (e.g., tight/moderate/loose) with justification. |
Migration Cost Estimation | Analysis provides a rough order-of-magnitude cost estimate broken down by engineering time, data transfer, and dual-run overhead. | Output states migration cost is 'high' or 'low' without any breakdown or basis for the estimate. | Parse check: confirm the output contains at least three cost line items with numeric ranges or T-shirt sizes. |
Open Standards Compatibility | Analysis evaluates support for OpenTelemetry, Prometheus exposition format, W3C Trace Context, and other relevant standards. | Output claims 'supports open standards' without verifying which signals and versions are actually compatible. | Schema check: confirm a standards compatibility matrix is present with explicit support levels (full/partial/none). |
Multi-Cloud Portability | Analysis assesses whether the vendor solution can run across AWS, Azure, and GCP with equivalent functionality. | Output assumes multi-cloud support based on marketing claims without analyzing region parity or feature gaps. | Manual review: check for cloud-specific limitations documented in the portability section. |
Contractual Lock-In Indicators | Analysis identifies minimum commit terms, auto-renewal clauses, data retention policies after termination, and price increase caps. | Output focuses only on technical lock-in and ignores contractual terms that create commercial dependency. | Checklist test: verify at least four contractual dimensions are addressed in the analysis. |
Alternative Vendor Comparison | Analysis names at least two alternative vendors and compares migration complexity to each. | Output evaluates the current vendor in isolation without benchmarking against alternatives. | Count test: confirm at least two named alternatives with distinct migration complexity assessments. |
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Adapt This Prompt
How to adapt
Use the base prompt with a single vendor and lighter evidence requirements. Replace [VENDOR_DOCUMENTATION] with a single datasheet or pricing page. Accept qualitative risk ratings (Low/Medium/High) without requiring migration cost estimates or multi-cloud portability scores.
Watch for
- Overly broad instructions producing generic "vendor lock-in is bad" output without specific technical coupling points
- Missing structured output schema leading to narrative prose instead of actionable risk items
- No validation that the model actually identified proprietary query languages, agent formats, or export limitations

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us