launchdarkly-guarded-rollout

作者: launchdarkly

配置受控發布,包含漸進式流量增加、指標監控與自動回滾。適用於逐步釋出功能並確保安全性的場景…

npx skills add https://github.com/launchdarkly/ai-tooling --skill launchdarkly-guarded-rollout

LaunchDarkly Guarded Rollouts

You're using a skill that will guide you through configuring guarded rollouts in LaunchDarkly. Your job is to design rollout stages, select monitoring metrics, configure regression thresholds, and start the rollout.

Prerequisites

This skill requires the remotely hosted LaunchDarkly MCP server to be configured in your environment.

Required MCP tools:

  • start-guarded-rollout -- start a progressive rollout with monitoring
  • get-flag -- inspect the flag and its variations
  • list-metrics -- find metrics to monitor during the rollout

Optional MCP tools:

  • stop-guarded-rollout -- halt an active rollout immediately
  • toggle-flag -- ensure the flag is turned on before starting
  • create-metric -- create metrics if they don't exist

Core Concepts

What Are Guarded Rollouts?

A guarded rollout progressively increases traffic to a new feature flag variation through a series of stages. At each stage, LaunchDarkly monitors selected metrics for regressions. If a regression is detected, the rollout can automatically pause and notify the team — or even roll back.

Key Components

ComponentDescription
Test variationThe new variation being rolled out
Control variationThe existing/baseline variation
StagesSteps with increasing traffic percentage and monitoring windows
MetricsWhat to monitor for regressions (error rate, latency, etc.)
Regression thresholdHow much a metric can degrade before triggering action
On regressionWhether to notify, rollback, or both when a threshold is breached

Rollout Weight Units

Rollout weights use thousandths (basis points):

  • 1000 = 1%
  • 10000 = 10%
  • 50000 = 50%
  • 100000 = 100%

Monitoring Window

The monitoring window is specified in milliseconds:

  • 3600000 = 1 hour
  • 86400000 = 24 hours
  • 604800000 = 7 days

Core Principles

  1. Start Small: Begin with a low percentage (1-5%) to catch issues early
  2. Monitor What Matters: Choose metrics that reflect user experience
  3. Set Realistic Thresholds: Too tight = false alarms; too loose = missed regressions
  4. Allow Time: Each stage needs enough monitoring time for signal to emerge
  5. Have a Rollback Plan: Always configure at least notification on regression

Workflow

Step 1: Prepare

Before starting a guarded rollout:

  1. Use get-flag to inspect the flag — note the variation IDs for test and control
  2. Use list-metrics to find metrics suitable for monitoring
  3. Ensure the flag is on in the target environment (use toggle-flag if needed)
  4. Confirm there's no active guarded rollout on this flag already

Step 2: Design Stages

Plan the rollout progression. A typical pattern:

StageTrafficMonitoring WindowPurpose
11%1 hourSmoke test — catch obvious crashes
210%24 hoursEarly signal on metrics
350%24 hoursConfidence building
4100%24 hoursFull rollout with monitoring

Step 3: Configure Metrics

Select metrics that indicate problems:

Metric TypeExampleThresholdAction
Error rateapi-error-rate0.05 (5% increase)Rollback
Latencyp99-response-time0.2 (20% increase)Notify
Conversioncheckout-completed0.1 (10% decrease)Notify + Rollback

Step 4: Start the Rollout

Use start-guarded-rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production",
  "testVariationId": "variation-id-for-new-flow",
  "controlVariationId": "variation-id-for-current-flow",
  "randomizationUnit": "user",
  "stages": [
    {"rolloutWeight": 1000, "monitoringWindowMilliseconds": 3600000},
    {"rolloutWeight": 10000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 50000, "monitoringWindowMilliseconds": 86400000},
    {"rolloutWeight": 100000, "monitoringWindowMilliseconds": 86400000}
  ],
  "metrics": [
    {
      "metricKey": "api-error-rate",
      "onRegression": {"notify": true, "rollback": true},
      "regressionThreshold": 0.05
    },
    {
      "metricKey": "checkout-completed",
      "onRegression": {"notify": true, "rollback": false},
      "regressionThreshold": 0.1
    }
  ]
}

Step 5: Verify

  1. Use get-flag to confirm the guarded rollout is active
  2. Check that the flag shows the rollout configuration in the environment
  3. Monitor for any immediate regression notifications

Report results:

  • Guarded rollout started with N stages
  • M metrics being monitored
  • First stage at X% traffic for Y hours

Stopping a Rollout

If issues arise or you need to halt the rollout:

{
  "projectKey": "my-project",
  "flagKey": "new-checkout-flow",
  "environmentKey": "production"
}

This immediately stops the progressive rollout and locks the flag at its current state.

Edge Cases

SituationAction
Flag is offTurn it on first with toggle-flag — rollouts require the flag to be on
Active rollout existsStop it first with stop-guarded-rollout before starting a new one
No suitable metricsCreate metrics first with create-metric
Approval requiredIf the environment requires approvals, the tool will return an approval URL

What NOT to Do

  • Don't start a guarded rollout on a flag that's turned off
  • Don't skip the monitoring window design — rushing through stages defeats the purpose
  • Don't set regression thresholds to 0 — small fluctuations are normal
  • Don't forget to configure at least one metric — a rollout without monitoring is just a regular rollout

來自 launchdarkly 的更多技能

aiconfig-online-evals
launchdarkly
已棄用的重新導向 — 此技能已重新命名為 online-evals。請勿使用此技能;請改為呼叫 online-evals。保留此項僅供舊有參考…
official
launchdarkly-experiment-setup
launchdarkly
在 LaunchDarkly 中設定並執行實驗。建立包含指標、處理方式與旗標配置的實驗,啟動迭代以收集資料,切換設計介於…
official
custom-metrics
launchdarkly
建立、追蹤、擷取、更新及刪除用於配置的自訂業務指標。涵蓋完整生命週期:透過 API 定義指標類型、透過 SDK 發送事件,以及…
official
projects
launchdarkly
在程式碼庫中設定 LaunchDarkly 專案的指南。協助您評估技術堆疊、選擇合適的方法,並整合專案管理,以…
official
aiconfig-ai-metrics
launchdarkly
已棄用的重新導向——此技能已更名為 built-in-metrics。請勿使用此技能;請改為調用 built-in-metrics。保留此項僅供舊有參考…
official
aiconfig-projects
launchdarkly
已棄用的重新導向——此技能已重新命名為 projects。請勿使用此技能,改為呼叫 projects。保留此項僅為舊有對 aiconfig-projects 的引用……
official
aiconfig-migrate
launchdarkly
已棄用的重定向——此技能已重新命名為 migrate。請勿使用此技能;請改用 migrate。保留此項僅為使舊有對 aiconfig-migrate 的引用仍能…
official
aiconfig-tools
launchdarkly
已棄用的重新導向——此技能已更名為 tools。請勿使用此技能,請改用 tools。保留此項僅為使舊有對 aiconfig-tools 的引用仍能指向……
official