Forecast governed release competing risks

Forecast company-local rollback, hotfix and incident incidence conditional on deployment with inverse-propensity-corrected discrete-time competing risks, strict whole-release chronological validation, posterior intervals and mandatory improvement over both a simple baseline and the legacy PR score.

What it's for

Upgrades the headline 'release risk based on historical patterns' from universal hand-set thresholds to a tenant-local, validation-gated probability of distinct production outcomes with honest uncertainty.

What you give it

Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.

Field Type Role Required
as_of_ms number ≥ 0 Your calibration Yes
current_changes array of objects (6 fields) Evidence Yes
eligible_history array of objects (11 fields) Evidence Yes
feature_names array of string Evidence Yes
holdout_fraction number ≥ 0.1, ≤ 0.4 Your calibration Optional
horizon_periods integer ≥ 1, ≤ 104 Your calibration Optional
l2_penalty number > 0, ≤ 100 Your calibration Optional
max_detail_rows integer ≥ 1, ≤ 1000 Numerical control Optional
maximum_failure_ece number ≥ 0, ≤ 1 Your calibration Optional
maximum_inverse_propensity_weight number ≥ 1, ≤ 1000 Your calibration Optional
minimum_deployment_propensity number > 0, ≤ 1 Your calibration Optional
minimum_events_per_cause integer ≥ 1 Your calibration Optional
minimum_holdout_releases integer ≥ 5 Your calibration Optional
minimum_log_loss_improvement number ≥ 0, ≤ 1 Your calibration Optional
posterior_draws integer ≥ 100, ≤ 5000 Numerical control Optional
release_periods array of objects (8 fields) Evidence Yes
seed integer ≥ 0, ≤ 4294967295 Numerical control Optional

Each eligible_history record

Field Type Required
change_class_id string (non-empty) Yes
decision_at_ms number (≥ 0) Yes
deployed boolean Yes
deployment_propensity number (> 0, ≤ 1) Yes
evidence_verified boolean Yes
feature_values object Yes
id string (non-empty) Yes
legacy_risk_probability number,null (≥ 0, ≤ 1) Optional
propensity_source_id string (non-empty) Yes
propensity_verified boolean Yes
repository_id string (non-empty) Yes
Example input
{
  "as_of_ms": 10000,
  "current_changes": [
    {
      "change_class_id": "class-3",
      "decision_at_ms": 9000,
      "evidence_verified": true,
      "feature_values": {
        "clean_signal": 0,
        "hotfix_signal": 0,
        "incident_signal": 0,
        "rollback_signal": 1
      },
      "id": "current-payments-release",
      "repository_id": "payments"
    }
  ],
  "eligible_history": [
    {
      "change_class_id": "class-0",
      "decision_at_ms": 1000,
      "deployed": true,
      "deployment_propensity": 0.8,
      "evidence_verified": true,
      "feature_values": {
        "clean_signal": 1,
        "hotfix_signal": 0,
        "incident_signal": 0,
        "rollback_signal": 0
      },
      "id": "release-example-0",
      "legacy_risk_probability": 0.5,
      "propensity_source_id": "registered-release-policy",
      "propensity_verified": true,
      "repository_id": "payments"
    },
    {
      "change_class_id": "class-1",
      "decision_at_ms": 1100,
      "deployed": true,
      "deployment_propensity": 0.8,
      "evidence_verified": true,
      "feature_values": {
        "clean_signal": 1,

Truncated for display — the full payload is 2076 lines.

What you get back

This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.

Example output
{
  "accepted": true,
  "assumptions": [
    "Deployment propensities are point-in-time probabilities for the actual release decision and all joint causes of deployment selection and production outcome are represented by the submitted aggregate features.",
    "Release periods are contiguous at-risk intervals with one mutually exclusive first rollback, hotfix or incident event; censoring and the maturity window are independent conditional on the modeled history."
  ],
  "counts": {
    "current_changes": 1,
    "deployed_releases": 48,
    "eligible_historical_changes": 60,
    "holdout_releases": 10,
    "training_events_by_cause": {
      "hotfix": 6,
      "incident": 6,
      "rollback": 6
    },
    "training_releases": 38,
    "undeployed_changes_retained": 12
  },
  "decision": "release_competing_risk_model_accepted",
  "failed_gates": [],
  "forecasts": [
    {
      "any_failure_probability": 0.9428,
      "change_id": "current-payments-release",
      "competing_outcomes": {
        "hotfix": {
          "p05": 0,
          "p95": 0.8953,
          "probability": 0.0032
        },
        "incident": {
          "p05": 0,
          "p95": 0.9595,
          "probability": 0.0051
        },
        "none": {
          "p05": 0.0003,
          "p95": 0.5229,
          "probability": 0.0572
        },
        "rollback": {
          "p05": 0.0148,
          "p95": 0.9845,

Truncated for display — the full payload is 75 lines.

How it works

Sequential Bayesian & bandits — Learn while deciding — update beliefs as evidence arrives and choose where the next unit of effort is worth spending.

  1. 1 Retain every eligible historical change and its frozen deployment propensity, then build contiguous mature at-risk periods only for exactly linked deployed releases.
  2. 2 Hold out the latest whole releases, fit inverse-propensity-weighted cause-specific softmax hazards on earlier releases and compare cumulative competing incidence against a base model and any supplied legacy risk score.
  3. 3 Abstain on selection-support, cause-support, maturity, calibration or baseline failure; otherwise refit and return posterior cumulative-incidence intervals explicitly conditional on deployment.

Before you trust it

Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.

Assumptions & guardrails

  • The likelihood or reward model, prior support, action logging, delayed outcomes, and any stationarity assumptions match the deployment process.
  • Known deployment propensities and submitted aggregate features make deployment selection conditionally exchangeable with production outcomes, positivity holds, censoring is conditionally independent and the first-event taxonomy is stable.
  • Posterior probability and adaptive selection are model-conditional; they are not substitutes for randomized propensities or guaranteed safety.
  • The estimand is production outcome if the eligible change is deployed under strong selection assumptions—not the causal effect of merging, a reason to blame an author, or autonomous authority to block.

Minimum evidence

  • eligible_history: required and organization-defined
  • release_periods: required and organization-defined
  • current_changes: required and organization-defined
  • feature_names: required and organization-defined
  • as_of_ms: required and organization-defined

How to validate it

Use chronological train/calibration/test windows, compare proper scores and decision value with a simple baseline, and recalibrate only from outcomes resolved after prediction time.

Calibrating it to your org

Same for everyone

The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.

Specific to you

  • zero-inclusive contiguous release-period panel linked exactly through PR commits to production deployments, mature competing outcomes, point-in-time aggregate code/process features and the legacy risk probability for honest benchmark comparison
  • feature set and change classes, deployment policy and propensity source, time period and horizon, outcome maturity/censoring, positivity and inverse-weight caps, holdout/cause support, calibration/improvement gates, regularization and model-review authority

Calibration workflow

  1. 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
  2. 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
  3. 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
  4. 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
  5. 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
  6. 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.

Call it from your AI

You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.

gitrevio_capabilities_search
  { "q": "forecast companylocal rollback hotfix and incident" }
  → finds "forecast_governed_release_competing_risks"

gitrevio_capability_describe
  { "capability_id": "forecast_governed_release_competing_risks" }
  → returns the input schema and agent guidance shown on this page

gitrevio_capability_run
  { "capability_id": "forecast_governed_release_competing_risks", "arguments": { ... } }
  → returns the result shown above

Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.

Related tools

Audit release risk prediction integrity

Audit a complete eligible-change release-risk cohort for point-in-time prediction lineage, exact change-to-deployment linkage, mature mutually exclusive outcomes, selective labels, score-triggered intervention contamination, calibration and false alarms before the score influences a release decision.

Forecasting & survival

Optimize causal release assurance portfolio

Select one release, assurance or hold option per change from prospectively identified Beta-binomial relative-risk effects while pricing delay, failure and shared common-mode loss under budget, scarce resources, mandatory controls, expected-failure and CVaR constraints with an exact or disclosed beam-search Pareto frontier.

Causal inference & experiment design

Audit commercial technical commitment integrity

Audit signed commercial promises against explicitly allocated technical scope, dependency order, funded capacity, acceptance criteria and evidence; expose orphan scope, double allocation, cycles, late plans and maximum contractual penalty without interpreting legal rights from engineering activity.

Constrained optimization

Audit decision execution fidelity

Audit whether approved decisions actually became verified implementation at the promised aggregate-unit and component grain, with whole-unit bootstrap uncertainty and simultaneous gates for fidelity, overdue scope, unverifiable evidence, exceptions and critical gaps.

Statistical audit & measurement

Audit KPI threshold bunching

Detect a post-target excess concentration immediately above a governed KPI threshold: compare within-unit pre/post local mass and above-versus-below mirror asymmetry, bootstrap whole units, report density bins and a smoothed log-density jump, and explicitly refuse to equate bunching with individual gaming or intent.

Statistical audit & measurement

Audit sunk cost escalation

Audit whether cumulative sunk cost predicts aggregate project continuation after project fixed effects, checkpoint time, forward value, success probability, remaining cost, and future irreversibility, with project-cluster bootstrap uncertainty.

Statistical audit & measurement

See every tool in Delivery forecasting & commitments →

Ready to See Your Engineering work clearly?

Request a free demo