Forecast governed release competing risks
Forecast company-local rollback, hotfix and incident incidence conditional on deployment with inverse-propensity-corrected discrete-time competing risks, strict whole-release chronological validation, posterior intervals and mandatory improvement over both a simple baseline and the legacy PR score.
What it's for
Upgrades the headline 'release risk based on historical patterns' from universal hand-set thresholds to a tenant-local, validation-gated probability of distinct production outcomes with honest uncertainty.
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| as_of_ms | number ≥ 0 | Your calibration | Yes |
| current_changes | array of objects (6 fields) | Evidence | Yes |
| eligible_history | array of objects (11 fields) | Evidence | Yes |
| feature_names | array of string | Evidence | Yes |
| holdout_fraction | number ≥ 0.1, ≤ 0.4 | Your calibration | Optional |
| horizon_periods | integer ≥ 1, ≤ 104 | Your calibration | Optional |
| l2_penalty | number > 0, ≤ 100 | Your calibration | Optional |
| max_detail_rows | integer ≥ 1, ≤ 1000 | Numerical control | Optional |
| maximum_failure_ece | number ≥ 0, ≤ 1 | Your calibration | Optional |
| maximum_inverse_propensity_weight | number ≥ 1, ≤ 1000 | Your calibration | Optional |
| minimum_deployment_propensity | number > 0, ≤ 1 | Your calibration | Optional |
| minimum_events_per_cause | integer ≥ 1 | Your calibration | Optional |
| minimum_holdout_releases | integer ≥ 5 | Your calibration | Optional |
| minimum_log_loss_improvement | number ≥ 0, ≤ 1 | Your calibration | Optional |
| posterior_draws | integer ≥ 100, ≤ 5000 | Numerical control | Optional |
| release_periods | array of objects (8 fields) | Evidence | Yes |
| seed | integer ≥ 0, ≤ 4294967295 | Numerical control | Optional |
Each eligible_history
record
| Field | Type | Required |
|---|---|---|
| change_class_id | string (non-empty) | Yes |
| decision_at_ms | number (≥ 0) | Yes |
| deployed | boolean | Yes |
| deployment_propensity | number (> 0, ≤ 1) | Yes |
| evidence_verified | boolean | Yes |
| feature_values | object | Yes |
| id | string (non-empty) | Yes |
| legacy_risk_probability | number,null (≥ 0, ≤ 1) | Optional |
| propensity_source_id | string (non-empty) | Yes |
| propensity_verified | boolean | Yes |
| repository_id | string (non-empty) | Yes |
{
"as_of_ms": 10000,
"current_changes": [
{
"change_class_id": "class-3",
"decision_at_ms": 9000,
"evidence_verified": true,
"feature_values": {
"clean_signal": 0,
"hotfix_signal": 0,
"incident_signal": 0,
"rollback_signal": 1
},
"id": "current-payments-release",
"repository_id": "payments"
}
],
"eligible_history": [
{
"change_class_id": "class-0",
"decision_at_ms": 1000,
"deployed": true,
"deployment_propensity": 0.8,
"evidence_verified": true,
"feature_values": {
"clean_signal": 1,
"hotfix_signal": 0,
"incident_signal": 0,
"rollback_signal": 0
},
"id": "release-example-0",
"legacy_risk_probability": 0.5,
"propensity_source_id": "registered-release-policy",
"propensity_verified": true,
"repository_id": "payments"
},
{
"change_class_id": "class-1",
"decision_at_ms": 1100,
"deployed": true,
"deployment_propensity": 0.8,
"evidence_verified": true,
"feature_values": {
"clean_signal": 1, Truncated for display — the full payload is 2076 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"accepted": true,
"assumptions": [
"Deployment propensities are point-in-time probabilities for the actual release decision and all joint causes of deployment selection and production outcome are represented by the submitted aggregate features.",
"Release periods are contiguous at-risk intervals with one mutually exclusive first rollback, hotfix or incident event; censoring and the maturity window are independent conditional on the modeled history."
],
"counts": {
"current_changes": 1,
"deployed_releases": 48,
"eligible_historical_changes": 60,
"holdout_releases": 10,
"training_events_by_cause": {
"hotfix": 6,
"incident": 6,
"rollback": 6
},
"training_releases": 38,
"undeployed_changes_retained": 12
},
"decision": "release_competing_risk_model_accepted",
"failed_gates": [],
"forecasts": [
{
"any_failure_probability": 0.9428,
"change_id": "current-payments-release",
"competing_outcomes": {
"hotfix": {
"p05": 0,
"p95": 0.8953,
"probability": 0.0032
},
"incident": {
"p05": 0,
"p95": 0.9595,
"probability": 0.0051
},
"none": {
"p05": 0.0003,
"p95": 0.5229,
"probability": 0.0572
},
"rollback": {
"p05": 0.0148,
"p95": 0.9845, Truncated for display — the full payload is 75 lines.
How it works
Sequential Bayesian & bandits — Learn while deciding — update beliefs as evidence arrives and choose where the next unit of effort is worth spending.
- 1 Retain every eligible historical change and its frozen deployment propensity, then build contiguous mature at-risk periods only for exactly linked deployed releases.
- 2 Hold out the latest whole releases, fit inverse-propensity-weighted cause-specific softmax hazards on earlier releases and compare cumulative competing incidence against a base model and any supplied legacy risk score.
- 3 Abstain on selection-support, cause-support, maturity, calibration or baseline failure; otherwise refit and return posterior cumulative-incidence intervals explicitly conditional on deployment.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- The likelihood or reward model, prior support, action logging, delayed outcomes, and any stationarity assumptions match the deployment process.
- Known deployment propensities and submitted aggregate features make deployment selection conditionally exchangeable with production outcomes, positivity holds, censoring is conditionally independent and the first-event taxonomy is stable.
- Posterior probability and adaptive selection are model-conditional; they are not substitutes for randomized propensities or guaranteed safety.
- The estimand is production outcome if the eligible change is deployed under strong selection assumptions—not the causal effect of merging, a reason to blame an author, or autonomous authority to block.
Minimum evidence
- eligible_history: required and organization-defined
- release_periods: required and organization-defined
- current_changes: required and organization-defined
- feature_names: required and organization-defined
- as_of_ms: required and organization-defined
How to validate it
Use chronological train/calibration/test windows, compare proper scores and decision value with a simple baseline, and recalibrate only from outcomes resolved after prediction time.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- zero-inclusive contiguous release-period panel linked exactly through PR commits to production deployments, mature competing outcomes, point-in-time aggregate code/process features and the legacy risk probability for honest benchmark comparison
- feature set and change classes, deployment policy and propensity source, time period and horizon, outcome maturity/censoring, positivity and inverse-weight caps, holdout/cause support, calibration/improvement gates, regularization and model-review authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "forecast companylocal rollback hotfix and incident" }
→ finds "forecast_governed_release_competing_risks"
gitrevio_capability_describe
{ "capability_id": "forecast_governed_release_competing_risks" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "forecast_governed_release_competing_risks", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Audit release risk prediction integrity
Audit a complete eligible-change release-risk cohort for point-in-time prediction lineage, exact change-to-deployment linkage, mature mutually exclusive outcomes, selective labels, score-triggered intervention contamination, calibration and false alarms before the score influences a release decision.
Optimize causal release assurance portfolio
Select one release, assurance or hold option per change from prospectively identified Beta-binomial relative-risk effects while pricing delay, failure and shared common-mode loss under budget, scarce resources, mandatory controls, expected-failure and CVaR constraints with an exact or disclosed beam-search Pareto frontier.
Audit commercial technical commitment integrity
Audit signed commercial promises against explicitly allocated technical scope, dependency order, funded capacity, acceptance criteria and evidence; expose orphan scope, double allocation, cycles, late plans and maximum contractual penalty without interpreting legal rights from engineering activity.
Audit decision execution fidelity
Audit whether approved decisions actually became verified implementation at the promised aggregate-unit and component grain, with whole-unit bootstrap uncertainty and simultaneous gates for fidelity, overdue scope, unverifiable evidence, exceptions and critical gaps.
Audit KPI threshold bunching
Detect a post-target excess concentration immediately above a governed KPI threshold: compare within-unit pre/post local mass and above-versus-below mirror asymmetry, bootstrap whole units, report density bins and a smoothed log-density jump, and explicitly refuse to equate bunching with individual gaming or intent.
Audit sunk cost escalation
Audit whether cumulative sunk cost predicts aggregate project continuation after project fixed effects, checkpoint time, forward value, success probability, remaining cost, and future irreversibility, with project-cluster bootstrap uncertainty.