Optimize causal release assurance portfolio
Select one release, assurance or hold option per change from prospectively identified Beta-binomial relative-risk effects while pricing delay, failure and shared common-mode loss under budget, scarce resources, mandatory controls, expected-failure and CVaR constraints with an exact or disclosed beam-search Pareto frontier.
What it's for
Converts a release-risk score into the economically valuable next question: which review, test, canary, staged rollout or hold action has demonstrated incremental protection and deserves scarce release capacity?
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| assurance_options | array of objects (10 fields) | Evidence | Yes |
| baseline_mode_id | string non-empty | Your calibration | Yes |
| beam_width | integer ≥ 10, ≤ 100000 | Numerical control | Optional |
| budget | number ≥ 0 | Your calibration | Yes |
| changes | array of objects (8 fields) | Evidence | Yes |
| confidence_level | number ≥ 0.5, < 1 | Your calibration | Optional |
| effect_studies | array of objects (14 fields) ≥ 0 items | Evidence | Yes |
| max_exact_combinations | integer ≥ 1, ≤ 1000000 | Your calibration | Optional |
| max_frontier_rows | integer ≥ 1, ≤ 500 | Your calibration | Optional |
| maximum_cvar_loss | number ≥ 0 | Your calibration | Yes |
| maximum_expected_failures | number ≥ 0 | Your calibration | Yes |
| minimum_cases_per_arm | integer ≥ 2 | Your calibration | Optional |
| minimum_probability_of_benefit | number ≥ 0, ≤ 1 | Your calibration | Optional |
| resource_capacities | object | Evidence | Yes |
| risk_aversion | number ≥ 0 | Your calibration | Optional |
| risk_groups | array of objects (4 fields) | Evidence | Yes |
| seed | integer ≥ 0, ≤ 4294967295 | Numerical control | Optional |
| simulation_draws | integer ≥ 500, ≤ 20000 | Numerical control | Optional |
Each effect_studies
record
| Field | Type | Required |
|---|---|---|
| assignment_probability_known | boolean | Yes |
| change_class_id | string (non-empty) | Yes |
| control_cases | integer (≥ 1) | Yes |
| control_failures | integer (≥ 0) | Yes |
| design_id | one of "randomized", "quasi_experimental" | Yes |
| evidence_verified | boolean | Yes |
| id | string (non-empty) | Yes |
| interference_checked | boolean | Yes |
| mode_id | string (non-empty) | Yes |
| outcome_mature | boolean | Yes |
| pre_registered | boolean | Yes |
| transport_weight | number (≥ 0, ≤ 1) | Yes |
| treated_cases | integer (≥ 1) | Yes |
| treated_failures | integer (≥ 0) | Yes |
{
"assurance_options": [
{
"change_id": "payments-release",
"cost": 0,
"delay_cost_per_hour": 0,
"delay_hours": 0,
"evidence_verified": true,
"id": "standard-release",
"mode_id": "standard",
"provided_control_ids": [
"peer-review"
],
"releases_change": true,
"resource_requirements": {
"release-engineer-hours": 0
}
},
{
"change_id": "payments-release",
"cost": 2500,
"delay_cost_per_hour": 500,
"delay_hours": 2,
"evidence_verified": true,
"id": "canary-release",
"mode_id": "canary",
"provided_control_ids": [
"peer-review",
"canary"
],
"releases_change": true,
"resource_requirements": {
"release-engineer-hours": 2
}
}
],
"baseline_mode_id": "standard",
"budget": 5000,
"changes": [
{
"base_failure_probability": 0.3,
"change_class_id": "service-change",
"evidence_verified": true,
"failure_loss": 250000, Truncated for display — the full payload is 86 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"assumptions": [
"Accepted randomized or quasi-experimental studies identify the assurance mode's effect for the submitted change class after the declared transport weight; consistency, positivity and checked interference remain required.",
"Failure losses, release values, common-risk groups, resource capacities and mandatory controls are organization-owned decision inputs rather than values learned from another tenant."
],
"decision": "release_assurance_portfolio_selected",
"evidence": {
"accepted_effects": [
{
"accepted_studies": 1,
"change_class_id": "service-change",
"eligible": true,
"median_relative_risk": 0.283,
"mode_id": "canary",
"probability_of_benefit": 1,
"relative_risk_p95": 0.4903
}
],
"rejected_options": [],
"rejected_studies": 0
},
"limitations": [
"Relative-risk posteriors do not make observational risk factors causal; unmeasured study confounding, implementation drift and changing release systems can invalidate transport.",
"The result is a human-governed assurance recommendation. It does not autonomously merge or block a change and never treats an author, reviewer or team as the cause of release risk."
],
"method": "causal_beta_binomial_common_risk_assurance_portfolio_v1",
"pareto_frontier": [
{
"cost": 0,
"cvar_loss": 252083.3333,
"expected_loss": 73600,
"expected_net_value": 106400,
"option_ids": [
"standard-release"
]
},
{
"cost": 2500,
"cvar_loss": 253500,
"expected_loss": 22600,
"expected_net_value": 157400,
"option_ids": [
"canary-release"
] Truncated for display — the full payload is 83 lines.
How it works
Causal inference & experiment design — Separate what a change caused from what merely moved alongside it.
- 1 Validate randomized or propensity-known preregistered quasi-experimental assurance studies, discount them by declared transport weight and estimate class-by-mode posterior relative-risk distributions.
- 2 Reject modes without mature interference-checked evidence or required controls, then simulate every feasible option portfolio with common random numbers and count each shared risk-group event once.
- 3 Choose the highest risk-adjusted net-value portfolio that clears budget, capacity, expected-failure and CVaR gates; disclose exact versus beam search and the cost/loss/value Pareto frontier.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- Assignment or adoption timing, interference policy, overlap, attrition, and outcome availability match the estimand encoded by the method.
- Accepted studies identify the assurance effect for the target change class, transport weights are defensible, implementation is consistent, and loss/value/common-risk inputs represent the organization's decision horizon.
- A causal label is warranted only when design and diagnostic requirements pass; otherwise treat the result as descriptive or abstain.
- A selected portfolio is a human-governed recommendation, never autonomous merge or block authority; observational PR risk factors, author identity and reviewer identity are not treated as causal effects.
Minimum evidence
- changes: required and organization-defined
- assurance_options: required and organization-defined
- effect_studies: at least 0 rows/items
- risk_groups: required and organization-defined
- baseline_mode_id: required and organization-defined
- budget: required and organization-defined
- resource_capacities: required and organization-defined
- maximum_expected_failures: required and organization-defined
- maximum_cvar_loss: required and organization-defined
How to validate it
Preserve the assignment/adoption design and validate overlap, pre-period or placebo diagnostics, attrition, interference policy, and cluster-level uncertainty; never tune on the estimated effect.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- change-class-by-assurance-mode causal evidence mart with mature control/treatment failures, assignment provenance, interference checks and transport weights joined to one versioned option/control/resource set
- baseline mode, mandatory controls, study admissibility and transport, failure and common-event loss, release value and delay cost, budget/resources, expected-failure and CVaR appetite, simulation/search controls and accountable release authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "select one release assurance or hold" }
→ finds "optimize_causal_release_assurance_portfolio"
gitrevio_capability_describe
{ "capability_id": "optimize_causal_release_assurance_portfolio" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "optimize_causal_release_assurance_portfolio", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Audit release risk prediction integrity
Audit a complete eligible-change release-risk cohort for point-in-time prediction lineage, exact change-to-deployment linkage, mature mutually exclusive outcomes, selective labels, score-triggered intervention contamination, calibration and false alarms before the score influences a release decision.
Forecast governed release competing risks
Forecast company-local rollback, hotfix and incident incidence conditional on deployment with inverse-propensity-corrected discrete-time competing risks, strict whole-release chronological validation, posterior intervals and mandatory improvement over both a simple baseline and the legacy PR score.
Audit commercial technical commitment integrity
Audit signed commercial promises against explicitly allocated technical scope, dependency order, funded capacity, acceptance criteria and evidence; expose orphan scope, double allocation, cycles, late plans and maximum contractual penalty without interpreting legal rights from engineering activity.
Audit decision execution fidelity
Audit whether approved decisions actually became verified implementation at the promised aggregate-unit and component grain, with whole-unit bootstrap uncertainty and simultaneous gates for fidelity, overdue scope, unverifiable evidence, exceptions and critical gaps.
Audit KPI threshold bunching
Detect a post-target excess concentration immediately above a governed KPI threshold: compare within-unit pre/post local mass and above-versus-below mirror asymmetry, bootstrap whole units, report density bins and a smoothed log-density jump, and explicitly refuse to equate bunching with individual gaming or intent.
Audit sunk cost escalation
Audit whether cumulative sunk cost predicts aggregate project continuation after project fixed effects, checkpoint time, forward value, success probability, remaining cost, and future irreversibility, with project-cluster bootstrap uncertainty.