Optimize causal release assurance portfolio

Select one release, assurance or hold option per change from prospectively identified Beta-binomial relative-risk effects while pricing delay, failure and shared common-mode loss under budget, scarce resources, mandatory controls, expected-failure and CVaR constraints with an exact or disclosed beam-search Pareto frontier.

What it's for

Converts a release-risk score into the economically valuable next question: which review, test, canary, staged rollout or hold action has demonstrated incremental protection and deserves scarce release capacity?

What you give it

Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.

Field Type Role Required
assurance_options array of objects (10 fields) Evidence Yes
baseline_mode_id string non-empty Your calibration Yes
beam_width integer ≥ 10, ≤ 100000 Numerical control Optional
budget number ≥ 0 Your calibration Yes
changes array of objects (8 fields) Evidence Yes
confidence_level number ≥ 0.5, < 1 Your calibration Optional
effect_studies array of objects (14 fields) ≥ 0 items Evidence Yes
max_exact_combinations integer ≥ 1, ≤ 1000000 Your calibration Optional
max_frontier_rows integer ≥ 1, ≤ 500 Your calibration Optional
maximum_cvar_loss number ≥ 0 Your calibration Yes
maximum_expected_failures number ≥ 0 Your calibration Yes
minimum_cases_per_arm integer ≥ 2 Your calibration Optional
minimum_probability_of_benefit number ≥ 0, ≤ 1 Your calibration Optional
resource_capacities object Evidence Yes
risk_aversion number ≥ 0 Your calibration Optional
risk_groups array of objects (4 fields) Evidence Yes
seed integer ≥ 0, ≤ 4294967295 Numerical control Optional
simulation_draws integer ≥ 500, ≤ 20000 Numerical control Optional

Each effect_studies record

Field Type Required
assignment_probability_known boolean Yes
change_class_id string (non-empty) Yes
control_cases integer (≥ 1) Yes
control_failures integer (≥ 0) Yes
design_id one of "randomized", "quasi_experimental" Yes
evidence_verified boolean Yes
id string (non-empty) Yes
interference_checked boolean Yes
mode_id string (non-empty) Yes
outcome_mature boolean Yes
pre_registered boolean Yes
transport_weight number (≥ 0, ≤ 1) Yes
treated_cases integer (≥ 1) Yes
treated_failures integer (≥ 0) Yes
Example input
{
  "assurance_options": [
    {
      "change_id": "payments-release",
      "cost": 0,
      "delay_cost_per_hour": 0,
      "delay_hours": 0,
      "evidence_verified": true,
      "id": "standard-release",
      "mode_id": "standard",
      "provided_control_ids": [
        "peer-review"
      ],
      "releases_change": true,
      "resource_requirements": {
        "release-engineer-hours": 0
      }
    },
    {
      "change_id": "payments-release",
      "cost": 2500,
      "delay_cost_per_hour": 500,
      "delay_hours": 2,
      "evidence_verified": true,
      "id": "canary-release",
      "mode_id": "canary",
      "provided_control_ids": [
        "peer-review",
        "canary"
      ],
      "releases_change": true,
      "resource_requirements": {
        "release-engineer-hours": 2
      }
    }
  ],
  "baseline_mode_id": "standard",
  "budget": 5000,
  "changes": [
    {
      "base_failure_probability": 0.3,
      "change_class_id": "service-change",
      "evidence_verified": true,
      "failure_loss": 250000,

Truncated for display — the full payload is 86 lines.

What you get back

This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.

Example output
{
  "assumptions": [
    "Accepted randomized or quasi-experimental studies identify the assurance mode's effect for the submitted change class after the declared transport weight; consistency, positivity and checked interference remain required.",
    "Failure losses, release values, common-risk groups, resource capacities and mandatory controls are organization-owned decision inputs rather than values learned from another tenant."
  ],
  "decision": "release_assurance_portfolio_selected",
  "evidence": {
    "accepted_effects": [
      {
        "accepted_studies": 1,
        "change_class_id": "service-change",
        "eligible": true,
        "median_relative_risk": 0.283,
        "mode_id": "canary",
        "probability_of_benefit": 1,
        "relative_risk_p95": 0.4903
      }
    ],
    "rejected_options": [],
    "rejected_studies": 0
  },
  "limitations": [
    "Relative-risk posteriors do not make observational risk factors causal; unmeasured study confounding, implementation drift and changing release systems can invalidate transport.",
    "The result is a human-governed assurance recommendation. It does not autonomously merge or block a change and never treats an author, reviewer or team as the cause of release risk."
  ],
  "method": "causal_beta_binomial_common_risk_assurance_portfolio_v1",
  "pareto_frontier": [
    {
      "cost": 0,
      "cvar_loss": 252083.3333,
      "expected_loss": 73600,
      "expected_net_value": 106400,
      "option_ids": [
        "standard-release"
      ]
    },
    {
      "cost": 2500,
      "cvar_loss": 253500,
      "expected_loss": 22600,
      "expected_net_value": 157400,
      "option_ids": [
        "canary-release"
      ]

Truncated for display — the full payload is 83 lines.

How it works

Causal inference & experiment design — Separate what a change caused from what merely moved alongside it.

  1. 1 Validate randomized or propensity-known preregistered quasi-experimental assurance studies, discount them by declared transport weight and estimate class-by-mode posterior relative-risk distributions.
  2. 2 Reject modes without mature interference-checked evidence or required controls, then simulate every feasible option portfolio with common random numbers and count each shared risk-group event once.
  3. 3 Choose the highest risk-adjusted net-value portfolio that clears budget, capacity, expected-failure and CVaR gates; disclose exact versus beam search and the cost/loss/value Pareto frontier.

Before you trust it

Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.

Assumptions & guardrails

  • Assignment or adoption timing, interference policy, overlap, attrition, and outcome availability match the estimand encoded by the method.
  • Accepted studies identify the assurance effect for the target change class, transport weights are defensible, implementation is consistent, and loss/value/common-risk inputs represent the organization's decision horizon.
  • A causal label is warranted only when design and diagnostic requirements pass; otherwise treat the result as descriptive or abstain.
  • A selected portfolio is a human-governed recommendation, never autonomous merge or block authority; observational PR risk factors, author identity and reviewer identity are not treated as causal effects.

Minimum evidence

  • changes: required and organization-defined
  • assurance_options: required and organization-defined
  • effect_studies: at least 0 rows/items
  • risk_groups: required and organization-defined
  • baseline_mode_id: required and organization-defined
  • budget: required and organization-defined
  • resource_capacities: required and organization-defined
  • maximum_expected_failures: required and organization-defined
  • maximum_cvar_loss: required and organization-defined

How to validate it

Preserve the assignment/adoption design and validate overlap, pre-period or placebo diagnostics, attrition, interference policy, and cluster-level uncertainty; never tune on the estimated effect.

Calibrating it to your org

Same for everyone

The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.

Specific to you

  • change-class-by-assurance-mode causal evidence mart with mature control/treatment failures, assignment provenance, interference checks and transport weights joined to one versioned option/control/resource set
  • baseline mode, mandatory controls, study admissibility and transport, failure and common-event loss, release value and delay cost, budget/resources, expected-failure and CVaR appetite, simulation/search controls and accountable release authority

Calibration workflow

  1. 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
  2. 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
  3. 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
  4. 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
  5. 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
  6. 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.

Call it from your AI

You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.

gitrevio_capabilities_search
  { "q": "select one release assurance or hold" }
  → finds "optimize_causal_release_assurance_portfolio"

gitrevio_capability_describe
  { "capability_id": "optimize_causal_release_assurance_portfolio" }
  → returns the input schema and agent guidance shown on this page

gitrevio_capability_run
  { "capability_id": "optimize_causal_release_assurance_portfolio", "arguments": { ... } }
  → returns the result shown above

Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.

Related tools

Audit release risk prediction integrity

Audit a complete eligible-change release-risk cohort for point-in-time prediction lineage, exact change-to-deployment linkage, mature mutually exclusive outcomes, selective labels, score-triggered intervention contamination, calibration and false alarms before the score influences a release decision.

Forecasting & survival

Forecast governed release competing risks

Forecast company-local rollback, hotfix and incident incidence conditional on deployment with inverse-propensity-corrected discrete-time competing risks, strict whole-release chronological validation, posterior intervals and mandatory improvement over both a simple baseline and the legacy PR score.

Sequential Bayesian & bandits

Audit commercial technical commitment integrity

Audit signed commercial promises against explicitly allocated technical scope, dependency order, funded capacity, acceptance criteria and evidence; expose orphan scope, double allocation, cycles, late plans and maximum contractual penalty without interpreting legal rights from engineering activity.

Constrained optimization

Audit decision execution fidelity

Audit whether approved decisions actually became verified implementation at the promised aggregate-unit and component grain, with whole-unit bootstrap uncertainty and simultaneous gates for fidelity, overdue scope, unverifiable evidence, exceptions and critical gaps.

Statistical audit & measurement

Audit KPI threshold bunching

Detect a post-target excess concentration immediately above a governed KPI threshold: compare within-unit pre/post local mass and above-versus-below mirror asymmetry, bootstrap whole units, report density bins and a smoothed log-density jump, and explicitly refuse to equate bunching with individual gaming or intent.

Statistical audit & measurement

Audit sunk cost escalation

Audit whether cumulative sunk cost predicts aggregate project continuation after project fixed effects, checkpoint time, forward value, success probability, remaining cost, and future irreversibility, with project-cluster bootstrap uncertainty.

Statistical audit & measurement

See every tool in Delivery forecasting & commitments →

Ready to See Your Engineering work clearly?

Request a free demo