Optimize incident learning portfolio

Choose immediate remediation or a predeclared experiment-contingent action for each failure mode using Bayesian value of information, prospective test accuracy and causal remediation effects, common scenarios, shared-loss accounting, Pareto search and hard cost, capacity and tail-risk gates.

What it's for

Moves reliability investment beyond backlog ranking: Gitrevio can decide when to remediate now and when a controlled experiment is worth buying because its result would actually change the action under risk and budget constraints.

What you give it

Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.

Field Type Role Required
beam_width integer ≥ 1 Numerical control Optional
budget number ≥ 0 Your calibration Yes
capacity_units number ≥ 0 Your calibration Yes
exact_combination_limit integer ≥ 1 Your calibration Optional
experiments array of objects (12 fields) ≥ 0 items Evidence Yes
max_detail_rows integer ≥ 1, ≤ 500 Numerical control Optional
maximum_conditional_value_at_risk any Your calibration Optional
maximum_expected_loss any Your calibration Optional
minimum_information_gain number ≥ 0 Your calibration Optional
remediation_options array of objects (11 fields) ≥ 0 items Evidence Yes
risk_aversion number ≥ 0 Your calibration Optional
risk_modes array of objects (5 fields) Evidence Yes
scenarios array of objects (4 fields) Evidence Yes
seed integer ≥ 0 Numerical control Optional
simulations integer ≥ 500, ≤ 100000 Numerical control Optional
tail_probability number > 0.5, ≤ 1 Your calibration Optional

Each experiments record

Field Type Required
capacity_units number (≥ 0) Yes
controls_verified boolean Yes
depends_on array of string Yes
design_reliability number (≥ 0, ≤ 1) Yes
disruption_loss_by_scenario array of number (≥ 1 item) Yes
evidence_verified boolean Yes
excludes array of string Yes
experiment_cost number (≥ 0) Yes
id string (non-empty) Yes
risk_mode_id string (non-empty) Yes
sensitivity number (≥ 0, ≤ 1) Yes
specificity number (≥ 0, ≤ 1) Yes
Example input
{
  "budget": 10000,
  "capacity_units": 10,
  "experiments": [
    {
      "capacity_units": 0.5,
      "controls_verified": true,
      "depends_on": [],
      "design_reliability": 0.9,
      "disruption_loss_by_scenario": [
        20,
        80
      ],
      "evidence_verified": true,
      "excludes": [],
      "experiment_cost": 200,
      "id": "isolated-failure-injection",
      "risk_mode_id": "dependency-timeout",
      "sensitivity": 0.9,
      "specificity": 0.9
    }
  ],
  "minimum_information_gain": 0.01,
  "remediation_options": [
    {
      "capacity_units": 2,
      "causal_effect_verified": true,
      "controls_verified": true,
      "depends_on": [],
      "design_reliability": 0.9,
      "effectiveness_by_scenario": [
        0.9,
        0.8
      ],
      "evidence_verified": true,
      "excludes": [],
      "id": "adaptive-timeout-control",
      "implementation_cost": 3000,
      "risk_mode_id": "dependency-timeout"
    }
  ],
  "risk_modes": [
    {
      "conditional_loss_by_scenario": [

Truncated for display — the full payload is 70 lines.

What you get back

This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.

Example output
{
  "configuration": {
    "budget": 10000,
    "capacity_units": 10,
    "maximum_conditional_value_at_risk": null,
    "maximum_expected_loss": null,
    "minimum_information_gain": 0.01,
    "risk_aversion": 0.25,
    "seed": 53,
    "simulations": 800,
    "tail_probability": 0.95
  },
  "decision": "portfolio_selected",
  "evidence_diagnostics": {
    "effect_shrinkage": "remediation effects shrink toward zero and experiment accuracy toward chance by design reliability",
    "unverified_risk_mode_ids": []
  },
  "excluded_options": [],
  "interpretation": "Information gain is valuable only through a predeclared contingent decision; sensitivity, specificity and remediation effects require prospective evidence. Selection is not authorization to run a production experiment, alter incident policy, or judge an individual.",
  "method": "two_stage_bayesian_value_of_information_common_scenario_portfolio_search",
  "pareto_frontier": [
    {
      "conditional_value_at_risk": 62421,
      "expected_risk_loss": 3908.55,
      "expected_total_cost": 4821.05,
      "information_gain_nats": 0.1299,
      "objective": 20426.3,
      "option_ids": [
        "adaptive-timeout-control",
        "isolated-failure-injection"
      ],
      "reserved_capacity": 2.5,
      "reserved_cost": 3200,
      "value_at_risk": 12720
    }
  ],
  "search": {
    "candidate_combination_count": 3,
    "evaluated_portfolio_count": 3,
    "feasible_portfolio_count": 1,
    "global_optimum_certified": true,
    "method": "exact_enumeration"
  },
  "selected_policies": [

Truncated for display — the full payload is 70 lines.

How it works

Causal inference & experiment design — Separate what a change caused from what merely moved alongside it.

  1. 1 Admit only controlled experiments with verified prospective sensitivity/specificity evidence and remediations with verified causal effects; represent each failure mode by a governed prior and coherent conditional-loss scenarios.
  2. 2 Shrink experiment sensitivity/specificity toward chance and remediation effects toward zero by their governed design reliability; then compute Bayesian posterior risk after positive and negative signals and predeclare whether the linked remediation would execute in each branch, so information has value only through that contingent decision.
  3. 3 Evaluate one baseline, immediate or experiment-contingent policy per mode under common latent states and scenarios, count shared loss groups once, and exact-enumerate or deterministically beam-search the feasible cost/capacity/expected-loss/CVaR/information Pareto set.

Before you trust it

Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.

Assumptions & guardrails

  • Assignment or adoption timing, interference policy, overlap, attrition, and outcome availability match the estimand encoded by the method.
  • Failure-mode priors, experiment likelihoods, remediation consistency/effects, scenario losses and shared-loss groups are decision-relevant and prospectively governed; dependencies, exclusions, control boundaries and reserved follow-up resources are complete.
  • A causal label is warranted only when design and diagnostic requirements pass; otherwise treat the result as descriptive or abstain.
  • Selection is a human-reviewed plan, never authorization for a production chaos experiment, control bypass, deployment, procurement or personal judgment. Beam results are heuristic and disclose that global optimality is unproven.

Minimum evidence

  • risk_modes: required and organization-defined
  • remediation_options: at least 0 rows/items
  • experiments: at least 0 rows/items
  • scenarios: required and organization-defined
  • budget: required and organization-defined
  • capacity_units: required and organization-defined

How to validate it

Preserve the assignment/adoption design and validate overlap, pre-period or placebo diagnostics, attrition, interference policy, and cluster-level uncertainty; never tune on the estimated effect.

Calibrating it to your org

Same for everyone

The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.

Specific to you

  • versioned mode-to-experiment-to-remediation decision graph joining point-in-time priors, prospective likelihood/effect evidence, predeclared positive/negative signal policies, common scenarios, unique loss groups and reserved follow-up resources
  • failure-mode completeness and prior, experiment safety/blast radius and likelihood evidence, causal remediation consistency/effect, shared-loss uniqueness, full direct/disruption cost, dependencies/exclusions, budget/capacity, expected-loss/CVaR/information gates and production authority

Calibration workflow

  1. 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
  2. 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
  3. 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
  4. 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
  5. 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
  6. 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.

Call it from your AI

You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.

gitrevio_capabilities_search
  { "q": "choose immediate remediation or a predeclared" }
  → finds "optimize_incident_learning_portfolio"

gitrevio_capability_describe
  { "capability_id": "optimize_incident_learning_portfolio" }
  → returns the input schema and agent guidance shown on this page

gitrevio_capability_run
  { "capability_id": "optimize_incident_learning_portfolio", "arguments": { ... } }
  → returns the result shown above

Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.

Related tools

Audit incident learning evidence integrity

Audit the complete point-in-time incident-to-postmortem-to-corrective-action lineage, separating missing or contradictory evidence from genuine overdue learning debt without attributing individual fault.

Statistical audit & measurement

Forecast incident learning debt economics

Forecast how much corrective-action debt will remain open and what recurrent incident and operating loss it may create using hierarchical closure, recurrence and severity models that must beat global baselines on the latest whole period.

Forecasting & survival

Audit CI pipeline evidence integrity

Audit the complete point-in-time change-to-pipeline-to-job-to-rerun cohort, exposing missing CI, orphan records, future leakage, inconsistent required-job outcomes, incomplete provider evidence and same-configuration fail-then-pass flake proxies without scoring people.

Statistical audit & measurement

Audit operational alert decision integrity

Audit every point-in-time operational alert evaluation by recomputing fire/suppress decisions and verifying effective policy, cooldown, evidence freshness, context, controls, severity routing, acknowledgement, action and mature outcome lineage.

Constrained optimization

Audit root cause traceback evidence integrity

Audit whether an anomaly traceback is complete, point-in-time, multiplicity-controlled and honestly labeled as temporal or causal, including every upstream candidate, path lag, edge identification basis and later root-recovery validation.

Causal inference & experiment design

Estimate software reliability growth

Estimate long-run software reliability growth with a power-law nonhomogeneous Poisson process, bootstrap trend evidence, and future incident exposure.

Forecasting & survival

See every tool in Quality, incidents & reliability →

Ready to See Your Engineering work clearly?

Request a free demo