Optimize incident learning portfolio
Choose immediate remediation or a predeclared experiment-contingent action for each failure mode using Bayesian value of information, prospective test accuracy and causal remediation effects, common scenarios, shared-loss accounting, Pareto search and hard cost, capacity and tail-risk gates.
What it's for
Moves reliability investment beyond backlog ranking: Gitrevio can decide when to remediate now and when a controlled experiment is worth buying because its result would actually change the action under risk and budget constraints.
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| beam_width | integer ≥ 1 | Numerical control | Optional |
| budget | number ≥ 0 | Your calibration | Yes |
| capacity_units | number ≥ 0 | Your calibration | Yes |
| exact_combination_limit | integer ≥ 1 | Your calibration | Optional |
| experiments | array of objects (12 fields) ≥ 0 items | Evidence | Yes |
| max_detail_rows | integer ≥ 1, ≤ 500 | Numerical control | Optional |
| maximum_conditional_value_at_risk | any | Your calibration | Optional |
| maximum_expected_loss | any | Your calibration | Optional |
| minimum_information_gain | number ≥ 0 | Your calibration | Optional |
| remediation_options | array of objects (11 fields) ≥ 0 items | Evidence | Yes |
| risk_aversion | number ≥ 0 | Your calibration | Optional |
| risk_modes | array of objects (5 fields) | Evidence | Yes |
| scenarios | array of objects (4 fields) | Evidence | Yes |
| seed | integer ≥ 0 | Numerical control | Optional |
| simulations | integer ≥ 500, ≤ 100000 | Numerical control | Optional |
| tail_probability | number > 0.5, ≤ 1 | Your calibration | Optional |
Each experiments
record
| Field | Type | Required |
|---|---|---|
| capacity_units | number (≥ 0) | Yes |
| controls_verified | boolean | Yes |
| depends_on | array of string | Yes |
| design_reliability | number (≥ 0, ≤ 1) | Yes |
| disruption_loss_by_scenario | array of number (≥ 1 item) | Yes |
| evidence_verified | boolean | Yes |
| excludes | array of string | Yes |
| experiment_cost | number (≥ 0) | Yes |
| id | string (non-empty) | Yes |
| risk_mode_id | string (non-empty) | Yes |
| sensitivity | number (≥ 0, ≤ 1) | Yes |
| specificity | number (≥ 0, ≤ 1) | Yes |
{
"budget": 10000,
"capacity_units": 10,
"experiments": [
{
"capacity_units": 0.5,
"controls_verified": true,
"depends_on": [],
"design_reliability": 0.9,
"disruption_loss_by_scenario": [
20,
80
],
"evidence_verified": true,
"excludes": [],
"experiment_cost": 200,
"id": "isolated-failure-injection",
"risk_mode_id": "dependency-timeout",
"sensitivity": 0.9,
"specificity": 0.9
}
],
"minimum_information_gain": 0.01,
"remediation_options": [
{
"capacity_units": 2,
"causal_effect_verified": true,
"controls_verified": true,
"depends_on": [],
"design_reliability": 0.9,
"effectiveness_by_scenario": [
0.9,
0.8
],
"evidence_verified": true,
"excludes": [],
"id": "adaptive-timeout-control",
"implementation_cost": 3000,
"risk_mode_id": "dependency-timeout"
}
],
"risk_modes": [
{
"conditional_loss_by_scenario": [ Truncated for display — the full payload is 70 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"configuration": {
"budget": 10000,
"capacity_units": 10,
"maximum_conditional_value_at_risk": null,
"maximum_expected_loss": null,
"minimum_information_gain": 0.01,
"risk_aversion": 0.25,
"seed": 53,
"simulations": 800,
"tail_probability": 0.95
},
"decision": "portfolio_selected",
"evidence_diagnostics": {
"effect_shrinkage": "remediation effects shrink toward zero and experiment accuracy toward chance by design reliability",
"unverified_risk_mode_ids": []
},
"excluded_options": [],
"interpretation": "Information gain is valuable only through a predeclared contingent decision; sensitivity, specificity and remediation effects require prospective evidence. Selection is not authorization to run a production experiment, alter incident policy, or judge an individual.",
"method": "two_stage_bayesian_value_of_information_common_scenario_portfolio_search",
"pareto_frontier": [
{
"conditional_value_at_risk": 62421,
"expected_risk_loss": 3908.55,
"expected_total_cost": 4821.05,
"information_gain_nats": 0.1299,
"objective": 20426.3,
"option_ids": [
"adaptive-timeout-control",
"isolated-failure-injection"
],
"reserved_capacity": 2.5,
"reserved_cost": 3200,
"value_at_risk": 12720
}
],
"search": {
"candidate_combination_count": 3,
"evaluated_portfolio_count": 3,
"feasible_portfolio_count": 1,
"global_optimum_certified": true,
"method": "exact_enumeration"
},
"selected_policies": [ Truncated for display — the full payload is 70 lines.
How it works
Causal inference & experiment design — Separate what a change caused from what merely moved alongside it.
- 1 Admit only controlled experiments with verified prospective sensitivity/specificity evidence and remediations with verified causal effects; represent each failure mode by a governed prior and coherent conditional-loss scenarios.
- 2 Shrink experiment sensitivity/specificity toward chance and remediation effects toward zero by their governed design reliability; then compute Bayesian posterior risk after positive and negative signals and predeclare whether the linked remediation would execute in each branch, so information has value only through that contingent decision.
- 3 Evaluate one baseline, immediate or experiment-contingent policy per mode under common latent states and scenarios, count shared loss groups once, and exact-enumerate or deterministically beam-search the feasible cost/capacity/expected-loss/CVaR/information Pareto set.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- Assignment or adoption timing, interference policy, overlap, attrition, and outcome availability match the estimand encoded by the method.
- Failure-mode priors, experiment likelihoods, remediation consistency/effects, scenario losses and shared-loss groups are decision-relevant and prospectively governed; dependencies, exclusions, control boundaries and reserved follow-up resources are complete.
- A causal label is warranted only when design and diagnostic requirements pass; otherwise treat the result as descriptive or abstain.
- Selection is a human-reviewed plan, never authorization for a production chaos experiment, control bypass, deployment, procurement or personal judgment. Beam results are heuristic and disclose that global optimality is unproven.
Minimum evidence
- risk_modes: required and organization-defined
- remediation_options: at least 0 rows/items
- experiments: at least 0 rows/items
- scenarios: required and organization-defined
- budget: required and organization-defined
- capacity_units: required and organization-defined
How to validate it
Preserve the assignment/adoption design and validate overlap, pre-period or placebo diagnostics, attrition, interference policy, and cluster-level uncertainty; never tune on the estimated effect.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- versioned mode-to-experiment-to-remediation decision graph joining point-in-time priors, prospective likelihood/effect evidence, predeclared positive/negative signal policies, common scenarios, unique loss groups and reserved follow-up resources
- failure-mode completeness and prior, experiment safety/blast radius and likelihood evidence, causal remediation consistency/effect, shared-loss uniqueness, full direct/disruption cost, dependencies/exclusions, budget/capacity, expected-loss/CVaR/information gates and production authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "choose immediate remediation or a predeclared" }
→ finds "optimize_incident_learning_portfolio"
gitrevio_capability_describe
{ "capability_id": "optimize_incident_learning_portfolio" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "optimize_incident_learning_portfolio", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Audit incident learning evidence integrity
Audit the complete point-in-time incident-to-postmortem-to-corrective-action lineage, separating missing or contradictory evidence from genuine overdue learning debt without attributing individual fault.
Forecast incident learning debt economics
Forecast how much corrective-action debt will remain open and what recurrent incident and operating loss it may create using hierarchical closure, recurrence and severity models that must beat global baselines on the latest whole period.
Audit CI pipeline evidence integrity
Audit the complete point-in-time change-to-pipeline-to-job-to-rerun cohort, exposing missing CI, orphan records, future leakage, inconsistent required-job outcomes, incomplete provider evidence and same-configuration fail-then-pass flake proxies without scoring people.
Audit operational alert decision integrity
Audit every point-in-time operational alert evaluation by recomputing fire/suppress decisions and verifying effective policy, cooldown, evidence freshness, context, controls, severity routing, acknowledgement, action and mature outcome lineage.
Audit root cause traceback evidence integrity
Audit whether an anomaly traceback is complete, point-in-time, multiplicity-controlled and honestly labeled as temporal or causal, including every upstream candidate, path lag, edge identification basis and later root-recovery validation.
Estimate software reliability growth
Estimate long-run software reliability growth with a power-law nonhomogeneous Poisson process, bootstrap trend evidence, and future incident exposure.