Calculate analytics calibration liability
Price the hidden financial liability of stale analytical functions from coherent joint calibration-failure scenarios, decision value at risk, loss fractions and remediation costs; calculate expected loss, VaR, CVaR, reserve breach probability, required reserve and exactly reconciled tail contributions.
What it's for
Shows CEOs, CTOs and investors the expected and severe-loss exposure hidden in unmaintained analytics, and whether the organization has enough maintenance reserve.
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| current_maintenance_reserve | number ≥ 0 | Your calibration | Yes |
| functions | array of objects (5 fields) ≥ 1 item | Evidence | Yes |
| max_detail_rows | integer ≥ 1, ≤ 500 | Numerical control | Optional |
| maximum_acceptable_cvar_loss | number ≥ 0 | Your calibration | Optional |
| reserve_confidence_level | number ≥ 0.5, < 1 | Your calibration | Optional |
| scenarios | array of objects (2 fields) | Evidence | Yes |
| tail_probability | number > 0, ≤ 0.5 | Your calibration | Optional |
Each functions
record
| Field | Type | Required |
|---|---|---|
| decision_value_at_risk_scenarios | array of number (≥ 2 items) | Yes |
| id | string (non-empty) | Yes |
| loss_fraction_if_uncalibrated_scenarios | array of number (≥ 2 items) | Yes |
| remediation_cost_scenarios | array of number (≥ 2 items) | Yes |
| uncalibrated_state_scenarios | array of boolean (≥ 2 items) | Yes |
{
"current_maintenance_reserve": 50,
"functions": [
{
"decision_value_at_risk_scenarios": [
100,
100,
100
],
"id": "completion-forecast",
"loss_fraction_if_uncalibrated_scenarios": [
0.5,
0.5,
0.5
],
"remediation_cost_scenarios": [
10,
10,
10
],
"uncalibrated_state_scenarios": [
false,
true,
true
]
},
{
"decision_value_at_risk_scenarios": [
200,
200,
200
],
"id": "decision-policy",
"loss_fraction_if_uncalibrated_scenarios": [
0.25,
0.25,
0.25
],
"remediation_cost_scenarios": [
20,
20,
20
],
"uncalibrated_state_scenarios": [ Truncated for display — the full payload is 67 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"configuration": {
"maximum_acceptable_cvar_loss": null,
"reserve_confidence_level": 0.9,
"tail_probability": 0.2
},
"decision": "analytics_maintenance_liability_action_required",
"failed_gates": [
"maintenance_reserve_shortfall"
],
"function_liability_contributions": [
{
"expected_liability": 14,
"function_id": "decision-policy",
"share_of_expected_liability": 0.3182,
"tail_cvar_contribution": 70
},
{
"expected_liability": 30,
"function_id": "completion-forecast",
"share_of_expected_liability": 0.6818,
"tail_cvar_contribution": 60
}
],
"guardrails": [
"Scenario columns must be coherent joint states: independently sorting or multiplying marginal failure probabilities destroys the dependence that drives portfolio tail liability.",
"Decision value at risk, loss fractions, remediation cost, currency, horizon and reserve confidence are finance/risk-owned. Activity volume is not value exposure and missing common-cause scenarios remain outside CVaR.",
"Function contribution allocates modeled portfolio loss for maintenance planning. It is not employee blame, causal attribution or an automatic suspension decision."
],
"method": "coherent_calibration_failure_scenario_liability_and_tail_allocation_v1",
"summary": {
"current_maintenance_reserve": 50,
"expected_calibration_liability": 44,
"function_count": 2,
"maintenance_reserve_shortfall": 80,
"required_maintenance_reserve": 130,
"reserve_breach_probability": 0.5,
"scenario_count": 3,
"tail_conditional_value_at_risk_loss": 130,
"value_at_risk_loss": 130
},
"truncation": {
"functions_omitted": 0
} Truncated for display — the full payload is 45 lines.
How it works
Simulation & stress testing — Run the system forward many times to see what the bad tail actually looks like.
- 1 Freeze complete joint scenarios describing which function versions are uncalibrated together, plus finance-owned decision exposure, loss-given-failure and remediation cost on one horizon and currency basis.
- 2 Build function and portfolio loss in each unchanged joint scenario, aggregate expected liability, weighted VaR/CVaR and exact function tail contributions without independently sorting marginal outcomes.
- 3 Compare the governed confidence reserve and optional CVaR limit with current maintenance reserve, expose breach probability and quantify the shortfall requiring action.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- The scenario generator preserves relevant dependencies, tail behavior, feedback, and constraints rather than varying inputs independently for convenience.
- Scenario columns preserve common-cause dependence and sum to one; failure states refer to the same horizon; exposure is incremental decision value rather than activity; loss fractions, remediation costs and reserve are complete.
- Simulation quantifies consequences under the encoded world model; it cannot validate assumptions omitted from that model.
- CVaR covers represented joint scenarios only; function contributions allocate modeled maintenance liability rather than causal blame, employee performance or automatic suspension authority.
Minimum evidence
- functions: at least 1 rows/items
- scenarios: required and organization-defined
- current_maintenance_reserve: required and organization-defined
How to validate it
Preserve the assignment/adoption design and validate overlap, pre-period or placebo diagnostics, attrition, interference policy, and cluster-level uncertainty; never tune on the estimated effect.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- versioned analytics-risk scenario ledger combining calibration survival/drift evidence, shared operating shocks, finance-resolved decision exposure, remediation plans and reserve perimeter without independently sorted marginals
- scenario dependence/horizon, function and failure versions, value exposure, loss fraction, remediation cost, currency/price basis, reserve, confidence, tail probability, CVaR limit and escalation authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "price the hidden financial liability of" }
→ finds "calculate_analytics_calibration_liability"
gitrevio_capability_describe
{ "capability_id": "calculate_analytics_calibration_liability" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "calculate_analytics_calibration_liability", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Forecast analytics calibration survival
Forecast how long each locally calibrated analytical function remains decision-safe using right-censored calibration episodes, a discrete empirical-Bayes failure hazard, conditional survival from current calibration age, posterior uncertainty and explicit endpoint-support gates.
Optimize multi period calibration maintenance
Optimize a finite-horizon analytics maintenance schedule by propagating each function's healthy/degraded Markov belief under passive operation or recalibration, valuing healthy decisions and uncalibrated loss, enforcing period cash and specialist-capacity constraints, and disclosing exact state enumeration versus deterministic beam search.
Audit analytical specification multiverse
Audit whether an analytical conclusion survives a prespecified multiverse of admissible windows, cohorts, metrics, and models using aligned bootstrap draws, a weighted specification curve, practical-effect support gates, and descriptive choice-influence diagnostics.
Audit analytics challenger independence
Audit whether an analytical challenger supplies genuinely independent error information: use paired temporal moving-block bootstrap bounds on error correlation, incumbent-failure catch rate and common-mode joint failure, with simultaneous Bonferroni control across every screened challenger and explicit evidence gates.
Audit analytics function calibration readiness
Gate analytical functions on paired out-of-time decision loss against a frozen baseline using temporal moving-block bootstrap, autocorrelation- and weight-adjusted effective sample size, evidence coverage, lower confidence bounds, improvement probability and recent degradation rather than declaring a model calibrated from training fit.
Audit analytics transportability
Audit whether locally calibrated analytical functions retain decision-loss improvement across target-similar operating environments using similarity-weighted random-effects meta-analysis, between-environment variance, I-squared, sign consistency and a conservative target prediction interval.