Forecast agentic action loss

Forecast expected and tail operational AI-agent loss with tenant-local empirical-Bayes absorbing Markov chains across execution, deviation, containment, recovery, completion and loss, preserving shared control-failure regimes and unresolved-chain mass.

What it's for

Shows CTOs, boards and investors the locally calibrated downside of agentic operations—including common control failures and incomplete recovery chains—instead of borrowing generic AI incident rates.

What you give it

Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.

Field Type Role Required
business_assets array of objects (3 fields) ≥ 1 item Evidence Yes
current_action_plans array of objects (6 fields) Evidence Yes
historical_loss_events array of objects (4 fields) Evidence Yes
historical_transition_counts array of objects (6 fields) Evidence Yes
max_detail_rows integer ≥ 1, ≤ 500 Numerical control Optional
maximum_chain_steps integer ≥ 2, ≤ 1000 Your calibration Optional
maximum_unresolved_chain_probability number ≥ 0, ≤ 1 Your calibration Optional
minimum_loss_events integer ≥ 1 Your calibration Optional
minimum_transitions_per_class integer ≥ 1 Your calibration Optional
scenarios array of objects (10 fields) Evidence Yes
seed integer ≥ 0 Numerical control Optional
severity_prior_strength number > 0 Your calibration Optional
simulations integer ≥ 100, ≤ 100000 Numerical control Optional
tail_probability number ≥ 0.001, ≤ 0.5 Your calibration Optional
transition_prior_strength number > 0 Your calibration Optional

Each scenarios record

Field Type Required
adverse_transition_multiplier number (≥ 0, ≤ 1000) Yes
asset_loss_multiplier number (≥ 0, ≤ 1000) Yes
containment_multiplier number (≥ 0, ≤ 1000) Yes
evidence_verified boolean Yes
id string (non-empty) Yes
probability number (≥ 0, ≤ 1) Yes
recovery_multiplier number (≥ 0, ≤ 1000) Yes
severity_multiplier number (≥ 0, ≤ 1000) Yes
shared_control_adverse_multiplier number (≥ 1, ≤ 1000) Yes
shared_control_failure_probability number (≥ 0, ≤ 1) Yes
Example input
{
  "business_assets": [
    {
      "evidence_verified": true,
      "id": "payments",
      "value_at_risk": 100
    }
  ],
  "current_action_plans": [
    {
      "action_class": "deployment",
      "asset_id": "payments",
      "asset_loss_fraction_if_terminal_loss": 0.8,
      "evidence_verified": true,
      "id": "deploy-service",
      "planned_action_count": 2
    },
    {
      "action_class": "deployment",
      "asset_id": "payments",
      "asset_loss_fraction_if_terminal_loss": 0.6,
      "evidence_verified": true,
      "id": "deploy-worker",
      "planned_action_count": 1
    }
  ],
  "historical_loss_events": [
    {
      "action_class": "deployment",
      "direct_loss": 10,
      "evidence_verified": true,
      "id": "agentic-loss-0"
    },
    {
      "action_class": "deployment",
      "direct_loss": 15,
      "evidence_verified": true,
      "id": "agentic-loss-1"
    },
    {
      "action_class": "deployment",
      "direct_loss": 20,
      "evidence_verified": true,
      "id": "agentic-loss-2"

Truncated for display — the full payload is 157 lines.

What you get back

This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.

Example output
{
  "action_class_diagnostics": [
    {
      "action_class": "deployment",
      "historical_loss_event_count": 3,
      "historical_transition_count": 130,
      "loss_support_sufficient": true,
      "mean_terminal_loss_probability_per_action": 0.08107543,
      "mean_unresolved_probability_after_chain_limit": 0.00000543,
      "observed_transient_states": [
        "contained",
        "deviated",
        "executing",
        "recovered"
      ],
      "posterior_direct_loss_median": 14.4225,
      "transition_support_sufficient": true
    }
  ],
  "action_plan_diagnostics": [
    {
      "action_class": "deployment",
      "action_plan_id": "deploy-service",
      "asset_id": "payments",
      "planned_action_count": 2,
      "posterior_mean_terminal_loss_probability_per_action": 0.08107543
    },
    {
      "action_class": "deployment",
      "action_plan_id": "deploy-worker",
      "asset_id": "payments",
      "planned_action_count": 1,
      "posterior_mean_terminal_loss_probability_per_action": 0.08107543
    }
  ],
  "asset_diagnostics": [
    {
      "asset_id": "payments",
      "expected_loss": 21.42,
      "probability_of_any_loss": 0.26,
      "value_at_risk": 100
    }
  ],
  "assumptions": [

Truncated for display — the full payload is 95 lines.

How it works

Markov & state-space control — Choose a policy over evolving states when today's action changes tomorrow's options.

  1. 1 Build complete class-by-transition counts including zeros for every transient action state and fit structurally masked Dirichlet posteriors with tenant-level pooling plus partially pooled lognormal direct-loss marks.
  2. 2 Draw coherent operating scenarios and one shared control-failure regime per simulation, adjust adverse/containment/recovery transitions, and propagate each posterior chain to completion, loss or explicit unresolved mass.
  3. 3 Simulate planned action volumes, union terminal failures across plans reaching the same asset, add non-overlapping direct loss, and gate VaR/CVaR on local transition, severity, evidence and absorption support.

Before you trust it

Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.

Assumptions & guardrails

  • States are decision-sufficient at the chosen cadence and transition evidence is recent, identifiable, and not silently pooled across incompatible regimes.
  • Action-state definitions, transition counting, loss perimeter and class epoch are stable; every transient state includes zero cells; scenarios share one horizon; unfinished chains are not selectively omitted.
  • A policy is conditional on the declared state abstraction and transition model; hidden omitted state can invalidate its ranking.
  • This is an aggregate conditional loss distribution, not proof of agent intent, employee conduct, security compromise, legal liability or authority for autonomous actions, investigation, surveillance, disclosure or production change.

Minimum evidence

  • historical_transition_counts: required and organization-defined
  • historical_loss_events: required and organization-defined
  • business_assets: at least 1 rows/items
  • current_action_plans: required and organization-defined
  • scenarios: required and organization-defined

How to validate it

Use chronological train/calibration/test windows, compare proper scores and decision value with a simple baseline, and recalibrate only from outcomes resolved after prediction time.

Calibrating it to your org

Same for everyone

The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.

Specific to you

  • immutable tenant-local action-chain cohort reconstructed from execution state events through deviation, containment, recovery, completion or loss, retaining unfinished chains and zero cells and joined to the same asset, loss and scenario epoch
  • action-class/state taxonomy, transition risk set and censoring, completed/lost definitions, zero-cell completeness, direct-versus-asset loss perimeter, shared-control scenario dependence, prior/support, finite chain limit, unresolved-mass and tail gates, value/currency/horizon and accountable platform/security/risk/finance owners

Calibration workflow

  1. 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
  2. 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
  3. 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
  4. 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
  5. 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
  6. 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.

Call it from your AI

You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.

gitrevio_capabilities_search
  { "q": "forecast expected and tail operational aiagent" }
  → finds "forecast_agentic_action_loss"

gitrevio_capability_describe
  { "capability_id": "forecast_agentic_action_loss" }
  → returns the input schema and agent guidance shown on this page

gitrevio_capability_run
  { "capability_id": "forecast_agentic_action_loss", "arguments": { ... } }
  → returns the result shown above

Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.

Related tools

Audit agentic action control integrity

Audit operational AI-agent actions from bounded least-privilege permission scope through independently tested authorization, approval, sandbox, monitoring, rollback or compensation, and kill-switch controls, counting unique value exposure once.

Statistical audit & measurement

Optimize agentic autonomy portfolio

Choose one manual, approval-required, bounded-autonomous or autonomous operating mode per action class, maximizing scenario net value under hard authorization/reversibility controls, shared-asset loss, reviewer capacity, cost, availability, dependencies and CVaR.

Constrained optimization

Audit AI configuration release integrity

Audit that the exact immutable AI configuration bundle evaluated and approved is the bundle exposed in every staged rollout, with consecutive parent lineage, complete blast-radius declaration, effective runtime controls, monotone traffic and a tested prior-version rollback path.

Causal inference & experiment design

Audit AI data rights provenance integrity

Audit every AI training, fine-tuning, retrieval, evaluation, logging and persisted-output use against an immutable rights grant and the complete derivative lineage, including time, revocation, deletion, purpose, jurisdiction, consent, derivative and evidence gates.

Statistical audit & measurement

Audit AI evaluation contamination integrity

Audit frozen AI evaluation suites for temporal or answer leakage, model-version mismatch, incomplete pre-label predictions, weak label provenance, missing subgroup support, cross-suite case reuse and near-duplicate content components before evaluation scores are trusted.

Forecasting & survival

Audit AI output IP provenance integrity

Audit aggregate AI outputs against the exact model and provider terms effective at generation, pre-commercialization similarity evidence, counsel-owned ownership/use rules, human review and any claimed indemnity coverage.

Statistical audit & measurement

See every tool in AI risk, rights & assurance →

Ready to See Your Engineering work clearly?

Request a free demo