Construct calibration shared evidence graph
Discover stable candidate relationships for shared calibration design by correlating standardized held-out loss improvement across common environments, resampling whole environments, stability-selecting practical edges, controlling sign discoveries with Benjamini-Hochberg FDR and returning connected components without claiming parameter transfer.
What it's for
Maps which Gitrevio analytics succeed and fail together across operating environments, revealing reusable calibration infrastructure while preserving function-specific proof and privacy boundaries.
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| bootstrap_draws | integer ≥ 200, ≤ 20000 | Numerical control | Optional |
| false_discovery_rate | number > 0, < 1 | Your calibration | Optional |
| max_detail_rows | integer ≥ 1, ≤ 500 | Numerical control | Optional |
| minimum_absolute_correlation | number ≥ 0, ≤ 1 | Your calibration | Optional |
| minimum_selection_probability | number ≥ 0, ≤ 1 | Your calibration | Optional |
| minimum_shared_environments | integer ≥ 4, ≤ 10000 | Your calibration | Optional |
| observations | array of objects (5 fields) ≥ 12 items | Evidence | Yes |
| seed | integer ≥ 0, ≤ 2147483647 | Numerical control | Optional |
Each observations
record
| Field | Type | Required |
|---|---|---|
| environment_id | string (non-empty) | Yes |
| function_id | string (non-empty) | Yes |
| id | string (non-empty) | Yes |
| reliability_weight | number (> 0) | Yes |
| standardized_loss_improvement | number | Yes |
{
"bootstrap_draws": 200,
"minimum_shared_environments": 6,
"observations": [
{
"environment_id": "environment-0",
"function_id": "forecast",
"id": "forecast-0",
"reliability_weight": 1,
"standardized_loss_improvement": 0
},
{
"environment_id": "environment-0",
"function_id": "policy",
"id": "policy-0",
"reliability_weight": 1,
"standardized_loss_improvement": 0
},
{
"environment_id": "environment-1",
"function_id": "forecast",
"id": "forecast-1",
"reliability_weight": 1,
"standardized_loss_improvement": 1
},
{
"environment_id": "environment-1",
"function_id": "policy",
"id": "policy-1",
"reliability_weight": 1,
"standardized_loss_improvement": 2.1
},
{
"environment_id": "environment-2",
"function_id": "forecast",
"id": "forecast-2",
"reliability_weight": 1,
"standardized_loss_improvement": 2
},
{
"environment_id": "environment-2",
"function_id": "policy",
"id": "policy-2",
"reliability_weight": 1, Truncated for display — the full payload is 175 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"configuration": {
"bootstrap_draws": 200,
"false_discovery_rate": 0.1,
"minimum_absolute_correlation": 0.5,
"minimum_selection_probability": 0.8,
"minimum_shared_environments": 6,
"seed": 7
},
"connected_components": [
[
"forecast",
"policy"
]
],
"decision": "shared_calibration_design_candidates_available",
"guardrails": [
"Edges describe stable co-movement of standardized held-out loss improvement across represented environments. They do not prove shared causality, exchangeability, identical coefficients or permission to pool raw data.",
"Use connected components to propose shared calibration infrastructure or hypotheses, then preregister and validate transfer prospectively. Each function retains its own readiness and safety gates.",
"Environment resampling and false-discovery control limit selection noise but do not repair an omitted common shock, incompatible loss definition, target shift or cross-tenant privacy boundary."
],
"method": "environment_cluster_bootstrap_stability_graph_with_bh_fdr_v1",
"stable_edges": [
{
"bootstrap_interval": [
1,
1
],
"fdr_adjusted_significance": true,
"left_function_id": "forecast",
"right_function_id": "policy",
"selection_probability": 1,
"shared_environment_count": 12,
"sign_stability_probability": 1,
"weighted_correlation": 1
}
],
"summary": {
"eligible_pair_count": 1,
"environment_count": 12,
"function_count": 2,
"multi_function_component_count": 1,
"stable_edge_count": 1
}, Truncated for display — the full payload is 49 lines.
How it works
Network & dependency analysis — Trace how load, failure and knowledge propagate through a graph of teams, services or components.
- 1 Build one standardized, reliability-weighted held-out improvement observation per function and operating environment under a common prospective evaluation protocol.
- 2 For every sufficiently supported function pair, estimate weighted correlation and resample whole environments to measure practical edge-selection and sign stability.
- 3 Control pairwise sign discoveries with Benjamini-Hochberg FDR, retain only practically large stable edges, and expose connected components as shared-design hypotheses.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- Nodes, edges, direction, time window, missing-link policy, and aggregation boundary represent the coordination or dependency mechanism of interest.
- Environment is the independent resampling unit; function losses are compatible and standardized prospectively; common shocks and missing function-environment cells are understood; reliability weights are frozen.
- Structural centrality, fragility, or clustering describes a modeled graph and must not be interpreted as intent, guilt, or personal value.
- An edge is association, not shared causality, coefficient equality or pooling permission; components propose common experimental infrastructure and must not cross tenant/privacy boundaries or replace function-specific validation.
Minimum evidence
- observations: at least 12 rows/items
How to validate it
Use chronological train/calibration/test windows, compare proper scores and decision value with a simple baseline, and recalibrate only from outcomes resolved after prediction time.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- rectangular or explicitly missing function-by-environment evaluation panel derived from common loss definitions and independent operating-environment resolution, with common-shock and version metadata
- function versions, environment/resampling unit, loss standardization, reliability weights, missing-cell policy, minimum shared support, practical correlation, stability probability, FDR, bootstrap controls, privacy boundary and follow-up experiment authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "discover stable candidate relationships for shared" }
→ finds "construct_calibration_shared_evidence_graph"
gitrevio_capability_describe
{ "capability_id": "construct_calibration_shared_evidence_graph" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "construct_calibration_shared_evidence_graph", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Audit analytics transportability
Audit whether locally calibrated analytical functions retain decision-loss improvement across target-similar operating environments using similarity-weighted random-effects meta-analysis, between-environment variance, I-squared, sign consistency and a conservative target prediction interval.
Calculate analytics portfolio realized ROI
Reconcile the analytics portfolio's realized ROI from unique finance-owned incremental benefit sources, causal-evidence weights, non-overlapping function allocations, implementation/recurring/shared costs and coherent joint scenarios, with positive-value probability and CVaR loss gates.
Audit analytical specification multiverse
Audit whether an analytical conclusion survives a prespecified multiverse of admissible windows, cohorts, metrics, and models using aligned bootstrap draws, a weighted specification curve, practical-effect support gates, and descriptive choice-influence diagnostics.
Audit analytics challenger independence
Audit whether an analytical challenger supplies genuinely independent error information: use paired temporal moving-block bootstrap bounds on error correlation, incumbent-failure catch rate and common-mode joint failure, with simultaneous Bonferroni control across every screened challenger and explicit evidence gates.
Audit analytics function calibration readiness
Gate analytical functions on paired out-of-time decision loss against a frozen baseline using temporal moving-block bootstrap, autocorrelation- and weight-adjusted effective sample size, evidence coverage, lower confidence bounds, improvement probability and recent degradation rather than declaring a model calibrated from training fit.
Audit forecast ensemble lineage integrity
Audit whether a claimed forecast ensemble is a complete, independently sealed and point-in-time evidence set rather than duplicated consensus, then score only mature uncontaminated outcomes.