Audit AI data rights provenance integrity
Audit every AI training, fine-tuning, retrieval, evaluation, logging and persisted-output use against an immutable rights grant and the complete derivative lineage, including time, revocation, deletion, purpose, jurisdiction, consent, derivative and evidence gates.
What it's for
Gives leaders a defensible AI data bill of materials: which systems used which data, under which grant and purpose, through which derivative chain—and which uses must be quarantined now.
What you give it
Inputs split into evidence read from your connected systems, calibration your team owns, and numerical controls that affect precision but never the result's meaning.
| Field | Type | Role | Required |
|---|---|---|---|
| data_assets | array of objects (9 fields) | Evidence | Yes |
| max_detail_rows | integer ≥ 1, ≤ 500 | Numerical control | Optional |
| minimum_evidence_coverage | number ≥ 0, ≤ 1 | Your calibration | Optional |
| rights_grants | array of objects (11 fields) | Evidence | Yes |
| usage_events | array of objects (10 fields) | Evidence | Yes |
Each rights_grants
record
| Field | Type | Required |
|---|---|---|
| derivative_use_allowed | boolean | Yes |
| evidence_verified | boolean | Yes |
| id | string (non-empty) | Yes |
| permitted_jurisdiction_ids | array of string | Yes |
| permitted_purpose_ids | array of string | Yes |
| permitted_use_types | array of values | Yes |
| revoked_at_ms | any | Yes |
| rights_holder_id | string (non-empty) | Yes |
| sublicensing_allowed | boolean | Yes |
| valid_from_ms | number (≥ 0) | Yes |
| valid_until_ms | any | Yes |
{
"data_assets": [
{
"acquired_at_ms": 100,
"content_hash": "sha256:support-knowledge-snapshot",
"deletion_requested_at_ms": null,
"evidence_verified": true,
"id": "support-knowledge-snapshot",
"parent_asset_ids": [],
"rights_grant_id": "grant-support-eu",
"subject_consent_required": false,
"subject_consent_verified": false
}
],
"rights_grants": [
{
"derivative_use_allowed": true,
"evidence_verified": true,
"id": "grant-support-eu",
"permitted_jurisdiction_ids": [
"eu"
],
"permitted_purpose_ids": [
"customer-support"
],
"permitted_use_types": [
"retrieval"
],
"revoked_at_ms": null,
"rights_holder_id": "customer-contract-pool",
"sublicensing_allowed": true,
"valid_from_ms": 0,
"valid_until_ms": 10000
}
],
"usage_events": [
{
"asset_id": "support-knowledge-snapshot",
"derivative_created": false,
"evidence_verified": true,
"id": "retrieval-use-1",
"jurisdiction_id": "eu",
"occurred_at_ms": 1000,
"output_persisted": true, Truncated for display — the full payload is 50 lines.
What you get back
This is the actual output of running the example above — computed by the same function the platform calls, not an illustration.
{
"assumptions": [
"Grant, consent, revocation, deletion, purpose, jurisdiction and lineage records are authoritative, immutable and joined by stable tenant-scoped IDs.",
"Every persisted output is conservatively treated as a transferable derivative requiring the declared right; local counsel owns the actual legal interpretation.",
"Passing proves consistency with represented grants, not ownership, consent validity, copyrightability, regulatory compliance or permission to deploy."
],
"counts": {
"data_assets": 1,
"exposed_systems": 0,
"invalid_usage_events": 0,
"rights_grants": 1,
"usage_events": 1,
"valid_usage_events": 1
},
"decision": "rights_provenance_verified",
"evidence": {
"gate_pass": true,
"minimum_required_fraction": 0.95,
"verified_fraction": 1
},
"failure_counts": {},
"integrity_pass": true,
"limitations": [
"The audit cannot discover unregistered shadow datasets, memorized content, fraudulent attestations or rights restrictions absent from the supplied ledger.",
"Results concern data assets and systems, never the character, nationality, loyalty or employment suitability of a contributor or rights holder."
],
"method": "ai_data_rights_lineage_purpose_integrity_audit_v1",
"truncated_detail_rows": 0,
"usage_diagnostics": []
} How it works
Statistical audit & measurement — Check whether a number is fit to decide on: coverage, timing, reconciliation, and the gaps a dashboard hides.
- 1 Validate unique grants, canonical content hashes, authoritative consent/deletion state and an acyclic parent-asset lineage.
- 2 For every usage event, traverse the full ancestor set and test grant window, revocation, purpose, use type, jurisdiction, consent, deletion and derivative rights.
- 3 Quarantine unverified uses, aggregate failure mechanisms and affected systems, and enforce a portfolio evidence-coverage gate.
Before you trust it
Every tool in the catalog ships with the conditions under which its answer is meaningful — and the conditions under which it should abstain instead of guessing.
Assumptions & guardrails
- Metric definitions, weights, aggregate grain, sampling, missingness, dependence, and comparison windows correspond to the management claim being audited.
- The tenant rights ledger is complete and point-in-time correct; content hashes, lineage IDs, grants, consent, revocation, deletion and usage events are immutable and tenant scoped.
- Association, instability, or measurement quality is not a causal effect and must not be converted directly into an individual employment decision.
- Passing proves internal ledger consistency only; it is not legal advice, ownership proof, copyrightability analysis, regulatory certification or permission to deploy.
Minimum evidence
- rights_grants: required and organization-defined
- data_assets: required and organization-defined
- usage_events: required and organization-defined
How to validate it
Validate on future periods or held-out aggregate units, compare with a simple baseline, and require stability across plausible metric definitions and decision thresholds.
Calibrating it to your org
Same for everyone
The mathematical kernel, validation rules, method version, and JSON output semantics are organization-independent; no tenant-trained coefficients or company benchmark is embedded in the function.
Specific to you
- tenant-scoped AI data bill of materials joining every registered training, fine-tuning, retrieval, evaluation and logging event to a point-in-time grant and complete acyclic derivative ancestry without dropping invalid or deleted uses
- rights-ledger perimeter, grant interpretation, purpose/use taxonomy, jurisdiction, consent/deletion authority, persisted-output semantics, evidence verification, coverage gate and quarantine authority
Calibration workflow
- 1 Define the management decision, target outcome, aggregate unit, privacy boundary, cadence, and prediction/intervention horizon for this organization.
- 2 Build a tenant-scoped historical cohort using only information available before each prediction or decision; preserve zero periods, censoring, assignment probabilities, and unresolved outcomes when the method requires them.
- 3 Estimate statistical parameters on training history, but obtain costs, utilities, risk tolerance, practical-effect thresholds, capacity, and policy constraints from accountable decision owners.
- 4 Validate on later time windows or held-out aggregate units at the deployment grain, against a simple baseline and the function-specific validation strategy.
- 5 Deploy only if the returned decision clears evidence, overlap, calibration, robustness, and guardrail checks; warning, unsupported, schema-gap, and fallback decisions are abstentions.
- 6 Monitor realized outcomes, data drift, coverage, and decision regret; recalibrate at a governed cadence or after a detected regime/definition change, never merely because a stakeholder dislikes the result.
Call it from your AI
You don't wire up 388 tools in your MCP client. The GitRevio MCP server exposes 18 tools, three of which let an agent search the catalog, read a tool's schema, and run it — so the assistant finds this one on its own.
gitrevio_capabilities_search
{ "q": "audit every ai training finetuning retrieval" }
→ finds "audit_ai_data_rights_provenance_integrity"
gitrevio_capability_describe
{ "capability_id": "audit_ai_data_rights_provenance_integrity" }
→ returns the input schema and agent guidance shown on this page
gitrevio_capability_run
{ "capability_id": "audit_ai_data_rights_provenance_integrity", "arguments": { ... } }
→ returns the result shown above Works in Claude Desktop, Claude Code, Cursor, Cline, Continue.dev, Goose and Aider. See the MCP server.
Related tools
Forecast AI data rights liability
Forecast correlated AI data-rights loss, disruption and response cost with locally calibrated Beta defect priors, partially shared Gaussian-copula occurrence and severity, lognormal harm, coherent jurisdiction scenarios, controls and portfolio VaR/CVaR.
Optimize AI data rights remediation portfolio
Choose license, replace, delete, disable or retrain actions that maximize preserved risk-adjusted AI value under budget, legal/execution gates, dependencies and scarce resources, while pricing scenario CVaR and counting shared lineage contamination once at its weakest residual member.
Audit agentic action control integrity
Audit operational AI-agent actions from bounded least-privilege permission scope through independently tested authorization, approval, sandbox, monitoring, rollback or compensation, and kill-switch controls, counting unique value exposure once.
Audit AI configuration release integrity
Audit that the exact immutable AI configuration bundle evaluated and approved is the bundle exposed in every staged rollout, with consecutive parent lineage, complete blast-radius declaration, effective runtime controls, monotone traffic and a tested prior-version rollback path.
Audit AI evaluation contamination integrity
Audit frozen AI evaluation suites for temporal or answer leakage, model-version mismatch, incomplete pre-label predictions, weak label provenance, missing subgroup support, cross-suite case reuse and near-duplicate content components before evaluation scores are trusted.
Audit AI output IP provenance integrity
Audit aggregate AI outputs against the exact model and provider terms effective at generation, pre-commercialization similarity evidence, counsel-owned ownership/use rules, human review and any claimed indemnity coverage.