AUDIT / CALIBRATION / VALIDATION OPS

Calibration Control Room

Validate LLM prompt and agent changes before deployment with cost-gated, metered, evidence-preserved workflows.

Quick actions

What to do next

+ New RunAnalyze codeManage provider keys

AUDIT-GRADE LLM VALIDATION BEFORE DEPLOYMENT

Every run is cost-gated, metered, and preserved as evidence.

Start calibration run
1
Preflight Auditmini-antemortem-cli

configuration traps and calibration risk

2
Empirical Preflightmini-omega-lock

judge consistency, schema reliability, context margin

3
Calibration Runomegaprompt

prompt train/test/holdout gates

4
Evidence FinalizationFINALIZING

billing capture, artifact gate, token revoke

Audit Runs

Recent validation evidence

View all runs →
Empty stateNo validation Runs yet.

Start with a Preflight Audit and Cost Gate, then preserve results as Artifact evidence.

  1. Paste a snippet at /onboard so the audit proposer can suggest a Run config.
  2. Pick an intent in /runs/new and the IntentPicker fills the 9 fields for you.
  3. Review, then hit 'Reserve Run' — BillingGuard enforces the hard cap before worker pickup.
New Calibration

BILLING

Cost Gate

Manage billing →
Provider modeMANAGED
Hard cap$20.00
Reserved$20.00
Projected capture$12.30
Release preview$7.70

MANAGED / Hard cap / ModelGateway: MANAGED reserve = hard cap. ModelGateway denies calls above reserved remaining.

BYOK is not free hosted execution. Provider-token cost is externalized to the customer's provider account, while platform execution, orchestration, storage, and Artifact Ledger costs remain billable.