AUDIT / CALIBRATION / VALIDATION OPS

Omega Tools — Live demo

LLM prompt/agent validation evidence · read-only walkthrough

READ-ONLY DEMOStatic walkthrough — three canned calibration runs. No DB, no BYOK key, no signup needed. To run your own, sign up and follow the README quickstart.Sign up →

Demo runs

Three finalized calibration runs

Pick a run to see the inline ResultCard — pass rate, top failed samples, target/judge model split. All data is canned and isolated from production. Korean customer-service scenario.

SUCCEEDED

한국어 CS 응대 — Gemini Flash · PASS 87.5%

gemini / gemini-2.5-flash · 0.0056 USD

COMPLETED_HOLD

Preflight HOLD — 잘못된 prompt template 검증

gemini / gemini-2.5-flash-lite · 0.0000 USD

FAILED

동일 dataset, 더 약한 prompt 변형 — FAIL 0%

openai / gpt-4.1-mini · 0.0043 USD