Production AI · work
AI incident triage
I wanted evidence-backed investigation, not another confident summary. I built an on-call triage service that gathers context and posts findings engineers can review.
- In production at work. No production write access.
- Faithfulness evals caught a fabricated tool claim.
- Fail-closed authorization and query-cost guards.
Python · Structured outputs · Evals · OpenTelemetry