Lesson 102: Synthetic eval data ethics
Focus
Prefer explicit failure rehearsals over aspirational wording. Token Synthetic eval data ethics:102 keeps neighbouring lessons differentiable.
Key ideas
- Thread: Synthetic eval data ethics · drill v2 · spin
443709. - Habit: attach a trace_id to every completion you would paste into an ops dashboard.
- Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.
Deep dive notebook
Synthetic drill artefacts
Red-team tableau
1. Actor **support_agent**
2. Injection `INJECT-126`
3. Detector `policy-tier-2` → pager `llmops-oncall-3`
4. Log fields `trace_id,tenant_id,redaction_tier`
Practice
Practice Paste the worked template into an internal wiki stub and name owners. — 102 Bump 12.