LLMOps Basic — 056: map RACI for prompt changes on `Safety scaffolding for pilots` — memo `385298 [56]`

Lesson 056: Safety scaffolding for pilots

Focus

Bias toward observable metrics: latency, cost, escalation rate. Token Safety scaffolding for pilots:56 keeps neighbouring lessons differentiable.

Key ideas

• Thread: Safety scaffolding for pilots · drill v6 · spin 375928.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Refusal RACI

policy_id: LLM-811
allow_when:
  confidence_gt: 0.57
refuse_when:
  - legal_hold
  - unverified_medical
owner: ethics-bas

Practice

Practice List five adversarial prompts using your org's domain nouns. — 56 Bump 13.