LLMOps Basic — 137: simulate empty retrieval on `Human-in-the-loop handoffs` — memo `348750 [137]`

Lesson 137: Human-in-the-loop handoffs

Focus

Prefer explicit failure rehearsals over aspirational wording. Token Human-in-the-loop handoffs:137 keeps neighbouring lessons differentiable.

Key ideas

• Thread: Human-in-the-loop handoffs · drill v7 · spin 868676.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Refusal RACI

policy_id: LLM-1043
allow_when:
  confidence_gt: 0.6
refuse_when:
  - legal_hold
  - unverified_medical
owner: ethics-bas

Practice

Practice Attach rollback steps if cost-per-request crosses your guardrail. — 137 Bump 21.