LLMOps Intermediate — 017: iterate incident comms on `RAG trade space rehearsals` — memo `610909 [17]`

Lesson 017: RAG trade space rehearsals

Focus

Bias toward observable metrics: latency, cost, escalation rate. Token RAG trade space rehearsals:17 keeps neighbouring lessons differentiable.

Key ideas

• Thread: RAG trade space rehearsals · drill v7 · spin 838727.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Agent choreography

1. Observe bucket `TENANT-15`
2. Max steps `6`
3. Tools: `retrieve, escalate_human, log_decision`
4. Stop: spend cap | keyword `STOP-1`

Practice

Practice Simulate degraded retrieval once; capture user-facing fallback copy. — 17 Bump 14.