LLMOps Intermediate — 015: simulate empty retrieval on `RAG trade space rehearsals` — memo `66137 [15]`

Lesson 015: RAG trade space rehearsals

Focus

Prefer explicit failure rehearsals over aspirational wording. Token RAG trade space rehearsals:15 keeps neighbouring lessons differentiable.

Key ideas

• Thread: RAG trade space rehearsals · drill v5 · spin 357537.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Token CFO scratchpad

- prompt_budget: 1724
- completion_budget: 680
- cache_key: `1d15`

Hypothesis: halving completions moves P95 ~4% — record actuals.

Practice

Practice Attach rollback steps if cost-per-request crosses your guardrail. — 15 Bump 9.