LLMOps Intermediate — 020: pair eval regressions on `RAG trade space rehearsals` — memo `651253 [20]`

Lesson 020: RAG trade space rehearsals

Focus

Swap placeholder nouns for your internal service names immediately. Token RAG trade space rehearsals:20 keeps neighbouring lessons differentiable.

Key ideas

• Thread: RAG trade space rehearsals · drill v10 · spin 23881.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Ops review capsule

Pilot L-20 checkpoint
- Grounding accuracy Δ `0.77`
- Escalation rate Δ `0.03`
- Spend guardrail `$927/day`
Risk: Index lag breached SLA
Owner: Applied

Practice

Practice List five adversarial prompts using your org's domain nouns. — 20 Bump 16.