LLMOps Basic — 049: map RACI for prompt changes on `Eval slices that compound` — memo `169028 [49]`

Lesson 049: Eval slices that compound

Focus

Document interfaces between retrieval, prompts, and policy engines. Token Eval slices that compound:49 keeps neighbouring lessons differentiable.

Key ideas

• Thread: Eval slices that compound · drill v9 · spin 189085.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Eval harness snippet

case_id: LO-8481
route: support_rag_v2
must_include_patterns:
  - "\[chunk_"
forbid_patterns:
  - "guaranteed SLA"
judge_profile: tempered_2

Practice

Practice Draft three eval assertions QA must pass before prompt promotion. — 49 Bump 30.