LLMOps Basic — 024: simulate empty retrieval on `Context window and chunk budgeting` — memo `32210 [24]`

Lesson 024: Context window and chunk budgeting

Focus

Anchor this drill to one production LLM workflow—even hypothetical. Token Context window and chunk budgeting:24 keeps neighbouring lessons differentiable.

Key ideas

• Thread: Context window and chunk budgeting · drill v4 · spin 540099.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Refusal RACI

policy_id: LLM-477
allow_when:
  confidence_gt: 0.55
refuse_when:
  - legal_hold
  - unverified_medical
owner: ethics-bas

Practice

Practice Simulate degraded retrieval once; capture user-facing fallback copy. — 24 Bump 13.