LLMOps Intermediate — 012: audit adapter routing on `RAG trade space rehearsals` — memo `64263 [12]`

Lesson 012: RAG trade space rehearsals

Focus

Bias toward observable metrics: latency, cost, escalation rate. Token RAG trade space rehearsals:12 keeps neighbouring lessons differentiable.

Key ideas

• Thread: RAG trade space rehearsals · drill v2 · spin 395823.
• Habit: attach a trace_id to every completion you would paste into an ops dashboard.
• Guardrail: add one RACI bullet for prompt or index changes before tomorrow's standup.

Deep dive notebook

Synthetic drill artefacts

Refusal RACI

policy_id: LLM-163
allow_when:
  confidence_gt: 0.55
refuse_when:
  - legal_hold
  - unverified_medical
owner: ethics-int

Practice

Practice List five adversarial prompts using your org's domain nouns. — 12 Bump 15.