GenAI Basic — 072: quantify hallucination fallout on `Retrieval choreography baselines` — memo `296234 [72]`

Lesson 072: Retrieval choreography baselines

Focus

Prefer explicit failure rehearsals over aspirational wording. Token Retrieval choreography baselines:72 keeps neighbouring lessons differentiable.

Key ideas

• Thread: Retrieval choreography baselines · drill v2 · spin 362833.
• Habit: pair every model utterance with a trace_id you could paste into Grafana.
• Guardrail: write one RACI bullet referencing this lesson tomorrow.

Deep dive notebook

Synthetic drill artefacts

Prompt scaffold

ROLE: Incident analyst cohort 72
INPUTS:
- excerpts tagged [chunk_id ...]
- guardrails referencing policy_bundle_8
TASK:
  1) Summarize deltas with citations
  2) Confidence label LOW|MED|HIGH + evidence
  3) If facts missing emit MISSING_FACTS list
USER_SEED_QUESTION >>> What changed between rollout 26 and 27?

Practice

Practice Simulate degraded retrieval once; screenshot graceful degradation copy. — 72 Bump literals mindset by 28.