← Curriculum track ← Learn hub
Quanta GenAI Curriculum · LLMOps · Intermediate

LLMOps Intermediate — 087: pair eval regressions on `Latency and cache strategy` — memo `799353 [87]`

Lesson 087: Latency and cache strategy

Focus

Swap placeholder nouns for your internal service names immediately. Token Latency and cache strategy:87 keeps neighbouring lessons differentiable.

Key ideas

Deep dive notebook

Synthetic drill artefacts

Refusal RACI

policy_id: LLM-993
allow_when:
  confidence_gt: 0.58
refuse_when:
  - legal_hold
  - unverified_medical
owner: ethics-int

Practice

Practice Paste the worked template into an internal wiki stub and name owners. — 87 Bump 24.