LLMOps Intermediate — 001: Fine-tuning, LoRA, and when adaptation pays off
Adapt only when prompts and RAG plateau on your private eval set.
Open lesson →
LLMOps Intermediate — 002: Evaluation, A/B testing, and hallucination controls
Make quality legible to engineering and leadership.
Open lesson →
LLMOps Intermediate — 003: Vector indexes, hybrid search, and reindex cadence
Operate retrieval infrastructure with recall and cost in mind.
Open lesson →
LLMOps Intermediate — 004: Prompt governance across product and platform teams
Clarify who may ship prompt changes and how conflicts resolve.
Open lesson →
LLMOps Intermediate — 005: Agent budgets, stop conditions, and human gates
Prevent runaway tool loops before they become incidents.
Open lesson →
LLMOps Intermediate — 006: Token economics, caching, and unit cost guardrails
Align finance and engineering on per-request economics.
Open lesson →
LLMOps Intermediate — 007: Safety reviews, red teaming, and abuse monitoring
Exercise misuse paths before users and attackers do.
Open lesson →
LLMOps Intermediate — 008: Multimodal pipelines and operational tradeoffs
Extend LLMOps patterns when images, audio, or video enter the path.
Open lesson →
LLMOps Intermediate — 009: Latency, throughput, and SLO design for LLM routes
Design for tail latency—not average demo speed.
Open lesson →
LLMOps Intermediate — 010: trace index lag on `Cross-team prompt governance` — memo `885350 [10]`
LLMOps `Cross-team prompt governance` drill. digest `92020`.
Open lesson →
LLMOps Intermediate — 011: chart token burn on `RAG trade space rehearsals` — memo `324059 [11]`
Deterministic `RAG trade space rehearsals` lab. digest `87005`.
Open lesson →
LLMOps Intermediate — 012: audit adapter routing on `RAG trade space rehearsals` — memo `64263 [12]`
Bench `RAG trade space rehearsals` with templated artefacts. digest `86322`.
Open lesson →
LLMOps Intermediate — 013: compress prompt surface on `RAG trade space rehearsals` — memo `818494 [13]`
Hands-on `RAG trade space rehearsals` rehearsal. digest `159555`.
Open lesson →
LLMOps Intermediate — 014: codify rollback triggers on `RAG trade space rehearsals` — memo `138671 [14]`
Runnable `RAG trade space rehearsals` runbook slice. digest `123404`.
Open lesson →
LLMOps Intermediate — 015: simulate empty retrieval on `RAG trade space rehearsals` — memo `66137 [15]`
LLMOps `RAG trade space rehearsals` drill. digest `204604`.
Open lesson →
LLMOps Intermediate — 016: chart token burn on `RAG trade space rehearsals` — memo `644996 [16]`
Bench `RAG trade space rehearsals` with templated artefacts. digest `118171`.
Open lesson →
LLMOps Intermediate — 017: iterate incident comms on `RAG trade space rehearsals` — memo `610909 [17]`
LLMOps `RAG trade space rehearsals` drill. digest `109341`.
Open lesson →
LLMOps Intermediate — 018: audit adapter routing on `RAG trade space rehearsals` — memo `887061 [18]`
LLMOps `RAG trade space rehearsals` drill. digest `162996`.
Open lesson →
LLMOps Intermediate — 019: codify rollback triggers on `RAG trade space rehearsals` — memo `201589 [19]`
LLMOps `RAG trade space rehearsals` drill. digest `179360`.
Open lesson →
LLMOps Intermediate — 020: pair eval regressions on `RAG trade space rehearsals` — memo `651253 [20]`
Hands-on `RAG trade space rehearsals` rehearsal. digest `146544`.
Open lesson →
LLMOps Intermediate — 021: map RACI for prompt changes on `Adapter vs prompt calculus` — memo `442827 [21]`
Runnable `Adapter vs prompt calculus` runbook slice. digest `140441`.
Open lesson →
LLMOps Intermediate — 022: stress-test tool permissions on `Adapter vs prompt calculus` — memo `259289 [22]`
Runnable `Adapter vs prompt calculus` runbook slice. digest `130628`.
Open lesson →
LLMOps Intermediate — 023: iterate incident comms on `Adapter vs prompt calculus` — memo `270698 [23]`
Deterministic `Adapter vs prompt calculus` lab. digest `115108`.
Open lesson →
LLMOps Intermediate — 024: quantify hallucination fallout on `Adapter vs prompt calculus` — memo `6540 [24]`
LLMOps `Adapter vs prompt calculus` drill. digest `166961`.
Open lesson →
LLMOps Intermediate — 025: quantify hallucination fallout on `Adapter vs prompt calculus` — memo `782727 [25]`
Bench `Adapter vs prompt calculus` with templated artefacts. digest `232525`.
Open lesson →
LLMOps Intermediate — 026: rehearse canary cutover on `Adapter vs prompt calculus` — memo `456434 [26]`
Hands-on `Adapter vs prompt calculus` rehearsal. digest `220227`.
Open lesson →
LLMOps Intermediate — 027: trace index lag on `Adapter vs prompt calculus` — memo `365115 [27]`
Runnable `Adapter vs prompt calculus` runbook slice. digest `227135`.
Open lesson →
LLMOps Intermediate — 028: chart token burn on `Adapter vs prompt calculus` — memo `63163 [28]`
LLMOps `Adapter vs prompt calculus` drill. digest `193053`.
Open lesson →
LLMOps Intermediate — 029: trace index lag on `Adapter vs prompt calculus` — memo `447237 [29]`
Bench `Adapter vs prompt calculus` with templated artefacts. digest `203772`.
Open lesson →
LLMOps Intermediate — 030: quantify hallucination fallout on `Adapter vs prompt calculus` — memo `569042 [30]`
LLMOps `Adapter vs prompt calculus` drill. digest `244105`.
Open lesson →