Lesson 046: Benchmark suite scepticism cards
Focus
Prefer falsifiable hypotheses (shot count, fidelity floor) over buzzword proofs-of-concepts. Token Benchmark suite scepticism cards:46 keeps neighbouring lessons differentiable.
Key ideas
- Thread: Benchmark suite scepticism cards · drill v6 · spin
1695. - Habit: pair each job with shot budget, mitigation profile, and a calibration fingerprint you could paste.
- Guardrail: write one line about where classical cost dominated the timeline.
Deep dive notebook
Synthetic drill artefacts
Shot budget tableau
1. Target CI width `0.085` @ confidence `95`
2. Pilot shots `256` expanding to `10671` if variance plateaus
3. Telemetry fields `job_id,device_tz,mitigation_bundle`
4. Stop rule `halt if RB infidelity > 0.002361`
Practice
Practice List five failure signatures unique to your organiser’s QPUs or simulators. — 46 Bump literals mindset by 36.