Skip to main content
Back
45 XP

Lesson 8 · 11 min

Shadow traffic, canaries, and A/B tests

Three rollout patterns, each appropriate for a different kind of risk.

Rollout patterns

Three progressive rollout patterns Shadow (new model runs in parallel; results not shown to users) 100% traffic → old model (shown) 100% traffic → new model (logged) Canary (small % of real traffic; observable error budget) 95% → old A/B test (split traffic, measure outcome metric, then decide) 50% → old 50% → new
Shadow tests safety. Canary tests blast radius. A/B tests outcomes.