2026-04-12 · 5 min read
A/B testing subject lines without fooling yourself
Sample sizes, novelty effects, and when to stop—so your "winner" still wins next Tuesday.
Subject tests need enough volume per cell and a pre-registered stop rule, otherwise noise looks like insight.
Novelty lifts fade quickly; bake a re-test window into the playbook before you declare a permanent champion.