The Peeking Problem in A/B Testing (And How to Fix It)
Checking your A/B test daily and stopping at the first win inflates your false positive rate. The math behind the peeking problem, and how to avoid it.
Complete, honest guides on CRO, A/B testing and experimentation. The most complete articles on the web, no fluff. (page 4 of 4)
Checking your A/B test daily and stopping at the first win inflates your false positive rate. The math behind the peeking problem, and how to avoid it.
Statistical significance in A/B testing explained in plain English, with the full z-test formula, a worked example, and free live calculators.
A complete, honest walkthrough of running an A/B test: hypothesis, sample size, setup, avoiding peeking, and reading results, with a free calculator.
A/B testing from zero to advanced: how it works, how many visitors you need, the mistakes that invalidate results, and how to call a winner honestly.