AB test calculator: significance and sample size
Is B really better than A: p-value, confidence interval and the sample needed for the lift you care about.
A/B test and sample sizeIs B really better than A, and how many visitors does it take?
VerdictB differs from A at 95% confidence
Conversion A3%
Conversion B3.5%
B against A16.5%
p-value0.0299
95% interval of the difference0.05 → 0.94 points
Sample per group to detect 10%53,211
Do not stop the moment it looks significant: peeking raises false positives from 5% to about 30%.
%
What you enter is kept in this browser; a share link carries exactly these numbers.
Want it to work exactly your way?
Keep this tool in your Mini-Apps to run it again in one click, or describe the job and AI builds an app of your own.
Run it on your own figures
Upload your orders or report to DataMimi and ask in plain English — this calculator opens prefilled with the prices, volumes and costs from your own file, and every figure shows which rows it came from.
Open DataMimi
