A/B test sample size calculator for landing pages
How many visitors does each version of your page need before the result means something? Three numbers give the answer, and how many days of traffic it takes.
Calculator
How many visitors does your test need?
Two-sided test at 95% confidence and 80% power, two versions with an even split.
Change the current rate to 2% to see why tests on purchases need so much more traffic than tests on click-through.
My comparison notebook
0/4
Keep up to four named runs, compare what changed and download a report. The notebook stays in this tab’s memory: export it to reopen it later.
Nothing is sent. Closing or reloading this tab clears an unexported notebook.
Images and audio keep their dedicated exports. The notebook records parameters and text results.
What the numbers mean
A test compares two versions of a page on the same traffic. Because visitors are random, the two versions never score exactly the same, even when they are identical. The sample size is the number of visitors each version needs before a difference of the size you care about can be told apart from that noise.
Three inputs decide it:
- The current rate. Your conversion rate today, on the step you will measure: click-through from a presell page to the product page, or purchases per visitor.
- The smallest lift worth detecting, written relative to the current rate. Detecting a move from 30% to 34.5% is a 15% lift.
- Your daily traffic, to turn visitors into days.
The formula behind it
The calculator uses the standard formula for comparing two proportions, with a two-sided test at 95% confidence (z = 1.96) and 80% power (z = 0.84). With p₁ the current rate, p₂ the rate you want to detect and p̄ their average:
n per version = (1.96 × √(2 p̄ (1 − p̄)) + 0.84 × √(p₁(1 − p₁) + p₂(1 − p₂)))² ÷ (p₂ − p₁)²
You do not need to compute it by hand, but it explains the two rules every tester learns the hard way: the sample grows with the square of the inverse of the gap, and it explodes when the rate is small.
Why purchases are so hard to test
| What you measure | Current rate | Lift to detect | Visitors per version | Days at 400 visitors a day |
|---|---|---|---|---|
| Click-through to the product page | 30% | 15% | 1,693 | 9 |
| Purchases per visitor | 2% | 30% | 9,798 | 49 |
| Purchases per visitor | 2% | 15% | 36,693 | 184 |
The same 15% lift that takes nine days to detect on click-through takes six months on purchases. Two habits follow:
- Test bold changes. Halving the lift you want to detect roughly quadruples the visitors you need. A new angle or a new format can move the rate by 20% or more; a button color will not, and you will never have the traffic to prove it did.
- Measure the step with volume. Decide on click-through to the product page when purchases are too rare, then keep watching purchases to confirm the winner holds.
Run the test properly
- Run whole weeks. People browse and buy differently on a Monday and on a Sunday. Cover at least one full week, two when you can, even if the sample size is reached earlier.
- Do not peek and stop. Checking every day and stopping at the first significant result finds false winners far more often than the 5% you accepted.
- Change nothing during the test. Budgets, audiences, offers and ads stay the same until the end, or the two versions no longer see the same visitors.
- Write the decision down, including "no difference". A test log stops a team from re-testing the same idea every six months.
When the planned sample is reached, read the result with the A/B test significance calculator. For what to test first on a presell page (angles and formats before buttons), read the A/B testing guide.
Frequently asked questions
What is a minimum detectable effect?
The smallest lift you want the test to be able to see, written relative to your current rate. A 15% effect on a 30% rate means detecting a move to 34.5%. Smaller effects are real but need far more visitors to tell apart from noise.
Why 95% confidence and 80% power?
They are the usual defaults. 95% confidence means a 5% chance of calling a winner when the versions perform the same; 80% power means an 80% chance of detecting the lift if it is real. Raising either one raises the sample size.
Can I stop the test as soon as one version is significantly ahead?
No. Checking repeatedly and stopping at the first significant result produces false winners far more often than 5% of the time. Decide the sample size first, run whole weeks, and read the result once at the end.
Should I measure purchases or click-through?
Purchases are what you want, but they are rare, so tests on them need a lot of traffic. Click-through to the product page needs far fewer visitors. A common compromise is to decide on click-through and keep watching purchases to confirm the winner holds.
More free tools
- ROAS calculatorReturn on ad spend, cost per purchase and profit after ads, measured against your break-even ROAS.
- Break-even ROAS calculatorThe ROAS, cost per purchase and cost per click at which your ads stop losing money, fees included.
- Presell page calculatorSame budget, two funnels: straight to the product page, or through a presell page. Which one leaves more profit.
- A/B test significance calculatorLift, p-value and confidence for two versions of a page, with a plain-language verdict.
- Discount Profit PlannerA discount's sale price, margin, contribution and required order volume, with a reusable scenario sheet.
- The refund pressure ledgerRefunded sales, inventory recovery and return costs in three exportable cohort scenarios.
- Advertorial headline generatorHeadlines for presell pages and advertorials, written for the reader's level of awareness, with copy and CSV export.
- Presell format pickerFive questions about your reader, proof, product and traffic, then the three best-fit presell formats and why.
- CTR, CVR and EPC calculatorRaw counts in, every rate out: CTR, CPM, CPC, CVR, AOV, CPA, ROAS and earnings per click.
- Funnel drop-off calculatorStep-by-step conversion from ad click to purchase, the weakest step and a what-if on one improvement.
- UTM link builderClean UTM links for one ad or a batch, with the page in utm_content and the ad in utm_term, and CSV export.
- Test budget and profit per 1,000 visitorsProfit per 1,000 visitors, break-even conversion and the budget to reach your target orders, in three scenarios.
- Free shipping threshold calculatorCompare lost shipping revenue, carrier costs and contribution targets with exportable scenarios.
- Page weight and speed budgetEstimated network load time on three connections, and the kilobytes you can afford for your goal.
- Customer acquisition cost calculatorCompare fully loaded CAC, acquisition cost lines and target budgets in two exportable scenarios.
- Message-match scorecardTen weighted checks between an ad and its page, a score, the fixes to make first and a word-overlap helper.


