Experimentation ROI Calculator

How to use it

1. Enter the visitors per month on the flow you test and your current conversion rate.
2. Add the average value per conversion (order value, lead value or revenue per sale).
3. Set how many tests per month you run, your win rate and the average uplift of a winner.
4. Fill in the monthly program cost (tool subscription plus team hours).
5. Read the three numbers: first-year ROI, incremental revenue per year at run-rate and net gain in the first year.

How it works: the math behind it

The calculator projects the program's value in four steps, all running in your browser:

The 0.5 factor in the first year is the ramp: because winners land across the year, the first year captures about half of what the program produces at run-rate. The accumulated uplift sums the winners' uplifts (additive model, simple and reproducible).

Worked example (reproduces the default result)

With the values that come prefilled: 40,000 visitors/month, 2.5% conversion, $200 per conversion, 1 test/month, 25% win rate, 6% average uplift and $1,500/month cost.

• Baseline monthly revenue: 40,000 × 0.025 × 200 = $200,000. Annual: $2,400,000.
• Tests/year: 1 × 12 = 12. Winners/year: 12 × 0.25 = 3. Accumulated uplift: 3 × 6% = 18%.
• Incremental revenue at run-rate: 2,400,000 × 0.18 = $432,000/year.
• Realized in year one: 432,000 × 0.5 = $216,000. Annual cost: 1,500 × 12 = $18,000.
• Net gain: 216,000 − 18,000 = $198,000. First-year ROI: 198,000 / 18,000 = 1,100%.

That is exactly what the tool shows above when you open the page: 1,100% ROI, $432,000 of incremental revenue per year and $198,000 of net gain in the first year.

How to read it, and where it misleads

The number has two honest uses: justifying the investment in experimentation to whoever owns the budget, and comparing scenarios (what changes if I double the testing cadence? if I lift the win rate?). Experimentation ROIs are famous for looking high, and it is true: when tests win, the gain recurs and the cost is fixed. But the result is a projection, not a guarantee.

Limits to keep in mind: the math assumes your win rate and average uplift hold, that the gains persist (they do not decay) and that you have the traffic to reach significance. It uses additive uplift (not multiplicative compounding) and a fixed half-year ramp. If your traffic is low, first check whether you can win tests consistently with the A/B test significance calculator and read the complete CRO guide. If you do not run tests yet, start with the basics in what is A/B testing.

Best practices when estimating ROI

Before you take the number into a meeting, calibrate the inputs honestly. These rules avoid the optimism that discredits the projection later.

• Use your real win rate (from history), not the one you wish you had. With no history, start at 20%.
• Measure the average uplift only from winners confirmed by significance, not from every test that seemed to rise.
• Put the true cost in the monthly field: tool, analysis hours, design and development of the variations.
• Run the conservative and the optimistic scenario. If the conservative one already pays for the program, the decision is easy.

Frequently asked questions

How do you calculate the ROI of an A/B testing program?

You project how much revenue the winning tests add and compare it to the cost of the program (tool plus hours). Each winner applies a relative uplift to your conversion rate; over a year the winners add up to an accumulated uplift that multiplies your baseline revenue. First-year ROI is (realized incremental revenue minus annual cost) divided by annual cost.

Why does the first year realize only half the run-rate revenue?

Because the winners do not all land on day one. They spread across the year, so the first winning test earns revenue for almost 12 months while the last earns for only a few weeks. On average, the first year captures about half of the revenue the program produces at run-rate (from year two onward, with every gain live).

What win rate and uplift should I use?

Mature programs win 1 in 5 to 1 in 3 tests (20% to 33%), with an average winner uplift between 4% and 10% relative. If you are just starting, use conservative numbers (20% win rate, 5% uplift). Plugging in a 50% win rate with 20% uplift inflates the result and only fools you.

Does a high ROI mean testing always pays off?

The math assumes your win rate and average uplift hold and that the gains persist. That is true when you have the traffic to reach significance and the discipline not to stop tests early. Low-traffic sites may not gather enough sample to win tests consistently. Treat the number as a projection of the potential, not a promise.

Does the calculator account for losing and flat tests?

Yes, implicitly: the win rate is already the fraction of tests that win. Losers and flats do not add to incremental revenue (a discarded loser does not change conversion), but their cost is in the monthly program cost, which you pay whether a test wins or not.

Keep going

Before counting on a test's uplift, confirm it is real with the A/B test significance calculator and plan how many you can run with the A/B test duration calculator. For the business context, see the complete CRO guide.