Blog

Donnu A/B Blog

Complete, honest guides on CRO, A/B testing and experimentation: statistics, sample size, test design and what to do with the results. No fluff.

CRO

Landing Page Optimization: A Repeatable Testing Method

Landing page optimization as a method: diagnose with the page funnel, prioritize with ICE, size each test to your traffic and read the result honestly.

Statistics

Budget Experiments: Where Spend Stops Paying Off

A budget experiment measures a curve, not a winner. Marginal return versus average ROI, why two arms never find the optimum, and the cost in power.

CRO

Budget Pacing: When the Daily Cap Breaks Your Test

Budget pacing: a daily cap cuts the hours, not just the spend. How a throttled arm flips the verdict and why user level randomization does not fix it.

Statistics

Budget Reallocation: The Portfolio Experiment

Budget reallocation cannot be tested channel by channel. Why the unit of analysis is the portfolio, what average CPA hides and what it costs to measure.

Statistics

Attribution Model: Same Test, Different Verdict

Your attribution model changes how many conversions an A/B test counts. Why fractional credit breaks the proportion test, and what to count instead.

Statistics

Marketing Mix Modeling, Calibrated With Experiments

Marketing mix modeling has 156 data points and 60 parameters. How an experiment becomes an ROI prior, with the adjustment formulas and a worked example.

CRO

Smart Bidding: The Optimizer Is Part of Your Test

Smart Bidding recalibrates while your A/B test runs. How the learning period dilutes the effect, its cost in power, and three designs that survive.

CRO

Ad Fatigue: How to Test Ad Frequency Properly

Ad fatigue: why the frequency curve in your dashboard is not causal, what field data shows, and how to test a frequency cap with a real experiment.

CRO

Ad Creative Testing: What to Actually Measure

Ad creative testing: why the creative picks its own audience, why click-through rate misleads, and which metric can actually carry the decision.