A/B Test
Decision Engine
Statistical significance · Power analysis · Revenue impact · RPV T-test · SRM detection
Test Inputs
Control
Variation
Pre-Test Planning
Revenue Impact Calculator
Control
Variation
£
Revenue Per Visitor – Welch's T-Test
?Tests whether average revenue per visitor differs. Paste raw values — 0 for no purchase. Better than CVR when AOV varies.Paste individual revenue values – one per line or comma-separated. Use 0 for sessions with no purchase.
Control – Sample 1
Variation – Sample 2
Sample Ratio Mismatch Checker
?An SRM means the actual traffic split differs from the intended split. Can invalidate results even when p-value looks good.Enter actual user counts per variant. If the chi-square test detects imbalance (p < 0.01), your results may be unreliable.