AB+ Test Calculator by CXL

BETA

One test calculator to answer all your pre and post test analysis questions:

Test analysis
  • Does the test variation beat the original?
  • Does the test have the needed sample size?
  • Does the test have the needed duration?
  • What is the monetary ROI of the test variation?
Pre-test analysis
  • What is the minimal detectible effect I can test for?
  • How long should I test for considering the effect?
  • What's the sample size for a test on this page?
  • Does confidence level affect my test duration?

Pre-Test Analysis

Test Analysis

Pre-Test Analysis

Test Analysis

  • Does the test variation beat the original?
  • Does the test have the needed sample size?
  • Does the test have the needed duration?
  • What is the monetary ROI of the test variation?
  • What is the minimal detectible effect I can test for?
  • How long should I test for considering the effect?
  • What's the sample size for a test on this page?
  • Does confidence level affect my test duration?

To explore calculator without real test data: click here to add dummy test data

Test duration

%
Additional days needed
---

Control

Conversion Rate
---

Variation 1

Conversion Rate
---
Lift
---
Extra transactions
---
Monthly monetary contribution
---
P-value
---
×

Sample size calculator

%
%
Required sample size per variation
---

Duration calculator

%
%
%
How long in total to run the test
---

Monthly Monetary Contribution based on data above

Minimal Detectible Effect (MDE)

Week MDE
1 ---
2 ---
3 ---
4 ---
5 ---
6 ---

Results

Significance calculation method:
Bayesian
Z Test
Chi Squared

More information is required for the graph


Verdict:

Verdict: