Articles by tag: ab-testing

Hypothesis Testing in Statistics: Basics and Errors

Breakdown of Statistical Hypothesis Testing: H0, H1, Type I and Type II Errors, Test Power. Experiment Planning for data science. Learn how to avoid typical mistakes in A/B tests.

Evan Miller Calculator for A/B Tests

Learn to calculate sample size in A/B tests using Evan Miller's tool. Parameters, examples, impact on power and significance. Optimize experiments without overspending resources.

Promotion Evaluation without A/B: Diff-in-Diff and PSM

Learn how to evaluate the effect of open promotions without A/B tests: Diff-in-Diff, thematic control, and Propensity Score Matching. Calculation examples and code for analysts.

VWE and CUPED in A/B tests: variance reduction

Learn when VWE complements CUPED to increase the sensitivity of A/B tests. RMSE simulations, code examples, and use cases. For data scientists and analysts.