Module · Beginner
Correlation
What r measures, what it does not, and when it lies.
- 1 lesson
- 14 min
- 2 simulations
Free module
Data Analytics: Statistics & Data Visualization· Statistics
A/B Testing
Designing, running and reading product experiments — including the mistakes that make the results meaningless.
- Level
- Intermediate
- Lessons
- 4
- Total time
- 1h 3m
- Simulations
- 4
Included in Data Analytics: Statistics & Data Visualization · $9
Tools you'll use
Python
pandas
NumPy
Skills
- Experiment design
- Sample sizing
- Sample ratio mismatch
Try it now — free
This is the real simulation from the module. No account needed.
What you will be able to do
- Design an A/B test with the right metric and sample size
- Spot an experiment whose result cannot be trusted
Before you start
A suggestion, never a lock — you can start here.
- sampling-and-hypothesis-testing
Modules that help first
Syllabus
4 lessons · 1h 3mEvery lesson's title and summary is public. The lessons themselves open once you own the track.
Every lesson in Data Analytics: Statistics & Data VisualizationDesigning an Experiment
16 minHypotheses, primary metrics, guardrail metrics and the unit of randomisation — the decisions to make before a single visitor enters the experiment.
Included with the track SimulationSample Size and Duration
15 minThe minimum detectable effect decides how many visitors you need, and the calendar decides how long — always in full weeks.
Included with the track SimulationAnalysing A/B Test Results
17 minA proportion test, a confidence interval for the difference, continuous guardrail metrics, and how to report the result to the people who have to decide.
Included with the track SimulationA/B Testing Pitfalls
15 minPeeking, sample ratio mismatch, novelty effects and too many metrics — four habits that feel reasonable and make a tidy experiment give the wrong answer.
Included with the track Simulation
Lifetime access
$9More in Data Analytics: Statistics & Data Visualization
Module · Beginner
Bayesian
How to invert a probability, and why a 99%-accurate test can be wrong nine times in ten.
- 1 lesson
- 18 min
- 1 simulation
Included in Data Analytics: Statistics & Data Visualization· $9
Module · Beginner
Sampling & Hypothesis Testing
Why sample means behave so predictably, what a p-value really means, and how much data you need.
- 3 lessons
- 58 min
- 5 simulations
Included in Data Analytics: Statistics & Data Visualization· $9
Module · Intermediate
Regression for Analysts
Reading coefficients, controlling for confounders, and checking whether a regression can be trusted.
- 3 lessons
- 49 min
- 4 simulations
Included in Data Analytics: Statistics & Data Visualization· $9