This Course Covers	This Course Doesn't Cover
Deciding what's worth testing	Which testing tool to buy
Writing hypotheses and choosing metrics	Implementing the split yourself
Sample size and duration in plain language	The underlying statistical theory
Reading results, including flat and negative ones	Bayesian vs frequentist debates
The six ways tests mislead you	Multi-armed bandits and adaptive allocation
When not to test at all	Experiment platform architecture

One running example throughout: a meal-kit subscription company. Around 180,000 active subscribers, roughly 40,000 people a week reaching the signup funnel, and a weekly conversion rate from landing page to first order of about 3.2%. Those numbers get used repeatedly, so you can follow the arithmetic.

A/B Testing for Product Managers

Module 1Why Most A/B Tests Waste Three Weeks

Module 2Is This Even Worth Testing?

Module 3Writing a Hypothesis You Can Be Wrong About

Module 4Choosing the Metric

Module 5How Long It Needs to Run

Module 6Running It Without Ruining It

Module 7Reading the Result

Module 8Deciding and Shipping

Module 9The Six Ways Tests Lie

Module 10When A/B Testing Is the Wrong Tool

Module 11Final Project: Design, Run and Report One Real Test

Module 12Appendix: The Prompt Library

Module 13Glossary: Words Explained

What This Course Covers