For help with the Hypothesis Kit and Power Analysis click here.
Learn more about A/B testing and hypothesis-driven experimentation with the A/B Sensei, click here!
Based on [quantitative/qualitative insight].
We predict that [product change] will cause [impact].
We will test this by assuming the change has no effect (the null hypothesis) and running an experiment for [X week(s)].
If we can measure a Y% statistically significant change in [metric] then we reject the null hypothesis and conclude there is an effect.
Experimentation Hub was created by Rik Higham, who is a Senior Product Manager at Skyscanner.
Read Rik's Medium posts on experimentation and Product Management here.
Copyright © Rik Higham 2016 - 2017
The Hypothesis Kit was developed by Rik Higham and Colin McFarland, with contributions from David Pier, Lukas Vermeer, Ya Xu and Ronny Kohavi. “Design like you’re right, test like you’re wrong” props to Jane Murison and Karl Weick. Original Hypothesis Kit from Craig Sullivan.
Power analysis calculation based on Experiment Calculator by Dan McKinley, adapted by Rik Higham.