hard20 pts · first answer countsab-testingstatistics
Detecting a small lift
Your baseline conversion is 5%. You want to detect a 0.25 percentage-point absolute lift instead of a 1 point lift, with the same power and significance. Roughly how does the needed sample size change?