medium10 pts · first answer countsstatisticsab-testing

Reading a 95% confidence interval

An A/B test reports the lift in conversion as +3% with a 95% confidence interval of [+1%, +5%]. Which reading is best?

A.The plausible range for the true lift is about 1% to 5%, and because it excludes 0 the result is significant at the 5% levelB.There is a 95% chance the true lift is exactly 3%C.95% of users saw a lift between 1% and 5%D.The test must be rerun because the interval is too wide

← Average price across two stores False positive in an A/B test →