hard20 pts · first answer countsexperimentationproduct-metrics

Do the wins add up

Over a year, your team shipped 15 A/B test winners, each with a 2% to 5% lift in engagement. Yet overall engagement is flat. What is the best way to measure the true combined effect going forward?

A.Add up all the lifts to report about 50% growthB.Stop running experimentsC.Keep a long-term holdout group that does not get the shipped changes, and compare it with everyone else over monthsD.Rerun every old test once

Discussion 0

Join free to post in the discussion.

Do the wins add up

Discussion 0

Related questions