Skip to content
Skills
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Data Analyst
/
Questions
/
A/B Testing
Data Analyst
A/B Testing questions
10 questions on A/B Testing for data analysts, easiest first.
Medium
4
What a p-value means
medium
Reading a 95% confidence interval
medium
False positive in an A/B test
medium
Relative lift of a variant
medium
Hard
6
Overall rate goes the other way
hard
Stopping a test early
hard
Detecting a small lift
hard
Uneven groups in a 50/50 test
hard
Lift that fades after week one
hard
Randomised by user, analysed by session
hard