Skip to content
Skills
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Problems
Questions
Drills
Roles
Skills
Interview
Contest
Leaderboard
Home
/
Data Scientist
/
Questions
/
A/B Testing
Data Scientist
A/B Testing questions
12 questions on A/B Testing for data scientists, easiest first.
Medium
6
Sample size for a smaller effect
medium
Reading a 95% confidence interval
medium
Testing 20 metrics at once
medium
Users needed to detect a 1 point lift
medium
A lift that fades after week one
medium
PM wants to ship an unclear win
medium
Hard
6
Checking results every day
hard
Unexpected group sizes
hard
Using pre-experiment data
hard
Click-through rate standard errors
hard
Treated drivers take control rides
hard
Big effect in one segment
hard
