How big must the test be?

Your baseline conversion rate is 2% and you want to detect a 10% relative lift (to 2.2%) with 80% power and 95% significance. Roughly how many visitors do you need per variant?

Rule of thumb: n per variant = 16 x p x (1 - p) / (difference)^2