Decide the Sample Size Before the Test
A test judged too early is a coin flip dressed as data. The sample-size formulas used here turn your ambition — how small an improvement you need to detect, and how sure you want to be — into a concrete number of scans. The honest trade-off is that small effects need large samples: if the required sample exceeds the traffic the placement will ever get, the test cannot answer the question, and you should either accept a larger detectable effect or pick a busier placement.
After the test
Run to the planned size, then judge the result with a significance test on the final numbers — do not re-decide the sample size mid-test based on interim results.
