QR Incrementality Benchmarks Explained

What benchmarks can and cannot do

Incrementality asks whether QR-driven conversions would have happened anyway. It is the hardest and most honest question in QR measurement, because a scan that merely replaces a typed URL adds no new value.

Benchmarks for incrementality are tempting because they promise a shortcut: one number that tells you whether you are doing well. In practice, a benchmark is only as useful as its definition, and definitions vary widely. One source may count every scan, another may count only unique scanners, and a third may measure a different placement type entirely. Two benchmarks that disagree are not a puzzle to solve; they are a signal that the underlying measurements differ. Treat any benchmark as a rough reference, never as a verdict.

Why benchmarks for incrementality vary

Benchmarks vary for reasons that have nothing to do with quality. Placement changes everything: a code at a checkout behaves differently from a code on a poster. Audience matters too: existing customers scan for different reasons than strangers do. Offer strength, season, device mix, and time of day all shift the number. Even the definition shifts it: changing the denominator or the time window changes the result without changing the campaign at all. Incrementality tests are expensive to run well and cheap to get wrong. A sloppy holdout is worse than no holdout.

This variation is why copying a published benchmark as a target is risky. You may be comparing your menu code against someone else's checkout code, or your first month against their twelfth. The gap you see may be a measurement gap, not a performance gap, and chasing it can lead you to fix things that were never broken.

How to build your own baseline

Your own baseline is the benchmark that matters most, because it shares your definition, your placements, and your audience. Build it in four steps. First, write down the definition: Incremental conversions = conversions in the exposed group minus conversions in a comparable holdout group. Incremental lift = incremental conversions divided by holdout conversions, multiplied by 100. Second, measure it for a fixed period on a stable placement and record the raw counts, the date range, and the method. Third, repeat the measurement for two or three more comparable periods. Fourth, use the range you observed as your baseline, not a single point, because a range respects normal variation.

Illustrative example numbers, not real-world data: an exposed group produces 45 conversions and a comparable holdout group produces 30, giving 45 - 30 = 15 incremental conversions and 15 / 30 x 100 = 50% incremental lift in this example.

Once the baseline exists, judge new results against it. A result inside the baseline range is normal variation. A result outside the range for two consecutive periods is a signal worth investigating. This approach is slower than copying a published number, but it is honest, and it improves as your own history grows.

Comparing fairly

When you do compare against an external figure, check four things: the definition, the placement type, the audience, and the period. If any of them differ materially, adjust your expectations or skip the comparison. Compare like with like, and note the differences in writing so the next person who reads the comparison understands its limits. Also remember that benchmarks describe a group, not a promise: being below a benchmark does not prove failure, and being above it does not prove excellence.

Putting this into practice

Pick one placement and build a baseline for incrementality over the next four comparable periods. Record the definition, the raw counts, and the method alongside every reading. At the end of the four periods, write down the baseline range and the one improvement you will test next. From then on, every new reading gets judged against your own baseline first and against external figures only as a secondary check.

Common mistakes to avoid

- Treating every scan as incremental by default. - Running a holdout in a different season and calling the gap causal. - Treating a published benchmark as a target without checking its definition. - Comparing placements with different audiences and calling the gap a performance gap. - Freezing a baseline forever instead of updating it each quarter.

Quick checklist

- Write the definition down before comparing anything. - Build your own baseline from three or more comparable periods. - Use a range, not a single point, as the baseline. - Check definition, placement, audience, and period before using an external figure. - Update the baseline each quarter. - Judge two consecutive out-of-range readings as a signal, not one.

Related tools and guides

- Model the numbers before you commit with the [QR analytics simulator](/qr-analytics-simulator), which shows every formula behind the projection. - Plan goals, placements, quantities, and QA with the [QR campaign planner](/qr-campaign-planner) before the first print run. - Keep a simple record of your own observations with the [QR scan log](/qr-scan-log) so field notes are not lost. - Tag every destination consistently with the [UTM builder](/utm-builder) so each scan can be traced to its placement. - Review placement, height, and lighting in the [QR placement guide](/qr-placement-guide) before moving any code. - Check proofs under real conditions with the [printed QR tester](/printed-qr-tester) before a full run. - The [blog](/blog) collects more guides on sizing, printing, security, and measurement for QR codes.