What is incrementality testing for a fashion store?
Hold ads back from some shoppers or regions and see how much sales drop. If you sell clothes, avoid sale weeks and launches and run the test longer than shoppers browse. Read the result again after returns, using net sales.
By Joris van Huët, Founder & CEOUpdated 5 min read
Run the numbers for your store: the free holdout test planner.
For a fashion store, incrementality testing usually means holding ads back from some shoppers or regions and checking how much sales drop. If you sell clothes, run it away from sales and launches and make it longer than your buyers browse. Judge it on sales after returns, not on orders the platform counts.
If you sell clothes and accessories
If you sell clothes, your calendar is crowded. Collections land, drops sell out, mid-season sales come and go, and each one moves sales whether or not an ad is running. Your shoppers may browse, compare sizes, leave and come back, sometimes on another device. A test has to fit between all of that.
Returns are the quiet problem. If shoppers order two sizes and send one back, an ad can lift orders without lifting the money you keep. Shopify books a return as negative sales on the date the order was returned, so a test's returns can land after the test has ended.
If your budget leans on retargeting and brand search, test those first. They sit closest to the sale, so they are best placed to collect sales that were coming anyway. Field experiments at eBay found brand-keyword ads had no measurable short-term benefits. eBay is a marketplace, not a fashion label, but the logic travels.
One store's export, read for timing
Below is one store's anonymised GA4 export, 1 January 2024 to 21 August 2026. It holds revenue shares only: no ad spend, no order counts. Nothing in the export says it sells clothes, so it is not a benchmark for fashion.
| What the export shows | Share of revenue | Source cell |
|---|---|---|
| Journeys with 1 touch (0.5 days to buy) | 79.5% | Journeys sheet, 1 touch row |
| Journeys with two or three touches (12.5 days to buy) | 12.2% | Journeys sheet, two to three touches row |
| Journeys with four to nine touches (16.9 days to buy) | 5.4% | Journeys sheet, four to nine touches row |
| Journeys with ten or more touches (16.0 days to buy) | 3.0% | Journeys sheet, ten or more touches row |
In this store, most revenue came from one-touch journeys, at 0.5 days to buy. Journeys with more touches took between 12.5 and 16.9 days in the Journeys sheet. If you sell clothes and your shoppers browse before they buy, your own gap could be longer still. A two-week test would close before many of them decide.
The export can't show returns, sizes or what any channel caused. Returns come from Shopify. Causes come from a test.
What changes for a fashion store?
Timing beats size. Pick a window with no sale, no drop and no peak in either group. A test that runs through a sale mostly measures the sale.
Count the sales you keep. Read the result twice: when the test ends, and again once your return window has passed. Shopify's sales reversals include the value of returned products, so net sales shows the money that stayed.
Fit the split to the channel. A regional go-dark suits channels that run everywhere, like brand search. Google's geo guide also says to watch for major regional launches during a test. For a fashion brand, that includes a pop-up or a new store in one region.
Mind the browsing gap. Google's minimum lift study is 7 days, and it typically recommends more than 14. Set the length from your own days to buy, not from habit.
What to do this week
- Find your return lag. In Shopify, go to Analytics, then Reports, and filter by the Sales category. Open Total sales over time, grouped by week. Pass: you can see how many weeks after a busy week the returns land. Fail: returns trickle in for months, so plan to read any test result late.
- Measure how long shoppers browse. In GA4, open Key event attribution paths under Advertising and read Days to key event for your last full-price month. Pass: your next quiet window is longer than that. Fail: no gap in your calendar is that long, so test one channel with a user-based study instead.
- Check your brand campaign can be tested. In Google Ads, open Campaigns, then Experiments, then the Lift studies tab. Select the plus button and choose Conversion Lift based on users. Pass: your brand search campaign shows as eligible. Fail: it shows as needs attention, meaning inactive, in another study or incompatible.
Check the homework. Your GA4 Attribution paths export already holds the evidence. Causality Engine reads that one file and shows what each channel caused next to what last-click gave it, in 1 to 2 minutes, for €99 once (excluding VAT), refundable within 30 days. Check the homework
Sources, 1 October 2026: Sales reports (Shopify Help Center). Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment (NBER). Implement campaigns for geo experiments (Google Ads Help). Set up Conversion Lift based on users (Google Ads Help). Key events attribution paths report (Analytics Help).
Related answers
Frequently asked questions
Should a fashion brand test retargeting first?
Usually, if retargeting takes a large share of your budget. It reaches people who already visited, so it is well placed to collect sales that were coming anyway. Hold it back from a random group or some regions and see whether total sales drop.Do returns change an incrementality test result?
They can. A test counts sales when they happen, and Shopify books a return on the date it is processed. If you sell clothes, read the result again after your return window closes, using net sales, so the lift reflects money you kept.Can I run an incrementality test during a sale?
You can, but it answers a narrower question: what ads add while a discount runs. A sale lifts both groups, and a promotion in only one group breaks the comparison. For a clean answer about everyday spend, test in a full-price window.
Go deeper: Causal attribution, explained.
Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.
Keep reading
Terms in this article
- AnalyticsAnalytics is the systematic computational analysis of data. It reveals customer behavior and measures campaign performance.
- AttributionAttribution identifies user actions that contribute to a desired outcome and assigns value to each. It reveals which marketing touchpoints drive conversions.
- ConversionConversion is a specific, desired action a user takes in response to a marketing message, such as a purchase or a sign-up.
- ExperimentsExperiments are scientific procedures that test hypotheses or demonstrate facts. In marketing, experiments like A/B tests determine the causal effect of campaign changes, enabling data-driven decisions.
- Google AdsGoogle Ads is an online advertising platform where advertisers bid to display ads, service offerings, and product listings.
- IncrementalityIncrementality measures the true causal impact of a marketing campaign. It quantifies the additional conversions or revenue directly from that activity.
- Incrementality TestingIncrementality Testing measures the additional impact of a marketing campaign. It compares exposed and control groups to determine causal effect.
- RetargetingRetargeting is online advertising that targets users who have previously interacted with your website or content. Attribution analysis shows the causal role of retargeting in driving conversions and improving ad spend.