Back to Resources

ROAS & Incrementality

14 min readJoris van Huët

The Incrementality Playbook for Shopify Brands Spending 100K per Month

Your Shopify store is spending 100k per month on ads, but is it driving growth? Learn to measure incrementality in Shopify and unlock true ROI.

Quick Answer·14 min read

The Incrementality Playbook for Shopify Brands Spending 100K per Month: Your Shopify store is spending 100k per month on ads, but is it driving growth? Learn to measure incrementality in Shopify and unlock true ROI.

Read the full article below for detailed insights and actionable strategies.

You are spending €100,000 per month on ads. Your Meta dashboard shows a 4.5x ROAS, Google Analytics reports a 3.2x, and Shopify revenue is... well, not 4.5x your ad spend. You are stuck in an attribution black box, a vortex of conflicting data where every platform claims credit for the same sale. You are burning cash, but you cannot prove which half of your budget is being wasted. Scaling past this point feels like gambling. Your competitors in the Dutch beauty market seem to be scaling effortlessly, leaving you wondering what they know that you do not.

This is the reality for most Shopify brands that hit the €100k/month ad spend ceiling. You have refined your creatives, perfected your targeting, and A/B tested your landing pages. Yet, true growth remains elusive. The problem is not your marketing execution. The problem is your measurement. You are using a broken compass: last-click marketing attribution.

Imagine a different reality. You open your dashboard and see a single, unified view of your marketing performance. You know with 95% accuracy the exact number of incremental sales each channel, campaign, and ad generated. You see that your TikTok prospecting campaign, despite a low 1.8x ROAS in Meta's dashboard, is actually your most profitable top-of-funnel investment, creating causality chains that lead to high-value purchases on Meta and Google 2 weeks later. You discover that 40% of your branded search budget is cannibalistic, capturing sales that would have happened anyway. You reallocate that wasted spend to a new influencer campaign, and your incremental revenue jumps by 22% the next month. You are no longer guessing. You are making decisions with causal, not correlational, data. You have moved beyond attribution and into the world of behavioral intelligence.

This transformation is not a fantasy. It is the direct result of shifting from a broken measurement model to a causal one. The bridge is incrementality. This playbook provides the exact steps for Shopify brands spending over €100,000 per month to cross it.

The ROAS Illusion: Why Your Platforms Are Lying

The ROAS illusion is the misinterpretation of marketing performance due to self-serving attribution models from ad platforms like Meta and Google. Unlike true performance analysis, this illusion inflates ROAS by claiming credit for sales that would have happened anyway, leading to wasted ad spend. This matters for ecommerce brands because it creates a false sense of security and prevents sustainable, profitable scaling.

The core problem is that every ad platform from Meta to Google is financially incentivized to take as much credit as possible for your sales. They use self-serving, last-click attribution models that ignore the complex, cross-channel reality of a customer's journey. A customer sees your TikTok ad, gets retargeted on Instagram, Googles your brand name, and then clicks a search ad. Every platform shouts, "This sale was mine!" The result is attribution overlap, where the sum of your channel-reported revenues far exceeds your actual revenue.

This leads to a dangerous misinterpretation of performance. A branded search campaign might report a 15x ROAS, but a high percentage of those customers were already coming to your site. They would have bought anyway. This is a cannibalistic channel, and every euro you spend on it is wasted. The true impact, the incremental sales, is close to zero. Your reported ROAS is a vanity metric. The formula you think you are using is:

Revenue / Ad Spend = ROAS

But the real, hidden formula is:

(Incremental Revenue + Self-Attributed Revenue) / Ad Spend = Inflated ROAS

Your entire budget allocation is based on this lie. You pour money into channels with high reported ROAS, unknowingly starving the channels that actually introduce new customers to your brand. This is the very definition of the [/blog/roas-trap-high-roas-low-value](ROAS trap). You can see how different [/tools/attribution-models](attribution models) contribute to this problem.

The Incrementality Playbook: Three Methods to Measure True Impact

The Incrementality Playbook is a set of three methods grounded in causal inference to measure the true impact of marketing spend. Unlike relying on misleading platform-reported ROAS, this playbook uses controlled experiments to isolate the actual incremental sales generated by your campaigns. For Shopify brands, this means moving from guesswork to scientific budget allocation and unlocking profitable growth.

To break free from the ROAS illusion, you must adopt a measurement framework grounded in causal inference. This means running controlled experiments to isolate the true, incremental impact of your marketing. For a Shopify brand spending €100k per month, three methods are essential. These are not mutually exclusive; they work together to create a complete picture of your marketing effectiveness.

1. The Control Group Holdout Test

This is the gold standard for measuring incrementality. It is the application of the scientific method to your marketing. The concept is simple: you create a small, statistically significant group of customers who are held back from seeing a specific ad campaign. Everyone else (the test group) sees the ads as normal. After the campaign, you compare the purchasing behavior of the two groups. The difference in conversion rate is your incremental lift.

For example, to measure the true impact of your Meta retargeting campaign, you would create a 10% holdout group. This group is randomly selected from your retargeting audience but is excluded from seeing the ads. After 30 days, you might find:

  • Test Group (90%): 5.2% conversion rate

  • Holdout Group (10%): 3.8% conversion rate

The incremental lift from your retargeting campaign is 1.4% (5.2% - 3.8%). This is the real impact. Any conversions from the holdout group represent people who would have purchased anyway. This is a powerful way to run a [/blog/holdout-test-meta-ads](holdout test on Meta ads) without significant revenue risk. For a deeper dive into the methodology, Harvard Business Review's article on A/B testing provides a solid foundation.

2. The Geo-Lift Test

Holdout tests are powerful but can be complex to set up for channels that lack granular audience controls. This is where geo-lift testing comes in. This method is particularly effective for channels like TikTok, podcasts, or out-of-home advertising where you cannot create user-level control groups.

In a geo-lift test, you divide your market into similar regions. In the Netherlands, you might group Amsterdam and Rotterdam as the test markets, and Utrecht and The Hague as the control markets. You then run your campaign only in the test markets. By measuring the difference in sales lift between the test and control regions, you can isolate the campaign's incremental impact. This is a core technique detailed in our guide to [/blog/geo-lift-testing-ecommerce](geo-lift testing for ecommerce).

This method requires careful selection of matched markets to ensure the results are valid, but it is one of the few ways to measure the impact of broad-reach channels. As explained by Sellforte, causal inference methods like these are essential for measuring true incremental impact.

3. Causal Modeling with a Behavioral Intelligence Platform

While holdout and geo-lift tests are powerful, they are periodic and do not provide a continuous, real-time view of performance. This is the role of a behavioral intelligence platform like Causality Engine. Our platform uses causal inference to analyze all your data streams—from Shopify sales data to ad platform APIs—and build a complete model of your customer behavior.

Instead of relying on cookies or last-click attribution, our engine identifies the causality chains that lead to purchase. It understands how a view of a TikTok ad influences a Google search three days later, and how that search contributes to a final purchase. It quantifies the incremental lift of every single marketing activity, continuously and automatically. This is not another attribution tool; it is a causal inference engine that provides a single source of truth for your marketing performance. It moves you from asking "What happened?" to understanding "Why did it happen?" Causality Engine is a behavioral intelligence platform that uses causal inference to replace broken marketing attribution for ecommerce brands.

Putting the Playbook into Action

Putting the playbook into action means shifting from a passive reliance on flawed metrics to an active, scientific approach to growth. Unlike the conventional method of chasing platform-reported ROAS, this action plan provides a structured, 30-day framework to implement causal measurement. For ambitious ecommerce brands, this is the definitive path to breaking growth plateaus and achieving a true, sustainable competitive advantage.

Adopting an incrementality mindset is a cultural shift. It requires moving away from the dopamine hit of platform-reported ROAS and embracing a more rigorous, scientific approach to growth. The window of opportunity to gain a competitive advantage with this methodology is closing. Your competitors are either already using these techniques or will be soon. The top-performing Dutch Shopify brands are not guessing; they are using causal inference to build a sustainable growth engine.

Here is your 30-day action plan:

  1. Week 1: Run Your First Holdout Test. Start with your highest-spending retargeting campaign on Meta. Create a 10% holdout audience and run the test for 14 days. Measure the difference in conversion rate. This is your first taste of true incremental lift.

  2. Week 2: Identify Your Biggest Cannibalistic Channel. Analyze your branded search campaigns. What percentage of that traffic would have come to your site anyway? A simple way to estimate this is to pause a campaign for a short period and measure the drop in direct and organic traffic. This will give you a sense of the overlap. You can also use our [/tools/waste-calculator](waste calculator) to quantify the damage.

  3. Week 3: Explore Causal Inference. You do not need a Ph.D. in statistics to understand the fundamentals. Brady Neal’s free online course, Introduction to Causal Inference, is an excellent starting point for any marketer serious about understanding true impact. This is the foundation of modern marketing measurement, and our [/blog/causal-inference-marketers-guide](guide for marketers) provides a practical overview.

  4. Week 4: Unify Your Data. The final step is to move beyond periodic tests and adopt a continuous measurement platform. Causality Engine is built for this purpose. We connect to all your data sources and provide a single, causal view of your marketing performance. No more conflicting dashboards. No more wasted ad spend. Just a clear, actionable path to profitable growth. Get started with our developer quickstart guide.

Frequently Asked Questions

What is incrementality in Shopify?

Incrementality in Shopify refers to the measurement of sales that are a direct result of a specific marketing activity. It isolates the impact of your ads from sales that would have occurred organically. For Shopify brands, it is the most accurate way to measure the true return on ad spend (ROAS) and make profitable budget decisions.

How do I measure ecommerce incrementality?

You can measure ecommerce incrementality through several methods. The most common are holdout tests, where you exclude a control group from seeing an ad, and geo-lift tests, where you run a campaign in specific geographic locations and compare the sales lift to control locations. For continuous measurement, a causal inference platform can model the incremental lift of all your marketing activities in real-time.

Why is Shopify attribution so difficult?

Shopify attribution is difficult because the modern customer journey is complex and fragmented across multiple channels and devices. Ad platforms use self-serving, last-click attribution models that fail to capture this complexity, leading to conflicting data and an inaccurate picture of marketing performance. True attribution requires moving beyond platform-reported metrics and embracing causal measurement.

What is the difference between incrementality and ROAS?

Incrementality measures the causal impact of your ads, telling you how many sales would not have happened without them. ROAS, as reported by ad platforms, simply divides revenue by ad spend, often including sales that were not caused by the ads. Incrementality provides a true measure of marketing effectiveness, while platform ROAS is an inflated vanity metric.

How can Causality Engine help with incrementality measurement?

Causality Engine automates and standardizes incrementality measurement across your entire marketing mix. Our behavioral intelligence platform uses causal inference to provide a continuous, real-time view of the incremental sales generated by each channel, campaign, and ad. This eliminates the need for manual, periodic tests and provides a single source of truth for profitable growth. Causality Engine is a behavioral intelligence platform that uses causal inference to replace broken marketing attribution for ecommerce brands.

See your true ROAS.


{

"@context": "https://schema.org",

"@graph": [

{

"@type": "Organization",

"@id": "https://causalityengine.ai/#organization",

"name": "Causality Engine",

"url": "https://causalityengine.ai",

"logo": {

"@type": "ImageObject",

"url": "https://causalityengine.ai/logo.png"

}

},

{

"@type": "BreadcrumbList",

"itemListElement": [

{

"@type": "ListItem",

"position": 1,

"name": "Home",

"item": "https://causalityengine.ai"

},

{

"@type": "ListItem",

"position": 2,

"name": "Blog",

"item": "https://causalityengine.ai/blog"

},

{

"@type": "ListItem",

"position": 3,

"name": "ROAS + Incrementality",

"item": "https://causalityengine.ai/blog/category/roas-incrementality"

},

{

"@type": "ListItem",

"position": 4,

"name": "The Incrementality Playbook for Shopify Brands Spending 100K per Month"

}

]

},

{

"@type": "Article",

"mainEntityOfPage": {

"@type": "WebPage",

"@id": "https://causalityengine.ai/blog/incrementality-playbook-shopify-100k"

},

"headline": "The Incrementality Playbook for Shopify Brands Spending 100K per Month",

"description": "Your Shopify store is spending 100k per month on ads, but is it driving growth? Learn to measure incrementality in Shopify and unlock true ROI.",

"image": "https://causalityengine.ai/blog/incrementality-playbook-shopify-100k.jpg",

"author": {

"@id": "https://causalityengine.ai/#organization"

},

"publisher": {

"@id": "https://causalityengine.ai/#organization"

},

"datePublished": "2026-02-23",

"dateModified": "2026-02-23",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#the-incrementality-playbook-for-shopify-brands-spending-100k-per-month + p"

]

}

},

{

"@type": "FAQPage",

"mainEntity": [

{

"@type": "Question",

"name": "What is incrementality in Shopify?",

"acceptedAnswer": {

"@type": "Answer",

"text": "Incrementality in Shopify refers to the measurement of sales that are a direct result of a specific marketing activity. It isolates the impact of your ads from sales that would have occurred organically. For Shopify brands, it is the most accurate way to measure the true return on ad spend (ROAS) and make profitable budget decisions.",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#what-is-incrementality-in-shopify + p"

]

}

}

},

{

"@type": "Question",

"name": "How do I measure ecommerce incrementality?",

"acceptedAnswer": {

"@type": "Answer",

"text": "You can measure ecommerce incrementality through several methods. The most common are holdout tests, where you exclude a control group from seeing an ad, and geo-lift tests, where you run a campaign in specific geographic locations and compare the sales lift to control locations. For continuous measurement, a causal inference platform can model the incremental lift of all your marketing activities in real-time.",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#how-do-i-measure-ecommerce-incrementality + p"

]

}

}

},

{

"@type": "Question",

"name": "Why is Shopify attribution so difficult?",

"acceptedAnswer": {

"@type": "Answer",

"text": "Shopify attribution is difficult because the modern customer journey is complex and fragmented across multiple channels and devices. Ad platforms use self-serving, last-click attribution models that fail to capture this complexity, leading to conflicting data and an inaccurate picture of marketing performance. True attribution requires moving beyond platform-reported metrics and embracing causal measurement.",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#why-is-shopify-attribution-so-difficult + p"

]

}

}

},

{

"@type": "Question",

"name": "What is the difference between incrementality and ROAS?",

"acceptedAnswer": {

"@type": "Answer",

"text": "Incrementality measures the *causal* impact of your ads, telling you how many sales would *not* have happened without them. ROAS, as reported by ad platforms, simply divides revenue by ad spend, often including sales that were not caused by the ads. Incrementality provides a true measure of marketing effectiveness, while platform ROAS is an inflated vanity metric.",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#what-is-the-difference-between-incrementality-and-roas + p"

]

}

}

},

{

"@type": "Question",

"name": "How can Causality Engine help with incrementality measurement?",

"acceptedAnswer": {

"@type": "Answer",

"text": "Causality Engine automates and standardizes incrementality measurement across your entire marketing mix. Our behavioral intelligence platform uses causal inference to provide a continuous, real-time view of the incremental sales generated by each channel, campaign, and ad. This eliminates the need for manual, periodic tests and provides a single source of truth for profitable growth. Causality Engine is a behavioral intelligence platform that uses causal inference to replace broken marketing attribution for ecommerce brands.",

"speakable": {

"@type": "SpeakableSpecification",

"cssSelector": [

"#how-can-causality-engine-help-with-incrementality-measurement + p"

]

}

}

}

]

}

]

}

Get attribution insights in your inbox

One email per week. No spam. Unsubscribe anytime.

Key Terms in This Article

Ready to see your real numbers?

Upload your GA4 data. See which channels drive incremental sales. Confidence-scored results in minutes.

Book a Demo

Full refund if you don't see it.

Stay ahead of the attribution curve

Weekly insights on marketing attribution, incrementality testing, and data-driven growth. Written for marketers who care about real numbers, not vanity metrics.

No spam. Unsubscribe anytime. We respect your data.

Ad spend wasted.Revenue recovered.