Skip to content

For GA4 usersFrustrated with GA4 attribution? Upload your GA4 export, see causal insights in 5–10 minutes for €99 pay-per-use.

Causal Inference

5 min read

Attribution Vendors That Explain Their Methodology Openly

Open does not mean the code is public. It means the vendor states what the model assumes, whether the number is experimental or observational, what the interval is, which of your channels it cannot measure, and what it would report if your ads did nothing.

Share
Quick Answer·5 min read

Attribution Vendors That Explain Their Methodology Openly: Open does not mean the code is public. It means the vendor states what the model assumes, whether the number is experimental or observational, what the interval is, which of your channels it cannot measure, and what it would report if your ads did nothing.

Read the full article below for detailed insights and actionable strategies.

The attribution problem

One sale. Four channels. 400% credit claimed.

100
1 sale
Meta
100%
claimed
Google
100%
claimed
TikTok
100%
claimed
Klaviyo
100%
claimed

Reported revenue: 400 · Actual revenue: 100 · Gap: €300

An attribution vendor explains its methodology openly when it states, in writing you can read before you buy, what the model assumes, whether each number is experimental or observational, what the confidence interval is, which of your channels it cannot measure at your spend, and what it would report if your advertising had no effect at all. A black box is any vendor that answers those with an accuracy percentage instead. The Price of Being Found audited the public materials of 31 commercial measurement vendors between 14 August and 2 September 2026 and found none with a published validation against randomised experiments, which is the reason the questions matter more than the marketing.

What open actually means

Open is not open source. No commercial vendor publishes its estimator, and none needs to. Open means the four properties of a defensible number are visible on the vendor's own pages and in its reports:

  1. The source of the number, and whether that source sells you media.
  2. The coverage: how much of your real orders the data could see.
  3. The design: experimental, quasi-experimental, or observational, and if observational, labelled as a description rather than a causal claim.
  4. The interval, and the smallest effect the design could have detected.

A vendor that shows all four on a sample report is explaining its methodology. A vendor that shows a single confident number per channel is not, whatever the method behind it.

The thirteen questions

The book's list is addressed to any vendor, including this site's publisher. The ones that separate open from opaque fastest:

  • What is my minimum detectable effect under your design, with my data, before we start?
  • Have you validated this method against randomised experiments on real data, not simulated, not backtested? Show the study, the sample, and the discrepancies.
  • What is my coverage, the share of my true conversions your system observes, and how did you compute it?
  • When your number disagrees with my commerce platform's orders, which is wrong, and how would we find out?
  • Does your estimate come from a model fitted on observational data, on experimental data, or both?
  • Is there an LLM anywhere in the causal estimate, as opposed to the presentation of it?
  • What result would this system produce if my advertising had no effect at all? Have you tested that?
  • What is the confidence interval, not the point estimate?
  • Which of my channels are not measurable at my current spend, on your method?
  • What would falsify your model?

The book's note on the measurability question: a vendor who says all of your channels are measurable has just failed it. Ask your attribution vendor for a placebo test covers the placebo question in depth, and how to vet an attribution vendor before you sign turns the list into a checklist.

Why "AI-powered" is not an answer to any of them

Two of the largest vendors of measurement tooling are the platforms themselves, and their own documentation is instructive. The book quotes Google's Meridian page on assessing a fitted model: directly validating the quality of causal inference is difficult and requires well-designed experiments, and since you are using an MMM, experiments are likely not practical. A method that cannot be validated by its own documentation is not made more open by a machine-learning label. The same applies to any vendor whose estimate comes from a model fitted on observed journeys: the better it fits, the more faithfully it may be reproducing the platform's targeting rather than the advertising's effect, which is the selection trap the Facebook experiments the book quotes demonstrated.

An LLM in the presentation layer is fine and useful. An LLM in the estimate is a question mark, and the honest vendor says which it is.

What this site publishes, for comparison

Causality Engine's method is proprietary causal inference, counterfactual estimation on aggregated first-party data, and it is not machine-learning attribution and not an LLM. The how it works page states the assumptions: complete and accurate spend and sales data, enough natural variation in the window to identify each channel's effect, and no unobserved external factor moving sales in lockstep with one channel. Every estimate carries an interval that widens where an assumption is uncertain, the read states which channels fall below its fit floor rather than inventing a number, and a methodology document is available on request. It is bound by the same audit finding as everyone else, and the placebo question applies to it too.

What to do this week

  • If you have to defend the number: send the ten questions above to your current vendor in writing. Answers that exist in September are a specification; answers that arrive with the December report are a rationalisation.
  • If you own the budget: ask only the measurability question. The list you get back is the list of channels the vendor is currently describing with false precision.

The interactive demo shows what a report with intervals, coverage and a stated design looks like on a sample store, with no signup.

As of 9 September 2026. The 31-vendor audit, the vendor questions and the Meridian quotation are from The Price of Being Found (Edition 2.10), Chapter 17, with the book's stated limitations: the audit covered public materials only.

Get attribution insights in your inbox

One email per week. No spam. Unsubscribe anytime.

Key Terms in This Article

Related Articles

Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.

Ready to see your real numbers?

Own the budget? Upload your GA4 export and see which channels drive incremental sales, with confidence intervals, in minutes. Have to defend it? Start with the live demo and take the read to your CFO.

Full refund if you don't see value.

Stay ahead of the attribution curve

Weekly insights on marketing attribution, incrementality testing, and data-driven growth. Written for the person who owns the budget and the person who has to defend it.

Which one are you? Optional.

No spam. Unsubscribe anytime. We respect your data.

Frequently Asked Questions

What does it mean for an attribution vendor to be transparent?

That the four properties of a defensible number are visible before you buy: where the number comes from, the coverage of the data, whether the design is experimental or observational, and the interval with the smallest detectable effect. A single confident number per channel is not transparency, whatever the method.

How do I tell a black-box attribution model from an open one?

Ask the placebo question: what would the system report if my advertising had no effect at all, and has that been tested? Then ask which of your channels are not measurable at your spend. A vendor that answers both with a list and a test is open; one that answers with an accuracy percentage is not.

Has any attribution vendor validated its model against experiments?

The Price of Being Found audited 31 commercial measurement vendors' public materials between 14 August and 2 September 2026 and found no published validation against randomised experiments with a disclosed sample, design and discrepancies. The book notes this is a finding about public materials on those dates.

Related reports

Real reports on this topic.

Anonymised reports from the Attribution Report Library tagged with causal inference.

Browse all related reports

Find your wasted ad spend in 5–10 minutes.

Watch the model work on a sample store first, no signup. Then upload your last 40–90 days of GA4 sessions and get incremental ROAS with confidence intervals. No pixel, no SDK. €99 per read.

Prefer to talk it through? Book a 20-min call, or read how it works.

Last-click guesses.We run the math.

Causal attribution for ecommerce brands. Watch the model work on a sample store first, then upload your GA4 export and see which channels really drove revenue in 5–10 minutes. €99, pay-per-use. Pro at €299/mo when you want it continuous.

No signup for the demo. Book a 20-min call or compare plans.