Attribution Vendors That Explain Their Methodology Openly
Open does not mean the code is public. It means the vendor states what the model assumes, whether the number is experimental or observational, what the interval is, which of your channels it cannot measure, and what it would report if your ads did nothing.
€99 once, excl. VAT. Full refund within 30 days, no questions asked. You keep the read.
By Joris van Huët, Founder & CEOUpdated 5 min read
An attribution vendor explains its methodology openly when it states, in writing you can read before you buy, what the model assumes, whether each number is experimental or observational, what the confidence interval is, which of your channels it cannot measure at your spend, and what it would report if your advertising had no effect at all. A black box is any vendor that answers those with an accuracy percentage instead. The Price of Being Found audited the public materials of 31 commercial measurement vendors between 14 August and 2 September 2026 and found none with a published validation against randomised experiments, which is the reason the questions matter more than the marketing.
What open actually means
Open is not open source. No commercial vendor publishes its estimator, and none needs to. Open means the four properties of a defensible number are visible on the vendor's own pages and in its reports:
- The source of the number, and whether that source sells you media.
- The coverage: how much of your real orders the data could see.
- The design: experimental, quasi-experimental, or observational, and if observational, labelled as a description rather than a causal claim.
- The interval, and the smallest effect the design could have detected.
A vendor that shows all four on a sample report is explaining its methodology. A vendor that shows a single confident number per channel is not, whatever the method behind it.
| Property | Disclosed looks like | Withheld looks like |
|---|---|---|
| Source | The named system, and whether it sells you media | "Our AI model" |
| Coverage | A share of your real orders, computed and shown | Not mentioned at all |
| Design | Experimental, quasi-experimental or observational, labelled | "Data-driven" |
| Interval | A range on every estimate, plus the smallest detectable effect | One confident number per channel |
The thirteen questions
The book's list is addressed to any vendor, including this site's publisher. The ones that separate open from opaque fastest:
- What is my minimum detectable effect under your design, with my data, before we start?
- Have you validated this method against randomised experiments on real data, not simulated, not backtested? Show the study, the sample, and the discrepancies.
- What is my coverage, the share of my true conversions your system observes, and how did you compute it?
- When your number disagrees with my commerce platform's orders, which is wrong, and how would we find out?
- Does your estimate come from a model fitted on observational data, on experimental data, or both?
- Is there an LLM anywhere in the causal estimate, as opposed to the presentation of it?
- What result would this system produce if my advertising had no effect at all? Have you tested that?
- What is the confidence interval, not the point estimate?
- Which of my channels are not measurable at my current spend, on your method?
- What would falsify your model?
The book's note on the measurability question: a vendor who says all of your channels are measurable has just failed it. Ask your attribution vendor for a placebo test covers the placebo question in depth, and how to vet an attribution vendor before you sign turns the list into a checklist.
Why "AI-powered" is not an answer to any of them
Two of the largest vendors of measurement tooling are the platforms themselves, and their own documentation is instructive. The book quotes Google's Meridian page on assessing a fitted model: directly validating the quality of causal inference is difficult and requires well-designed experiments, and since you are using an MMM, experiments are likely not practical. A method that cannot be validated by its own documentation is not made more open by a machine-learning label. The same applies to any vendor whose estimate comes from a model fitted on observed journeys: the better it fits, the more faithfully it may be reproducing the platform's targeting rather than the advertising's effect, which is the selection trap the Facebook experiments the book quotes demonstrated.
An LLM in the presentation layer is fine and useful. An LLM in the estimate is a question mark, and the honest vendor says which it is.
What this site publishes, for comparison
Causality Engine's method is causal inference, counterfactual estimation on aggregated first-party data, and it is not machine-learning attribution and not an LLM.
What to do this week
- If you have to defend the number: send the ten questions above to your current vendor in writing. Answers that exist in September are a specification; answers that arrive with the December report are a rationalisation.
- If you own the budget: ask only the measurability question. The list you get back is the list of channels the vendor is currently describing with false precision.
As of 9 September 2026. The 31-vendor audit, the vendor questions and the Meridian quotation are from The Price of Being Found (Edition 2.10), Chapter 17, with the book's stated limitations: the audit covered public materials only.
Frequently asked questions
What does it mean for an attribution vendor to be transparent?
That the four properties of a defensible number are visible before you buy: where the number comes from, the coverage of the data, whether the design is experimental or observational, and the interval with the smallest detectable effect. A single confident number per channel is not transparency, whatever the method.How do I tell a black-box attribution model from an open one?
Ask the placebo question: what would the system report if my advertising had no effect at all, and has that been tested? Then ask which of your channels are not measurable at your spend. A vendor that answers both with a list and a test is open; one that answers with an accuracy percentage is not.Has any attribution vendor validated its model against experiments?
The Price of Being Found audited 31 commercial measurement vendors' public materials between 14 August and 2 September 2026 and found no published validation against randomised experiments with a disclosed sample, design and discrepancies. The book notes this is a finding about public materials on those dates.
Go deeper: Causal attribution, explained.
Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.
Have an audience of ecommerce operators? Earn 20% recurring commission by recommending the €99 read.
Keep reading
Terms in this article
- AttributionAttribution identifies user actions that contribute to a desired outcome and assigns value to each. It reveals which marketing touchpoints drive conversions.
- Causal InferenceCausal inference is the set of methods for estimating how much an outcome changes because of a cause, rather than alongside it. It works by comparing what happened with an estimate of what would have happened without the cause.
- CausalityCausality is the relationship where one event directly causes another, essential for identifying specific actions that drive desired outcomes in marketing.
- Confidence IntervalConfidence Interval is a statistical range of values that likely contains the true value of a metric. In marketing analytics, it quantifies uncertainty around estimates, indicating the precision of an outcome or causal effect.
- ConversionConversion is a specific, desired action a user takes in response to a marketing message, such as a purchase or a sign-up.
- CounterfactualA counterfactual is what would have happened under conditions that did not occur, such as a customer's outcome had they not received the campaign they did receive. It is never observed, so every effect estimate has to stand in for it with a control group, comparable units or a forecast.
- ExperimentsExperiments are scientific procedures that test hypotheses or demonstrate facts. In marketing, experiments like A/B tests determine the causal effect of campaign changes, enabling data-driven decisions.
- Quasi-ExperimentA quasi-experiment estimates the causal impact of an intervention without random assignment. It applies when random assignment is not feasible or ethical.