Skip to content

Attribution Vendors That Explain Their Methodology Openly

Open does not mean the code is public. It means the vendor states what the model assumes, whether the number is experimental or observational, what the interval is, which of your channels it cannot measure, and what it would report if your ads did nothing.

€99 once, excl. VAT. Full refund within 30 days, no questions asked. You keep the read.

By , Founder & CEOUpdated 5 min read

An attribution vendor explains its methodology openly when it states, in writing you can read before you buy, what the model assumes, whether each number is experimental or observational, what the confidence interval is, which of your channels it cannot measure at your spend, and what it would report if your advertising had no effect at all. A black box is any vendor that answers those with an accuracy percentage instead. The Price of Being Found audited the public materials of 31 commercial measurement vendors between 14 August and 2 September 2026 and found none with a published validation against randomised experiments, which is the reason the questions matter more than the marketing.

What open actually means

Open is not open source. No commercial vendor publishes its estimator, and none needs to. Open means the four properties of a defensible number are visible on the vendor's own pages and in its reports:

  1. The source of the number, and whether that source sells you media.
  2. The coverage: how much of your real orders the data could see.
  3. The design: experimental, quasi-experimental, or observational, and if observational, labelled as a description rather than a causal claim.
  4. The interval, and the smallest effect the design could have detected.

A vendor that shows all four on a sample report is explaining its methodology. A vendor that shows a single confident number per channel is not, whatever the method behind it.

PropertyDisclosed looks likeWithheld looks like
SourceThe named system, and whether it sells you media"Our AI model"
CoverageA share of your real orders, computed and shownNot mentioned at all
DesignExperimental, quasi-experimental or observational, labelled"Data-driven"
IntervalA range on every estimate, plus the smallest detectable effectOne confident number per channel

The thirteen questions

The book's list is addressed to any vendor, including this site's publisher. The ones that separate open from opaque fastest:

  • What is my minimum detectable effect under your design, with my data, before we start?
  • Have you validated this method against randomised experiments on real data, not simulated, not backtested? Show the study, the sample, and the discrepancies.
  • What is my coverage, the share of my true conversions your system observes, and how did you compute it?
  • When your number disagrees with my commerce platform's orders, which is wrong, and how would we find out?
  • Does your estimate come from a model fitted on observational data, on experimental data, or both?
  • Is there an LLM anywhere in the causal estimate, as opposed to the presentation of it?
  • What result would this system produce if my advertising had no effect at all? Have you tested that?
  • What is the confidence interval, not the point estimate?
  • Which of my channels are not measurable at my current spend, on your method?
  • What would falsify your model?

The book's note on the measurability question: a vendor who says all of your channels are measurable has just failed it. Ask your attribution vendor for a placebo test covers the placebo question in depth, and how to vet an attribution vendor before you sign turns the list into a checklist.

Why "AI-powered" is not an answer to any of them

Two of the largest vendors of measurement tooling are the platforms themselves, and their own documentation is instructive. The book quotes Google's Meridian page on assessing a fitted model: directly validating the quality of causal inference is difficult and requires well-designed experiments, and since you are using an MMM, experiments are likely not practical. A method that cannot be validated by its own documentation is not made more open by a machine-learning label. The same applies to any vendor whose estimate comes from a model fitted on observed journeys: the better it fits, the more faithfully it may be reproducing the platform's targeting rather than the advertising's effect, which is the selection trap the Facebook experiments the book quotes demonstrated.

An LLM in the presentation layer is fine and useful. An LLM in the estimate is a question mark, and the honest vendor says which it is.

What this site publishes, for comparison

Causality Engine's method is causal inference, counterfactual estimation on aggregated first-party data, and it is not machine-learning attribution and not an LLM.

What to do this week

  • If you have to defend the number: send the ten questions above to your current vendor in writing. Answers that exist in September are a specification; answers that arrive with the December report are a rationalisation.
  • If you own the budget: ask only the measurability question. The list you get back is the list of channels the vendor is currently describing with false precision.

As of 9 September 2026. The 31-vendor audit, the vendor questions and the Meridian quotation are from The Price of Being Found (Edition 2.10), Chapter 17, with the book's stated limitations: the audit covered public materials only.

Frequently asked questions

  • What does it mean for an attribution vendor to be transparent?
    That the four properties of a defensible number are visible before you buy: where the number comes from, the coverage of the data, whether the design is experimental or observational, and the interval with the smallest detectable effect. A single confident number per channel is not transparency, whatever the method.
  • How do I tell a black-box attribution model from an open one?
    Ask the placebo question: what would the system report if my advertising had no effect at all, and has that been tested? Then ask which of your channels are not measurable at your spend. A vendor that answers both with a list and a test is open; one that answers with an accuracy percentage is not.
  • Has any attribution vendor validated its model against experiments?
    The Price of Being Found audited 31 commercial measurement vendors' public materials between 14 August and 2 September 2026 and found no published validation against randomised experiments with a disclosed sample, design and discrepancies. The book notes this is a finding about public materials on those dates.

Go deeper: Causal attribution, explained.

Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.

Have an audience of ecommerce operators? Earn 20% recurring commission by recommending the €99 read.

Keep reading

Terms in this article

Browse the full glossary

Your platforms guess.
We run the math.

Upload a GA4 export and see what each channel caused, next to last-click, in 1–2 minutes. The read is yours to keep.

The free finding runs in your browser. Your file never leaves it. The full read is €99, refundable within 30 days, no questions asked. Prices exclude VAT.