Copying bestsellers is survivorship bias: Browsing what sells shows you the winners only. The near-identical products that failed are invisible, which makes any pattern you spot from that view unreliable.
Read the full article below for detailed insights and actionable strategies.
The attribution problem
One sale. Four channels. 400% credit claimed.
Reported revenue: €400 · Actual revenue: €100 · Gap: €300
You are looking at a filtered list and drawing conclusions as though it were the whole population. That is the error, and it has a name.
The shape of it
You browse bestsellers. You notice a pattern. You conclude the pattern causes sales.
Missing from the view: every product sharing that pattern which did not sell. If there were a hundred of those, the pattern is not a success factor, it is just a common thing to try.
Why this specific version is so persistent
The advice to study what sells is good advice, right up to the point where it becomes a theory of causation. Studying winners is a fine way to generate hypotheses. It is a poor way to test them, and the step between the two is usually skipped entirely.
What the filtered view cannot show you
| You can see | You cannot see |
|---|---|
| Which products sold well | How many similar ones did not |
| What winners have in common | Whether losers had it too |
| The current top of the list | What the traffic behind it was |
| That a category is busy | Whether it is busy because it works |
Row two is the whole argument. A feature shared by every winner and also by every loser explains nothing.
The correction
Look at the losers. On most platforms you can see products with few or no reviews in the same category, and that is your comparison group. If the pattern you spotted is equally present there, you have learned something genuinely useful and saved yourself a launch.
That comparison is crude and it is still enormously better than reading the winners alone.
Then test rather than infer
Once a hypothesis survives the loser check, isolate it. Vary one element across a batch and read the interval.
A causal read on a Google Analytics export applies the same logic on the channel side: an estimate, a confidence interval, a coverage share, and a label for what could not be resolved. 99 euro once, refunded if it does not move a budget decision. The interactive demo shows it with no signup.
Related answers
Key Terms in This Article
Analytics
Analytics is the systematic computational analysis of data. It reveals customer behavior and measures campaign performance.
Attribution
Attribution identifies user actions that contribute to a desired outcome and assigns value to each. It reveals which marketing touchpoints drive conversions.
Causality
Causality is the relationship where one event directly causes another, essential for identifying specific actions that drive desired outcomes in marketing.
Causation
Causation is the relationship where a change in one variable directly causes a change in another.
Confidence Interval
Confidence Interval is a statistical range of values that likely contains the true value of a metric. In marketing analytics, it quantifies uncertainty around estimates, indicating the precision of an outcome or causal effect.
Google Analytics
Google Analytics is a web analytics service that tracks and reports website traffic.
Product Page
Product Page is a webpage dedicated to a single product. It includes images, descriptions, pricing, and purchase options.
Related Articles
Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.
Ready to see your real numbers?
Own the budget? Upload your GA4 export and see which channels drive incremental sales, with confidence intervals, in minutes. Have to defend it? Start with the live demo and take the read to your CFO.
Full refund if you don't see value.
Stay ahead of the attribution curve
Weekly insights on marketing attribution, incrementality testing, and data-driven growth. Written for the person who owns the budget and the person who has to defend it.
No spam. Unsubscribe anytime. We respect your data.
Frequently Asked Questions
What is survivorship bias in product research?
Drawing conclusions from a list of winners while the failures that shared the same features are invisible. A pattern common to every winner and also to every loser explains nothing.
Is studying bestsellers useless then?
No. It is a good way to generate hypotheses and a poor way to test them. The error is skipping the step between the two.
How do I check for survivorship bias cheaply?
Look at products in the same category with few or no reviews. If the pattern you spotted is equally present there, it is not a success factor, and you have saved yourself a launch.