What a real-time alert is actually detecting
Take a firing alert apart and you find one of four causes. Only one is a change in your marketing, and it is not the most common.
Three platforms, three answers, one budget to defend. Your GA4 export already holds the answer, and the first finding is free and never leaves your browser. Get your first finding free
By Joris van Huët, Founder & CEOUpdated 3 min read
Take apart an attribution alert that fired and you usually find one of four causes, and only one of them is a change in your marketing. Knowing the four turns a fire drill into a two-minute triage.
The four
| Cause | Frequency | How to check |
|---|---|---|
| Sampling variation inside the interval | Most common | Is the move smaller than the interval width? |
| A collection change | Common | Did coverage move at the same time? |
| A definition change | Occasional | Did anyone alter grouping, window or timezone? |
| An actual change in your marketing | Least common | Is there a spend or creative change with the right timing? |
Check them in that order, because the first two account for most firings and take seconds to rule out.
Sampling variation
If the estimate moved less than the width of its own confidence interval, nothing has been detected. The number is a draw from a distribution and it landed somewhere else this week. This is not a subtle statistical point; it is the single most common reason an attribution alert fires.
A collection change
Coverage moving at the same time as an estimate is the signature. A consent banner change, a tag misfiring, an app update that strips referrers, a bot filter adjustment: all of these change what your analytics sees without anything changing in your marketing.
The estimate then shifts because the input shifted. Check coverage first, every time. The concept is explained in the unassigned traffic problem.
A definition change
Somebody regrouped channels, changed a lookback, or a platform quietly updated its default attribution window. Your number moves and your business did not. This is the one that produces the longest investigations, because there is no trace of it in the marketing data at all.
The defence is a written, dated record of your definitions, which is the first step in automating attribution reporting in one afternoon.
An actual change
Last on the list because it is least common, not because it is unimportant. If the first three are ruled out and the timing lines up with a spend or creative change, you have found something real, and the right response is to design a test rather than to act immediately.
Why this list is an argument against alerting
If three of four firings are artefacts, an alerting scheme is mostly a machine for generating investigations. A recurring review with the four checks built into its agenda catches the same real changes and produces far fewer false ones. The case is in a weekly budget review instead of alerts.
What our read gives you for the triage
Every channel gets a data-health score from 0 to 100 that grades the read, not the channel, and a next step: raise, cut or hold, or fix tagging first. From a Google Analytics export, €99 for a first read, refundable within 30 days, no questions asked. No alerting layer and no automated budget action, as explained in why real-time attribution alerts mislead.
The triage in one line
Smaller than the interval, coverage moved, definitions changed, or something real. In that order, every time.
Related answers
Frequently asked questions
Why did my attribution number suddenly change?
Check four things in order: whether the move was smaller than the confidence interval, whether coverage moved at the same time, whether anyone changed a definition or window, and only then whether something changed in your marketing.What does it mean if coverage moves with the estimate?
Almost always a collection change rather than a marketing one. A consent banner update, a misfiring tag, an app that strips referrers or a bot filter adjustment all change what analytics sees without anything changing in your campaigns.How do I protect against silent definition changes?
Keep a written, dated record of your channel grouping, lookback window and timezone, outside the tool. Platform defaults change without announcement, and without a record there is no way to tell a definition change from a real one.
Go deeper: Causal attribution, explained.
Sixty-second versions of these ideas: Causality Engine on YouTube Shorts.
Have an audience of ecommerce operators? Earn 20% recurring commission by recommending the €99 read.
Keep reading
Terms in this article
- AnalyticsAnalytics is the systematic computational analysis of data. It reveals customer behavior and measures campaign performance.
- AttributionAttribution identifies user actions that contribute to a desired outcome and assigns value to each. It reveals which marketing touchpoints drive conversions.
- Attribution ReportAttribution Report shows which touchpoints or channels receive credit for a conversion. It identifies which campaigns drive desired actions.
- Attribution WindowAttribution Window is the defined period after a user interacts with a marketing touchpoint, during which a conversion can be credited to that ad. It sets the timeframe for assigning conversion credit.
- Confidence IntervalConfidence Interval is a statistical range of values that likely contains the true value of a metric. In marketing analytics, it quantifies uncertainty around estimates, indicating the precision of an outcome or causal effect.
- Google AnalyticsGoogle Analytics is a web analytics service that tracks and reports website traffic.
- TaggingTagging labels or mentions another user, page, or location in a social media post. It creates links between entities, which helps analyze influence and attribution.