How do you measure ad effectiveness?

Start by sorting the question into one of three. A counting question asks whether the results that happened were recorded, and it is cheap to check and fixable. A comparison question asks which platform or channel did better, and platforms cannot answer it because they count different units over different windows. A causal question asks whether the result would have happened anyway, and only a designed test such as a geo holdout can answer it. Each one needs a different instrument, so answering before sorting is what produces arguments that never close.

What is the difference between attribution and incrementality?

Attribution assigns credit for a result that already happened, using rules about which touchpoint counts and for how long. Incrementality asks whether the result would have happened without the ad, which requires withholding the ad from a comparable group. Attribution can be computed from data you already have. Incrementality has to be designed, funded and protected while it runs, which is why it is the measurement that most often dies inside the organisation rather than in the statistics.

Can you measure ad effectiveness without conversion tracking?

Partly. Without a click identifier you lose the counting question entirely, so the comparison question becomes guesswork. What survives is a designed comparison: a holdout region, a period with the spend switched off, or a before and after with the dates and the changes written down in advance. Those are weaker than tracking and they are not nothing. The failure to avoid is reporting a platform number as if it were the missing measurement.

Is a missing conversion an attribution problem?

No, and the distinction saves weeks. Two tools disagreeing about who gets credit is an attribution disagreement, and it can be reasoned about but not resolved. A conversion that happened and was recorded nowhere is a bug with a cause: a broken tag, a consent state, a gap in collection. Counting the orders that carry a click identifier against what the platform reports separates the two in an afternoon.

Measurement · Effectiveness

“Did it work?” is three questions. Only one has a dashboard.

Most arguments about measuring ad effectiveness are arguments between people answering different questions. One of the three is a counting problem you can fix this week. One is a comparison the platforms cannot make for you. One needs a test you have to design, fund and defend.

Sort the question first ↓

The three questions hiding inside one

Ask anyone to measure ad effectiveness and you get a single sentence back. Underneath it there are three questions. They fail differently, they cost different amounts, and only one of them is answered by a report.

An operator in r/PPC drew the first of the three lines more cleanly than we had:

“Attribution disagreement is philosophical and you learn to live with it. A missing conversion is a bug and you can fix it.”
u/ksz2018, r/PPC, 3 August 2026. Recorded in our own ICP voice bank.

Those twenty words are half the sorting job. A disagreement between two tools is something you reason about and live with. A conversion that was never recorded is something you go and find. The other half is the question neither of those two is about.

The counting question: Did the results that actually happened get recorded? This one has a right answer, it is cheap to check, and when it breaks it breaks as a bug.
The comparison question: Which platform, campaign or channel did better? Two platforms counting the same sale are not wrong for disagreeing. They count different units over different windows, and neither can see the other.
The causal question: Would the result have happened anyway? No dashboard answers this. It needs a test that withholds something from someone, which costs budget, time and internal agreement.

What a room full of practitioners does with an unsorted question

On 29 August 2026 an agency owner asked r/PPC how to prove that a billboard campaign had worked. The thread reached 30 replies. The votes are the finding, so we counted them.

Declared limits, because they matter here. One thread, one channel, one day. Our note records the ranking and the two top replies, not a full reading of all 30. It is evidence about what a room rewards, not a survey of what practitioners believe.

Top answer, 25 points: “if they're looking for definitive proof in the OOH advertising space then they're in the wrong space”.
Second, 13 points: the Wanamaker line about half the advertising budget being wasted.
Below both: the two replies that brought a method. Geo lift ranked 20th, media mix modelling 21st.

The crowd is not being cynical

For a channel with no click identifier, ranking “you cannot prove it” above two methods is a defensible answer to the causal question. Geo lift and media mix modelling are both real, and both are slow, expensive and easy to kill halfway.

The failure is upstream of all of that: nobody established which question the owner had. An agency owner facing a renewal does not need proof of causality. He needs a comparison someone agreed to in advance and a record of what changed, which is a different job with a different price.

Thirty replies went to the hardest of the three questions because it was the one the sentence sounded like. That is the same move that makes measurement meetings circular in a room with a budget in it.

How to sort the question before you answer it

The vendor formulation we have seen that survives contact with a real account splits it the same way, one measurement and the rest declared as choices:

“I treat the deduped nCAC as the only number I'll call a measurement and everything at the channel level as a decision I'm making on purpose.”
u/WickedReports, r/analytics, 27 July 2026. A vendor, and still the cleanest version of this we have read.

Four lines, in this order, before anybody opens a platform. It takes about ten minutes and it decides which of the three problems you have.

What decision changes with the answer? Renew the campaign, move the budget, fire the channel. If no decision moves, the measurement is an argument, and arguments are settled by whoever speaks last.
What is the unit, and who holds the record? A click is held by the ad platform. A session is held by analytics. An order is held by your billing system. Pick the one closest to money and call the other two approximations out loud.
Who can see the outcome, and do we have that access today? Most effectiveness questions are answerable in principle and blocked in practice, because what happened to the lead lives in a system nobody gave you.
What would count as an answer, and what does it cost? A counting check costs an afternoon. A platform comparison costs a caveat you have to keep repeating. A holdout costs revenue you agree not to earn.

The sorting block, for a brief or an assistant's context

DECISION     What changes if the answer is yes. If nothing, stop here.
UNIT         Click, session or order. Name who holds the record.
ACCESS       Who can see the outcome, and do we have that access today.
INSTRUMENT   Counting check, platform comparison, or designed holdout.
COST         Hours, revenue withheld, and who has to agree to it.

RULE         Report which of the three questions was answered.
             An unanswered question is a result. A substituted
             number is not.

Line three is where most of this dies, and it is not a measurement problem

Seven years of running accounts for other people, with more than $1.3M in managed spend, and the pattern repeats in every sector. The client hires you so they can stop thinking about marketing. To measure anything past the click, you need them to think about it hard for a few weeks: which leads closed, which were junk, what sales did with them.

Often there is no CRM access. Sometimes there is no CRM. You build the measurement out of whatever you can reach, and you say which parts are estimates.

Asking for that access in week one is the least popular and the cheapest item on this page. An access you do not have in month one is an answer you will not have in month six.

The objections this gets

My client wants proof, not a taxonomy

Then give the decision, not the taxonomy. “We can show you what was recorded and what it cost. We cannot show you what would have happened without it, unless you fund a holdout.” That sentence ends more meetings than a chart does, because it names the price of the missing answer.

A holdout is never going to happen in this account

Fine. Then the causal question stays open, and the honest report says so in one line. The damage is not the missing test. The damage is filling the hole with a platform number and letting everyone read it as the answer.

So you are saying nothing is measurable

The opposite. The counting question is answerable today in almost every account, and a surprising number of accounts fail it. Orders that carry a click identifier against what the platform reports is an afternoon of work, and it separates a bug from a philosophy.

We already have attribution set up

Attribution is a set of rules for assigning credit after the fact. It answers the comparison question with a convention. It was never designed to answer whether the spend caused anything, and reading it that way is how a reasonable model becomes a wrong decision.

What we cannot measure, starting with this page

This argument would be cheap if we did not have to live in it.

We publish one piece a week on this site and we cannot tell you which one earns anything. In the 28 days to 12 September 2026 the site recorded 3,775 impressions and 23 clicks in Search Console. The connector we read it with serves that channel at site level only, so the per page split does not exist for us. Measured on 12 and 15 September 2026.

So the unit of judgement became the whole programme, not the piece. We wrote that down in the plan, instead of assigning those 23 clicks to whichever page we would like to have earned them.

What we would do differently. Wire the export before writing the content calendar. In the order we did it, every individual bet is unfalsifiable until the export exists.
What we still do not know. Whether sorting the question in front of a client changes the conversation or just moves the argument one level up. We have no clean case either way.
Where the billboard crowd may be right. For a channel with no identifier, their answer may be the practical one. Geo tests die inside organisations more often than they fail statistically.

The short version

Sort the question, then pick the instrument. Counting is cheap, comparison is a convention, causality is a purchase.

An unanswered question, reported as unanswered, is worth more than a number standing in for it.

If you would rather have someone sort it with you on your real accounts, that is what the free ad account audit is for.