Hirst AcademyMarketing in Practice
← Course overview
Module 14

Performance, Attribution and ROI

Estimated time: 4–5 hours · Shows what worked, what didn't and what it earned, in terms a finance director accepts.

Why it matters. Every channel's dashboard will tell you it worked. A leader's job is to find out what really happened, and say so, even when the answer is "less than we hoped". This is the first topic of the Leader stage. Earlier you set baselines in Module 6, planned a campaign with a budget, and worked out what a customer is worth in Module 12. Now you bring those together and ask the question a finance director asks: what did we get for the money? You'll review results against objectives, see what attribution can and can't tell you, estimate what would have happened anyway, and calculate return on investment with a check on how fragile it is.

Progress marker: I can judge what marketing really achieved and calculate its ROI honestly. Rate yourself now on this marker (not yet, with support, independently or could teach it) and note your rating in your portfolio.

Choose your route. On a first pass, work through the lessons in order. Each ends in a task for your portfolio, and the last uses the Campaign ROI and Incrementality Calculator. If someone has just asked you "was it worth it?", read the worked example first, then go to Lesson 14.4. Larkfield Coffee Roasters, the course's coffee roaster, is fictional and its figures are illustrative. If your organisation hasn't run a campaign yet, use projected results and label them as projections, or use the Larkfield figures. Your answers feed the performance review in your final milestone.

Interactive Tool

Campaign ROI and Incrementality Calculator

Enter results, the baseline, spend and customer lifetime value, and see incremental results, cost per incremental customer, the value created and the ROI, with a sensitivity check on your assumptions.

Open the tool →
14.1

Reviewing Performance

A performance review compares what happened with what you meant to happen, and with what you would have expected anyway. It has three parts.

Results against objectives. Take each objective from your plan and put the result beside it. Use the same measure and the same dates. A target of "net new customers" is not met by a result of "gross new customers". A simple table does the job:

MeasureTargetResultDifference
(the measure from your plan)

Results against baselines. You set baselines in the KPIs topic: where the numbers stood before you started. A result only means something beside its baseline. Sales of 500 are good news if the baseline was 300 and bad news if it was 700.

What changed besides the marketing. Season, a price change, a competitor's offer, a stock shortage, even the weather can move results. List them. You can't always remove their effect, but you can say they were there. A review that credits marketing for everything is as unreliable as one that blames it for everything.

Say what missed, and why. If you missed a target, say so in the first line, with the size of the miss. Then give the reasons you can support with evidence, and the ones you only suspect, labelled as suspicions. People trust a review that opens with the bad news far more than one that buries it.

Keep the sums checkable. Every figure should be traceable to a source, and every total should add up. Check your own arithmetic before anyone else does.

Learning ObjectiveReview a campaign's results against its objectives and baselines, name the other factors that may have moved them, and say plainly what missed and why.
Key ConceptsResults against objectives and against baselines (from the KPIs topic); like-for-like measures and dates; other factors such as season, price and competitors; stating a miss first and separating evidence from suspicion; checkable sums.
Practical ExampleA café runs a month of social posts and sees takings rise. Before crediting the posts, it checks the same month last year, a bank holiday weekend and a nearby roadworks closure that ended. The honest review reports the rise and lists all three.
ExerciseBuild a results table for the campaign in your organisation's plan, with objective, baseline, result and difference, and list the other factors that may have affected it. If your organisation has not run the campaign, use projected results and label them as projections.
14.2

Attribution

Attribution means giving credit for a sale or sign-up to the marketing touchpoints that came before it. Most people meet more than one before they act: a social ad, then a search, then an email. Attribution is the rule for sharing out the credit.

The common models.

  • Last click gives all the credit to the final touchpoint before the conversion.
  • First click gives it all to the first.
  • Position-based gives most to the first and last and a little to those between.
  • Data-driven uses a platform's statistical model of customer paths to share out the credit. It is only as good as the data it can see.

The choice of model changes the answer. Google removed first click, linear, time decay and position-based attribution from Google Analytics 4 and Google Ads in 2023, leaving last click and data-driven. Check the current help pages.

Why every platform over-claims. Each platform counts the conversions it can see and takes credit for those it touched. Add up the claims and the total is often more than the sales you made. Nobody is lying. Each is measuring its own view of the path.

What it cannot show. Attribution follows people who clicked. It can't tell you:

  • who would have bought anyway, which the next lesson tackles
  • the effect of things people saw but did not click, such as a poster, a video or a friend's recommendation
  • offline influence, such as a conversation in a shop
  • how changing ways of finding answers affect clicks. When search tools answer questions directly, fewer people may click through, and the data can understate what that activity did

UK example: published effectiveness research. In April 2024 Thinkbox, the UK television industry's marketing body, published Profit Ability 2. Five agencies combined their econometric databases of client data, covering 141 brands, to measure profit payback over several time periods. Read the source for its findings, and note that it relies on modelling, not experiments, and an industry body commissioned it. Les Binet and Peter Field's The Long and the Short of It (IPA, 2013) reports that, on average across the cases studied, a mix of roughly 60% brand-building and 40% activation performed well. That ratio is an average from their data and varies by category, so treat it as a starting point for discussion, not a rule. Both matter here because effects that take time to build don't show up in a last-click report.

AI activity. Ask an AI assistant to explain why last-click and incremental results can differ for your campaign. Compare its answer with this lesson and your data, and note anything it states as fact that you cannot check.

Learning ObjectiveCredit conversions under two attribution models, explain why each platform over-claims, and say what attribution cannot show.
Key ConceptsAttribution; last click, first click, position-based and data-driven models; why platforms over-claim; what clicks cannot show (would have bought anyway, views without clicks, offline influence, answers given directly by search tools); long-term effects in published IPA and Thinkbox research; Binet and Field's 60:40 as an average that varies.
Practical ExampleUK example: Thinkbox's Profit Ability 2 (April 2024) and the IPA's work on effectiveness, both described as published, with the reminder that effects built over time are invisible to last click.
ExerciseTake one month of conversions for your organisation, or the Larkfield figures from the worked example, and credit them two ways, for example last click and an even split across the touchpoints. Compare where the credit moves. Then do the AI activity and record what you checked.
14.3

Incrementality

Incrementality is the part of a result that would not have happened without the marketing. The rest would have happened anyway. Attribution tells you who was touched. Incrementality asks whether the touch made a difference. If you take one question from this topic, take that one: would it have happened anyway?

The calculation is simple. Incremental results = results with the marketing − what you expected without it. The hard part is the second number.

Three ways to find it.

  1. A holdout group. Choose a group at random and deliberately don't show them the marketing. Compare their results with the group that saw it. This is the strongest method, because the two groups differ only in the marketing. The cost is that you forgo some sales from the held-out group, which you can often afford if the group is small.
  2. A geographic or matched comparison. Run the marketing in some areas or shops and not in similar ones. It works when you cannot hold out individuals, but areas never match perfectly.
  3. Before and after against a baseline. Compare the campaign period with your baseline from the KPIs topic. It needs no special set-up, so most organisations start here. Its weakness is that it assumes nothing else changed. If the season, price or a competitor shifted, the baseline no longer shows what would have happened.

State the weakness whichever you use. A figure that comes with its limitation is more useful than one that pretends to certainty.

Marketing mix modelling (MMM) is a statistical method that uses months or years of sales and spend data to estimate how much each activity, and factors such as price and season, contributed to sales. It suits organisations with several channels and a good run of data, and it does not rely on tracking individual people. It needs a lot of clean data and skilled interpretation. Open-source tools exist, such as Meta's Robyn and Google's Meridian, but both come from advertising platforms, so ask who built a model and what they gain from the answer. For a small organisation, a simple holdout or comparison is often the practical choice.

Designing a test. Write down before you start:

  • the question: what are you trying to learn?
  • the groups: who sees the marketing, who does not, and how you chose them
  • the measure and the period
  • what result would change your decision
  • how you will tell if something else interfered
Learning ObjectiveEstimate incremental results with a holdout, a comparison or a before-and-after baseline, state the method's weakness, and describe when marketing mix modelling helps.
Key ConceptsIncrementality; incremental results as results minus expected results; holdout groups; geographic or matched comparisons; before-and-after baselines and their weaknesses; marketing mix modelling in outline; designing a test before running it.
Practical ExampleAn email team picks a random tenth of its list to receive no promotional email for a month. Comparing orders from that tenth with the rest shows how many orders the emails added, rather than how many followed them.
ExerciseDesign one incrementality test for a campaign in your organisation: the question, the groups, the measure and period, what would change your decision, and the weakness you accept. If you can't run it, write it as a plan.
14.4

ROI Honestly

Marketing ROI is the return on marketing investment. This course measures it on contribution, not revenue, because revenue ignores the cost of delivering what you sold. Some organisations use revenue. When someone quotes an ROI, ask which they mean.

The steps.

  1. Incremental customers = customers gained − customers expected anyway.
  2. Value created = incremental customers × lifetime value per customer.
  3. ROI = (value created − cost) ÷ cost.
  4. Cost per incremental customer = cost ÷ incremental customers.

Pull back what you know. Before reading on, try to recall how lifetime value is worked out. It is contribution per month multiplied by expected lifetime, and expected lifetime is 1 ÷ monthly churn. You met it in Module 12. Lifetime value is a forecast. It is earned over time, not paid into the bank this quarter. So an ROI built on it is an expected return, not cash already received.

Compare with a target. The cost per incremental customer is the figure to hold against the target you set when you planned the budget. It is also worth comparing with lifetime value: the gap between the two is what each new customer is expected to earn after paying for their own acquisition.

Test the assumptions. An ROI depends on inputs you estimated. Change the important ones and see what happens. Lifetime value is usually the largest. Run the sum at the figure you expect and at a more cautious and a more optimistic one. If the ROI stays positive across them, you can say so with confidence. If it turns negative at a plausible lower value, say that, too.

Read the worked example first. It models every step for Larkfield. Then use the Campaign ROI and Incrementality Calculator with your own figures.

AI activity. Give an AI assistant your spend, results, expected results and lifetime value, and ask it to check your ROI arithmetic and explain any difference between last-click and incremental results. Then redo every step yourself. Note any step it got wrong or any number it introduced that you did not give it.

Learning ObjectiveCalculate incremental customers, cost per incremental customer, value created and ROI with lifetime value, and test how sensitive the ROI is to your assumptions.
Key ConceptsROI on contribution; incremental customers times lifetime value; ROI as (value − cost) ÷ cost; cost per incremental customer against the target; lifetime value as a forecast; sensitivity to assumptions; checking AI arithmetic.
Practical ExampleRead the worked example in this topic first: Larkfield Coffee Roasters (fictional) reviews its autumn campaign.
ExerciseUse the Campaign ROI and Incrementality Calculator to calculate the ROI of a campaign in your organisation, with a second lifetime value for the sensitivity check. Do the AI activity and record any step it got wrong. If you lack real figures, use projections and label them, or use the Larkfield figures.
Worked Example

Larkfield Reviews "Roasted This Week"

Larkfield Coffee Roasters is fictional, and all its figures are illustrative. Maya Collins, the marketing manager, reviews the autumn campaign (1 September to 30 November 2026). She states the miss first.

Step 1: against the objective. Spend was £30,000, on budget. The aim was to grow active subscribers from 1,800 to 2,100, a net gain of 300. There were 510 new subscribers. Cancellations were 90, 85 and 78 across the three months: 253 in all. Subscribers at 30 November: 1,800 + 510 − 253 = 2,057. The net gain was 257 against 300, so Larkfield missed by 43. Maya says so first. Churn was about 4% by November, after the one-click pause.

Step 2: what would have happened anyway. Larkfield was winning about 90 new subscribers a month, so 270 over three months. The campaign added 510 − 270 = 240 incremental subscribers. That assumes the baseline of 90 a month would have held, and Maya records the assumption as a limitation.

Step 3: what last click says. It credits paid search with 190 of the 510, email 110, paid social 95, and direct and organic 115 (the total is 510). Paid social looks weakest, but last click sees only the final step, so social ads may have started journeys that ended in a search. It also credits the 270 who would have joined anyway.

Step 4: cost per incremental subscriber. £30,000 ÷ 240 = £125, against the £100 target.

Step 5: ROI. Lifetime value at 5% churn was £160 in the CRM topic. Value created: 240 × £160 = £38,400. ROI: (£38,400 − £30,000) ÷ £30,000 = 28%. At £200, the value at 4% churn: £48,000 and an ROI of 60%.

Lifetime value £160Lifetime value £200
Value created£38,400£48,000
Spend£30,000£30,000
ROI28%60%

Her conclusion. The campaign missed its target by 43 and cost £25 more per extra subscriber than planned, yet it still earned more than it cost at either value, if the baseline holds. The target was net growth after cancellations. The ROI counts only the 240 added, over their lifetime. Each cost £125 and is expected to earn £160, an expected return earned over time. Maya records the figures in the Campaign ROI and Incrementality Calculator and plans a holdout group for the next campaign.

Knowledge Check

  1. Three platforms report 400, 350 and 250 conversions between them, but the shop took 600 orders. What most likely explains the gap?
    Each platform claims credit for conversions it touched, so the same order is counted by more than one: they total 1,000 against 600 real orders.
  2. A campaign costing £9,000 brings 400 new customers when 250 were expected anyway. How many are incremental, and what is the cost per incremental customer?
    400 − 250 = 150 incremental customers, and £9,000 ÷ 150 = £60 each.
  3. Each of those customers has a lifetime value of £80. What is the ROI?
    Value created is 150 × £80 = £12,000, so ROI is (£12,000 − £9,000) ÷ £9,000, which is 33.3%.
  4. If the lifetime value in question 3 turns out to be £50, what happens to the ROI?
    Value created falls to £7,500 and ROI to (£7,500 − £9,000) ÷ £9,000, about −16.7%: the campaign loses money, so the result is sensitive to the assumption.
  5. A shop compares sales this December with last month's to judge a new ad. What is the weakness, and what would be stronger?
    The comparison ignores the Christmas rise that would have happened anyway; a holdout group or a matched comparison separates the ad's effect from the season.
  6. Larkfield missed its subscriber target by 43 but shows a positive ROI. How can both be true?
    The target was net growth after cancellations, while the ROI values only the 240 incremental subscribers against the £30,000 spend; the two measure different things.

Resources & Further Practice

  • The UK example at source: Thinkbox, Profit Ability 2, published April 2024; search for the title on the Thinkbox website and read its method and limits before quoting any finding.
  • Effectiveness over time: Les Binet and Peter Field, The Long and the Short of It (IPA, 2013). Treat the 60:40 split as an average from their data, and check later IPA updates before quoting figures.
  • Attribution models: Google Ads Help, "First click, linear, time decay, and position-based attribution models are going away"; search for the title, and check the current Google Analytics help pages for the models offered today.
  • Marketing mix modelling: search for Meta's Robyn and Google's Meridian, two open-source tools, and read who publishes each and how it describes itself.
  • Baselines and lifetime value: revisit the KPIs topic for baselines and the CRM topic for lifetime value if either is hazy.
  • Further practice: complete the Campaign ROI and Incrementality Calculator for your organisation and keep the results and assumptions in your portfolio. They feed Module 15 and your final milestone.
Checkpoint

Your Performance Review

  • My review: the results against objectives and baselines, with any miss stated first.
  • What attribution hid in my organisation's results.
  • What I would measure differently next time.
  • Rate yourself again on this topic's progress marker (not yet, with support, independently or could teach it) and note your before and after ratings in your portfolio.
  • Choose what to do next: design the incrementality test properly, with groups, measure and decision rule, or move on to the next topic.