Hirst AcademyMarketing Strategy and Planning
← Course overview
Module 8

Marketing Analytics and Performance Measurement

Estimated time: 5–6 hours · Closes the loop from the objectives set in the situation analysis by measuring what the channel plan actually delivered, rather than reporting activity metrics that flatter the campaign.

By the end of this module you will be able to choose KPIs that connect directly to a plan's stated objectives rather than whatever a channel happens to report, tell a vanity metric apart from one that reflects real business impact, compare first-touch, last-touch and multi-touch attribution models and explain why they can disagree about the same data, and build a performance report that states results honestly against the original targets — including where the plan fell short. You'll check each channel's results against target using Marketing Performance Dashboard Calculator, the Marketing Performance Dashboard Calculator that accompanies this module.

Interactive Tool

Marketing Performance Dashboard Calculator

Enter spend and results by channel to see cost per acquisition, conversion rate and return on marketing investment against your targets.

Open the tool →
8.1

KPIs That Prove the Plan, Not Just Activity

A KPI is not simply any number a dashboard happens to produce. It is a specific, measurable indicator chosen in advance, before a campaign runs, because it would prove or disprove progress toward a stated objective — not selected afterwards from whichever numbers look best. Parmenter (2007) argues that a genuine KPI is tied to the organisation's critical success factors, measured frequently, and understood well enough that everyone can act on it, which rules out most of what a channel's own reporting dashboard surfaces by default. Parmenter himself reserves "KPI" for those frequent operational measures and calls financial outcomes such as revenue "key result indicators"; this module uses KPI in the broader sense common in marketing planning, for the indicator that proves an objective.

The discipline is to work backwards from the objective, not forwards from whatever data is easiest to pull. Module 1 give two distinct things to prove: that revenue is growing toward its target, and that distribution is expanding toward its target. Each needs its own KPI, measured on its own terms, rather than a single blended "marketing performance" number that can hide one problem behind one success. It also helps to pair a lagging indicator, which confirms an outcome after the fact (revenue, active listings), with a leading indicator, which moves first and can still be acted on (the conversion rate of meetings with supermarket buyers).

A KPI framework built this way also resists the pressure to add metrics simply because they are available. Site traffic, email open rates and social engagement can all be useful diagnostic numbers, but none of them is the KPI for a revenue or distribution objective unless a credible chain of evidence connects the two. Where that chain doesn't exist, the number belongs in a diagnostics appendix, not the headline report.

Learning ObjectiveDerive the specific KPIs that would prove or disprove progress toward a stated objective, rather than defaulting to whatever a channel reports automatically.
Key ConceptsKPI versus activity metric; leading versus lagging indicators; working back from objective to KPI (Parmenter, 2007); diagnostic metrics versus headline KPIs.
Practical ExampleFor a revenue objective, the KPI is revenue growth and gross margin by channel; for a distribution objective, the KPI is the number of active listings and the buyer-meeting conversion rate — not social engagement or site traffic alone, however healthy those numbers look.
ExerciseFirst read the worked example at the end of this module to see how Birchwater's year-one results are reported against both objectives. Then take one objective your own organisation or team is working toward and write down the one KPI that would most directly prove whether it had been met, and one commonly reported metric that would not prove it even if it looked good. If you don't have one to use, take Birchwater's listings objective (2 to 4 of the big four within three years): this lesson names its KPIs, so go further by saying which is a leading and which a lagging indicator, and why.
8.2

Vanity Metrics and the Pressure to Report Them

A vanity metric is a number that looks good in a report but doesn't connect to a business outcome — impressions, followers or page views counted on their own, with no line drawn to revenue, margin or distribution. Ries (2011) popularised the term, contrasting vanity metrics with actionable ones that show cause and effect clearly enough to guide a decision; the same logic applies to a marketing report, which should be built around the numbers that connect to economic value even when the activity numbers are larger and more flattering.

The pressure to report vanity metrics anyway is real and rarely comes from dishonesty alone. A campaign that moved impressions by a large multiple but revenue barely at all is an uncomfortable thing to report plainly, and a dashboard full of growing follower counts is an easy way to fill a slide while avoiding that discomfort. The discipline this module asks for is a simple audit question, applied to every metric before it goes in a report: would this number still look good if revenue had fallen? A vanity metric usually survives that question unchanged; a meaningful one moves with the business outcome it claims to represent.

This matters most exactly where the temptation is strongest — in the channels generating the most visible but least accountable activity. A large paid social or earned PR campaign can produce enormous reach and engagement numbers that say nothing on their own about whether a single viewer became a paying customer, which is precisely why the next lesson's attribution models matter: they are what connects that activity back to results the business actually needs.

Learning ObjectiveSeparate a vanity metric from one that reflects genuine business impact, and resist the pressure to lead a report with the former.
Key ConceptsVanity versus actionable metrics (Ries, 2011); activity versus outcome; the "would it still look good if revenue fell?" audit test; metric inflation under reporting pressure.
Practical ExampleA paid social campaign generating millions of impressions and tens of thousands of new followers is an impressive-looking result that says nothing about whether any follower became a paying customer, compared with a smaller but harder number: a measurable lift in branded search volume that can be traced toward actual conversions.
ExerciseList three metrics from a real marketing report at your own organisation, or one you have seen at work, and classify each as vanity or meaningful by asking whether it would still look good if revenue had fallen. If you don't have one to use, classify the impressions, follower count and branded-search lift in this lesson's example, then add one metric Birchwater's team might be tempted to report, labelling it as your own assumption.
8.3

Attribution Models and Why They Disagree

Attribution models exist because a customer rarely converts after a single interaction with a brand, and something has to decide which of the several touchpoints along the way gets credit for the sale. A first-touch model gives all the credit to the very first interaction a customer had; a last-touch model gives all the credit to the final interaction immediately before conversion; multi-touch models split the credit across every touchpoint in the journey, either evenly (linear) or weighted toward the touchpoints closest to conversion (time-decay). Dalessandro et al. (2012) and Berman (2018) both show, from very different data sets, that the model chosen is not a neutral technical detail — it systematically changes which channel appears to be doing the work.

Last-touch is the easiest model to implement and the most common default, which is exactly why it is dangerous on its own: it structurally over-credits the channels that tend to sit right before a conversion, such as paid search and retargeting, because those are often the last thing a customer clicks before buying. It structurally under-credits the channels that start a journey but rarely finish it, such as earned PR coverage or a paid social post that a customer later searches for by brand name rather than clicking through directly. A multi-touch view run on the same underlying data can tell a strikingly different story, revealing that a large share of "paid search" conversions actually began with an earned or paid upper-funnel touchpoint that last-touch had assigned zero credit to.

The honest conclusion is not that one model is "right" and the others wrong, but that any single model is a simplification, and the choice of simplification changes the recommended budget. Comparing more than one model on the same journey data, rather than reporting whichever one the ad platform surfaces by default, is what turns attribution from a reporting convenience into a genuine input to next year's channel decisions.

Learning ObjectiveCompare first-touch, last-touch and multi-touch attribution models and explain why the choice of model changes which channel appears to be working.
Key ConceptsFirst-touch; last-touch; multi-touch (linear, time-decay); structural bias toward the touchpoint closest to conversion (Dalessandro et al., 2012; Berman, 2018).
Practical ExampleA last-touch report credits paid search with most conversions. A multi-touch (linear) view run on the same data shows a large share of those same conversions began with an earned PR mention or a paid social post that drove the customer's first branded search — a touchpoint last-touch assigned no credit to at all.
ExerciseTrace a real customer journey from your own organisation's data, or a recent purchase of your own, into its touchpoints; assign conversion credit under first-touch, last-touch and a simple linear multi-touch model, and note which channel's apparent value changes most between models. If you don't have one to use, take this Birchwater journey: a paid social post, then a visit to the DTC website, then a paid search ad clicked after a branded search, then a purchase.
8.4

Reporting Honestly Against the Original Targets

A performance report earns trust by stating results against the targets set before the plan ran, not against a comparison invented afterwards to make the number look better. Rust, Lemon and Zeithaml (2004) make the underlying case directly: marketing spend deserves the same financial accountability as any other investment, measured against the return it was projected to deliver, not against a softer benchmark chosen once the actual return is known. That discipline applies as much to a shortfall as to a success — a report that reframes a missed target rather than stating it plainly has stopped being a measurement and started being a sales pitch to the board.

Honest reporting also means holding every objective to the same standard, not just the one that happened to go well. A plan with two objectives can show real but uneven progress — one measure roughly on pace against its target, the other some way behind — and the report's job is to say exactly that, in those terms, rather than letting the stronger number carry the weaker one. Partial progress, stated plainly, is more useful to a board making a year-two decision than a single blended figure that obscures which half of the plan still needs work.

The attribution finding from the previous lesson belongs in this report too, not as a footnote but as a recommendation: if multi-touch analysis shows an upper-funnel channel was quietly doing more than last-touch credited it for, that is evidence for shifting next year's budget, not a curiosity to mention and move past. A credible report connects the measured shortfall, the attribution finding, and a specific recommended change in the following year's spend — building directly on Module 7 this analytics work is measuring.

Learning ObjectiveBuild a performance report that states results against the objectives set at the start of the plan, including where the plan has fallen short, and recommend a change in direction supported by the evidence.
Key ConceptsReporting against original targets (Rust, Lemon and Zeithaml, 2004); avoiding post-hoc reframing; holding every objective to the same standard; turning an attribution finding into a budget recommendation.
Practical ExampleA report that states one objective as roughly on pace against its original target and a second objective as behind its target, naming the shortfall plainly rather than letting the stronger number carry the weaker one, and recommending a specific year-two budget shift based on the attribution finding.
ExerciseEnter each channel's spend and results in Marketing Performance Dashboard Calculator to see cost per acquisition and return on marketing investment against target, then draft three sentences of a performance update for your own organisation's board or your manager that state two results against their original targets without softening whichever one is behind, and recommend a next-year budget shift based on an attribution finding. If you don't have results to use, keep the illustrative figures in Marketing Performance Dashboard Calculator and write the update for Birchwater's board from the worked example's figures in your own words, and size the year-two shift you would recommend, labelling the amount as your own assumption.
Worked Example

Birchwater's Year-One Performance Review

A year into its marketing plan, Birchwater's board asks for an honest scorecard against the objectives set in the situation analysis: revenue from £14m to £20m and supermarket listings from 2 to 4 of the big four, both within three years.

The headline numbers are genuinely mixed. Revenue has grown from £14m to £15.6m: £1.6m of the £6m gap closed in the first of three years, slightly behind a straight-line path that would put it at about £16m by now, and the honest report says so rather than rounding it up to a success. Distribution has moved further: one new listing secured, taking Birchwater from 2 to 3 of the targeted 4, half the gap closed in a third of the time. The report credits that, but adds the caveat that a single listing is a lumpy measure and the last of the big four is likely to be the hardest to win, so being ahead on count is not the same as being safe. On the DTC side, the £450,000 consumer marketing budget produced a customer acquisition cost of £56, a number that only means something alongside the revenue each of those customers goes on to generate.

The attribution picture adds a complication a simple results table would miss. A last-touch view of the same conversion data credits paid search with most of the sales, because that channel tends to be the last click before checkout. A multi-touch view of the same data tells a different story: a substantial share of those conversions began with an earned PR mention or a paid social post that drove the customer's first branded search — a touchpoint last-touch had ignored entirely. That finding doesn't change the headline revenue or listings numbers, but it directly changes the recommendation for year two: shift more of the consumer budget toward the upper-funnel channels multi-touch shows are actually doing the work, rather than continuing to credit paid search with value it only partly earned.

Knowledge Check

  1. Why is "number of social media followers gained" a weak KPI for a revenue and distribution objective, even though it is easy to track?
    It is an activity metric, not a KPI tied to the objective — it can rise a great deal without moving revenue or supermarket listings at all.
  2. A Birchwater customer sees a paid social post, later searches for the brand and clicks a paid search ad, then buys. Which channel gets the credit under first-touch and which under last-touch, and why might relying on either alone mislead the year-two budget?
    First-touch credits paid social, the first interaction; last-touch credits paid search, the final one before purchase. Each model hides the other channel's contribution, so either alone would push budget toward one channel and starve the one that did the other half of the work.
  3. Suppose Birchwater's year-one report led with the number of new social media followers. Apply the "would it still look good if revenue had fallen?" test: what does it show, and what would be a better number to lead with?
    The follower count would look just as good if revenue had fallen, so on its own it is a vanity metric; a better number moves with the outcome, such as a lift in branded search traced toward conversions, or the revenue and listings results themselves, stated against their targets.
  4. In year one Birchwater's revenue grew from £14m to £15.6m against a three-year target of £20m, and one of the two additional supermarket listings it targeted was secured (2 to 3 of the big four). Why does it matter that the report states both results plainly rather than leading with the listings result alone?
    Because the two objectives are progressing at different speeds: listings have closed half their gap in a third of the time, while revenue has closed just over a quarter of its gap and is slightly behind a straight-line path; a report that lets the stronger number carry the weaker one would misrepresent genuinely partial progress as a success.
  5. What is the practical consequence of Birchwater's multi-touch attribution finding for year two?
    It argues for shifting more of the consumer budget toward earned PR and paid social, the channels that actually drove the branded search last-touch ignored, rather than continuing to over-credit paid search.
  6. Go back to Module 1's SMART objectives. Which SMART properties of Birchwater's objectives make an honest year-one report possible, and what could the board conclude if the distribution objective had simply been "grow distribution"?
    Measurable and Time-bound: listings from 2 to 4 of the big four within three years gives a number and a date, so one new listing can be judged against pace (half the gap closed in a third of the time) and £15.6m against a straight-line path to £20m; "grow distribution" would let any increase count as success, leaving no target to report a shortfall against (Doran, 1981).

Resources & Further Practice

  • Parmenter's KPI framework: David Parmenter's Key Performance Indicators: Developing, Implementing, and Using Winning KPIs (2007) sets out the characteristics that separate a genuine KPI from a merely interesting metric.
  • Vanity metrics: Ries, E. (2011) The Lean Startup. New York: Crown Business — the source of the vanity-versus-actionable metrics distinction behind the audit this module teaches.
  • Attribution modelling research: Dalessandro et al. (2012) and Berman (2018) both model, from different data sets, why first-touch, last-touch and multi-touch attribution can disagree about which channel is driving conversions.
  • Return on marketing investment: Rust, Lemon and Zeithaml's (2004) Journal of Marketing article is the foundational case for holding marketing spend to the same financial accountability as any other business investment.
  • Your channel plan: Revisit Module 7 before building your dashboard — you can only measure the channels you actually planned for.
  • SMART objectives: Doran, G.T. (1981) 'There's a S.M.A.R.T. way to write management's goals and objectives', Management Review, 70(11), pp. 35–36 — the standard the objectives this module reports against were written to.
Checkpoint

Reflect on Your Performance Report

  • What I did: name the objective and KPI you chose, the metrics you classified as vanity, the channel whose credit changed most between attribution models, and the results you reported against their targets.
  • What I learned: note one point where the vanity test or a second attribution model changed which result you would have led with.
  • What I'll change: write one reporting habit you will take into work or the organisation you studied, for example agreeing the KPI before a campaign runs rather than choosing it afterwards.