Marketing Analytics and Performance Measurement
By the end of this module you will be able to choose KPIs that connect directly to a plan's stated objectives rather than whatever a channel happens to report, tell a vanity metric apart from one that reflects real business impact, compare first-touch, last-touch and multi-touch attribution models and explain why they can disagree about the same data, and build a performance report that states results honestly against the original targets — including where the plan fell short. You'll check each channel's results against target using Marketing Performance Dashboard Calculator, the Marketing Performance Dashboard Calculator that accompanies this module.
Marketing Performance Dashboard Calculator
Enter spend and results by channel to see cost per acquisition, conversion rate and return on marketing investment against your targets.
8.1KPIs That Prove the Plan, Not Just Activity
A KPI is not simply any number a dashboard happens to produce. It is a specific, measurable indicator chosen in advance, before a campaign runs, because it would prove or disprove progress toward a stated objective — not selected afterwards from whichever numbers look best. Parmenter (2007) argues that a genuine KPI is tied to the organisation's critical success factors, measured frequently, and understood well enough that everyone can act on it, which rules out most of what a channel's own reporting dashboard surfaces by default. Parmenter himself reserves "KPI" for those frequent operational measures and calls financial outcomes such as revenue "key result indicators"; this module uses KPI in the broader sense common in marketing planning, for the indicator that proves an objective.
The discipline is to work backwards from the objective, not forwards from whatever data is easiest to pull. Module 1 give two distinct things to prove: that revenue is growing toward its target, and that distribution is expanding toward its target. Each needs its own KPI, measured on its own terms, rather than a single blended "marketing performance" number that can hide one problem behind one success. It also helps to pair a lagging indicator, which confirms an outcome after the fact (revenue, active listings), with a leading indicator, which moves first and can still be acted on (the conversion rate of meetings with supermarket buyers).
A KPI framework built this way also resists the pressure to add metrics simply because they are available. Site traffic, email open rates and social engagement can all be useful diagnostic numbers, but none of them is the KPI for a revenue or distribution objective unless a credible chain of evidence connects the two. Where that chain doesn't exist, the number belongs in a diagnostics appendix, not the headline report.
8.2Vanity Metrics and the Pressure to Report Them
A vanity metric is a number that looks good in a report but doesn't connect to a business outcome — impressions, followers or page views counted on their own, with no line drawn to revenue, margin or distribution. Ries (2011) popularised the term, contrasting vanity metrics with actionable ones that show cause and effect clearly enough to guide a decision; the same logic applies to a marketing report, which should be built around the numbers that connect to economic value even when the activity numbers are larger and more flattering.
The pressure to report vanity metrics anyway is real and rarely comes from dishonesty alone. A campaign that moved impressions by a large multiple but revenue barely at all is an uncomfortable thing to report plainly, and a dashboard full of growing follower counts is an easy way to fill a slide while avoiding that discomfort. The discipline this module asks for is a simple audit question, applied to every metric before it goes in a report: would this number still look good if revenue had fallen? A vanity metric usually survives that question unchanged; a meaningful one moves with the business outcome it claims to represent.
This matters most exactly where the temptation is strongest — in the channels generating the most visible but least accountable activity. A large paid social or earned PR campaign can produce enormous reach and engagement numbers that say nothing on their own about whether a single viewer became a paying customer, which is precisely why the next lesson's attribution models matter: they are what connects that activity back to results the business actually needs.
8.3Attribution Models and Why They Disagree
Attribution models exist because a customer rarely converts after a single interaction with a brand, and something has to decide which of the several touchpoints along the way gets credit for the sale. A first-touch model gives all the credit to the very first interaction a customer had; a last-touch model gives all the credit to the final interaction immediately before conversion; multi-touch models split the credit across every touchpoint in the journey, either evenly (linear) or weighted toward the touchpoints closest to conversion (time-decay). Dalessandro et al. (2012) and Berman (2018) both show, from very different data sets, that the model chosen is not a neutral technical detail — it systematically changes which channel appears to be doing the work.
Last-touch is the easiest model to implement and the most common default, which is exactly why it is dangerous on its own: it structurally over-credits the channels that tend to sit right before a conversion, such as paid search and retargeting, because those are often the last thing a customer clicks before buying. It structurally under-credits the channels that start a journey but rarely finish it, such as earned PR coverage or a paid social post that a customer later searches for by brand name rather than clicking through directly. A multi-touch view run on the same underlying data can tell a strikingly different story, revealing that a large share of "paid search" conversions actually began with an earned or paid upper-funnel touchpoint that last-touch had assigned zero credit to.
The honest conclusion is not that one model is "right" and the others wrong, but that any single model is a simplification, and the choice of simplification changes the recommended budget. Comparing more than one model on the same journey data, rather than reporting whichever one the ad platform surfaces by default, is what turns attribution from a reporting convenience into a genuine input to next year's channel decisions.
8.4Reporting Honestly Against the Original Targets
A performance report earns trust by stating results against the targets set before the plan ran, not against a comparison invented afterwards to make the number look better. Rust, Lemon and Zeithaml (2004) make the underlying case directly: marketing spend deserves the same financial accountability as any other investment, measured against the return it was projected to deliver, not against a softer benchmark chosen once the actual return is known. That discipline applies as much to a shortfall as to a success — a report that reframes a missed target rather than stating it plainly has stopped being a measurement and started being a sales pitch to the board.
Honest reporting also means holding every objective to the same standard, not just the one that happened to go well. A plan with two objectives can show real but uneven progress — one measure roughly on pace against its target, the other some way behind — and the report's job is to say exactly that, in those terms, rather than letting the stronger number carry the weaker one. Partial progress, stated plainly, is more useful to a board making a year-two decision than a single blended figure that obscures which half of the plan still needs work.
The attribution finding from the previous lesson belongs in this report too, not as a footnote but as a recommendation: if multi-touch analysis shows an upper-funnel channel was quietly doing more than last-touch credited it for, that is evidence for shifting next year's budget, not a curiosity to mention and move past. A credible report connects the measured shortfall, the attribution finding, and a specific recommended change in the following year's spend — building directly on Module 7 this analytics work is measuring.
Birchwater's Year-One Performance Review
A year into its marketing plan, Birchwater's board asks for an honest scorecard against the objectives set in the situation analysis: revenue from £14m to £20m and supermarket listings from 2 to 4 of the big four, both within three years.
The headline numbers are genuinely mixed. Revenue has grown from £14m to £15.6m: £1.6m of the £6m gap closed in the first of three years, slightly behind a straight-line path that would put it at about £16m by now, and the honest report says so rather than rounding it up to a success. Distribution has moved further: one new listing secured, taking Birchwater from 2 to 3 of the targeted 4, half the gap closed in a third of the time. The report credits that, but adds the caveat that a single listing is a lumpy measure and the last of the big four is likely to be the hardest to win, so being ahead on count is not the same as being safe. On the DTC side, the £450,000 consumer marketing budget produced a customer acquisition cost of £56, a number that only means something alongside the revenue each of those customers goes on to generate.
The attribution picture adds a complication a simple results table would miss. A last-touch view of the same conversion data credits paid search with most of the sales, because that channel tends to be the last click before checkout. A multi-touch view of the same data tells a different story: a substantial share of those conversions began with an earned PR mention or a paid social post that drove the customer's first branded search — a touchpoint last-touch had ignored entirely. That finding doesn't change the headline revenue or listings numbers, but it directly changes the recommendation for year two: shift more of the consumer budget toward the upper-funnel channels multi-touch shows are actually doing the work, rather than continuing to credit paid search with value it only partly earned.
Knowledge Check
Why is "number of social media followers gained" a weak KPI for a revenue and distribution objective, even though it is easy to track?
It is an activity metric, not a KPI tied to the objective — it can rise a great deal without moving revenue or supermarket listings at all.A Birchwater customer sees a paid social post, later searches for the brand and clicks a paid search ad, then buys. Which channel gets the credit under first-touch and which under last-touch, and why might relying on either alone mislead the year-two budget?
First-touch credits paid social, the first interaction; last-touch credits paid search, the final one before purchase. Each model hides the other channel's contribution, so either alone would push budget toward one channel and starve the one that did the other half of the work.Suppose Birchwater's year-one report led with the number of new social media followers. Apply the "would it still look good if revenue had fallen?" test: what does it show, and what would be a better number to lead with?
The follower count would look just as good if revenue had fallen, so on its own it is a vanity metric; a better number moves with the outcome, such as a lift in branded search traced toward conversions, or the revenue and listings results themselves, stated against their targets.In year one Birchwater's revenue grew from £14m to £15.6m against a three-year target of £20m, and one of the two additional supermarket listings it targeted was secured (2 to 3 of the big four). Why does it matter that the report states both results plainly rather than leading with the listings result alone?
Because the two objectives are progressing at different speeds: listings have closed half their gap in a third of the time, while revenue has closed just over a quarter of its gap and is slightly behind a straight-line path; a report that lets the stronger number carry the weaker one would misrepresent genuinely partial progress as a success.What is the practical consequence of Birchwater's multi-touch attribution finding for year two?
It argues for shifting more of the consumer budget toward earned PR and paid social, the channels that actually drove the branded search last-touch ignored, rather than continuing to over-credit paid search.Go back to Module 1's SMART objectives. Which SMART properties of Birchwater's objectives make an honest year-one report possible, and what could the board conclude if the distribution objective had simply been "grow distribution"?
Measurable and Time-bound: listings from 2 to 4 of the big four within three years gives a number and a date, so one new listing can be judged against pace (half the gap closed in a third of the time) and £15.6m against a straight-line path to £20m; "grow distribution" would let any increase count as success, leaving no target to report a shortfall against (Doran, 1981).
Resources & Further Practice
- Parmenter's KPI framework: David Parmenter's Key Performance Indicators: Developing, Implementing, and Using Winning KPIs (2007) sets out the characteristics that separate a genuine KPI from a merely interesting metric.
- Vanity metrics: Ries, E. (2011) The Lean Startup. New York: Crown Business — the source of the vanity-versus-actionable metrics distinction behind the audit this module teaches.
- Attribution modelling research: Dalessandro et al. (2012) and Berman (2018) both model, from different data sets, why first-touch, last-touch and multi-touch attribution can disagree about which channel is driving conversions.
- Return on marketing investment: Rust, Lemon and Zeithaml's (2004) Journal of Marketing article is the foundational case for holding marketing spend to the same financial accountability as any other business investment.
- Your channel plan: Revisit Module 7 before building your dashboard — you can only measure the channels you actually planned for.
- SMART objectives: Doran, G.T. (1981) 'There's a S.M.A.R.T. way to write management's goals and objectives', Management Review, 70(11), pp. 35–36 — the standard the objectives this module reports against were written to.
Reflect on Your Performance Report
- What I did: name the objective and KPI you chose, the metrics you classified as vanity, the channel whose credit changed most between attribution models, and the results you reported against their targets.
- What I learned: note one point where the vanity test or a second attribution model changed which result you would have led with.
- What I'll change: write one reporting habit you will take into work or the organisation you studied, for example agreeing the KPI before a campaign runs rather than choosing it afterwards.
Did this module make sense?
Thanks for saying so: the Faculty sees every “not really”.
Which part lost you? (optional, anonymous)
Thanks: that tells the Faculty exactly where to look.
In the meantime:
Key terms in this module
- Attribution model
- A method for assigning credit for a conversion across the multiple touchpoints that led to it — first-touch, last-touch and multi-touch (e.g. linear, time-decay) models each tell a different, sometimes contradictory, story from the same data.
- Vanity metric
- A metric that looks good in a report but doesn't connect to a business outcome (e.g. impressions or followers alone), as distinct from a metric tied to the plan's actual objectives.
- KPI (key performance indicator)
- A specific, measurable indicator chosen in advance to track progress toward an objective — chosen before a campaign runs, not selected afterwards from whichever numbers look best.
Thanks. Good to hear.