Introduction: Can Numbers Lie?
In the world of Advanced Performance Management (APM), we often say that "what gets measured, gets done." However, there is a dangerous flip side: how those measurements are presented can completely change how they are understood.
As an APM student, you aren't just a "number cruncher." You are an advisor. Part of your role is to spot when data is being used to "spin" a story rather than tell the truth. This chapter focuses on Syllabus Area C (Performance Reporting) and specifically how numerical data can be manipulated to give a misleading impression of an organisation's performance. Don't worry if you find this tricky—once you know the "tricks of the trade," you'll start seeing them everywhere!
1. The Power of Aggregation: Hiding in the Crowd
Aggregation is the process of grouping data together. While it's necessary to avoid information overload, it can be used to hide poor performance.
Imagine a company with four divisions. Three are doing brilliantly, but one is losing millions of dollars. If the management report only shows the Total Group Profit, the failure of that one division is "hidden" by the success of the others. This is a classic way to mislead users by smoothing over "pockets" of underperformance.
Key Concept: Whenever you see a single "Total" or "Average" figure in a case study, use your Professional Scepticism. Ask: "Is there a specific product, region, or department that is actually struggling behind this nice-looking total?"
2. The "Small Base" Trick: Percentages vs. Absolute Values
Numbers can look much more impressive when expressed as percentages, especially when the starting point (the base) is very small. This is often used to exaggerate growth.
The Analogy: If you sell 1 lemonade on Monday and 2 lemonades on Tuesday, you have achieved 100% growth! It sounds incredible, but in reality, you only sold one extra drink.
APM Example:
Report A: "Our New Energy division saw a 50% increase in revenue!"
Report B: "Revenue grew from \$10,000 to \$15,000 (Total company revenue is \$10,000,000)."
Without the absolute values (\$), the percentage growth is misleading because it implies the division is a major success, when it is actually a tiny, insignificant part of the business.
Formula Check:
Always remember that \( Percentage Change = \frac{New - Old}{Old} \times 100 \). If the \( Old \) figure is very small, the percentage will be huge!
3. Misleading Averages: Mean vs. Median
In reports, the word "Average" usually refers to the Arithmetic Mean. However, the Mean can be heavily distorted by outliers (values that are much higher or lower than the rest).
Example: If 9 staff members earn \$20,000 and the CEO earns \$1,000,000, the Mean salary is:
\( \frac{(9 \times 20,000) + 1,000,000}{10} = \$118,000 \)
If management reports that "the average salary is \$118,000," they are giving a misleading impression that everyone is well-paid, when in fact 90% of the staff earn much less. In this case, the Median (the middle value) would be \$20,000, which is a much fairer reflection of reality.
4. Cherry-Picking Timeframes (Selective Data)
Management might choose specific start and end dates for a report to make performance look better than it actually is. This is known as "cherry-picking."
Look out for:
- Comparing against a "weak" year: If last year was a disaster (e.g., due to a global pandemic), this year’s "50% growth" might just mean the company is barely returning to normal.
- Ignoring seasonality: Showing growth between Q4 (Christmas peak) and Q3, while ignoring that sales actually dropped compared to last year's Q4.
5. Relative vs. Absolute Performance
Data can be misleading if it lacks context or benchmarking. (Note: For more on benchmarking types, see Syllabus Area A1).
If a company reports 10% growth, it sounds good. But if the entire industry grew by 25% during the same period, that 10% is actually a poor performance. By omitting the industry average, management presents a misleadingly positive view of their success.
6. Summary Table: Common Misinterpretations
When evaluating a report in your exam, look for these specific issues:
| Tactic | How it Misleads | How to Challenge it |
|---|---|---|
| Aggregation | Hides poor-performing segments behind a total. | Ask for segmented or divisional data. |
| Percentage Growth | Exaggerates small gains from a small starting point. | Compare with absolute dollar values. |
| Mean Averages | Distorted by "outliers" (very high/low values). | Check the range or the median. |
| Selective Timeframes | Hides long-term trends by focusing on a "good" period. | Request multi-year or trend analysis. |
Professional Skills Spotlight: Scepticism (E3)
In the APM exam, you get marks for Scepticism. This doesn't mean being "rude" or "negative." It means having an enquiring mind. When you see a table of data, don't just describe what the numbers say. Challenge them!
Example of a Sceptical comment in an exam answer:
"While the report shows a 20% increase in ROI, it should be noted that this was achieved by selling off key assets at the end of the year, which reduced the capital employed base. This gives a misleading impression of improved operational efficiency when, in reality, the company's productive capacity has decreased."
Quick Review: Top Tips for the Exam
- Check the denominator: If a ratio (like ROCE) has improved, is it because profit went up, or just because capital employed went down?
- Look for the "Missing" Data: Often, what isn't in the report is more important than what is.
- Think about the user: If the report is for the Board of Directors, are the numbers presented in a way that helps them make strategic decisions, or just makes the managers look good?
- Link to Narrative: This chapter connects closely to Narrative Commentary. Often, misleading numbers are paired with biased stories to reinforce a false impression.
Don't worry if this seems a bit cynical at first! Your job as a strategic professional is to ensure that performance reporting is honest, transparent, and useful for the organisation's mission and objectives.