Introduction to Evaluating Data Presentation
In your Thinking Skills course, you have already learned that evidence is the backbone of any strong argument. However, evidence isn't always just words; it often comes in the form of data—numbers, charts, graphs, and tables. In this chapter, we focus on Evaluating the presentation of data. This means looking closely at how information is shown to us and deciding if it is clear and honest, or if it has been designed to trick us into a specific conclusion.
Don't worry if you aren't a "math person"! You don't need complex formulas here. You just need a critical eye to spot when a graph or a table is trying to tell a story that the numbers don't actually support. This skill is vital for success in Paper 2 and Paper 4.
Note: For related skills on who provided the data or who was studied, see our chapters on "Assess credibility of evidence" and "Assess the representativeness of a sample".
1. Why Does Data Presentation Matter?
Data is often presented to make an argument more persuasive. While numbers themselves might be "facts," the way they are arranged on a page can change how we feel about them. A Thinking Skills student must be able to distinguish between the raw data and the visual impression created by the presentation.
Common Presentation Formats
The syllabus requires you to evaluate information in a variety of forms:
- Text: Numbers buried in a paragraph.
- Tables: Data organized into rows and columns.
- Graphs: Bar charts, line graphs, and pie charts.
- Diagrams: Flowcharts or maps.
2. Key Techniques for Evaluating Graphs and Charts
When you see a graph in an exam document, your first instinct should be to "fact-check" its layout. Authors sometimes use visual distortions to exaggerate or hide trends.
A. The Truncated (Broken) Axis
This is the most common trick. A graph's vertical axis (the Y-axis) should usually start at \(0\). If it starts at a higher number, like \(90\), even a tiny increase looks like a massive jump.
Example: A graph showing a rise in test scores from \(91\%\) to \(92\%\) will look like a huge spike if the axis only shows the range from \(90\) to \(95\). Always check the scale!
B. Uneven Scaling
Check if the gaps between numbers on the axis are equal. If a graph jumps from \(10\) to \(20\) and then suddenly from \(20\) to \(100\) in the same amount of space, it is distorting the logical relationship between the data points.
C. The "3D" and Perspective Trap
In pie charts, a 3D effect can make the slice at the "front" look much larger than the slices at the back, even if the slice at the back represents a larger percentage. Always look for the actual percentage (\%\) or ratio written on the chart rather than trusting your eyes.
Key Takeaway:
Always look at the labels and numbers on the axes before looking at the shape of the lines or bars. The shape can be deceptive; the numbers usually aren't.
3. Evaluating Numerical Logic
Sometimes the data presentation is visually "fair," but the way the numbers are grouped is misleading. This is often called "Cherry-Picking" or Selective Presentation.
Absolute Numbers vs. Percentages
An author might use whichever format sounds more dramatic to support their conclusion.
Analogy: Imagine a small village where the number of libraries doubled in one year. That sounds amazing! But if you look at the absolute numbers, it went from \(1\) library to \(2\). While technically a \(100\%\) increase, the significance is much lower than the percentage suggests.
Missing Context or Comparisons
Data is often meaningless without a baseline for comparison. If a document says, "Company X spent \$5,000 on safety last year," we cannot evaluate if that is "a lot" or "a little" unless we know their total budget or what they spent the year before.
The "Time Frame" Trick
When evaluating trends in data, look at the start and end dates. If a graph shows that crime has fallen over the last two years, it might be ignoring the fact that it rose for the ten years before that. The author has "framed" the data to show only the part that helps their argument.
4. Identifying Logic and Relationships
The 9694 syllabus emphasizes identifying logical relationships and patterns. When you evaluate data, ask yourself:
- Is there a correlation? Do two sets of data move together? (e.g., as \(x\) increases, does \(y\) also increase?)
- Is there a missing link? Just because a graph shows two things happening at once doesn't mean one caused the other (this relates to the causal fallacy).
- Are the units consistent? Watch out for data that switches between miles and kilometers, or dollars (\$) and pounds (£), without clearly stating the conversion.
5. Step-by-Step Checklist for the Exam
When you are asked to evaluate the presentation of data in Paper 2 or Paper 4, follow these steps:
- Check the Source: Is the person presenting the data biased? (Does it serve their vested interest?)
- Check the Axes: Does the Y-axis start at \(0\)? Are the intervals equal?
- Check the Labels: Are the units clear? Is it "thousands," "millions," or "percentages"?
- Look for Omissions: Is there a gap in the timeline? Is a crucial piece of comparison data missing?
- Identify Patterns: Does the data actually support the main conclusion of the argument, or does it only support a small part of it?
6. Common Mistakes to Avoid
Don't just describe the data: If the question asks you to "evaluate," don't just say, "The graph shows that sales went up." Instead, say, "The graph exaggerates the rise in sales by using a truncated Y-axis starting at 90."
Don't confuse "data" with "argument": Data is evidence. The argument is what the author claims because of that data. Your job is to see if the bridge between the data and the claim is strong.
Don't ignore the "small print": Always read the footnotes or the key/legend of a chart. Important assumptions are often hidden there.
Summary Review
Presentation is about how data is "packaged." To be a top-level Thinking Skills student, you must look past the pretty colors and dramatic curves of a graph to see the mathematical reality underneath. Always ask: "Is this data showing me the whole truth, or just the version of the truth that the author wants me to see?"
Quick Quiz for Yourself:
If a bar chart shows that "Product A" is twice as tall as "Product B," but the Y-axis starts at \(500\) and Product A is \(510\) while Product B is \(505\), is the visual presentation fair?
(Answer: No, the visual height suggests a \(100\%\) difference, but the actual numerical difference is only about \(1\%\)!)