Introduction to Evaluation and Refinement

You’ve planned your experiment, collected your data, and drawn your graphs. But in Chemistry, the work doesn't stop there! The final—and arguably most important—step is Evaluation. This is where you look at your results with a critical eye and ask: "How much can I actually trust these numbers?"

In this chapter, we will learn how to distinguish between "good" and "bad" data, identify where things might have gone wrong, and suggest clever ways to make the experiment better next time. This skill is vital for your AO3 (Analysis, Interpretation, and Evaluation) marks in the exam, which make up about a quarter of your total grade!

Note: If you need to review how to draw graphs or calculate gradients, check out the "Analysis of experimental data" chapter.

1. Precision vs. Accuracy: The Gold Standard

Students often use these two words to mean the same thing, but in A-Level Chemistry, they are very different!

Accuracy

Accuracy refers to how close your experimental value is to the true or accepted value. If you calculate the boiling point of water to be \(99.8^{\circ}C\), your result is very accurate because the true value is \(100^{\circ}C\).

Precision

Precision refers to how close your repeated measurements are to each other. If you do a titration three times and get \(24.50\text{ cm}^3\), \(24.55\text{ cm}^3\), and \(24.50\text{ cm}^3\), your results are precise because they are very similar (concordant).

The Dartboard Analogy:
Imagine you are throwing darts at a bullseye:
- Accurate and Precise: All darts hit the bullseye.
- Precise but not Accurate: All darts hit the same spot, but it’s the edge of the board, not the center.
- Accurate but not Precise: The darts are scattered all over, but their average position is the center.

Key Takeaway: You want your experiments to be both! High precision suggests your technique is consistent; high accuracy suggests your method is sound.

2. Identifying Anomalies

An anomaly (or outlier) is a piece of data that does not fit the general trend or does not match your other repeated readings.

How to handle anomalies:
1. Identify: Look for the point on your graph that is far away from the line of best fit, or the titration volume that is \(0.5\text{ cm}^3\) away from the others.
2. Investigate: Did you misread the burette? Did you spill some solid?
3. Process: Never include an anomaly when calculating a mean (average). You should discard it and, if possible, repeat that part of the experiment.

Common Mistake: Don't just ignore a result because it's slightly different. Only discard it if it is significantly outside the range of expected experimental error.

3. Errors: Why isn't my result perfect?

No experiment is perfect. We categorize errors into two main types:

Random Errors

These are unpredictable fluctuations that affect your precision. They might be caused by: - Difficulty in judging the exact color change of an indicator. - Slight changes in room temperature during a rate experiment. - Using a balance that fluctuates because of a breeze in the lab.

The Fix: You can reduce the effect of random errors by repeating the experiment and calculating a mean.

Systematic Errors

These are errors that are the same every time you repeat the experiment. They affect your accuracy. They might be caused by: - A balance that always reads \(0.05\text{ g}\) too high (a zero error). - Heat loss to the surroundings in an enthalpy experiment. - Reading from the top of the meniscus instead of the bottom.

The Fix: You cannot fix these by repeating the experiment. You must refine the design of the experiment (e.g., use better insulation).

Quick Review:
- Random error? Repeat and average.
- Systematic error? Change the equipment or method.

4. Evaluating Limitations and Refining Design

In the exam, you will often be asked to "evaluate the method" or "suggest improvements." Here are some classic OCR A scenarios:

Scenario A: Enthalpy Changes (Calorimetry)

The Problem: Your calculated enthalpy change (\(\Delta H\)) is much lower than the data book value.
The Limitation: Heat loss to the surroundings is the biggest factor.
The Refinement: Use a polystyrene cup with a lid to provide better insulation, or use a bomb calorimeter for more professional results.

Scenario B: Titrations

The Problem: The percentage uncertainty in your burette reading is too high.
The Limitation: The volume of the titre is too small (e.g., only \(5.00\text{ cm}^3\)).
The Refinement: Decrease the concentration of the solution in the burette or increase the mass of the solid in the flask so that a larger volume (closer to \(25.00\text{ cm}^3\)) is required. Larger readings have lower percentage uncertainties!

Scenario C: Gas Collection

The Problem: You didn't collect as much gas as the equation predicted.
The Limitation: Gas escaped before the bung was put on the flask.
The Refinement: Use a divided flask (a small tube inside the flask) so you can mix the reactants after the bung is securely in place.

Did you know? Using a digital thermometer with a resolution of \(0.1^{\circ}C\) instead of \(1^{\circ}C\) doesn't just make the experiment look "fancy"—it significantly reduces the measurement uncertainty of your data!

5. Drawing Conclusions

A good conclusion must be supported by the data you have evaluated. - If your results are precise (close together) and accurate (close to the true value), you can have high confidence in your conclusion. - If your results have a wide spread or many anomalies, your conclusion is uncertain.

The Golden Rule of Evaluation: Always justify your comments. Don't just say "the experiment was bad." Say "the result was likely an underestimate because heat was lost to the surroundings before the temperature could be measured."

Final Chapter Summary

- Accuracy is closeness to the true value; Precision is closeness of repeats.
- Anomalies should be identified, investigated, and excluded from means.
- Random errors affect precision and are reduced by repeats.
- Systematic errors affect accuracy and require a change in method.
- Refining means suggesting specific changes, like better insulation or using larger volumes to reduce percentage uncertainty.