Documents and official statistics in educational research

Introduction to Documents and Official Statistics

In your AQA Sociology Paper 1, you will often be asked to evaluate how a specific research method works when applied to a topic in education. This is called Methods in Context. In this chapter, we are looking at secondary data—information that already exists and wasn't collected by the researcher themselves. Specifically, we are looking at Official Statistics (numbers) and Documents (words and images).

Don't worry if this seems a bit "dry" at first! These methods are actually like being a detective. You are looking at clues left behind by schools, the government, and even students to figure out what is really going on in the education system.

1. Official Statistics in Education

Official Statistics are quantitative data (numbers) collected by government bodies. In education, the most common examples are exam results (like GCSE and A-Level grades), attendance records, and school league tables.

Practical Strengths and Limitations

Strengths:
- Easy to access: Most educational statistics are published online by the government. This saves the researcher a lot of time and money.
- Comparison: Because the government collects this data every year, researchers can easily see trends over time (e.g., are girls doing better than they were 10 years ago?).
- Large Scale: These statistics cover almost every school and pupil in the UK, making them highly representative.

Limitations:
- The "Soft" Side: Statistics don't tell us why things happen. They might show that students from certain backgrounds do less well, but they don't explain the feelings or meanings behind those numbers.
- Availability: The government only collects data that is useful for policy. If a sociologist wants to study something specific, like "how many hours of sleep students get," there might not be any official statistics for it.

Theoretical Perspectives

- Positivists: They love official statistics! They see them as objective "social facts" that are reliable and can be used to test hypotheses and find cause-and-effect relationships.
- Interpretivists: They are much more skeptical. They argue that statistics are socially constructed. For example, attendance records only show who was "officially" there, not who skipped a lesson after registration or who was sent out of class.

Key Takeaway: Statistics are great for seeing the "big picture" (patterns and trends) but bad for understanding individual experiences.

2. Documents in Education

Documents are qualitative data. In educational research, we split them into two main types: Public Documents and Personal Documents.

Public Documents

These are produced by organisations like schools or the government. Examples include Ofsted reports, school prospectuses, textbooks, and school websites.

- Strength: They can reveal the "hidden curriculum" or the school ethos. For instance, a school prospectus might focus heavily on sports or traditional values, telling us what the school thinks is important.
- Limitation: They are often publicity tools. A school website is designed to make the school look good to parents, so it might not be a totally honest account of what life is like there.

Personal Documents

These are private items created by individuals. Examples include students' diaries, letters between parents and teachers, or even graffiti on school desks.

- Strength: They provide high validity. They give a "raw" and honest look at how students or teachers feel about school life.
- Limitation: They are very difficult to get hold of (access) and may be unrepresentative because only certain types of people keep diaries.

Theoretical Perspectives

- Interpretivists: They value documents because they provide meaning. They allow the researcher to see the world through the eyes of the person who wrote the document.
- Positivists: They often dislike documents because they are unreliable and subjective. It is hard to turn a student's diary into a general law that applies to everyone.

3. Applying Methods in Context (The 20-Mark Question)

In your exam, you won't just be asked "what are statistics?" You will be asked how they work when investigating a specific group, like pupils, teachers, or parents.

Investigating Pupils

- Statistics: Very useful for comparing the achievement of different ethnic groups or social classes. Because the data is anonymous, there are few ethical issues.
- Documents: Personal documents like notes passed in class or graffiti can help researchers understand pupil subcultures without the "observer effect" (where pupils change their behaviour because they know they are being watched).

Investigating Teachers and Schools

- Statistics: Researchers can use league tables to see how marketisation policies (like school choice) affect different schools.
- Documents: Ofsted reports are a "goldmine" for researchers studying school performance. However, teachers may "perform" for Ofsted, so the reports might not reflect everyday reality.

Investigating Parents

- Documents: Parental newsletters or PTA minutes can show how much social capital middle-class parents have compared to working-class parents. Middle-class parents may be more likely to engage with these written documents.

4. Summary of Strengths and Limitations (PET)

Use the PET acronym to remember your evaluation points:

P - Practical Issues:
- Statistics: Cheap and fast to use. (Strength)
- Documents: Personal documents are very hard to find. (Limitation)

E - Ethical Issues:
- Statistics: Very safe as they are usually anonymous. (Strength)
- Documents: Using private diaries raises big privacy and consent concerns. (Limitation)

T - Theoretical Issues:
- Reliability: Statistics are high in reliability because the same data is collected the same way every year.
- Validity: Documents are high in validity because they provide deep, qualitative insights into thoughts and feelings.

Common Mistakes to Avoid

1. Forgetting the "Context": Don't just list the pros and cons of statistics. You must link them to education. Talk about GCSEs, schools, and teachers.
2. Mixing up Reliability and Validity: Remember, Reliability is about being able to repeat the research and get the same result (numbers/stats). Validity is about getting a true, "real-life" picture (words/documents).
3. Assuming Statistics are "True": Always remember the Interpretivist view—statistics are created by people (like teachers filling in registers) and can be manipulated or contain errors.

Quick Review Quiz

- Which group (Positivists or Interpretivists) prefers Official Statistics? (Answer: Positivists)
- Is a school prospectus a "public" or "personal" document? (Answer: Public)
- Give one practical reason why sociologists use government data. (Answer: It's free/cheap and easy to access)

Note: For more information on how these compare to other methods, see the chapters on Questionnaires and Observation.