Questionnaires and experiments in educational research

Welcome to Methods in Context!

In this chapter, we are looking at how sociologists use questionnaires and experiments specifically within the world of education. This is for the "Methods in Context" part of your Paper 1 exam. Instead of just asking "Is a questionnaire good?", you need to ask "Is a questionnaire good for studying pupils, teachers, or parents?"

Don't worry if this seems like a lot to remember. The trick is to always imagine yourself as the researcher standing at the school gates. What problems would you face? Let's dive in!

1. Questionnaires in Educational Research

Questionnaires are lists of written questions. They are a favorite for Positivist sociologists because they provide quantitative data (numbers and percentages) that help identify patterns, such as the link between social class and exam results.

Practical Strengths and Limitations

• The "Captive Audience": Schools are great for researchers because hundreds of students are in one building. If a headteacher agrees, you can hand out 100 questionnaires in one assembly and get them back immediately. This creates a very high response rate.
• Literacy Levels: This is a big "Context" point! If you are researching primary school children, a written questionnaire might be useless because their reading skills aren't developed yet. They might misunderstand the questions or get bored.
• Access: While students are easy to find, parents are hard to reach. Questionnaires sent home in "school bags" often get lost, leading to a low response rate from families.

Ethical Issues

• Anonymity: Questionnaires are great for sensitive topics like bullying or truancy. Students are more likely to be honest if they don't have to write their name.
• Informed Consent: Since many students are under 16, sociologists usually need "gatekeeper" permission (from the headteacher) and parental consent. This can be a slow and difficult process.

Theoretical Issues (Validity and Reliability)

• Reliability: Questionnaires are highly reliable. Because the questions are standardized (the same for everyone), another researcher could repeat the study and should get similar results.
• Validity (The Truth): Children might give "socially desirable" answers. For example, they might say they study 5 hours a night because they think that’s what the researcher (an adult) wants to hear. This lowers the validity of the data.

Quick Review: Questionnaires are fast and reach many people, but they rely on the students being able to read and willing to tell the truth to an adult researcher.

2. Experiments in Educational Research

In Sociology, we look at two main types: Laboratory Experiments (in a controlled room) and Field Experiments (out in the real world, like a classroom).

Laboratory Experiments in Education

These are rare because schools are "open systems" with too many things happening at once to control in a lab.
Example: A researcher might show teachers a photo of a "naughty" looking child and ask them to predict their grades.

• Strength: They allow the researcher to isolate one specific variable (like a child's appearance).
• Limitation: They lack ecological validity. A teacher might behave differently in a lab than they would in a busy, noisy classroom.

Field Experiments in Education

These take place in the actual school. The researcher might secretly change something to see the effect. For example, they might tell a teacher that a random group of students are "high achievers" to see if the teacher’s expectations change the students' actual grades.

Practical Strengths and Limitations

• Complexity: It is almost impossible to control all variables in a school. A student's progress might be affected by their home life, their friends, or a different teacher, not just the experiment.
• Scale: Field experiments are usually small-scale. You can't easily run a "secret" experiment across 50 different schools at once.

Ethical Issues (The Big One!)

• Deception: Many field experiments rely on lying to the participants (e.g., not telling a teacher which students are actually "smart"). This is ethically "grey" territory.
• Harm to Students: If an experiment involves giving one group of students "extra praise" and ignoring another, the group that was ignored might suffer lower self-esteem or worse grades. Is it fair to use children as "guinea pigs"?

Theoretical Issues

• The Hawthorne Effect: If students or teachers realize they are being watched or part of an experiment, they will change their behavior. This makes the results invalid.
• Interpretivism vs. Positivism: Positivists like experiments because they look for "cause and effect." However, Interpretivists argue that experiments fail to capture the "meaning" behind why teachers and students act the way they do.

Key Takeaway: Experiments are powerful for showing how teacher expectations work, but they are very difficult to pull off ethically and practically in a school setting.

3. Summary Table: Questionnaires vs. Experiments

Use this table to quickly compare the two methods for your exam answers.

4. Exam Tip: The 20-Mark Question

In your exam, you will get an Item (a short text). It will ask you to evaluate a method (like Questionnaires) for a specific topic (like "Investigating Ethnic Differences in Achievement").

Don't just talk about the method! You must link the method to the people involved:

• Pupils: Consider their age, vulnerability, and whether they understand the language used.
• Teachers: Consider if they are too busy to help, or if they are "protecting their professional image" (they don't want to look like bad teachers).
• Parents: Consider how hard they are to contact and if they feel intimidated by the school.
• Classrooms: Consider the physical environment—is it too small? Too public?

Memory Trick: Think P.E.T.
Practical (Time, Money, Access)
Ethical (Consent, Privacy, Harm)
Theoretical (Validity, Reliability, Representativeness)

Quick Check:

If a question asks about using Questionnaires to study Illegal Drug Use in Schools, what is the biggest strength?
Answer: Anonymity. Students are much more likely to admit to something illegal on a private piece of paper than in a face-to-face interview!