Introduction to Two-Way ANOVA Without Replication
In your study of One-Way ANOVA, you learned how to test if different levels of a single factor (like three different types of medicine) have different effects. But what if there is another variable that might interfere with your results? For example, what if the patients in your trial have different fitness levels?
This is where Two-Way Analysis of Variance (ANOVA) without replication comes in. It allows us to look at a primary factor while "blocking" out the noise from a second factor. In the Pearson Edexcel syllabus, this is specifically linked to the Randomised Block Design.
Don't worry if the tables look a bit bigger than what you are used to; the logic follows the same path as One-Way ANOVA!
1. The Randomised Block Design
In a Randomised Block Design, we group experimental units into "blocks" that are similar to each other. This helps us ensure that any differences we see are actually due to the factor we are testing, rather than some other background difference.
- The Factor: The main variable you are interested in (e.g., Types of Fertilizer).
- The Block: A secondary variable that might affect the outcome, which we want to control (e.g., Different Plots of Land).
- Without Replication: This means there is only one data point for each combination of factor and block. For example, Fertilizer A is used exactly once on Plot 1.
Analogy: Imagine testing how fast three different cars go. If you test them on three different types of road (sand, asphalt, and ice), the road type will definitely affect the speed. By treating the "Road Type" as a block, you can separate the "road effect" from the "car effect."
2. Assumptions and the Model
For the results of a Two-Way ANOVA to be valid, we make a few specific assumptions about the data:
The Additive Model: we assume that the value of any observation is simply the sum of the overall mean, the effect of the factor, the effect of the block, and a random error. Mathematically, we assume the errors are:
\( \text{Distributed as } N(0, \sigma^2) \)
Key Assumptions to Identify in Exams:
- The data in each "cell" comes from a Normal Distribution.
- The Variances of these distributions are equal (homoscedasticity).
- The effects are additive (the factor and the block don't "interact" in a complex way).
3. Setting up Hypotheses
In a Two-Way ANOVA without replication, you are usually testing the main factor, but you can also test the blocking factor. You will have two sets of hypotheses:
Test for the Main Factor (Rows):
- \(H_0\): There is no difference between the means of the factor levels.
- \(H_1\): At least one factor level mean is different.
Test for the Blocking Factor (Columns):
- \(H_0\): There is no difference between the means of the blocks.
- \(H_1\): At least one block mean is different.
4. The ANOVA Table and Calculations
In your exam, you will likely be given a partially completed table or computer output. You need to know how the "Sums of Squares" (SS) relate to each other. The formula booklet provides the specific formulas, but here is the structure:
The Fundamental Identity:
\( SS_{Total} = SS_{Rows} + SS_{Columns} + SS_{Residual} \)
Where:
- \( SS_{Rows} \): Variation due to the main factor.
- \( SS_{Columns} \): Variation due to the blocks.
- \( SS_{Residual} \): The "Error" or "Remainder" variation that we can't explain.
Degrees of Freedom (df)
If you have \( r \) rows and \( c \) columns:
- Rows df: \( r - 1 \)
- Columns df: \( c - 1 \)
- Residual (Error) df: \( (r - 1)(c - 1) \)
- Total df: \( n - 1 \) (where \( n = r \times c \))
Quick Tip: The degrees of freedom for Rows, Columns, and Residual must add up to the Total df!
Mean Squares (MS) and the F-Statistic
To find the Mean Square, you divide the Sum of Squares by the degrees of freedom:
\( MS = \frac{SS}{df} \)
The F-test statistic is always calculated by dividing the MS of the factor you are testing by the Residual MS:
\( F_{Rows} = \frac{MS_{Rows}}{MS_{Residual}} \)
5. Step-by-Step: Conducting the Test
Step 1: State Hypotheses. Be clear about which factor is which.
Step 2: Find the Critical Value. Use the \( F \)-tables in your formula booklet. You need the significance level (usually \( 5\% \)) and two sets of degrees of freedom:
\( \nu_1 = df \text{ for the factor being tested} \)
\( \nu_2 = df \text{ for the Residual (Error)} \)
Step 3: Calculate/Identify the F-statistic. This is usually \( \frac{MS_{Factor}}{MS_{Residual}} \).
Step 4: Compare and Conclude.
If \( F_{calc} > F_{crit} \), you reject \( H_0 \).
There is significant evidence of a difference between the means.
Step 5: Context. Always write your final sentence in terms of the original problem (e.g., "There is evidence that the type of fertilizer affects crop growth").
6. Summary Table for Quick Review
| Source of Variation | Sum of Squares (SS) | Degrees of Freedom (df) | Mean Square (MS) | F-ratio |
|---|---|---|---|---|
| Rows (Factor A) | \( SS_R \) | \( r - 1 \) | \( MS_R = \frac{SS_R}{r-1} \) | \( \frac{MS_R}{MS_{Res}} \) |
| Columns (Blocks) | \( SS_C \) | \( c - 1 \) | \( MS_C = \frac{SS_C}{c-1} \) | \( \frac{MS_C}{MS_{Res}} \) |
| Residual (Error) | \( SS_{Res} \) | \( (r-1)(c-1) \) | \( MS_{Res} = \frac{SS_{Res}}{df_{Res}} \) | - |
| Total | \( SS_{Total} \) | \( n - 1 \) | - | - |
Common Mistakes to Avoid
- Using the wrong denominator for F: In Two-Way ANOVA, you always divide by the Residual MS, never the other factor's MS.
- Mixing up df: When looking up the critical value for the "Rows" test, make sure you use \( df_{Rows} \) and \( df_{Residual} \). Don't accidentally use \( df_{Columns} \).
- Ignoring context: Statistics (9ST0) is all about the "Statistical Enquiry Cycle." A numerical answer without a contextual conclusion will lose marks.
- Misinterpreting "No Replication": Remember, this specific chapter only covers cases where there is one observation per combination. If you see multiple observations in one cell, that is a different type of ANOVA not covered here!
Did you know? Using blocks is one of the most powerful ways to increase the power of a test. By accounting for known differences (like the "Road Type" in our car example), we make it much easier to spot the real differences in the factor we actually care about!