Introduction to Conditional Probability and Independence

Welcome! In this chapter, we are moving beyond simple "what is the chance of this happening?" questions. We are going to look at how new information changes the odds. Imagine you are picking a card from a deck. The chance of it being a King is one thing, but if I tell you "the card is a face card," the chance of it being a King suddenly goes up! This is the essence of conditional probability.

We will also look at independent events—those rare moments in life where one thing happening has absolutely no effect on another. Whether you're a math whiz or find statistics a bit "hit or miss," these tools will help you calculate risks and outcomes with precision.

1. Conditional Probability: The "Given That" Rule

Conditional probability is the probability of an event occurring, given that another event has already happened. We use a vertical line \(|\) to represent "given that."

The notation \(P(A|B)\) is read as: "The probability of event \(A\) occurring given that event \(B\) has already occurred."

The Fundamental Formula

To find the conditional probability, we use this formula:

\(P(A|B) = \frac{P(A \cap B)}{P(B)}\)

Where:

  • \(P(A \cap B)\) is the probability of both \(A\) and \(B\) happening (the intersection).
  • \(P(B)\) is the probability of the condition (the event that has already happened).

Top Tip: Always divide by the event that comes AFTER the vertical line! If it's \(P(B|A)\), you divide by \(P(A)\).

Using Frequency Tables

The OxfordAQA syllabus often uses frequency tables to test this. This is great for us because it makes the math much simpler—you just look at a specific row or column!

Example: 100 students were asked if they like Math or History.

- 40 students like Math.
- 30 students like History.
- 10 students like both.

If we pick a student who likes History, what is the probability they also like Math?
We want \(P(\text{Math}|\text{History})\).

\(P(\text{Math}|\text{History}) = \frac{\text{Number who like both}}{\text{Total who like History}} = \frac{10}{30} = \frac{1}{3}\)

Key Takeaway: Conditional probability "shrinks" your world. Instead of looking at everyone, you only look at the group defined by the "given" condition.

2. The Multiplication Law

We can rearrange our conditional probability formula to find the probability of two events happening one after the other. This is the Multiplication Law.

The General Formula:
\(P(A \cap B) = P(B) \times P(A|B)\)

This tells us that to find the probability of \(A\) and \(B\) happening, we take the probability of the first event and multiply it by the probability of the second event knowing the first one happened.

Don't worry if this seems tricky! Just remember: "And" usually means multiply.

Real-World Example:
Suppose you have a bag with 5 red marbles and 3 blue marbles. You pick two marbles without putting the first one back (this is called without replacement).
What is the probability of picking two red marbles?
1. Probability the first is red: \(P(R_1) = \frac{5}{8}\)
2. Probability the second is red given the first was red: \(P(R_2|R_1) = \frac{4}{7}\) (because there are only 4 red left and 7 total).
3. Total probability: \(\frac{5}{8} \times \frac{4}{7} = \frac{20}{56} = \frac{5}{14}\)

3. Independent Events

Two events are independent if the occurrence of one does not change the probability of the other. In other words, they don't care about each other!

The Test for Independence:
Two events \(A\) and \(B\) are independent if and only if:
\(P(A|B) = P(A)\)
OR
\(P(A \cap B) = P(A) \times P(B)\)

Example:
If you flip a coin and roll a die, the result of the coin doesn't change the chance of rolling a 6. These are independent.
If \(P(\text{Heads}) = 0.5\) and \(P(\text{Six}) = \frac{1}{6}\), then:
\(P(\text{Heads and Six}) = 0.5 \times \frac{1}{6} = \frac{1}{12}\)

Common Pitfall: Independent vs. Mutually Exclusive

Students often mix these up. Here is the simple difference:

  • Mutually Exclusive: The events cannot happen at the same time (e.g., being in London and Paris at the same moment). \(P(A \cap B) = 0\).
  • Independent: The events can happen together, but they don't influence each other (e.g., it's raining in London and you are eating an apple).

Did you know? If two events have non-zero probabilities and are mutually exclusive, they cannot be independent! If one happens, the probability of the other immediately drops to zero, so they definitely influence each other.

4. Solving Problems: Tree Diagrams and Venn Diagrams

The syllabus says exams won't require you to draw these, but they are incredibly helpful tools for your own working out.

Tree Diagrams

Use these when you have a sequence of events (one after another). Multiply along the branches to find the probability of a specific outcome.

Venn Diagrams

Use these when you are looking at groups that overlap. - The "middle" (intersection) is \(P(A \cap B)\). - The total inside circle \(A\) is \(P(A)\). - The part of circle \(A\) that doesn't overlap is \(P(A \cap B')\).

Quick Review Box:
1. Conditional: \(P(A|B) = \frac{P(A \cap B)}{P(B)}\)
2. Multiplication Law: \(P(A \text{ and } B) = P(A) \times P(B|A)\)
3. Independence Check: Does \(P(A) \times P(B) = P(A \cap B)\)? If yes, they are independent!
4. Notation: Remember \(A'\) means "Not A" (the complement rule, covered in the previous chapter).

Summary Checklist

  • Can I calculate \(P(A|B)\) from a frequency table?
  • Do I know to multiply probabilities for "and" events?
  • Can I prove if two events are independent using the formula?
  • Do I remember that \(P(B)\) must not be zero for \(P(A|B)\) to exist?

Next up in Unit S1, we will look at Discrete Random Variables, where we start using these probability rules to calculate averages and spreads!