Introduction to Conditional Probability and Independence

Welcome to one of the most important chapters in Statistics! So far, you have likely looked at probability as the "chance" of something happening in isolation. However, in the real world, events are often linked. If you know that it is cloudy, the "chance" of it raining changes. This is the heart of conditional probability—it is all about how our knowledge of one event affects the likelihood of another.

In this chapter, we will learn how to calculate these probabilities and, just as importantly, how to prove when two events have absolutely no effect on each other (independence).

1. Understanding Conditional Probability

Conditional probability is the probability of an event \(A\) occurring, given that another event \(B\) has already happened. We use a vertical line to represent "given that".

Notation: \(P(A | B)\) means "the probability of \(A\) given \(B\)".

The Intuition

Imagine a standard deck of 52 cards.
1. The probability of picking a King, \(P(K)\), is \(\frac{4}{52}\).
2. If I tell you "the card I picked is a face card", your world has shrunk. You are no longer looking at 52 cards; you are only looking at the 12 face cards.
3. The probability of it being a King given it is a face card, \(P(K | F)\), is now \(\frac{4}{12}\).

The Formula

To calculate conditional probability, we use the following relationship:
\(P(A | B) = \frac{P(A \cap B)}{P(B)}\)

Where:
\(P(A \cap B)\) is the probability of both \(A\) and \(B\) happening (the intersection).
\(P(B)\) is the probability of the "given" event.

Quick Tip: Always divide by the probability of the event that comes after the vertical bar. If the question says "given \(B\)", \(P(B)\) goes on the bottom!

2. The Multiplication Law

We can rearrange the conditional probability formula to find the probability of both events happening. This is known as the multiplication law.

\(P(A \cap B) = P(B) \times P(A | B)\)

Or, if we know the condition of \(A\) first:
\(P(A \cap B) = P(A) \times P(B | A)\)

Example: If the probability it rains is 0.3 (\(P(R) = 0.3\)) and the probability you carry an umbrella given it is raining is 0.8 (\(P(U | R) = 0.8\)), then the probability it rains and you have your umbrella is:
\(P(R \cap U) = 0.3 \times 0.8 = 0.24\)

Key Takeaway: Use the multiplication law when events are "dependent"—where one event's outcome influences the next.

3. Statistical Independence

Two events are independent if the occurrence of one does not change the probability of the other. In other words, they have no relationship at all.

How to determine Independence

In your exam, you might be asked to "determine" or "show" if two events are independent. You can use any of these three mathematical tests. If the equations balance, the events are independent!

Test 1: \(P(A \cap B) = P(A) \times P(B)\)
Test 2: \(P(A | B) = P(A)\)
Test 3: \(P(B | A) = P(B)\)

Analogy: Imagine rolling a die and tossing a coin. Getting a 6 on the die does not change the 0.5 chance of the coin landing on Heads. Therefore, these events are independent. You would find that \(P(\text{Heads} | \text{Six}) = P(\text{Heads}) = 0.5\).

4. Mutually Exclusive vs. Independent

This is a common area where students lose marks. These two terms mean very different things!

Mutually Exclusive: The events cannot happen at the same time.
Example: A coin landing on Heads and Tails at the same time.
Formula: \(P(A \cap B) = 0\)

Independent: The events can happen at the same time, but they don't affect each other.
Example: It's Tuesday and you win the lottery.
Formula: \(P(A \cap B) = P(A) \times P(B)\)

Common Mistake: Don't assume that because \(P(A \cap B) = 0\), the events are independent. In fact, if two events are mutually exclusive, they are never independent (because if one happens, the probability of the other happening becomes zero!).

5. Using Representations

While this chapter focuses on the logic of conditional probability, you will often use visual tools to find the numbers you need. (Note: Detailed construction of these is covered in the chapter "Tree diagrams, Venn diagrams and two-way tables").

  • Two-way Tables: Excellent for conditional probability. If asked for \(P(A | B)\), you simply look only at the total for column/row \(B\) and use that as your denominator.
  • Venn Diagrams: Useful for seeing the intersection \(P(A \cap B)\) and the complements \(A'\). Remember that \(A'\) means "not \(A\)".
  • Tree Diagrams: The second set of branches on a tree diagram actually represents conditional probabilities. For example, the branch for "Event B" following "Event A" is \(P(B | A)\).

6. Summary and Quick Review

Key Formulas to Recall:

  • Conditional Probability: \(P(A | B) = \frac{P(A \cap B)}{P(B)}\)
  • Multiplication Law: \(P(A \cap B) = P(A) \times P(B | A)\)
  • Addition Law: \(P(A \cup B) = P(A) + P(B) - P(A \cap B)\) (Useful to find the intersection)
  • Independence Check: \(P(A \cap B) = P(A)P(B)\) or \(P(A | B) = P(A)\)

Step-by-Step for Exam Questions:
1. Identify what the "given" information is.
2. Write down the notation (e.g., \(P(\text{Late} | \text{Bus})\)).
3. Find the probability of the intersection (both happening).
4. Divide the intersection by the probability of the "given" condition.
5. If testing for independence, calculate \(P(A) \times P(B)\) and see if it equals your \(P(A \cap B)\).

Did you know? Conditional probability is used in medical testing. The probability that a test is positive given you have a disease is often different from the probability you have the disease given a positive test. Distinguishing between these two is vital for doctors! (You will explore this further in the Bayes' Theorem chapter).