Introduction to Probability Laws

Welcome to one of the most important parts of your Statistics course! Probability is all about measuring the "chance" of something happening. In this chapter, we are going to look at the "rules of the game"—the laws that tell us how to combine probabilities when we want to find the chance of two or more things happening together or separately.

Whether you are predicting the weather, calculating the risk of an accident, or just playing a board game, these laws help you make sense of uncertainty. Don't worry if it seems like a lot of formulas at first; once you see the logic behind them, they become much easier to remember!

1. Mutually Exclusive Events

The term mutually exclusive is just a fancy way of saying "two things that cannot happen at the same time."

Example: If you roll a single fair dice, you cannot roll a \(3\) and a \(5\) at the same time. These events are mutually exclusive. However, rolling an "even number" and rolling a "multiple of 3" are not mutually exclusive, because you could roll a \(6\) (which is both even and a multiple of 3).

The Addition Law (Foundation & Higher)

If two events, \(A\) and \(B\), are mutually exclusive, the probability of \(A\) OR \(B\) happening is found by adding their individual probabilities:

\(P(A \text{ or } B) = P(A) + P(B)\)

Quick Tip: In probability questions, the word "OR" almost always means you need to ADD.

Exhaustive Events

Events are exhaustive if they cover all possible outcomes. The sum of probabilities for a set of mutually exclusive and exhaustive events is always \(1\) (or \(100\%\)).

Example: In a race, if the only outcomes are "Win", "Lose", or "Draw", then:
\(P(\text{Win}) + P(\text{Lose}) + P(\text{Draw}) = 1\)

2. The General Addition Law (Higher Tier Only)

What happens if two events can happen at the same time? If we just add their probabilities, we "double-count" the bit where they overlap.

To fix this, we use the General Addition Law:

\(P(A \text{ or } B) = P(A) + P(B) - P(A \text{ and } B)\)

Analogy: Imagine a classroom where \(10\) students wear glasses and \(15\) students wear watches. If \(5\) students wear both, and you want to count how many students wear "glasses or a watch," you don't just do \(10 + 15 = 25\). That would count the \(5\) students with both items twice! You do \(10 + 15 - 5 = 20\).

3. Independent Events

Two events are independent if the outcome of the first event has absolutely no effect on the outcome of the second event.

Example: If you flip a coin and it lands on Heads, that doesn't change the chance of the coin landing on Heads on your second flip. Each flip is independent.

The Multiplication Law (Foundation & Higher)

To find the probability of two independent events, \(A\) AND \(B\), both happening, we multiply their probabilities:

\(P(A \text{ and } B) = P(A) \times P(B)\)

Quick Tip: In probability questions, the word "AND" almost always means you need to MULTIPLY.

Testing for Independence (Notation)

Sometimes a question will ask you to prove if two events are independent. You can use the formula above, or check using conditional probability notation:

  • If \(P(A|B) = P(A)\), then the events are independent.
  • This basically says: "The probability of \(A\) happening, given that \(B\) has already happened, is exactly the same as the probability of \(A\) on its own."

4. Summary Table: "Or" vs "And"

If you are ever confused about which law to use, look for these keywords in the question:

Keyword: OR
Operation: Addition (+)
Law: \(P(A \text{ or } B) = P(A) + P(B)\) (if mutually exclusive)

Keyword: AND
Operation: Multiplication (\(\times\))
Law: \(P(A \text{ and } B) = P(A) \times P(B)\) (if independent)

5. Common Mistakes to Avoid

Mistake 1: Confusing Mutually Exclusive with Independent.
These are different! Mutually exclusive means they can't happen together (like being in London and Paris at the same time). Independent means one doesn't affect the other (like you wearing blue socks and your friend in another city wearing blue socks).

Mistake 2: Forgetting to subtract the "overlap" (Higher Tier).
If you are asked for \(P(A \text{ or } B)\) and the events aren't mutually exclusive, you must subtract \(P(A \text{ and } B)\).

Mistake 3: Probabilities greater than 1.
Probabilities always stay between \(0\) and \(1\). If your addition gives you a number like \(1.2\), you've likely forgotten that the events overlap!

Key Takeaways

  • Mutually Exclusive: Cannot happen at the same time. Use the Addition Law.
  • Exhaustive: All possible outcomes. They add up to \(1\).
  • Independent: One does not affect the other. Use the Multiplication Law.
  • Notation: \(P(A|B)\) means "the probability of \(A\) given \(B\)."
  • Check your work: Always ensure your final probability is between \(0\) and \(1\).