Welcome to the World of Probability!

Ever wondered what the chances are of winning a game, or why weather forecasts talk about a "20% chance of rain"? That’s probability in action! In this chapter, we are going to look at how to measure "chance" using math. We will focus on finite sample spaces—which just means situations where there are a limited number of possible outcomes, like rolling a die or picking a card from a deck.

Don't worry if this seems tricky at first! Probability is very logical once you get the hang of the basic "rules of the game." We’ll break everything down step-by-step.


1. The Basics: Outcomes and Events

Before we calculate anything, we need to know what could happen. This is called the sample space.

Key Terms

  • Sample Space: The set of all possible outcomes of an experiment.
  • Event: A specific outcome or a collection of outcomes we are interested in (e.g., "rolling an even number").
  • Equally Likely Outcomes: When every outcome in the sample space has the same chance of happening (like a fair coin or a fair die).

The Probability Formula

If all outcomes are equally likely, the probability of an event \( A \), written as \( P(A) \), is:

\[ P(A) = \frac{\text{Number of outcomes in event } A}{\text{Total number of outcomes in the sample space}} \]

Example: Rolling a fair 6-sided die. What is the probability of rolling a prime number (2, 3, or 5)?
The total outcomes are 6. There are 3 prime numbers. So, \( P(\text{Prime}) = \frac{3}{6} = 0.5 \).

Complementary Events

The complement of event \( A \) is the event that \( A \) does not happen. We write this as \( A' \) (read as "A prime" or "not A").

Important Point: Since something must either happen or not happen, the probabilities always add up to 1:

\[ P(A) + P(A') = 1 \quad \text{or} \quad P(A') = 1 - P(A) \]

Quick Review Box

1. Probabilities are always between 0 (impossible) and 1 (certain).
2. If you know the chance of winning is 0.3, the chance of losing is \( 1 - 0.3 = 0.7 \).


2. Expected Frequency

If you know the probability of an event, you can predict how many times it will happen if you repeat the experiment many times.

Expected Frequency = \( n \times P(A) \)
(Where \( n \) is the number of trials.)

Example: If the probability of a seed germinating is 0.8 and you plant 50 seeds, you "expect" \( 50 \times 0.8 = 40 \) seeds to grow.


3. Visualising Probability: Venn and Tree Diagrams

Sometimes math is easier when you can see it! We use three main types of diagrams:

Venn Diagrams

These use circles to show relationships between events.

  • The intersection \( P(A \cap B) \) is where circles overlap (Both A AND B).
  • The union \( P(A \cup B) \) is everything inside both circles (Either A OR B or both).

Tree Diagrams

Great for "multi-stage" events (e.g., picking two socks one after another).
Tip: Multiply probabilities along the branches; add probabilities down the ends of the branches.

Sample Space Diagrams

Usually a grid or table used when you have two separate things happening at once, like rolling two dice and adding the scores.


4. Combined Events: OR and AND

This is where we look at how two different events interact.

Mutually Exclusive Events (The "OR" Rule)

Events are mutually exclusive if they cannot happen at the same time.
Analogy: You cannot be in London and Paris at the exact same moment.

For mutually exclusive events:

\[ P(A \cup B) = P(A) + P(B) \]

Note: In a Venn diagram, mutually exclusive circles do not overlap, so \( P(A \cap B) = 0 \).

Independent Events (The "AND" Rule)

Events are independent if the outcome of one does not change the probability of the other.
Analogy: Tossing a coin and then rolling a die. The die doesn't care what the coin did!

For independent events:

\[ P(A \cap B) = P(A) \times P(B) \]

The General Addition Rule

What if events can happen at the same time (not mutually exclusive)? If you just add their probabilities, you "double-count" the middle bit. So, we subtract the overlap:

\[ P(A \cup B) = P(A) + P(B) - P(A \cap B) \]


5. Conditional Probability

This is the probability of an event happening given that another event has already happened. We use the vertical bar \( | \).

\( P(A | B) \) means "The probability of A happening, given that we know B has happened."

The Formula

\[ P(A | B) = \frac{P(A \cap B)}{P(B)} \]

How to think about it: Imagine a Venn diagram. If you are told "Event B has happened," the whole world outside of Circle B disappears. Your new "total" is just Circle B, and the "favourable" part is the overlap where A also lives.

Checking for Independence (The Test)

You can prove two events are independent if:
\( P(A | B) = P(A) \)
(This literally means the probability of A is the same whether B happened or not!)


Common Mistakes to Avoid

  • Adding when you should multiply: Use "AND = Multiply" and "OR = Add".
  • Forgetting to subtract the intersection: When finding \( P(A \cup B) \), always ask: "Can these happen at the same time?" If yes, subtract the overlap!
  • Denominator errors in Conditional Probability: Always divide by the probability of the event that is given (the one after the vertical bar).

Summary Key Takeaways

- Sum of all probabilities in a sample space = 1.

- \( P(\text{Not } A) = 1 - P(A) \).

- Mutually Exclusive: Cannot happen together. Add them up for "OR".

- Independent: Do not affect each other. Multiply them for "AND".

- Conditional: \( P(A|B) \) shrinks your sample space to just the outcomes in B.

Did you know? Probability theory started largely because of gamblers in the 17th century wanting to know their odds in dice games. Today, it's the foundation of insurance, weather forecasting, and even AI!