Welcome to Hypothesis Testing: The "Fact-Checker" of Finance
Hello future Charterholders! Welcome to one of the most practical chapters in the Quantitative Methods section. Think of Hypothesis Testing as the "scientific method" for the investment world.
Imagine a fund manager claims their strategy beats the market. Is that true, or were they just lucky this year? Hypothesis testing gives us a mathematical way to decide whether a result is statistically significant or just a lucky coincidence. Don't worry if the math looks intimidating at first—we are going to break it down into simple, logical steps.
1. The Basics: Null vs. Alternative Hypotheses
Every test starts with two opposing statements.
The Null Hypothesis (\(H_0\)): This is the "status quo" or the statement we assume is true until we have enough evidence to prove otherwise. It almost always includes an "equal to" sign (=, ≤, or ≥).
Analogy: In a courtroom, the Null Hypothesis is "The defendant is innocent."
The Alternative Hypothesis (\(H_a\)): This is what the researcher actually wants to prove. It is the "challenge" to the status quo. It never includes an "equal to" sign (<, >, or ≠).
Analogy: The prosecutor's goal is to prove the Alternative Hypothesis: "The defendant is guilty."
Important Rule: We never "accept" the null hypothesis. We either "Reject \(H_0\)" (we found enough evidence for \(H_a\)) or "Fail to Reject \(H_0\)" (we didn't find enough evidence).
Key Takeaway:
Always look for the equals sign. If a statement says "is equal to" or "is at least," it belongs in \(H_0\). If it says "is different from" or "is greater than," it belongs in \(H_a\).
2. One-Tailed vs. Two-Tailed Tests
How do we know which way to look? It depends on the question.
Two-Tailed Test: Use this when you want to know if a value is different (either higher or lower) from the hypothesized value.
Example: \(H_0: \mu = 10\%\) vs. \(H_a: \mu \neq 10\%\).
One-Tailed Test: Use this when you are only interested in one direction (either "greater than" or "less than").
Example: \(H_0: \mu \le 0\) vs. \(H_a: \mu > 0\). (We only care if returns are positive).
Quick Trick: Look at the sign in the Alternative Hypothesis (\(H_a\)). If it is \(\neq\), it’s two-tailed. If it’s \(>\) or \(<\), the "arrow" points to the tail you are testing!
3. Errors in Testing: Type I and Type II
In a perfect world, we’d always be right. In statistics, we can make two types of mistakes:
Type I Error: Rejecting a true null hypothesis. This is like convicting an innocent person. The probability of making a Type I error is called Alpha (\(\alpha\)), also known as the Level of Significance.
Type II Error: Failing to reject a false null hypothesis. This is like letting a guilty person go free. The probability of this error is called Beta (\(\beta\)).
The Power of a Test: This is the probability of correctly rejecting a false null hypothesis. It is calculated as \(1 - \beta\). We want high power!
Memory Aid:
Type I is "False Positive" (You think you found something, but you didn't).
Type II is "False Negative" (There was something there, but you missed it).
4. The Test Statistic: Our Measuring Stick
To make a decision, we calculate a Test Statistic. The general formula for almost every test statistic in this chapter is:
\( \text{Test Statistic} = \frac{\text{Sample Statistic} - \text{Hypothesized Value}}{\text{Standard Error}} \)
Where Standard Error is usually the sample standard deviation divided by the square root of the sample size: \( \frac{s}{\sqrt{n}} \).
Did you know? The test statistic simply tells you how many "standard errors" your sample result is away from the null hypothesis. The further away it is, the more likely we are to reject the null!
5. Choosing the Right Test (z-test vs. t-test)
Students often struggle with which test to pick. Here is a simple guide:
Use the t-test if: You don't know the population variance (which is almost always the case in the real world) and you are using the sample standard deviation (\(s\)).
Note: For t-tests, you need to know the Degrees of Freedom (df), which is usually \(n - 1\).
Use the z-test if: You actually know the population variance (\(\sigma^2\)) or if the sample size is very large (though \(t\) is still technically preferred for unknown variance).
6. The Decision: Rejection Regions and P-values
Once you have your Test Statistic, how do you decide?
Method 1: Critical Values. You compare your calculated test statistic to a "critical value" from a table (based on your significance level, like 5%). If your statistic is more extreme than the critical value, you Reject \(H_0\).
Method 2: The P-value. This is the "probability" method. The p-value is the smallest level of significance at which the null hypothesis can be rejected.
The Golden Rule of P-values:
If p-value < \(\alpha\), then Reject \(H_0\).
If p-value ≥ \(\alpha\), then Fail to Reject \(H_0\).
Mnemonic: "If the p is low, the null must go!"
7. Testing for Variances
Sometimes we don't care about the average (mean); we care about the risk (variance).
Testing ONE variance: We use the Chi-square (\(\chi^2\)) test.
Formula: \( \chi^2 = \frac{(n-1)s^2}{\sigma_0^2} \)
Comparing TWO variances: We use the F-test. This is common when checking if two different stocks have the same level of risk.
Formula: \( F = \frac{s_1^2}{s_2^2} \) (Always put the larger variance on top so \(F > 1\)).
8. Parametric vs. Non-parametric Tests
Parametric Tests: These tests (like the t-test and z-test) assume the data follows a specific distribution (like the normal distribution) and rely on parameters like the mean and variance.
Non-parametric Tests: These are "distribution-free" tests. We use them when:
1. The data doesn't fit a normal distribution.
2. The data is "ranked" (like 1st place, 2nd place) rather than specific numbers.
3. The sample size is very small.
Common mistake to avoid: Don't assume non-parametric tests are "better." They are actually less powerful than parametric tests if the data is normally distributed.
9. Summary Checklist for the Exam
Before moving to the next chapter, make sure you can:
• Correctly identify \(H_0\) and \(H_a\) from a word problem.
• Distinguish between Type I and Type II errors.
• Calculate a t-statistic for a single mean.
• Decide whether to reject \(H_0\) using either critical values or p-values.
• Identify when to use Chi-square (one variance) vs. F-test (two variances).
Don't worry if this seems tricky at first! Hypothesis testing is like learning a new language. Once you get used to the "grammar" of nulls and alternatives, the logic will start to feel like second nature. Keep practicing those calculations!