Conditional Probability: The probability of event A occurring given that event B has occurred.
Dependent Events: Events where the occurrence of one affects the probability of the other.
Independent Events: Events where the occurrence of one does not affect the probability of the other.
Bayes' Theorem: Formula to update probability based on new evidence.
Law of Total Probability: Method to calculate the probability of an event by considering all possible scenarios.
- Definition: \(P(A|B) = \frac{P(A \cap B)}{P(B)}\) when \(P(B) > 0\)
- Multiplication Rule: \(P(A \cap B) = P(A|B) \cdot P(B)\)
- Independence: \(P(A|B) = P(A)\) when A and B are independent
- Bayes' Theorem: \(P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}\)
- Law of Total Probability: \(P(A) = \sum P(A|B_i) \cdot P(B_i)\)
Let A = "number is even", B = "number is greater than 3"
Sample space: S = {1, 2, 3, 4, 5, 6}
A = {2, 4, 6} (even numbers)
B = {4, 5, 6} (numbers > 3)
A ∩ B = {4, 6} (even and > 3)
P(B) = P(number > 3) = \(\frac{3}{6} = \frac{1}{2}\)
P(A ∩ B) = P(even and > 3) = \(\frac{2}{6} = \frac{1}{3}\)
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{1}{3}}{\frac{1}{2}} = \frac{1}{3} \cdot \frac{2}{1} = \frac{2}{3}\)
Given B occurred, possible outcomes: {4, 5, 6}
Favorable outcomes (even): {4, 6}
P(A|B) = \(\frac{2}{3}\) ✓
The probability that the number is even given it's greater than 3 is \(\frac{2}{3}\).
Let A = "both coins are heads", B = "at least one coin is heads"
Sample space: S = {HH, HT, TH, TT}
A = {HH}
B = {HH, HT, TH} (all except TT)
A ∩ B = {HH}
P(B) = P(at least one head) = \(\frac{3}{4}\)
P(A ∩ B) = P(both heads) = \(\frac{1}{4}\)
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{1}{4}}{\frac{3}{4}} = \frac{1}{4} \cdot \frac{4}{3} = \frac{1}{3}\)
Given B occurred, possible outcomes: {HH, HT, TH}
Favorable outcomes (both heads): {HH}
P(A|B) = \(\frac{1}{3}\) ✓
The probability that both coins show heads given that at least one shows heads is \(\frac{1}{3}\).
Let A = "card is a face card", B = "card is red"
Standard deck: 52 cards (26 red, 26 black)
Face cards: 12 total (3 per suit × 4 suits)
Red cards: 26 (hearts + diamonds)
Red face cards: 6 (J, Q, K of hearts and diamonds)
P(B) = P(red card) = \(\frac{26}{52} = \frac{1}{2}\)
P(A ∩ B) = P(red face card) = \(\frac{6}{52} = \frac{3}{26}\)
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{3}{26}}{\frac{1}{2}} = \frac{3}{26} \cdot \frac{2}{1} = \frac{6}{26} = \frac{3}{13}\)
Given B occurred (red card), possible outcomes: 26
Favorable outcomes (red face cards): 6
P(A|B) = \(\frac{6}{26} = \frac{3}{13}\) ✓
The probability that the card is a face card given it's red is \(\frac{3}{13}\).
• 95% accurate when the person has the disease
• 90% accurate when the person doesn't have the disease
• 2% of the population has the disease
If a person tests positive, what is the probability they actually have the disease?
Let D = "person has disease", T = "test is positive"
Given: P(D) = 0.02, P(T|D) = 0.95, P(T|D') = 0.10
P(D) = 0.02 (probability of having disease)
P(D') = 0.98 (probability of not having disease)
P(T|D) = 0.95 (probability of positive test given disease)
P(T|D') = 0.10 (probability of positive test given no disease)
P(T) = P(T|D)·P(D) + P(T|D')·P(D')
P(T) = (0.95)(0.02) + (0.10)(0.98) = 0.019 + 0.098 = 0.117
\(P(D|T) = \frac{P(T|D) \cdot P(D)}{P(T)} = \frac{(0.95)(0.02)}{0.117} = \frac{0.019}{0.117} = \frac{19}{117} \approx 0.162\)
Even though the test is quite accurate, only about 16.2% of positive results are true positives.
This demonstrates the importance of considering base rates in medical testing.
The probability that a person who tests positive actually has the disease is approximately 16.2%.
Find the probability that:
a) The second ball is red given that the first ball was red
b) Both balls are red
c) The first ball was red given that the second ball is red
Initial: 4 red, 6 blue → Total: 10 balls
Without replacement: composition changes after first draw
After drawing 1 red ball: 3 red, 6 blue → Total: 9 balls
\(P(R_2|R_1) = \frac{3}{9} = \frac{1}{3}\)
Using multiplication rule: \(P(R_1 \cap R_2) = P(R_1) \cdot P(R_2|R_1)\)
\(P(R_1) = \frac{4}{10} = \frac{2}{5}\)
\(P(R_2|R_1) = \frac{3}{9} = \frac{1}{3}\)
\(P(R_1 \cap R_2) = \frac{2}{5} \cdot \frac{1}{3} = \frac{2}{15}\)
Using Bayes' Theorem: \(P(R_1|R_2) = \frac{P(R_2|R_1) \cdot P(R_1)}{P(R_2)}\)
We need \(P(R_2)\): \(P(R_2) = P(R_2|R_1) \cdot P(R_1) + P(R_2|R_1') \cdot P(R_1')\)
\(P(R_2|R_1) = \frac{3}{9}\), \(P(R_1) = \frac{4}{10}\)
\(P(R_2|R_1') = \frac{4}{9}\) (after drawing 1 blue: 4 red, 5 blue)
\(P(R_1') = \frac{6}{10}\)
\(P(R_2) = \frac{3}{9} \cdot \frac{4}{10} + \frac{4}{9} \cdot \frac{6}{10} = \frac{12}{90} + \frac{24}{90} = \frac{36}{90} = \frac{2}{5}\)
\(P(R_1|R_2) = \frac{\frac{3}{9} \cdot \frac{4}{10}}{\frac{2}{5}} = \frac{\frac{12}{90}}{\frac{2}{5}} = \frac{12}{90} \cdot \frac{5}{2} = \frac{60}{180} = \frac{1}{3}\)
a) \(P(R_2|R_1) = \frac{1}{3}\), b) \(P(R_1 \cap R_2) = \frac{2}{15}\), c) \(P(R_1|R_2) = \frac{1}{3}\)
Conditional Probability: The probability of an event A given that event B has occurred, denoted as P(A|B).
Dependence: When knowledge of one event changes the probability of another event.
Bayes' Theorem: A formula for updating probabilities based on new evidence.
- Conditional Probability: \(P(A|B) = \frac{P(A \cap B)}{P(B)}\)
- Multiplication Rule: \(P(A \cap B) = P(A|B) \cdot P(B)\)
- Bayes' Theorem: \(P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}\)
- Law of Total Probability: \(P(A) = \sum P(A|B_i) \cdot P(B_i)\)
- Independence Check: \(P(A|B) = P(A)\) if A and B are independent
Base Rate Fallacy: Ignoring prior probabilities when interpreting conditional probabilities.
Time Order: The conditioning event comes first in sequence.
Normalization: Conditional probability is calculated within the reduced sample space.