Independent Events: Events A and B are independent if the occurrence of one does not affect the probability of the other.
Dependent Events: Events where the occurrence of one affects the probability of the other.
Bayes' Theorem: Formula to update the probability of a hypothesis based on new evidence.
Law of Total Probability: Method to calculate the probability of an event by considering all possible scenarios.
Posterior Probability: Updated probability after observing new evidence.
Prior Probability: Initial probability before observing evidence.
- Independence Test: \(P(A \cap B) = P(A) \cdot P(B)\) or \(P(A|B) = P(A)\)
- Bayes' Theorem: \(P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}\)
- Law of Total Probability: \(P(B) = \sum P(B|A_i) \cdot P(A_i)\)
- Chain Rule: \(P(A \cap B) = P(A|B) \cdot P(B)\)
Are A and B independent events?
Sample space: S = {1, 2, 3, 4, 5, 6}
A = {2, 4, 6} (even numbers)
B = {4, 5, 6} (numbers > 3)
A ∩ B = {4, 6} (even and > 3)
\(P(A) = \frac{3}{6} = \frac{1}{2}\)
\(P(B) = \frac{3}{6} = \frac{1}{2}\)
\(P(A \cap B) = \frac{2}{6} = \frac{1}{3}\)
\(P(A) \cdot P(B) = \frac{1}{2} \cdot \frac{1}{2} = \frac{1}{4}\)
Since \(P(A \cap B) = \frac{1}{3} \neq \frac{1}{4} = P(A) \cdot P(B)\), A and B are NOT independent.
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{1}{3}}{\frac{1}{2}} = \frac{2}{3}\)
Since \(P(A|B) = \frac{2}{3} \neq \frac{1}{2} = P(A)\), A and B are NOT independent.
Knowing that the die roll is greater than 3 increases the probability that it's even (from 1/2 to 2/3).
Events A and B are dependent because \(P(A \cap B) \neq P(A) \cdot P(B)\).
Are A and B independent events?
Sample space: S = {HH, HT, TH, TT}
A = {HH, HT} (first coin is heads)
B = {HT, TT} (second coin is tails)
A ∩ B = {HT} (first heads, second tails)
\(P(A) = \frac{2}{4} = \frac{1}{2}\)
\(P(B) = \frac{2}{4} = \frac{1}{2}\)
\(P(A \cap B) = \frac{1}{4}\)
\(P(A) \cdot P(B) = \frac{1}{2} \cdot \frac{1}{2} = \frac{1}{4}\)
Since \(P(A \cap B) = \frac{1}{4} = P(A) \cdot P(B)\), A and B ARE independent.
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{\frac{1}{4}}{\frac{1}{2}} = \frac{1}{2}\)
Since \(P(A|B) = \frac{1}{2} = P(A)\), A and B are independent.
The outcome of the first coin flip does not affect the probability of the second coin flip.
Events A and B are independent because \(P(A \cap B) = P(A) \cdot P(B)\).
Are A and B independent events?
Standard deck: 52 cards (26 red, 26 black)
Without replacement: composition changes after first draw
\(P(A) = \frac{26}{52} = \frac{1}{2}\)
\(P(B) = \frac{26}{52} = \frac{1}{2}\) (before any information about A)
If A occurs (first card is red): 25 red, 26 black remain → 51 total
\(P(B|A) = \frac{25}{51}\)
If A' occurs (first card is black): 26 red, 25 black remain → 51 total
\(P(B|A') = \frac{26}{51}\)
Since \(P(B|A) = \frac{25}{51} \neq \frac{1}{2} = P(B)\), A and B are NOT independent.
The first card drawn affects the probability of drawing a red card second.
\(P(A \cap B) = P(A) \cdot P(B|A) = \frac{1}{2} \cdot \frac{25}{51} = \frac{25}{102}\)
\(P(A) \cdot P(B) = \frac{1}{2} \cdot \frac{1}{2} = \frac{1}{4} = \frac{51}{204} = \frac{25.5}{102}\)
Since \(\frac{25}{102} \neq \frac{25.5}{102}\), A and B are dependent.
Events A and B are dependent because drawing the first card changes the composition of the deck for the second draw.
• 95% accuracy rate when the person has the disease
• 90% accuracy rate when the person doesn't have the disease
If a person tests positive, what is the probability they actually have the disease?
Let D = "person has disease", T = "test is positive"
Given: P(D) = 0.01, P(T|D) = 0.95, P(T'|D') = 0.90
Therefore: P(D') = 0.99, P(T|D') = 0.10
P(D) = 0.01 (prior probability of disease)
P(D') = 0.99 (probability of no disease)
P(T|D) = 0.95 (probability of positive test given disease)
P(T|D') = 0.10 (probability of positive test given no disease)
P(T) = P(T|D)·P(D) + P(T|D')·P(D')
P(T) = (0.95)(0.01) + (0.10)(0.99) = 0.0095 + 0.099 = 0.1085
\(P(D|T) = \frac{P(T|D) \cdot P(D)}{P(T)} = \frac{(0.95)(0.01)}{0.1085} = \frac{0.0095}{0.1085} = \frac{95}{1085} = \frac{19}{217} \approx 0.0876\)
Even though the test is quite accurate, only about 8.76% of positive results are true positives.
This demonstrates the importance of considering base rates in medical testing.
The probability that a person who tests positive actually has the disease is approximately 8.76%.
• Machine A produces 60% of the widgets (2% defective rate)
• Machine B produces 40% of the widgets (5% defective rate)
If a randomly selected widget is defective, what is the probability it came from Machine A?
Let A = "widget from Machine A", B = "widget from Machine B", D = "widget is defective"
Given: P(A) = 0.6, P(B) = 0.4, P(D|A) = 0.02, P(D|B) = 0.05
P(A) = 0.6 (probability widget from Machine A)
P(B) = 0.4 (probability widget from Machine B)
P(D|A) = 0.02 (probability defective given Machine A)
P(D|B) = 0.05 (probability defective given Machine B)
P(D) = P(D|A)·P(A) + P(D|B)·P(B)
P(D) = (0.02)(0.6) + (0.05)(0.4) = 0.012 + 0.020 = 0.032
\(P(A|D) = \frac{P(D|A) \cdot P(A)}{P(D)} = \frac{(0.02)(0.6)}{0.032} = \frac{0.012}{0.032} = \frac{12}{32} = \frac{3}{8} = 0.375\)
\(P(B|D) = \frac{P(D|B) \cdot P(B)}{P(D)} = \frac{(0.05)(0.4)}{0.032} = \frac{0.020}{0.032} = \frac{20}{32} = \frac{5}{8} = 0.625\)
Check: \(P(A|D) + P(B|D) = 0.375 + 0.625 = 1.0\) ✓
Even though Machine A produces more widgets, defective widgets are more likely to come from Machine B due to its higher defect rate.
The probability that a defective widget came from Machine A is 37.5%.
Independence: Two events are independent if the occurrence of one does not affect the probability of the other.
Bayes' Theorem: A method to update probabilities based on new evidence.
Conditional Probability: The probability of an event given that another event has occurred.
- Independence Test: \(P(A \cap B) = P(A) \cdot P(B)\)
- Alternative Independence: \(P(A|B) = P(A)\) or \(P(B|A) = P(B)\)
- Bayes' Theorem: \(P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}\)
- Law of Total Probability: \(P(B) = \sum P(B|A_i) \cdot P(A_i)\)
- Chain Rule: \(P(A \cap B) = P(A|B) \cdot P(B)\)
Base Rate Neglect: People often ignore prior probabilities when evaluating conditional probabilities.
Information Update: Bayes' theorem provides a rational way to update beliefs.
Independence Preservation: If A and B are independent, then A and B' are also independent.