Conditional Probability: P(A|B) = P(A ∩ B) / P(B), the probability of A given that B has occurred.
- Identify the given condition (B)
- Identify the event of interest (A)
- Calculate P(A ∩ B) and P(B), or use the direct conditional approach
- Apply the formula: P(A|B) = P(A ∩ B) / P(B)
Given: First marble is red (condition), Find: Second marble is red (event)
After drawing one red marble: 4 red marbles, 3 blue marbles, total 7 marbles
P(Second Red | First Red) = 4/7 (remaining red marbles / total remaining marbles)
P(First Red ∩ Second Red) = (5/8) × (4/7) = 20/56 = 5/14
P(First Red) = 5/8
P(Second Red | First Red) = (5/14) ÷ (5/8) = (5/14) × (8/5) = 4/7 ✓
First marble is red
Remaining: 4R, 3B
P(Second Red | First Red)
= 4/7
Given that the first marble was red, there are 4 red marbles left out of 7 total marbles. Therefore, P(Second Red | First Red) = 4/7.
• Definition: P(A|B) = P(A ∩ B) / P(B)
• Alternative: P(A|B) = |A ∩ B| / |B| (when outcomes are equally likely)
D = bulb is defective, T = test indicates defective
P(D) = 0.05, P(D') = 0.95
P(T|D) = 0.95, P(T'|D) = 0.05
P(T|D') = 0.10, P(T'|D') = 0.90
P(D ∩ T) = P(D) × P(T|D) = 0.05 × 0.95 = 0.0475
P(D' ∩ T) = P(D') × P(T|D') = 0.95 × 0.10 = 0.095
P(D|T) = P(D ∩ T) / P(T) = P(D ∩ T) / [P(D ∩ T) + P(D' ∩ T)]
P(D|T) = 0.0475 / (0.0475 + 0.095) = 0.0475 / 0.1425 ≈ 0.333 or 33.3%
The probability that a bulb is actually defective given that it tests positive is 33.3%. This counterintuitive result shows how prior probabilities affect conditional probabilities.
• Formula: P(A|B) = P(B|A) × P(A) / P(B)
• Extension: P(A|B) = P(B|A) × P(A) / [P(B|A) × P(A) + P(B|A') × P(A')]
Conditional Probability Formula: P(A|B) = P(A ∩ B) / P(B), where P(A ∩ B) is the joint probability of A and B.
Total: 30 students, Female: 18, Male: 12, Female with glasses: 10, Male with glasses: 4
P(Female | Glasses) - probability student is female given they wear glasses
P(Female ∩ Glasses) = 10/30 = 1/3
P(Glasses) = (10 + 4)/30 = 14/30 = 7/15
P(Female | Glasses) = P(Female ∩ Glasses) / P(Glasses) = (1/3) / (7/15) = (1/3) × (15/7) = 15/21 = 5/7
The probability that a student is female given that they wear glasses is 5/7 or approximately 71.4%. This shows that among students who wear glasses, the majority are female.
• Range: 0 ≤ P(A|B) ≤ 1
• Relationship: P(A ∩ B) = P(A|B) × P(B) = P(B|A) × P(A)
• Independence: If A and B are independent, P(A|B) = P(A)
Formula: P(A|B) = P(A ∩ B) / P(B)
Intuition: Restricts the sample space to where B has occurred
Use: Updating probabilities based on new evidence
Applications: Medical testing, spam filtering, decision making
Extension: P(A ∩ B ∩ C) = P(A|B,C) × P(B|C) × P(C)
Use: Breaking down joint probabilities
Medical Testing: A practical application of conditional probability where test accuracy and disease prevalence combine to affect predictive value.
D = has disease, T = tests positive
P(D) = 0.001, P(D') = 0.999
P(T|D) = 0.99, P(T'|D) = 0.01
P(T|D') = 0.01, P(T'|D') = 0.99
P(D ∩ T) = P(D) × P(T|D) = 0.001 × 0.99 = 0.00099
P(D' ∩ T) = P(D') × P(T|D') = 0.999 × 0.01 = 0.00999
P(T) = P(D ∩ T) + P(D' ∩ T) = 0.00099 + 0.00999 = 0.01098
P(D|T) = P(D ∩ T) / P(T) = 0.00099 / 0.01098 ≈ 0.090 or 9.0%
Despite the 99% accuracy of the test, if a person tests positive, there's only a 9% chance they actually have the disease. This demonstrates the importance of considering base rates (prevalence) in interpreting test results.
• Base rate neglect: People often ignore disease prevalence
• False positive problem: Common with rare diseases
• Positive predictive value: P(disease|positive) is often lower than expected
Sequential Events: Events that occur in sequence where each event affects the probability of subsequent events through changes in the sample space.
Given: First two balls drawn are white
Initially: 6 white, 4 black (total 10)
After drawing 2 white: 4 white, 4 black (total 8)
P(Third white | First two white) = 4/8 = 1/2
P(First two white) = (6/10) × (5/9) = 30/90 = 1/3
P(First three white) = (6/10) × (5/9) × (4/8) = 120/720 = 1/6
P(Third white | First two white) = (1/6) ÷ (1/3) = (1/6) × (3/1) = 1/2 ✓
Given that the first two balls drawn were white, there are 4 white balls and 4 black balls remaining. Therefore, P(Third ball is white | First two are white) = 4/8 = 1/2.
• Without replacement: Sample space changes after each draw
• Dependent events: Each draw affects subsequent probabilities
• Conditional approach: Update sample space based on given information
🔍 Definitions of Key Concepts
⚖️ Core Rules and Principles
⚙️ Step-by-Step Methods for Conditional Probability
- Identify the events: Clearly define events A and B in P(A|B).
- Identify the condition: Understand what information is given (the "given that" part).
- Update the sample space: Consider how the condition affects available outcomes.
- Choose the method: Use P(A ∩ B) / P(B) or direct counting if outcomes are equally likely.
- Calculate the probabilities: Compute P(A ∩ B) and P(B) or count favorable outcomes.
- Apply the formula: Divide to get the conditional probability.
- Interpret the result: Understand what the probability means in context.
🧪 Examples: From Simple to Advanced
💡 Tips, Tricks, and Common Pitfalls
📝 Key Notes for Memorization
📋 Bayes' Theorem Applications
| Field | Application | Events |
|---|---|---|
| Medicine | Disease testing | P(Disease | Positive test) |
| Spam Filtering | Email classification | P(Spam | Email features) |
| Jury Decisions | Evidence evaluation | P(Guilt | Evidence) |
| Quality Control | Defective products | P(Defective | Test positive) |
Questions & Answers
Question: Why is P(A|B) different from P(B|A)? Isn't conditional probability symmetric?
Answer: Conditional probability is not symmetric. Consider this example:
- P(Rain | Cloudy) = 0.6 - If it's cloudy, there's a 60% chance of rain
- P(Cloudy | Rain) = 0.9 - If it's raining, there's a 90% chance it's cloudy
Analogy: P(Dog | Animal) vs P(Animal | Dog). All dogs are animals, but not all animals are dogs.
Formula: P(A|B) = P(A ∩ B) / P(B) vs P(B|A) = P(A ∩ B) / P(A). The numerators are the same, but denominators are different.
Question: How do I know when to use Bayes' theorem versus the basic conditional probability formula?
Answer: Use the formula based on what information you have:
- Basic formula: Use when you know P(A ∩ B) and P(B), or can count outcomes directly
- Bayes' theorem: Use when you know P(B|A), P(A), and P(B), especially for updating beliefs based on evidence
When to use Bayes': Medical testing, diagnostic problems, updating probabilities with new evidence.
When to use basic: Simple conditional problems where joint and marginal probabilities are directly available.
Question: What happens if P(B) = 0 in P(A|B)? Is it undefined?
Answer: Yes, if P(B) = 0, then P(A|B) is undefined because division by zero is not allowed:
- Mathematical reason: P(A|B) = P(A ∩ B) / P(B) involves division by zero
- Intuitive reason: If B has zero probability, it never occurs, so conditioning on it is meaningless
- Practical issue: In real applications, we shouldn't condition on events that are impossible
Rule: Always verify P(B) > 0 before calculating P(A|B).
Advanced note: In measure theory, this is handled using more sophisticated mathematical concepts, but for high school statistics, just remember P(B) must be positive.