Conditional Probability: Complete Guide with Exercises and Detailed Summary

Master conditional probability: principles, methods, and their role in statistical inference and probability calculations through detailed examples and exercises.

Exercises 1 to 3: Solutions
1 Basic Conditional Probability
Exercise 1
A fair six-sided die is rolled. Given that the result is odd, what is the probability that it is a 3? Use the conditional probability formula to solve.
Key Definition:

Conditional Probability: The probability of an event A occurring given that event B has already occurred, denoted as P(A|B).

Conditional Probability Formula:
  1. Identify Events: Define A (what we want) and B (given condition)
  2. Find P(A and B): Probability of both events occurring
  3. Find P(B): Probability of the given condition
  4. Apply Formula: P(A|B) = P(A and B)/P(B)
Step 1: Define events

Event A: Rolling a 3, Event B: Rolling an odd number

Step 2: Find P(A and B)

P(3 and odd) = P(rolling a 3) = 1/6 (since 3 is odd)

Step 3: Find P(B)

P(odd) = P({1, 3, 5}) = 3/6 = 1/2

Step 4: Apply conditional probability formula

P(3|odd) = P(3 and odd)/P(odd) = (1/6)/(1/2) = 1/3

P(3|odd) = 1/3 ≈ 0.333
Final Answer:

Given that the result is odd, the probability of rolling a 3 is 1/3 or approximately 0.333.

Key Rules:

• Conditional Formula: P(A|B) = P(A and B)/P(B)

• Reduced Sample Space: Given B, we only consider outcomes in B

• Range: Conditional probability ranges from 0 to 1

Tip: Think of conditional probability as reducing the sample space to only include the given condition.
2 Two-Way Table Application
Exercise 2
In a class of 50 students, 20 are male and 30 are female. Of the males, 12 passed the exam. Of the females, 24 passed. What is the probability that a student passed given that they are female?
Key Definition:

Two-Way Table: A table showing the frequency distribution of two categorical variables.

Step 1: Create two-way table

Male/Passed: 12, Male/Failed: 8, Female/Passed: 24, Female/Failed: 6

Step 2: Identify given information

Condition: Student is female, Event: Student passed

Step 3: Count relevant numbers

Female students: 30, Female students who passed: 24

Step 4: Apply conditional probability

P(passed|female) = Number of female students who passed / Total female students = 24/30 = 4/5 = 0.8

P(passed|female) = 24/30 = 4/5 = 0.8
Final Answer:

The probability that a student passed given that they are female is 24/30 = 4/5 = 0.8 or 80%.

Key Rules:

• Table Reading: Focus on the row/column representing the given condition

• Counting: Numerator = favorable outcomes under condition, Denominator = total outcomes under condition

• Verification: Ensure probability is between 0 and 1

Tip: Two-way tables help visualize conditional probability by showing the reduced sample space.
3 Joint Probability Connection
Exercise 3
Two dice are rolled. Find P(sum = 7 | first die = 4). Then find P(first die = 4 and sum = 7) using the multiplication rule.
Key Definition:

Joint Probability: The probability of two events occurring together, P(A and B).

Step 1: Calculate P(sum = 7 | first die = 4)

Given first die = 4, second die must be 3 to get sum = 7. P(second die = 3) = 1/6

Step 2: Calculate P(first die = 4)

P(first die = 4) = 1/6

Step 3: Apply multiplication rule

P(first die = 4 and sum = 7) = P(first die = 4) × P(sum = 7 | first die = 4) = 1/6 × 1/6 = 1/36

Step 4: Verify with direct calculation

Only outcome (4,3) gives first die = 4 and sum = 7. P = 1/36 ✓

P(sum = 7 | first die = 4) = 1/6, P(first die = 4 and sum = 7) = 1/36
Final Answer:

P(sum = 7 | first die = 4) = 1/6. P(first die = 4 and sum = 7) = 1/36.

Key Rules:

• Multiplication Rule: P(A and B) = P(A) × P(B|A)

• Conditional to Joint: Use multiplication rule to find joint probability

• Verification: Check with direct counting when possible

Conditional Probability Fundamentals and Rules
\(P(A|B) = \frac{P(A \cap B)}{P(B)}\)
Conditional Probability Formula
Conditional Probability Rules
Basic Formula: P(A|B) = P(A and B)/P(B)
Multiplication Rule: P(A and B) = P(A) × P(B|A)
Range: 0 ≤ P(A|B) ≤ 1
Special Case: P(A|A) = 1
Bayes Theorem
Formula: P(A|B) = P(B|A) × P(A)/P(B)
Reversal: Find P(A|B) from P(B|A)
Applications: Medical testing, spam detection
Updating: Revise probabilities with new information
Given Condition
→
Reduce Sample Space
→
Count Favorable
→
Calculate Probability
Key Terms: Conditional Probability (P(A|B)), Joint Probability (P(A and B)), Marginal Probability (P(A)), Bayes Theorem (probability reversal)
Mathematical Foundation: Based on set theory and probability axioms
Exercises 4 to 5: Solutions
4 Medical Testing Application
Exercise 4
A medical test has a 95% accuracy rate. If 1% of the population has a disease, what is the probability that a person has the disease given they tested positive? Use Bayes theorem.
Key Definition:

Bayes Theorem: A formula for calculating conditional probability when direct calculation is difficult.

Step 1: Define events

D = person has disease, T = person tests positive

Step 2: Identify given information

P(D) = 0.01, P(T|D) = 0.95, P(T|not D) = 0.05 (false positive rate)

Step 3: Calculate P(T)

P(T) = P(T|D)×P(D) + P(T|not D)×P(not D) = 0.95×0.01 + 0.05×0.99 = 0.0095 + 0.0495 = 0.059

Step 4: Apply Bayes theorem

P(D|T) = P(T|D)×P(D)/P(T) = (0.95×0.01)/0.059 = 0.0095/0.059 ≈ 0.161

P(disease|positive test) ≈ 0.161 or 16.1%
Final Answer:

The probability that a person has the disease given they tested positive is approximately 0.161 or 16.1%.

Applied Rules:

• Law of Total Probability: P(T) = P(T|D)×P(D) + P(T|not D)×P(not D)

• Bayes Theorem: P(D|T) = P(T|D)×P(D)/P(T)

• Base Rate: Consider the prevalence of the condition in the population

5 Chain Rule Application
Exercise 5
Three cards are drawn without replacement from a standard deck. What is the probability that all three are hearts? Use conditional probability and the chain rule.
Key Definition:

Chain Rule: P(A₁ and A₂ and A₃) = P(A₁) × P(A₂|A₁) × P(A₃|A₁ and A₂).

Step 1: Define events

A₁ = first card is heart, A₂ = second card is heart, A₃ = third card is heart

Step 2: Calculate P(A₁)

P(A₁) = 13/52 = 1/4

Step 3: Calculate P(A₂|A₁)

Given first card is heart: 12 hearts left out of 51 cards. P(A₂|A₁) = 12/51

Step 4: Calculate P(A₃|A₁ and A₂)

Given first two cards are hearts: 11 hearts left out of 50 cards. P(A₃|A₁ and A₂) = 11/50

Step 5: Apply chain rule

P(all three hearts) = 13/52 × 12/51 × 11/50 = 1716/132600 = 11/850 ≈ 0.013

P(all three hearts) = 11/850 ≈ 0.013
Final Answer:

The probability that all three cards are hearts is 11/850 ≈ 0.013 or about 1.3%.

Applied Rules:

• Chain Rule: Extend multiplication rule to multiple dependent events

• Without Replacement: Adjust probabilities as population changes

• Sequential Conditioning: Update probabilities based on previous outcomes

Detailed Summary: Conditional Probability
\(P(A|B) = \frac{P(A \cap B)}{P(B)} = \frac{P(B|A) \cdot P(A)}{P(B)}\)
Bayes Theorem Version
Core Definitions:

Conditional Probability: The probability of event A occurring given that event B has occurred, denoted as P(A|B).

Joint Probability: The probability of two events occurring together, denoted as P(A and B) or P(A ∩ B).

Marginal Probability: The probability of an event without reference to other events, denoted as P(A).

Bayes Theorem: A formula for calculating conditional probability when the direction of conditioning is reversed.

Chain Rule: A method for calculating the probability of multiple dependent events occurring sequentially.

Conditional Probability Calculation Process:
  1. Define Events: Clearly identify what you want to find and what is given
  2. Identify Information: Determine what probabilities are known
  3. Choose Formula: Select appropriate conditional probability formula
  4. Calculate Components: Find P(A and B) and P(B) if needed
  5. Apply Formula: Substitute values into the conditional probability formula
  6. Verify Result: Ensure the probability is between 0 and 1
Tip 1: Think of conditional probability as "reducing the sample space" to only include the given condition.
Tip 2: Use two-way tables to visualize conditional probability problems.
Tip 3: Always check that P(B) > 0 when calculating P(A|B).
Tip 4: Use Bayes theorem when you know P(B|A) but need P(A|B).
Common Mistakes: Forgetting to adjust for the given condition, confusing P(A|B) with P(B|A), not checking that P(B) > 0, misinterpreting joint vs conditional probabilities.
Exam Focus: Calculating conditional probabilities, applying Bayes theorem, using two-way tables, solving real-world problems, distinguishing between different types of probabilities.
Critical Principles:

• Conditional Nature: Conditional probability changes the sample space to the given condition

• Dependence Relationship: Conditional probability quantifies how events influence each other

• Bayesian Updating: New information updates our probability assessments

• Consistency: All probability rules must be satisfied in conditional contexts

• Practical Applications: Conditional probability is fundamental to decision-making under uncertainty

\(P(A_1 \cap A_2 \cap \ldots \cap A_n) = P(A_1) \cdot P(A_2|A_1) \cdot P(A_3|A_1,A_2) \cdots P(A_n|A_1,\ldots,A_{n-1})\)
Chain Rule for Multiple Events

Questions & Answers

Question: What's the difference between P(A and B) and P(A|B)? They seem very similar to me.

Answer: These represent fundamentally different concepts:

  • P(A and B): Joint probability - probability that BOTH events happen simultaneously
  • P(A|B): Conditional probability - probability of A happening GIVEN that B has already happened

Example: In a class with 100 students (60 male, 40 female): P(male and passed) = probability someone is both male AND passed (joint) P(passed|male) = probability a male student passed (given they're male)

Relationship: P(A and B) = P(A|B) × P(B) - this connects the two concepts.

Think of it as: Joint probability looks at the entire population, while conditional probability focuses on a specific subgroup.

Question: When should I use Bayes theorem instead of the regular conditional probability formula?

Answer: Use Bayes theorem when:

  • You know P(B|A) but need P(A|B)
  • You have information about the "reverse" conditional
  • You're updating beliefs based on new evidence
  • Dealing with diagnostic tests or screening procedures

Regular Formula: P(A|B) = P(A and B)/P(B) - use when you know the joint probability

Bayes Theorem: P(A|B) = P(B|A) × P(A)/P(B) - use when you know P(B|A) instead

Example: Medical testing - you know test accuracy (P(positive|disease)) but want disease probability given test result (P(disease|positive)).

Question: Why is P(A|B) different from P(B|A)? Don't they mean the same thing?

Answer: These are fundamentally different questions:

  • P(A|B): "Given B occurred, what's the chance A occurred?"
  • P(B|A): "Given A occurred, what's the chance B occurred?"

Concrete Example:

P(rain|clouds) = probability it rains given there are clouds (high probability)

P(clouds|rain) = probability there are clouds given it's raining (100% - it's definitely cloudy when raining)

Another Example:

P(student|smart) = probability someone is a student given they're smart (low - not all smart people are students)

P(smart|student) = probability someone is smart given they're a student (higher - many students are smart)

The conditioning event changes what we're considering as our "new universe" of possibilities.