Probability Basics Review

Master probability fundamentals: sample spaces, events, conditional probability, and independence through these 5 detailed exercises.

Probability Concepts & Formulas
\(P(E) = \frac{\text{Number of favorable outcomes}}{\text{Total number of possible outcomes}}\)
Classical Probability
\(P(A \cup B) = P(A) + P(B) - P(A \cap B)\)
Addition Rule
\(P(A \cap B) = P(A) \cdot P(B|A)\)
Multiplication Rule
Key Definitions:

Sample Space (S): The set of all possible outcomes of an experiment.

Event: A subset of the sample space representing a particular outcome or set of outcomes.

Probability: A measure of the likelihood of an event occurring, ranging from 0 (impossible) to 1 (certain).

Complement: The event that A does not occur, denoted \(A^c\) or \(\overline{A}\).

Independent Events: Events where the occurrence of one does not affect the probability of the other.

Conditional Probability: The probability of an event given that another event has occurred.

Fundamental Rules:
  1. Range: \(0 \leq P(E) \leq 1\) for any event E
  2. Sample Space: \(P(S) = 1\)
  3. Impossible Event: \(P(\emptyset) = 0\)
  4. Complement Rule: \(P(A^c) = 1 - P(A)\)
  5. Addition Rule: \(P(A \cup B) = P(A) + P(B) - P(A \cap B)\)
Equally Likely Outcomes: When all outcomes are equally probable, classical probability applies.
Independence: If A and B are independent, then \(P(A \cap B) = P(A) \cdot P(B)\).
Tip 1: Always verify that probabilities are between 0 and 1.
Tip 2: Use complement rule when direct calculation is difficult.
Tip 3: Draw tree diagrams for sequential events.
Solution: Exercises 1 to 3
1 Single Die Roll
Exercise 1
A fair six-sided die is rolled. Find the probability of rolling:
a) An even number
b) A number greater than 4
c) An even number OR a number greater than 4
Sample Space:

\(S = \{1, 2, 3, 4, 5, 6\}\) with 6 equally likely outcomes

Part a: Even number

Even numbers: \(\{2, 4, 6\}\)

Favorable outcomes: 3

Total outcomes: 6

\(P(\text{even}) = \frac{3}{6} = \frac{1}{2}\)

Part b: Number greater than 4

Numbers > 4: \(\{5, 6\}\)

Favorable outcomes: 2

Total outcomes: 6

\(P(> 4) = \frac{2}{6} = \frac{1}{3}\)

Part c: Even OR > 4

Using Addition Rule: \(P(\text{even} \cup > 4) = P(\text{even}) + P(> 4) - P(\text{even} \cap > 4)\)

Even AND > 4: \(\{6\}\) → \(P(\text{even} \cap > 4) = \frac{1}{6}\)

\(P(\text{even} \cup > 4) = \frac{1}{2} + \frac{1}{3} - \frac{1}{6} = \frac{3}{6} + \frac{2}{6} - \frac{1}{6} = \frac{4}{6} = \frac{2}{3}\)

a) \(\frac{1}{2}\)     b) \(\frac{1}{3}\)     c) \(\frac{2}{3}\)
Final Answer:

a) \(P(\text{even}) = \frac{1}{2}\), b) \(P(> 4) = \frac{1}{3}\), c) \(P(\text{even} \cup > 4) = \frac{2}{3}\)

2 Two Coin Flips
Exercise 2
Two fair coins are flipped. Find the probability of:
a) Getting exactly one head
b) Getting at least one tail
c) Both coins showing the same result
Sample Space:

\(S = \{HH, HT, TH, TT\}\) with 4 equally likely outcomes

Part a: Exactly one head

Outcomes with exactly one head: \(\{HT, TH\}\)

Favorable outcomes: 2

Total outcomes: 4

\(P(\text{exactly one head}) = \frac{2}{4} = \frac{1}{2}\)

Part b: At least one tail

Using complement: \(P(\text{at least one tail}) = 1 - P(\text{no tails}) = 1 - P(HH)\)

\(P(\text{at least one tail}) = 1 - \frac{1}{4} = \frac{3}{4}\)

Part c: Same result

Same result outcomes: \(\{HH, TT\}\)

Favorable outcomes: 2

Total outcomes: 4

\(P(\text{same result}) = \frac{2}{4} = \frac{1}{2}\)

a) \(\frac{1}{2}\)     b) \(\frac{3}{4}\)     c) \(\frac{1}{2}\)
Final Answer:

a) \(P(\text{exactly one head}) = \frac{1}{2}\), b) \(P(\text{at least one tail}) = \frac{3}{4}\), c) \(P(\text{same result}) = \frac{1}{2}\)

3 Card Drawing
Exercise 3
A card is drawn from a standard deck of 52 cards. Find the probability of:
a) Drawing a face card (Jack, Queen, King)
b) Drawing a red card
c) Drawing a face card OR a red card
Standard Deck Composition:

52 cards: 4 suits (hearts, diamonds, clubs, spades) × 13 ranks each

Face cards: 3 per suit × 4 suits = 12 total

Red cards: hearts + diamonds = 26 total

Part a: Face card

Total face cards: 12

Total cards: 52

\(P(\text{face card}) = \frac{12}{52} = \frac{3}{13}\)

Part b: Red card

Total red cards: 26

Total cards: 52

\(P(\text{red card}) = \frac{26}{52} = \frac{1}{2}\)

Part c: Face card OR red card

Using Addition Rule: \(P(\text{face} \cup \text{red}) = P(\text{face}) + P(\text{red}) - P(\text{face} \cap \text{red})\)

Red face cards: 6 (J, Q, K of hearts and diamonds)

\(P(\text{face} \cap \text{red}) = \frac{6}{52} = \frac{3}{26}\)

\(P(\text{face} \cup \text{red}) = \frac{12}{52} + \frac{26}{52} - \frac{6}{52} = \frac{32}{52} = \frac{8}{13}\)

a) \(\frac{3}{13}\)     b) \(\frac{1}{2}\)     c) \(\frac{8}{13}\)
Final Answer:

a) \(P(\text{face card}) = \frac{3}{13}\), b) \(P(\text{red card}) = \frac{1}{2}\), c) \(P(\text{face} \cup \text{red}) = \frac{8}{13}\)

Solution: Exercises 4 to 5
4 Conditional Probability
Exercise 4
A bag contains 5 red marbles and 3 blue marbles. Two marbles are drawn without replacement.
Find the probability that:
a) Both marbles are red
b) The second marble is red given that the first was red
c) At least one marble is red
Setup:

Initial: 5 red, 3 blue → Total: 8 marbles

Without replacement: probabilities change after first draw

Part a: Both marbles are red

Using multiplication rule: \(P(R_1 \cap R_2) = P(R_1) \cdot P(R_2|R_1)\)

\(P(R_1) = \frac{5}{8}\) (probability first marble is red)

\(P(R_2|R_1) = \frac{4}{7}\) (probability second marble is red given first was red)

\(P(\text{both red}) = \frac{5}{8} \cdot \frac{4}{7} = \frac{20}{56} = \frac{5}{14}\)

Part b: Second marble red given first was red

This is a conditional probability: \(P(R_2|R_1)\)

Given first marble was red, there are now 4 red and 3 blue marbles left

\(P(R_2|R_1) = \frac{4}{7}\)

Part c: At least one marble is red

Using complement: \(P(\text{at least one red}) = 1 - P(\text{both blue})\)

\(P(\text{both blue}) = P(B_1) \cdot P(B_2|B_1) = \frac{3}{8} \cdot \frac{2}{7} = \frac{6}{56} = \frac{3}{28}\)

\(P(\text{at least one red}) = 1 - \frac{3}{28} = \frac{25}{28}\)

a) \(\frac{5}{14}\)     b) \(\frac{4}{7}\)     c) \(\frac{25}{28}\)
Final Answer:

a) \(P(\text{both red}) = \frac{5}{14}\), b) \(P(R_2|R_1) = \frac{4}{7}\), c) \(P(\text{at least one red}) = \frac{25}{28}\)

5 Real-world Application
Exercise 5
In a survey of 200 students:
• 120 students study mathematics
• 80 students study physics
• 50 students study both subjects
Find the probability that a randomly selected student:
a) Studies mathematics or physics
b) Studies mathematics given they study physics
c) Studies only mathematics
Given Information:

Total students: 200

Math students (M): 120

Physics students (P): 80

Both subjects (M ∩ P): 50

Part a: Studies mathematics or physics

Using addition rule: \(P(M \cup P) = P(M) + P(P) - P(M \cap P)\)

\(P(M) = \frac{120}{200} = \frac{3}{5}\)

\(P(P) = \frac{80}{200} = \frac{2}{5}\)

\(P(M \cap P) = \frac{50}{200} = \frac{1}{4}\)

\(P(M \cup P) = \frac{3}{5} + \frac{2}{5} - \frac{1}{4} = 1 - \frac{1}{4} = \frac{3}{4}\)

Part b: Studies mathematics given physics

Using conditional probability: \(P(M|P) = \frac{P(M \cap P)}{P(P)}\)

\(P(M|P) = \frac{50/200}{80/200} = \frac{50}{80} = \frac{5}{8}\)

Part c: Studies only mathematics

Students studying only math: Math students - Both subjects = 120 - 50 = 70

\(P(\text{only math}) = \frac{70}{200} = \frac{7}{20}\)

a) \(\frac{3}{4}\)     b) \(\frac{5}{8}\)     c) \(\frac{7}{20}\)
Final Answer:

a) \(P(M \cup P) = \frac{3}{4}\), b) \(P(M|P) = \frac{5}{8}\), c) \(P(\text{only math}) = \frac{7}{20}\)

Venn Diagram Approach:

Only Math: 70 students

Only Physics: 30 students

Both: 50 students

Neither: 50 students

Comprehensive Summary: Probability Basics
Core Concepts:

Probability: A measure of likelihood ranging from 0 (impossible) to 1 (certain).

Sample Space: The complete set of possible outcomes.

Events: Subsets of the sample space representing specific outcomes.

Essential Formulas:
  1. Basic Probability: \(P(E) = \frac{n(E)}{n(S)}\)
  2. Complement Rule: \(P(E^c) = 1 - P(E)\)
  3. Addition Rule: \(P(A \cup B) = P(A) + P(B) - P(A \cap B)\)
  4. Conditional Probability: \(P(A|B) = \frac{P(A \cap B)}{P(B)}\)
  5. Multiplication Rule: \(P(A \cap B) = P(A) \cdot P(B|A)\)
Important Principles:

Independence: Events A and B are independent if \(P(A \cap B) = P(A) \cdot P(B)\)

Mutual Exclusivity: Events A and B are mutually exclusive if \(P(A \cap B) = 0\)

Law of Total Probability: For mutually exclusive events covering the sample space

Memory Tip: "OR" uses addition, "AND" uses multiplication
Strategy Tip: Use complement when direct calculation is complex
Visualization Tip: Draw tree diagrams for sequential events
Verification Tip: Always check that probabilities are between 0 and 1
Problem-Solving Strategy
1
Define Sample Space
2
Identify Events
3
Choose Formula
4
Calculate & Verify

Questions & Answers

Question: When do I use conditional probability vs regular probability?

Answer: Use conditional probability when you have additional information about the outcome of one event that affects the probability of another event. Ask yourself: "What is the probability of A given that B has occurred?"

For example, if you want to know the probability of drawing a red card given that the first card drawn was a heart, you use conditional probability because the composition of the deck has changed.

Regular probability is used when no additional information is provided about other events.

Question: How do I know when events are independent?

Answer: Two events A and B are independent if the occurrence of one does not affect the probability of the other. This can be tested mathematically:

  • \(P(A \cap B) = P(A) \cdot P(B)\)
  • \(P(A|B) = P(A)\)
  • \(P(B|A) = P(B)\)

Examples of independent events: flipping a coin twice, rolling dice repeatedly, drawing cards with replacement.

Examples of dependent events: drawing cards without replacement, selecting people from a group without replacement.

Question: What's the difference between mutually exclusive and independent events?

Answer: These are completely different concepts:

  • Mutually Exclusive: Events cannot occur simultaneously. If A occurs, B cannot occur. \(P(A \cap B) = 0\)
  • Independent: Occurrence of one event doesn't affect probability of another. \(P(A \cap B) = P(A) \cdot P(B)\)

Mutually exclusive events are typically dependent (except in special cases). If two events are mutually exclusive and both have non-zero probability, knowing one occurred tells us the other did not occur.

Example: Rolling a die - getting a 3 and getting a 4 are mutually exclusive. Getting a 3 on the first roll and getting a 4 on the second roll are independent.