Basic Theoretical Probability: Complete Guide with Exercises and Detailed Summary

Master basic theoretical probability: principles, methods, and their role in statistical inference and mathematical reasoning through detailed examples and exercises.

Exercises 1 to 3: Solutions
1 Sample Space and Events
Exercise 1
A fair six-sided die is rolled. Find the probability of rolling an even number. Identify the sample space, favorable outcomes, and apply the probability formula.
Key Definition:

Theoretical Probability: The ratio of the number of favorable outcomes to the total number of possible outcomes in a sample space.

Probability Calculation:
  1. Identify Sample Space: All possible outcomes
  2. Count Total Outcomes: Total number of possible outcomes
  3. Identify Favorable Outcomes: Outcomes that satisfy the condition
  4. Apply Formula: P(A) = (Number of favorable outcomes)/(Total number of outcomes)
Step 1: Identify sample space

S = {1, 2, 3, 4, 5, 6} (all possible outcomes when rolling a die)

Step 2: Count total outcomes

Total outcomes = 6

Step 3: Identify favorable outcomes

Even numbers: {2, 4, 6} → 3 favorable outcomes

Step 4: Apply probability formula

P(even number) = 3/6 = 1/2 = 0.5 or 50%

P(even number) = 3/6 = 1/2 = 0.5
Final Answer:

The probability of rolling an even number is 3/6 = 1/2 = 0.5 or 50%.

Key Rules:

• Classical Formula: P(A) = (Number of favorable outcomes)/(Total number of outcomes)

• Range: Probabilities range from 0 (impossible) to 1 (certain)

• Sum Rule: Sum of all probabilities in sample space equals 1

Tip: Always list the sample space first to ensure you count all outcomes correctly.
2 Multiple Events
Exercise 2
Two fair coins are flipped. Find the probability of getting exactly one head. List all possible outcomes and identify favorable ones.
Key Definition:

Compound Event: An event consisting of multiple outcomes from multiple trials.

Step 1: List sample space

S = {HH, HT, TH, TT} (H=head, T=tail)

Step 2: Count total outcomes

Total outcomes = 4

Step 3: Identify favorable outcomes

Exactly one head: {HT, TH} → 2 favorable outcomes

Step 4: Calculate probability

P(exactly one head) = 2/4 = 1/2 = 0.5

P(exactly one head) = 2/4 = 1/2 = 0.5
Final Answer:

The probability of getting exactly one head when flipping two coins is 2/4 = 1/2 = 0.5.

Key Rules:

• Multiplication Rule: For independent events, multiply individual probabilities

• Counting Principle: Total outcomes = Product of individual outcomes

• Complementary Events: P(A) + P(not A) = 1

Tip: For multiple coin flips, list all possible combinations systematically.
3 Card Probability
Exercise 3
A card is drawn from a standard deck of 52 cards. Find the probability of drawing a face card (Jack, Queen, King). How many face cards are there in total?
Key Definition:

Face Card: Jack, Queen, or King of any suit in a standard deck.

Step 1: Identify total outcomes

Standard deck has 52 cards

Step 2: Count face cards

4 suits × 3 face cards per suit = 12 face cards

Step 3: Apply probability formula

P(face card) = 12/52 = 3/13 ≈ 0.231

Step 4: Convert to percentage

3/13 ≈ 0.231 = 23.1%

P(face card) = 12/52 = 3/13 ≈ 0.231 or 23.1%
Final Answer:

There are 12 face cards in a standard deck. P(face card) = 12/52 = 3/13 ≈ 0.231 or 23.1%.

Key Rules:

• Standard Deck: 52 cards (4 suits × 13 ranks)

• Face Cards: 3 per suit (Jack, Queen, King)

• Simplification: Reduce fractions to lowest terms

Basic Theoretical Probability Fundamentals
\(P(A) = \frac{\text{Number of favorable outcomes}}{\text{Total number of possible outcomes}}\)
Classical Probability Formula
Probability Rules
Range: 0 ≤ P(A) ≤ 1
Impossible: P(∅) = 0
Certain: P(S) = 1
Complement: P(A') = 1 - P(A)
Key Concepts
Sample Space: Set of all possible outcomes
Event: Subset of sample space
Outcome: Individual result
Equally Likely: Each outcome has same probability
Sample Space
→
Event Definition
→
Count Outcomes
→
Calculate Probability
Key Terms: Sample Space (S), Event (A), Outcome (specific result), Probability (measure of likelihood)
Mathematical Foundation: Classical probability assumes equally likely outcomes
Exercises 4 to 5: Solutions
4 Birthday Problem
Exercise 4
What is the probability that a randomly selected day in a non-leap year is a Monday? Assume all days are equally likely.
Key Definition:

Uniform Distribution: When all outcomes in a sample space have equal probability.

Step 1: Identify total days in year

Non-leap year = 365 days

Step 2: Count Mondays in year

365 ÷ 7 = 52 weeks with 1 extra day → 52 or 53 Mondays

Step 3: Average case calculation

On average, there are 365/7 ≈ 52.14 Mondays

Step 4: Calculate probability

P(Monday) = 52.14/365 = 1/7 ≈ 0.143

P(Monday) = 1/7 ≈ 0.143 or 14.3%
Final Answer:

The probability is 1/7 ≈ 0.143 or approximately 14.3%.

Applied Rules:

• Uniform Distribution: All days equally likely

• Cyclic Pattern: Days repeat every 7 days

• Proportional Reasoning: Equal probability for each day

5 Compound Probability
Exercise 5
A bag contains 3 red, 4 blue, and 5 green marbles. One marble is drawn at random. Find the probability of drawing a marble that is NOT blue. Verify using complement rule.
Key Definition:

Complement Rule: P(A') = 1 - P(A), where A' represents "not A".

Step 1: Find total marbles

Total = 3 + 4 + 5 = 12 marbles

Step 2: Method 1 - Direct calculation

Not blue = red + green = 3 + 5 = 8 marbles

P(not blue) = 8/12 = 2/3

Step 3: Method 2 - Complement rule

P(blue) = 4/12 = 1/3

P(not blue) = 1 - P(blue) = 1 - 1/3 = 2/3

Step 4: Verify equality

Both methods yield 2/3 ✓

P(not blue) = 2/3 ≈ 0.667
Final Answer:

The probability of drawing a marble that is not blue is 2/3 ≈ 0.667 or 66.7%.

Applied Rules:

• Complement Rule: Often easier than direct calculation

• Verification: Use multiple methods to confirm answer

• Reduction: Simplify fractions when possible

Detailed Summary: Basic Theoretical Probability
\(P(A) = \frac{n(A)}{n(S)}\)
Probability Formula (n notation)
Core Definitions:

Probability: A measure of the likelihood that an event will occur, expressed as a number between 0 and 1.

Sample Space (S): The set of all possible outcomes of an experiment.

Event (A): A subset of the sample space representing outcomes of interest.

Outcome: A single possible result of an experiment.

Theoretical Probability: The probability calculated using mathematical reasoning based on equally likely outcomes.

Probability Calculation Process:
  1. Define Experiment: Clearly specify what is being done
  2. List Sample Space: Enumerate all possible outcomes
  3. Count Total Outcomes: Determine total number of possible outcomes
  4. Identify Event: Specify the outcome(s) of interest
  5. Count Favorable Outcomes: Determine number of outcomes that satisfy the condition
  6. Apply Formula: Calculate P(A) = (favorable outcomes)/(total outcomes)
  7. Simplify: Reduce fraction to lowest terms
Tip 1: Always list the sample space first to ensure you count all outcomes correctly.
Tip 2: Use the complement rule when calculating "NOT" events - often easier than direct calculation.
Tip 3: Verify your answer makes sense - probabilities should be between 0 and 1.
Tip 4: Draw tree diagrams for complex multi-step experiments to visualize all outcomes.
Common Mistakes: Not counting all outcomes, forgetting to simplify fractions, mixing up favorable vs. total outcomes, not identifying equally likely outcomes.
Exam Focus: Identifying sample spaces, applying probability formulas, using complement rule, converting between fractions, decimals, and percentages.
Critical Principles:

• Equally Likely: Classical probability assumes all outcomes are equally probable

• Range Constraint: All probabilities must be between 0 and 1 inclusive

• Sum Property: Sum of all individual outcome probabilities equals 1

• Complement Property: P(A) + P(A') = 1

• Counting Accuracy: Precise counting is essential for correct probabilities

\(P(\text{complement}) = 1 - P(\text{event})\)
Complement Rule

Questions & Answers

Question: Why do we assume all outcomes are equally likely? What if they're not? Can we still use theoretical probability?

Answer: Theoretical probability specifically requires equally likely outcomes:

  • Theoretical Probability: Assumes all outcomes equally likely (classical definition)
  • Empirical Probability: Based on observed frequencies from experiments
  • Subjective Probability: Based on personal judgment or experience

When outcomes aren't equally likely: Use empirical probability by conducting experiments and observing frequencies.

Example: A weighted die - theoretical probability doesn't apply, but empirical probability (rolling many times) does.

Theoretical probability works well for symmetric situations like fair dice, coins, and cards.

Question: What's the difference between theoretical and experimental probability? When would I use each?

Answer: Two different approaches to probability:

  • Theoretical Probability: Calculated mathematically using equally likely outcomes
  • Experimental Probability: Based on actual observations from repeated trials

When to use Theoretical:

  • Symmetric situations (fair dice, coins, cards)
  • Mathematical models where symmetry is clear
  • When you can't perform experiments

When to use Experimental:

  • Real-world situations with unknown probabilities
  • When theoretical assumptions don't hold
  • To verify theoretical predictions

As trials increase, experimental probability approaches theoretical probability (Law of Large Numbers).

Question: How do I know if I've listed all possible outcomes in a sample space? What if I miss some?

Answer: Systematic listing prevents missing outcomes:

Strategies for Complete Sample Spaces:

  • Tree Diagrams: Visual representation of all possible sequences
  • Systematic Enumeration: List in logical order (alphabetical, numerical)
  • Counting Principle: Multiply number of choices at each step
  • Verification: Count total outcomes using multiplication rule

Example for two coins: Start with first coin H, then list HH, HT; then start with T, list TH, TT.

Missing outcomes: Causes incorrect probability calculations. Always verify your count matches expected total.

If you expect 4 outcomes but only list 3, you know you missed one.