Probability Distributions Introduction

Master probability distributions: discrete and continuous distributions, random variables, and probability models through these 5 detailed exercises.

Probability Distributions Concepts
\(\sum P(x_i) = 1\)
Discrete Distribution Property
\(\int_{-\infty}^{\infty} f(x) dx = 1\)
Continuous Distribution Property
\(F(x) = P(X \leq x)\)
Cumulative Distribution Function
Key Definitions:

Probability Distribution: A function that describes the likelihood of obtaining the possible values of a random variable.

Random Variable: A variable whose possible values are outcomes of a random phenomenon.

Discrete Distribution: A distribution for a random variable that takes on countable values.

Continuous Distribution: A distribution for a random variable that takes on uncountable values.

Probability Mass Function (PMF): Function giving probability of each value for discrete variables.

Probability Density Function (PDF): Function describing the relative likelihood for continuous variables.

Cumulative Distribution Function (CDF): Function giving probability that the random variable is less than or equal to a value.

Distribution Properties:
  1. Non-negativity: All probabilities ≥ 0
  2. Normalization: Sum of all probabilities = 1 (discrete) or integral of PDF = 1 (continuous)
  3. Monotonicity: CDF is non-decreasing
  4. Boundedness: CDF approaches 0 as x → -∞ and 1 as x → ∞
Discrete Examples: Fair die, coin flips, number of successes in trials
Continuous Examples: Heights, weights, temperatures, time intervals
Tip 1: Always verify that probabilities sum to 1 for discrete distributions.
Tip 2: For continuous distributions, probability of exact value is 0.
Tip 3: CDF gives P(X ≤ x), not P(X = x).
Solution: Exercises 1 to 3
1 Discrete Distribution
Exercise 1
A discrete random variable X has the following probability distribution:
P(X=1) = 0.2, P(X=2) = 0.3, P(X=3) = 0.4, P(X=4) = 0.1
Find the cumulative distribution function F(x) and verify the distribution is valid.
Setup:

Random variable X takes values {1, 2, 3, 4}

P(X=1) = 0.2, P(X=2) = 0.3, P(X=3) = 0.4, P(X=4) = 0.1

Step 1: Verify the distribution is valid

Check that all probabilities are non-negative: 0.2 ≥ 0, 0.3 ≥ 0, 0.4 ≥ 0, 0.1 ≥ 0 ✓

Check that probabilities sum to 1: 0.2 + 0.3 + 0.4 + 0.1 = 1.0 ✓

Step 2: Calculate the cumulative distribution function F(x)

F(x) = P(X ≤ x)

F(1) = P(X ≤ 1) = P(X = 1) = 0.2

F(2) = P(X ≤ 2) = P(X = 1) + P(X = 2) = 0.2 + 0.3 = 0.5

F(3) = P(X ≤ 3) = P(X = 1) + P(X = 2) + P(X = 3) = 0.2 + 0.3 + 0.4 = 0.9

F(4) = P(X ≤ 4) = P(X = 1) + P(X = 2) + P(X = 3) + P(X = 4) = 0.2 + 0.3 + 0.4 + 0.1 = 1.0

Step 3: Express the CDF

F(x) = 0 for x < 1

F(x) = 0.2 for 1 ≤ x < 2

F(x) = 0.5 for 2 ≤ x < 3

F(x) = 0.9 for 3 ≤ x < 4

F(x) = 1.0 for x ≥ 4

Step 4: Verify CDF properties

The CDF is non-decreasing: 0 ≤ 0.2 ≤ 0.5 ≤ 0.9 ≤ 1.0 ✓

The CDF approaches 0 as x approaches -∞ and 1 as x approaches ∞ ✓

F(1)=0.2, F(2)=0.5, F(3)=0.9, F(4)=1.0
Final Answer:

The distribution is valid (probabilities sum to 1 and are non-negative). The CDF is as calculated above.

2 Coin Flip Distribution
Exercise 2
A biased coin has probability 0.6 of landing heads. Let X = number of heads in two flips. Find the probability distribution of X and calculate P(X ≥ 1).
Setup:

P(heads) = 0.6, P(tails) = 0.4

X = number of heads in 2 flips

Possible values: X ∈ {0, 1, 2}

Step 1: Calculate P(X = 0) (no heads)

P(X = 0) = P(two tails) = (0.4) × (0.4) = 0.16

Step 2: Calculate P(X = 1) (one head)

P(X = 1) = P(head on first, tail on second) + P(tail on first, head on second)

P(X = 1) = (0.6 × 0.4) + (0.4 × 0.6) = 0.24 + 0.24 = 0.48

Step 3: Calculate P(X = 2) (two heads)

P(X = 2) = P(two heads) = (0.6) × (0.6) = 0.36

Step 4: Verify the distribution

Sum of probabilities: 0.16 + 0.48 + 0.36 = 1.0 ✓

Step 5: Calculate P(X ≥ 1)

P(X ≥ 1) = P(X = 1) + P(X = 2) = 0.48 + 0.36 = 0.84

Alternatively: P(X ≥ 1) = 1 - P(X = 0) = 1 - 0.16 = 0.84 ✓

P(X=0)=0.16, P(X=1)=0.48, P(X=2)=0.36, P(X≥1)=0.84
Final Answer:

Probability distribution: P(X=0)=0.16, P(X=1)=0.48, P(X=2)=0.36. P(X≥1) = 0.84

3 Frequency Table
Exercise 3
The number of customers arriving at a store in a given hour follows this distribution:
Customers: 0, 1, 2, 3, 4
Probabilities: 0.1, 0.2, 0.3, 0.25, 0.15
Find the expected number of customers and the probability of at least 2 customers.
Setup:

Let X = number of customers per hour

X: {0, 1, 2, 3, 4}

P(X): {0.1, 0.2, 0.3, 0.25, 0.15}

Step 1: Verify the distribution is valid

All probabilities ≥ 0: 0.1, 0.2, 0.3, 0.25, 0.15 ≥ 0 ✓

Sum of probabilities: 0.1 + 0.2 + 0.3 + 0.25 + 0.15 = 1.0 ✓

Step 2: Calculate expected number of customers

E(X) = Σ xᵢ · P(xᵢ)

E(X) = 0 × 0.1 + 1 × 0.2 + 2 × 0.3 + 3 × 0.25 + 4 × 0.15

E(X) = 0 + 0.2 + 0.6 + 0.75 + 0.6 = 2.15

Step 3: Calculate P(X ≥ 2)

P(X ≥ 2) = P(X = 2) + P(X = 3) + P(X = 4)

P(X ≥ 2) = 0.3 + 0.25 + 0.15 = 0.7

Step 4: Calculate P(X < 2) for verification

P(X < 2) = P(X ≤ 1) = P(X = 0) + P(X = 1) = 0.1 + 0.2 = 0.3

Check: P(X ≥ 2) + P(X < 2) = 0.7 + 0.3 = 1.0 ✓

E(X) = 2.15, P(X ≥ 2) = 0.7
Final Answer:

Expected number of customers per hour is 2.15. Probability of at least 2 customers is 0.7.

Solution: Exercises 4 to 5
4 Sum of Two Dice
Exercise 4
Two fair dice are rolled. Let X be the sum of the two numbers. Find the probability distribution of X and calculate P(7 ≤ X ≤ 10).
Setup:

Let X = sum of two dice

Possible values: {2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}

Total possible outcomes: 36

Step 1: Count outcomes for each sum

Sum 2: (1,1) → 1 outcome → P(X=2) = 1/36

Sum 3: (1,2), (2,1) → 2 outcomes → P(X=3) = 2/36

Sum 4: (1,3), (2,2), (3,1) → 3 outcomes → P(X=4) = 3/36

Sum 5: (1,4), (2,3), (3,2), (4,1) → 4 outcomes → P(X=5) = 4/36

Sum 6: (1,5), (2,4), (3,3), (4,2), (5,1) → 5 outcomes → P(X=6) = 5/36

Sum 7: (1,6), (2,5), (3,4), (4,3), (5,2), (6,1) → 6 outcomes → P(X=7) = 6/36

Sum 8: (2,6), (3,5), (4,4), (5,3), (6,2) → 5 outcomes → P(X=8) = 5/36

Sum 9: (3,6), (4,5), (5,4), (6,3) → 4 outcomes → P(X=9) = 4/36

Sum 10: (4,6), (5,5), (6,4) → 3 outcomes → P(X=10) = 3/36

Sum 11: (5,6), (6,5) → 2 outcomes → P(X=11) = 2/36

Sum 12: (6,6) → 1 outcome → P(X=12) = 1/36

Step 2: Verify the distribution

Sum of probabilities: (1+2+3+4+5+6+5+4+3+2+1)/36 = 36/36 = 1 ✓

Step 3: Calculate P(7 ≤ X ≤ 10)

P(7 ≤ X ≤ 10) = P(X=7) + P(X=8) + P(X=9) + P(X=10)

P(7 ≤ X ≤ 10) = 6/36 + 5/36 + 4/36 + 3/36 = 18/36 = 1/2

Step 4: Additional insights

Notice that P(X=7) = 6/36 = 1/6 is the highest probability (most likely sum).

The distribution is symmetric around X=7.

P(7 ≤ X ≤ 10) = 1/2
Final Answer:

Probability distribution: P(X=k) = number of ways to get sum k divided by 36. P(7 ≤ X ≤ 10) = 1/2.

5 Manufacturing Quality
Exercise 5
A machine produces parts with a 5% defect rate. A quality inspector checks 3 parts randomly. Let X = number of defective parts found. Find the probability distribution of X and calculate P(X ≤ 1).
Setup:

P(defective) = 0.05, P(not defective) = 0.95

X = number of defective parts in 3 checks

Possible values: X ∈ {0, 1, 2, 3}

Step 1: Calculate P(X = 0) (no defects)

P(X = 0) = (0.95)³ = 0.857375

Step 2: Calculate P(X = 1) (exactly one defect)

P(X = 1) = C(3,1) × (0.05)¹ × (0.95)² = 3 × 0.05 × 0.9025 = 0.135375

Step 3: Calculate P(X = 2) (exactly two defects)

P(X = 2) = C(3,2) × (0.05)² × (0.95)¹ = 3 × 0.0025 × 0.95 = 0.007125

Step 4: Calculate P(X = 3) (all three defects)

P(X = 3) = (0.05)³ = 0.000125

Step 5: Verify the distribution

Sum of probabilities: 0.857375 + 0.135375 + 0.007125 + 0.000125 = 1.0 ✓

Step 6: Calculate P(X ≤ 1)

P(X ≤ 1) = P(X = 0) + P(X = 1) = 0.857375 + 0.135375 = 0.99275

P(X=0)=0.857, P(X=1)=0.135, P(X=2)=0.007, P(X=3)=0.000, P(X≤1)=0.993
Final Answer:

Probability distribution: P(X=0)=0.857, P(X=1)=0.135, P(X=2)=0.007, P(X=3)=0.000. P(X≤1) = 0.993.

Comprehensive Summary: Probability Distributions
Core Concepts:

Probability Distribution: A mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.

Discrete Distribution: Distribution for variables that take distinct, separate values.

Continuous Distribution: Distribution for variables that can take any value within a range.

Essential Properties:
  1. Non-negativity: All probabilities ≥ 0
  2. Normalization: Sum of all probabilities = 1 (discrete) or integral of PDF = 1 (continuous)
  3. Cumulative Function: F(x) = P(X ≤ x) is non-decreasing
  4. Relationship: For discrete: P(a ≤ X ≤ b) = F(b) - F(a-1)
Key Principles:

Probability Models: Help predict outcomes and understand variability in random phenomena.

Expected Value: Long-run average value of repetitions of the experiment.

Variance: Measure of spread around the expected value.

Memory Tip: PMF gives P(X=x), CDF gives P(X≤x)
Strategy Tip: Use complement rule for "at least" problems
Visualization Tip: Histograms show discrete distributions well
Verification Tip: Always check that probabilities sum to 1
Probability Distribution Analysis
1
Identify Variable
2
List Possible Values
3
Calculate Probabilities
4
Verify Distribution
5
Analyze Properties

Questions & Answers

Question: What's the difference between probability mass function (PMF) and probability density function (PDF)?

Answer: The key differences are:

  • PMF (Discrete): Gives the probability that a discrete random variable is exactly equal to some value. P(X = x) is meaningful and can be > 0.
  • PDF (Continuous): Describes the relative likelihood for a continuous random variable. P(X = x) = 0 for any specific value x.

For discrete distributions: P(X = x) = PMF(x). For continuous distributions: P(a ≤ X ≤ b) = ∫[a to b] PDF(x)dx.

Question: Why can't the probability of a specific value be positive in a continuous distribution?

Answer: In a continuous distribution, there are infinitely many possible values in any interval. If each specific value had a positive probability, the sum of all probabilities would be infinite, violating the requirement that total probability equals 1.

Think of it like trying to assign a finite amount of "probability mass" to infinitely many points - each point gets "infinitesimally small" probability, which is effectively zero.

Instead, we calculate probabilities for ranges: P(a ≤ X ≤ b) > 0, but P(X = a) = 0.

Question: How do I know if a given function can serve as a probability distribution?

Answer: For a function to be a valid probability distribution, it must satisfy:

  • Non-negativity: All probabilities must be ≥ 0
  • Normalization: The sum of all probabilities must equal 1 (for discrete) or the integral must equal 1 (for continuous)

For discrete distributions: Check that p(x) ≥ 0 for all x and Σ p(x) = 1.

For continuous distributions: Check that f(x) ≥ 0 for all x and ∫f(x)dx = 1.