Probability Distribution: A function that describes the likelihood of obtaining the possible values of a random variable.
Random Variable: A variable whose possible values are outcomes of a random phenomenon.
Discrete Distribution: A distribution for a random variable that takes on countable values.
Continuous Distribution: A distribution for a random variable that takes on uncountable values.
Probability Mass Function (PMF): Function giving probability of each value for discrete variables.
Probability Density Function (PDF): Function describing the relative likelihood for continuous variables.
Cumulative Distribution Function (CDF): Function giving probability that the random variable is less than or equal to a value.
- Non-negativity: All probabilities ≥ 0
- Normalization: Sum of all probabilities = 1 (discrete) or integral of PDF = 1 (continuous)
- Monotonicity: CDF is non-decreasing
- Boundedness: CDF approaches 0 as x → -∞ and 1 as x → ∞
P(X=1) = 0.2, P(X=2) = 0.3, P(X=3) = 0.4, P(X=4) = 0.1
Find the cumulative distribution function F(x) and verify the distribution is valid.
Random variable X takes values {1, 2, 3, 4}
P(X=1) = 0.2, P(X=2) = 0.3, P(X=3) = 0.4, P(X=4) = 0.1
Check that all probabilities are non-negative: 0.2 ≥ 0, 0.3 ≥ 0, 0.4 ≥ 0, 0.1 ≥ 0 ✓
Check that probabilities sum to 1: 0.2 + 0.3 + 0.4 + 0.1 = 1.0 ✓
F(x) = P(X ≤ x)
F(1) = P(X ≤ 1) = P(X = 1) = 0.2
F(2) = P(X ≤ 2) = P(X = 1) + P(X = 2) = 0.2 + 0.3 = 0.5
F(3) = P(X ≤ 3) = P(X = 1) + P(X = 2) + P(X = 3) = 0.2 + 0.3 + 0.4 = 0.9
F(4) = P(X ≤ 4) = P(X = 1) + P(X = 2) + P(X = 3) + P(X = 4) = 0.2 + 0.3 + 0.4 + 0.1 = 1.0
F(x) = 0 for x < 1
F(x) = 0.2 for 1 ≤ x < 2
F(x) = 0.5 for 2 ≤ x < 3
F(x) = 0.9 for 3 ≤ x < 4
F(x) = 1.0 for x ≥ 4
The CDF is non-decreasing: 0 ≤ 0.2 ≤ 0.5 ≤ 0.9 ≤ 1.0 ✓
The CDF approaches 0 as x approaches -∞ and 1 as x approaches ∞ ✓
The distribution is valid (probabilities sum to 1 and are non-negative). The CDF is as calculated above.
P(heads) = 0.6, P(tails) = 0.4
X = number of heads in 2 flips
Possible values: X ∈ {0, 1, 2}
P(X = 0) = P(two tails) = (0.4) × (0.4) = 0.16
P(X = 1) = P(head on first, tail on second) + P(tail on first, head on second)
P(X = 1) = (0.6 × 0.4) + (0.4 × 0.6) = 0.24 + 0.24 = 0.48
P(X = 2) = P(two heads) = (0.6) × (0.6) = 0.36
Sum of probabilities: 0.16 + 0.48 + 0.36 = 1.0 ✓
P(X ≥ 1) = P(X = 1) + P(X = 2) = 0.48 + 0.36 = 0.84
Alternatively: P(X ≥ 1) = 1 - P(X = 0) = 1 - 0.16 = 0.84 ✓
Probability distribution: P(X=0)=0.16, P(X=1)=0.48, P(X=2)=0.36. P(X≥1) = 0.84
Customers: 0, 1, 2, 3, 4
Probabilities: 0.1, 0.2, 0.3, 0.25, 0.15
Find the expected number of customers and the probability of at least 2 customers.
Let X = number of customers per hour
X: {0, 1, 2, 3, 4}
P(X): {0.1, 0.2, 0.3, 0.25, 0.15}
All probabilities ≥ 0: 0.1, 0.2, 0.3, 0.25, 0.15 ≥ 0 ✓
Sum of probabilities: 0.1 + 0.2 + 0.3 + 0.25 + 0.15 = 1.0 ✓
E(X) = Σ xᵢ · P(xᵢ)
E(X) = 0 × 0.1 + 1 × 0.2 + 2 × 0.3 + 3 × 0.25 + 4 × 0.15
E(X) = 0 + 0.2 + 0.6 + 0.75 + 0.6 = 2.15
P(X ≥ 2) = P(X = 2) + P(X = 3) + P(X = 4)
P(X ≥ 2) = 0.3 + 0.25 + 0.15 = 0.7
P(X < 2) = P(X ≤ 1) = P(X = 0) + P(X = 1) = 0.1 + 0.2 = 0.3
Check: P(X ≥ 2) + P(X < 2) = 0.7 + 0.3 = 1.0 ✓
Expected number of customers per hour is 2.15. Probability of at least 2 customers is 0.7.
Let X = sum of two dice
Possible values: {2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}
Total possible outcomes: 36
Sum 2: (1,1) → 1 outcome → P(X=2) = 1/36
Sum 3: (1,2), (2,1) → 2 outcomes → P(X=3) = 2/36
Sum 4: (1,3), (2,2), (3,1) → 3 outcomes → P(X=4) = 3/36
Sum 5: (1,4), (2,3), (3,2), (4,1) → 4 outcomes → P(X=5) = 4/36
Sum 6: (1,5), (2,4), (3,3), (4,2), (5,1) → 5 outcomes → P(X=6) = 5/36
Sum 7: (1,6), (2,5), (3,4), (4,3), (5,2), (6,1) → 6 outcomes → P(X=7) = 6/36
Sum 8: (2,6), (3,5), (4,4), (5,3), (6,2) → 5 outcomes → P(X=8) = 5/36
Sum 9: (3,6), (4,5), (5,4), (6,3) → 4 outcomes → P(X=9) = 4/36
Sum 10: (4,6), (5,5), (6,4) → 3 outcomes → P(X=10) = 3/36
Sum 11: (5,6), (6,5) → 2 outcomes → P(X=11) = 2/36
Sum 12: (6,6) → 1 outcome → P(X=12) = 1/36
Sum of probabilities: (1+2+3+4+5+6+5+4+3+2+1)/36 = 36/36 = 1 ✓
P(7 ≤ X ≤ 10) = P(X=7) + P(X=8) + P(X=9) + P(X=10)
P(7 ≤ X ≤ 10) = 6/36 + 5/36 + 4/36 + 3/36 = 18/36 = 1/2
Notice that P(X=7) = 6/36 = 1/6 is the highest probability (most likely sum).
The distribution is symmetric around X=7.
Probability distribution: P(X=k) = number of ways to get sum k divided by 36. P(7 ≤ X ≤ 10) = 1/2.
P(defective) = 0.05, P(not defective) = 0.95
X = number of defective parts in 3 checks
Possible values: X ∈ {0, 1, 2, 3}
P(X = 0) = (0.95)³ = 0.857375
P(X = 1) = C(3,1) × (0.05)¹ × (0.95)² = 3 × 0.05 × 0.9025 = 0.135375
P(X = 2) = C(3,2) × (0.05)² × (0.95)¹ = 3 × 0.0025 × 0.95 = 0.007125
P(X = 3) = (0.05)³ = 0.000125
Sum of probabilities: 0.857375 + 0.135375 + 0.007125 + 0.000125 = 1.0 ✓
P(X ≤ 1) = P(X = 0) + P(X = 1) = 0.857375 + 0.135375 = 0.99275
Probability distribution: P(X=0)=0.857, P(X=1)=0.135, P(X=2)=0.007, P(X=3)=0.000. P(X≤1) = 0.993.
Probability Distribution: A mathematical function that provides the probabilities of occurrence of different possible outcomes in an experiment.
Discrete Distribution: Distribution for variables that take distinct, separate values.
Continuous Distribution: Distribution for variables that can take any value within a range.
- Non-negativity: All probabilities ≥ 0
- Normalization: Sum of all probabilities = 1 (discrete) or integral of PDF = 1 (continuous)
- Cumulative Function: F(x) = P(X ≤ x) is non-decreasing
- Relationship: For discrete: P(a ≤ X ≤ b) = F(b) - F(a-1)
Probability Models: Help predict outcomes and understand variability in random phenomena.
Expected Value: Long-run average value of repetitions of the experiment.
Variance: Measure of spread around the expected value.