Discrete Random Variable: Takes on countable number of distinct values
Probability Mass Function (PMF): Function that assigns probability to each possible value
Properties: 1) 0 ≤ P(X = x) ≤ 1, 2) Σ P(X = x) = 1
- Identify all possible outcomes of the random variable
- Calculate probability for each outcome
- Verify probabilities sum to 1
- For cumulative probability, sum individual probabilities
Die can show values: 1, 2, 3, 4, 5, 6
Since die is fair: P(X = 1) = P(X = 2) = ... = P(X = 6) = 1/6
P(X = 1) + P(X = 2) + ... + P(X = 6) = 6 × (1/6) = 1 ✓
P(X ≤ 3) = P(X = 1) + P(X = 2) + P(X = 3) = 1/6 + 1/6 + 1/6 = 3/6 = 1/2
The probability distribution of X is uniform with P(X = x) = 1/6 for x = 1,2,3,4,5,6, and P(X ≤ 3) = 1/2
• Probability axioms: Probabilities are between 0 and 1
• Normalization: Sum of all probabilities equals 1
• Cumulative probability: P(X ≤ k) = Σ P(X = i) for i ≤ k
Binomial Distribution: Models number of successes in n independent Bernoulli trials
Formula: \(P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}\)
Parameters: n (trials), p (probability of success)
n = 5 (number of flips), k = 2 (number of heads), p = 0.3 (probability of heads)
\(P(X = 2) = \binom{5}{2} (0.3)^2 (0.7)^3\)
\(\binom{5}{2} = \frac{5!}{2!(5-2)!} = \frac{5!}{2!3!} = \frac{120}{2 \times 6} = 10\)
\((0.3)^2 = 0.09\), \((0.7)^3 = 0.343\)
\(P(X = 2) = 10 \times 0.09 \times 0.343 = 0.3087\)
The probability of getting exactly 2 heads in 5 flips is 0.3087 or 30.87%
• Binomial formula: \(P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}\)
• Combinations: \(\binom{n}{k} = \frac{n!}{k!(n-k)!}\)
• Independent trials: Each flip is independent
Continuous Random Variable: Takes on uncountably infinite number of values in an interval
Probability Density Function (PDF): Function f(x) such that P(a ≤ X ≤ b) = ∫[a,b] f(x)dx
Uniform PDF: f(x) = 1/(b-a) for a ≤ x ≤ b, 0 otherwise
X follows uniform distribution over [0, 15], so a = 0, b = 15
f(x) = 1/(b-a) = 1/(15-0) = 1/15 for 0 ≤ x ≤ 15
For uniform distribution: P(c ≤ X ≤ d) = (d-c)/(b-a)
P(5 ≤ X ≤ 10) = (10-5)/(15-0) = 5/15 = 1/3
The probability is 1/3 or approximately 33.33%
The probability that a passenger waits between 5 and 10 minutes is 1/3 or approximately 33.33%
• Uniform distribution: f(x) = 1/(b-a) for [a,b]
• Probability calculation: Area under PDF curve
• For uniform: P(c ≤ X ≤ d) = (d-c)/(b-a)
Random Variable: Variable whose value depends on outcome of random experiment
Probability Distribution: Description of possible values and their probabilities
Expected Value: Long-run average value, E[X] = Σx·P(X=x) for discrete
- Identify type: Discrete vs continuous
- Find parameters: Mean, variance, distribution family
- Apply formula: PMF/PDF for specific probabilities
- Calculate probabilities: Using appropriate method
• Discrete: P(X = x) ≥ 0, Σ P(X = x) = 1
• Continuous: f(x) ≥ 0, ∫f(x)dx = 1
• Expected value: E[X] = Σx·P(X=x) (discrete), E[X] = ∫xf(x)dx (continuous)
• Variance: Var(X) = E[X²] - (E[X])²
Empirical Distribution: Probability distribution based on observed frequencies
Expected Value: E[X] = Σ x·P(X = x), weighted average of possible outcomes
Cumulative Probability: P(X ≤ k) = Σ P(X = i) for i ≤ k
P(X=0) + P(X=1) + P(X=2) + P(X=3) = 0.4 + 0.3 + 0.2 + 0.1 = 1.0 ✓
E[X] = 0×P(X=0) + 1×P(X=1) + 2×P(X=2) + 3×P(X=3)
E[X] = 0×0.4 + 1×0.3 + 2×0.2 + 3×0.1 = 0 + 0.3 + 0.4 + 0.3 = 1.0
P(X ≤ 2) = P(X=0) + P(X=1) + P(X=2) = 0.4 + 0.3 + 0.2 = 0.9
On average, there is 1 accident per day. There's a 90% chance of having at most 2 accidents.
The expected number of accidents per day is 1.0, and the probability of having at most 2 accidents is 0.9 or 90%
• Expected value formula: E[X] = Σ x·P(X = x)
• Cumulative probability: P(X ≤ k) = Σ P(X = i) for i ≤ k
• Normalization: All probabilities sum to 1
Transformed Random Variable: Y = g(X) where g is a function of X
Linearity of Expectation: E[aX + b] = aE[X] + b
Transformation Rule: P(Y = y) = P(X = x) where y = g(x)
When X=1: Y = 2(1) + 1 = 3
When X=2: Y = 2(2) + 1 = 5
When X=3: Y = 2(3) + 1 = 7
Since Y is uniquely determined by X:
P(Y=3) = P(X=1) = 0.2
P(Y=5) = P(X=2) = 0.5
P(Y=7) = P(X=3) = 0.3
E[Y] = 3×P(Y=3) + 5×P(Y=5) + 7×P(Y=7)
E[Y] = 3×0.2 + 5×0.5 + 7×0.3 = 0.6 + 2.5 + 2.1 = 5.2
E[Y] = E[2X + 1] = 2E[X] + 1
E[X] = 1×0.2 + 2×0.5 + 3×0.3 = 0.2 + 1.0 + 0.9 = 2.1
E[Y] = 2(2.1) + 1 = 4.2 + 1 = 5.2 ✓
The distribution of Y is P(Y=3)=0.2, P(Y=5)=0.5, P(Y=7)=0.3, and E[Y]=5.2
• Transformation rule: P(Y=y) = P(X=x) where y=g(x)
• Linearity of expectation: E[aX + b] = aE[X] + b
• Probability preservation: Transformation doesn't change probability
Random Variable (X): A function that maps outcomes of a random experiment to real numbers
Discrete Random Variable: Takes on a finite or countably infinite set of values
Continuous Random Variable: Takes on values in an interval or union of intervals
Probability Distribution: A specification of probabilities for all possible values of a random variable
- Problem identification: Determine if discrete or continuous, identify variable type
- Distribution selection: Choose appropriate distribution model
- Parameter estimation: Identify parameters from problem statement
- Probability calculation: Apply relevant formulas
• Discrete PMF: P(X = x) ≥ 0, Σ P(X = x) = 1
• Continuous PDF: f(x) ≥ 0, ∫f(x)dx = 1
• Expected value: E[X] = Σx·P(X=x) (discrete), E[X] = ∫xf(x)dx (continuous)
• Variance: Var(X) = E[X²] - (E[X])²
• Linearity of expectation: E[aX + b] = aE[X] + b
• Binomial: P(X = k) = C(n,k)·p^k·(1-p)^(n-k), E[X] = np, Var(X) = np(1-p)
Discrete: P(X = x) ≠ 0, PMF, Countable outcomes
Continuous: P(X = x) = 0, PDF, Uncountable outcomes
Both: E[X] = Expected value, Var(X) = Variance
Analysis: The chart shows probability distributions and their key characteristics.
- Discrete distributions: Point probabilities, sum to 1, examples: dice, coin flips
- Continuous distributions: Area probabilities, integrate to 1, examples: heights, time intervals
- Both types have expected value and variance measures