Discrete Random Variable: A variable that can take on a finite or countably infinite number of distinct values. Each value has a specific probability associated with it.
- List all possible values of the random variable
- Determine the probability for each value
- Verify that probabilities sum to 1
When rolling a fair die, the possible outcomes are 1, 2, 3, 4, 5, 6 dots.
Since the die is fair, each outcome has equal probability: P(X = 1) = P(X = 2) = ... = P(X = 6) = 1/6.
Check: P(X = 1) + P(X = 2) + ... + P(X = 6) = 1/6 + 1/6 + 1/6 + 1/6 + 1/6 + 1/6 = 6/6 = 1 ✓
The probability distribution of X is: P(X = x) = 1/6 for each x in {1, 2, 3, 4, 5, 6}.
• Probability axioms: Each probability must be between 0 and 1
• Total probability: Sum of all probabilities equals 1
• Discrete variable: Finite number of possible values
Expected Value: The long-run average value of a random variable, calculated as E[X] = Σx·P(X = x). It represents the mean outcome over many repetitions of an experiment.
Roll 6: Win $5, pay $2 → Net gain = $3. Roll anything else: Win $0, pay $2 → Net loss = -$2.
P(net gain of $3) = P(rolling 6) = 1/6. P(net loss of $2) = P(rolling 1,2,3,4,5) = 5/6.
E = ($3)(1/6) + (-$2)(5/6) = $3/6 - $10/6 = -$7/6 ≈ -$1.17.
The expected value of playing this game is approximately -$1.17 per game. On average, you lose $1.17 per game played.
• Expected value formula: E[X] = Σx·P(X = x)
• Net profit calculation: Include all costs and gains
• Long-term perspective: Expected value predicts average over many trials
Continuous Random Variable: A variable that can take on any value within a specified range or interval. Probabilities are represented by areas under a probability density curve.
Uniform distribution on [0, 10] means f(x) = 1/(10-0) = 1/10 for 0 ≤ x ≤ 10.
For uniform distribution, P(3 ≤ X ≤ 7) = Area of rectangle = Width × Height.
Width = 7 - 3 = 4 minutes. Height = 1/10. Area = 4 × 1/10 = 4/10 = 2/5.
The probability that a customer waits between 3 and 7 minutes is 2/5 or 0.4.
• Continuous probability: P(a ≤ X ≤ b) = Area under PDF curve
• Uniform distribution: Equal probability density over interval
• Area calculation: Rectangle area = base × height
Random Variable: A variable whose possible values depend on the outcome of a random phenomenon.
Discrete Random Variable: Takes on a finite or countably infinite number of distinct values.
Continuous Random Variable: Takes on values in a continuous range or interval.
Probability Distribution: Function that describes the probabilities of all possible outcomes.
Expected Value: The weighted average of all possible values, weighted by their probabilities.
- Identify the variable: Determine if discrete or continuous
- Find possible values: List or define the range of values
- Determine probabilities: Calculate probability for each value or range
- Verify distribution: Ensure probabilities sum/integrate to 1
- Calculate measures: Find expected value, variance, etc.
- Interpret results: Understand practical meaning
• Discrete expected value: E[X] = Σx·P(X = x)
• Continuous expected value: E[X] = ∫x·f(x)dx
• Discrete probability axioms: P(X = x) ≥ 0 and ΣP(X = x) = 1
• Continuous probability axioms: f(x) ≥ 0 and ∫f(x)dx = 1
Cumulative Probability: P(X ≤ x) represents the probability that the random variable X takes on a value less than or equal to x. It's the sum of all probabilities up to that value.
P(X ≤ 3) = P(X = 1) + P(X = 2) + P(X = 3) = 0.2 + 0.3 + 0.4 = 0.9.
Check: P(X = 1) + P(X = 2) + P(X = 3) + P(X = 4) = 0.2 + 0.3 + 0.4 + 0.1 = 1.0 ✓
E[X] = Σx·P(X = x) = (1)(0.2) + (2)(0.3) + (3)(0.4) + (4)(0.1) = 0.2 + 0.6 + 1.2 + 0.4 = 2.4.
P(X ≤ 3) = 0.9 and E[X] = 2.4.
• Cumulative probability: Sum all probabilities up to the value
• Expected value: Weighted average of all possible values
• Distribution verification: All probabilities must sum to 1
Binomial Distribution: Models the number of successes in n independent Bernoulli trials, each with probability p of success. X ~ B(n,p) has P(X=k) = C(n,k)p^k(1-p)^(n-k).
Each bulb is independently either defective (success) with probability p = 0.05 or not. X follows a binomial distribution: X ~ B(10, 0.05).
P(X = 2) = C(10,2)(0.05)²(0.95)⁸ = 45 × (0.0025) × (0.6634) ≈ 0.0746.
For binomial distribution: E[X] = np = 10 × 0.05 = 0.5 defective bulbs.
The probability of exactly 2 defective bulbs is approximately 0.0746, and the expected number of defective bulbs is 0.5.
• Binomial probability: P(X = k) = C(n,k)p^k(1-p)^(n-k)
• Binomial expectation: E[X] = np
• Independence assumption: Each trial is independent
Random Variable: A variable whose possible values depend on the outcome of a random phenomenon. It maps outcomes of a random process to numerical values.
Discrete Random Variable: Takes on a finite or countably infinite number of distinct values. Examples include number of heads in coin flips, number of customers arriving at a store.
Continuous Random Variable: Takes on values in a continuous range or interval. Examples include time between arrivals, height of individuals, temperature readings.
Probability Mass Function (PMF): For discrete variables, PMF gives P(X = x) for each possible value x.
Probability Density Function (PDF): For continuous variables, PDF describes the relative likelihood of different values.
Expected Value: The long-run average value of a random variable, representing the center of its distribution.
- Problem identification: Determine if dealing with discrete or continuous variable
- Variable definition: Clearly define what the random variable represents
- Parameter determination: Identify distribution type and parameters
- Probability calculation: Apply appropriate formulas for the distribution
- Measure computation: Calculate expected value, variance, or other measures
- Interpretation: Explain results in practical context
• Discrete expected value: E[X] = Σx·P(X = x)
• Continuous expected value: E[X] = ∫x·f(x)dx
• Discrete probability axioms: P(X = x) ≥ 0 and ΣP(X = x) = 1
• Continuous probability axioms: f(x) ≥ 0 and ∫f(x)dx = 1
• Binomial distribution: X ~ B(n,p), E[X] = np, P(X=k) = C(n,k)p^k(1-p)^(n-k)
• Simple: Fair die roll (uniform discrete)
• Intermediate: Expected value of a game
• Advanced: Continuous uniform distribution
• Complex: Binomial distribution applications
• Random variables map random outcomes to numbers
• Discrete: Countable values with probability masses
• Continuous: Uncountable values with probability densities
• Expected value is the theoretical average
• Probabilities must always sum/integrate to 1
Questions & Answers
Question: What's the difference between P(X = x) for discrete and continuous random variables?
Answer: This is a crucial distinction:
- Discrete RV: P(X = x) can be greater than 0. Each specific value has a positive probability.
- Continuous RV: P(X = x) = 0 for any specific value x. We only consider probabilities over intervals: P(a ≤ X ≤ b).
Think of it this way: For a continuous variable like height, the probability of someone being exactly 6 feet tall (to infinite precision) is zero, but the probability of being between 5.9 and 6.1 feet is positive.
Question: What does the expected value really mean? Is it the most likely outcome?
Answer: No, the expected value is NOT necessarily the most likely outcome! It's the long-run average:
- It's the weighted average of all possible values
- It represents what you'd expect on average over many trials
- It might not even be a possible value of the random variable
Example: Rolling a fair die has E[X] = 3.5, but 3.5 is impossible to roll. However, if you roll many times, the average of your rolls will approach 3.5.
Question: How do I know when to use discrete vs continuous models in real-world situations?
Answer: Consider the nature of what you're measuring:
- Discrete: Counting things (people, cars, defects, votes, coin flips)
- Continuous: Measuring quantities (time, distance, weight, temperature, speed)
However, practically measured continuous variables often appear discrete due to rounding (height measured to nearest cm), but theoretically they're continuous. The model depends on the precision needed and the nature of the underlying process.