Expected Value: The weighted average of all possible values of a random variable, where each value is weighted by its probability. For discrete variables: E[X] = Σx·P(X = x).
- Multiply each possible value by its probability
- Sum all the products
- Verify the calculation
E[X] = Σx·P(X = x) = (1)(0.2) + (2)(0.3) + (3)(0.4) + (4)(0.1)
(1)(0.2) = 0.2, (2)(0.3) = 0.6, (3)(0.4) = 1.2, (4)(0.1) = 0.4
E[X] = 0.2 + 0.6 + 1.2 + 0.4 = 2.4
E[X] = 2.4. The expected value of X is 2.4.
• Expected value formula: E[X] = Σx·P(X = x)
• Weighted average: Each value weighted by its probability
• Linearity: Sum of weighted values
Continuous Expected Value: For a continuous random variable with probability density function f(x), the expected value is E[X] = ∫xf(x)dx over the domain of X.
E[X] = ∫xf(x)dx = ∫₀¹ x·2x dx = ∫₀¹ 2x² dx
∫ 2x² dx = (2/3)x³ + C
E[X] = [(2/3)x³]₀¹ = (2/3)(1)³ - (2/3)(0)³ = 2/3
E[X] = 2/3. The expected value of X is 2/3.
• Continuous expected value: E[X] = ∫xf(x)dx
• Integration: Apply power rule for polynomials
• Domain: Integrate only over where f(x) > 0
Expected Value of a Function: For g(X), E[g(X)] = Σg(x)·P(X = x) for discrete variables, or E[g(X)] = ∫g(x)f(x)dx for continuous variables.
E[X²] = Σx²·P(X = x) = (1²)(0.2) + (2²)(0.3) + (3²)(0.4) + (4²)(0.1) = (1)(0.2) + (4)(0.3) + (9)(0.4) + (16)(0.1) = 0.2 + 1.2 + 3.6 + 1.6 = 6.6
Using the linearity property: E[2X + 3] = 2E[X] + 3 = 2(2.4) + 3 = 4.8 + 3 = 7.8
E[2X + 3] = Σ(2x + 3)·P(X = x) = (5)(0.2) + (7)(0.3) + (9)(0.4) + (11)(0.1) = 1.0 + 2.1 + 3.6 + 1.1 = 7.8 ✓
E[X²] = 6.6 and E[2X + 3] = 7.8.
• Function of random variable: E[g(X)] = Σg(x)·P(X = x)
• Linearity of expectation: E[aX + b] = aE[X] + b
• Computational efficiency: Linearity property simplifies calculations
Expected Value (Mean): The long-run average value of repetitions of an experiment it represents.
Discrete Expected Value: E[X] = Σx·P(X = x), where the sum is taken over all possible values of X.
Continuous Expected Value: E[X] = ∫xf(x)dx, where f(x) is the probability density function.
Linearity of Expectation: E[aX + b] = aE[X] + b for constants a and b.
Law of the Unconscious Statistician: Method for finding expected value of functions of random variables.
- Identify the type: Determine if discrete or continuous
- Verify distribution: Ensure probabilities/ densities are valid
- Select formula: Use appropriate expected value formula
- Perform calculation: Apply summation or integration
- Verify result: Check if the result makes sense
- Interpret meaning: Understand practical significance
• Discrete: E[X] = Σx·P(X = x)
• Continuous: E[X] = ∫xf(x)dx
• Linearity: E[aX + b] = aE[X] + b
• Function: E[g(X)] = Σg(x)·P(X = x) or ∫g(x)f(x)dx
• Additivity: E[X + Y] = E[X] + E[Y] (regardless of independence)
Variance: Measures the spread of a distribution. Var(X) = E[(X - E[X])²] = E[X²] - (E[X])². Standard Deviation: σ = √Var(X).
From Exercise 3: E[X] = 2.4 and E[X²] = 6.6.
Var(X) = E[X²] - (E[X])² = 6.6 - (2.4)² = 6.6 - 5.76 = 0.84
σ = √Var(X) = √0.84 ≈ 0.9165
Var(X) = 0.84 and the standard deviation is approximately 0.9165.
• Variance formula: Var(X) = E[X²] - (E[X])²
• Standard deviation: σ = √Var(X)
• Computational efficiency: Using the alternative variance formula
Expected Value of a Game: The average net gain or loss per game over many plays. Calculate net winnings for each outcome, multiply by probability, and sum.
Roll 6: Win $20, pay $5 → Net gain = $15. Roll 5: Win $10, pay $5 → Net gain = $5. Roll 1-4: Win $0, pay $5 → Net loss = -$5.
P(Roll 6) = 1/6, P(Roll 5) = 1/6, P(Roll 1-4) = 4/6.
E[Net] = ($15)(1/6) + ($5)(1/6) + (-$5)(4/6) = $15/6 + $5/6 - $20/6 = $0/6 = $0.
The expected value of playing this game is $0. This is a fair game where you expect to break even in the long run.
• Net calculation: Include all costs and gains
• Expected value: Weighted average of all outcomes
• Game fairness: Expected value of $0 indicates a fair game
Expected Value (Mean): The long-run average value of repetitions of an experiment it represents. It's the weighted average of all possible values of a random variable.
Discrete Expected Value: E[X] = Σx·P(X = x), where the sum is taken over all possible values of X.
Continuous Expected Value: E[X] = ∫xf(x)dx, where f(x) is the probability density function.
Linearity of Expectation: E[aX + b] = aE[X] + b for constants a and b.
Variance: Var(X) = E[X²] - (E[X])², measures the spread of the distribution.
Standard Deviation: σ = √Var(X), measures the average deviation from the mean.
- Identify the variable type: Determine if discrete or continuous
- Verify distribution: Ensure probabilities/densities are valid
- Select appropriate formula: Use discrete or continuous formula
- Perform calculations: Apply summation or integration
- Apply properties: Use linearity or other properties when helpful
- Interpret results: Understand practical significance
• Discrete: E[X] = Σx·P(X = x)
• Continuous: E[X] = ∫xf(x)dx
• Linearity: E[aX + b] = aE[X] + b
• Function: E[g(X)] = Σg(x)·P(X = x) or ∫g(x)f(x)dx
• Additivity: E[X + Y] = E[X] + E[Y] (regardless of independence)
• Variance: Var(X) = E[X²] - (E[X])²
• Standard deviation: σ = √Var(X)
• Simple: Fair die roll (E[X] = 3.5)
• Intermediate: Given probability distribution
• Advanced: Continuous probability density function
• Complex: Functions of random variables and games
• Expected value is the theoretical average over many trials
• It may not be a possible outcome of the random variable
• Linearity property: E[aX + b] = aE[X] + b
• Variance measures spread: Var(X) = E[X²] - (E[X])²
• Expected value represents the center of the distribution
Questions & Answers
Question: Is the expected value always one of the possible outcomes of the random variable?
Answer: No, the expected value does not need to be a possible outcome! For example:
- Rolling a fair die: E[X] = 3.5, but you can never roll 3.5
- Flipping a coin (0 = tails, 1 = heads): E[X] = 0.5, but you never get 0.5
The expected value is the long-run average, not the most likely outcome.
Question: Why do we use the formula Var(X) = E[X²] - (E[X])² instead of the definition?
Answer: The computational formula Var(X) = E[X²] - (E[X])² is more convenient because:
- It's easier to calculate than E[(X - E[X])²]
- It requires only E[X] and E[X²], both of which are often already calculated
- It avoids computing (X - E[X])² for each value
Both formulas are mathematically equivalent, but the computational version is more efficient.
Question: Does E[X + Y] = E[X] + E[Y] always hold, even if X and Y are dependent?
Answer: Yes! The linearity of expectation is remarkable because E[X + Y] = E[X] + E[Y] holds regardless of whether X and Y are independent or dependent.
- This is one of the most important properties of expected value
- It extends to any finite sum: E[X₁ + X₂ + ... + Xₙ] = E[X₁] + E[X₂] + ... + E[Xₙ]
- Independence is only required for E[XY] = E[X]E[Y]
This property makes expected value calculations much more manageable in complex scenarios.