Power: Probability of correctly rejecting a false null hypothesis
Beta (β): Probability of Type II error (failing to reject false H₀)
Effect Size: Magnitude of difference between true parameter and hypothesized value
Significance Level (α): Probability of Type I error
Sample Size (n): Number of observations in the sample
Power = f(α, n, σ, δ)
Where δ = effect size (true parameter - hypothesized parameter)
Given: Power = 0.85, n = 1000 patients with disease
Power = P(detecting disease | disease is present)
Power = P(reject H₀ | H₀ is false)
In this context: Power = P(test positive | patient has disease)
Expected correct detections = Total cases × Power
Expected correct detections = 1000 × 0.85 = 850
Missed cases = 1000 - 850 = 150
This corresponds to β = 0.15 (Type II error rate)
Power + β = 0.85 + 0.15 = 1.0 ✓
The test would correctly identify 850 out of 1000 patients who have the disease.
• Power Definition: Power = P(correctly rejecting false H₀)
• Expected Values: Expected outcomes = Total × Probability
• Power-Beta Relationship: Power + β = 1
Initial: n₁ = 25, Power₁ = 0.60
New: n₂ = 100
Standard Error = σ/√n
SE₁ = σ/√25 = σ/5
SE₂ = σ/√100 = σ/10
With n = 100, SE is half of SE with n = 25
Sample means are twice as precise
More precise estimates make it easier to detect true effects
Power will increase significantly
Expected Power₂ ≈ 0.85-0.90
Smaller SE ⇒ narrower confidence intervals
⇒ More likely to reject false H₀
⇒ Higher power
Increasing n by 4× often increases power substantially
But diminishing returns occur at very large n
Power would increase significantly, likely to approximately 0.85-0.90.
Power increases with sample size because larger samples provide more precise estimates.
• Sample Size-Precision: Precision increases with √n
• Power-Size Relationship: Larger n ⇒ Higher power
• Standard Error: SE = σ/√n, so precision improves with √n
Initial: α₁ = 0.05, Power₁ = 0.80
New: α₂ = 0.01
α = P(reject H₀ | H₀ is true) [Type I error]
Power = P(reject H₀ | H₀ is false) [Correct detection]
Lower α means more stringent criteria for rejection
Harder to reject H₀ in general
Even when H₀ is false
When α decreases, power also decreases
New Power₂ < 0.80
Maybe Power₂ ≈ 0.65-0.70
β = 1 - Power
If Power decreases, β increases
More likely to miss true effects
α ↓ ⇒ Power ↓ ⇒ β ↑
More conservative test, lower sensitivity
Power will decrease when α is reduced from 0.05 to 0.01.
There is an inverse relationship between α and power.
• Alpha-Power Trade-off: α ↓ ⇒ Power ↓ (inverse relationship)
• Conservatism Effect: Stricter α reduces test sensitivity
• Balance Principle: Must balance Type I and Type II error control
Initial: Effect size d₁ = 0.5, Power₁ = 0.70
New: Effect size d₂ = 1.0
Effect size = (true parameter - hypothesized parameter) / standard deviation
Larger effect size = bigger difference relative to variability
Effect size doubles from 0.5 to 1.0
Signal becomes much stronger relative to noise
Power increases with effect size
Larger effects are easier to detect
Expected Power₂ ≈ 0.90-0.95
Larger effect ⇒ larger test statistic
⇒ More likely to exceed critical value
⇒ Higher probability of rejection
Large effects require smaller sample sizes for adequate power
Small effects may need very large samples to detect
Power would increase significantly, likely to approximately 0.90-0.95.
Power increases with effect size because larger effects are easier to detect.
• Effect Size-Power: Larger effect size ⇒ Higher power
• Signal-to-Noise: Effect size = signal relative to noise
• Detection Sensitivity: Power increases with detectable differences
Designed for: 10% reduction, Power = 0.80
Actual: 5% reduction
Designed for: Large effect (10% reduction)
Actual: Smaller effect (5% reduction)
Actual effect is half the designed-for effect
Smaller effect size ⇒ Lower power
Power for 5% effect < 0.80
Maybe Power ≈ 0.40-0.50
β = 1 - Power
If Power ≈ 0.40, then β ≈ 0.60
60% chance of missing the true 5% effect
Non-significant result might be due to low power
Not necessarily evidence that drug is ineffective
Study may be underpowered for realistic effect sizes
Power calculations should reflect realistic expectations
Studies designed for optimistic effect sizes may be underpowered
Consider range of plausible effect sizes
Power decreases significantly (maybe to 0.40-0.50).
Study may be underpowered for the actual effect size, risking Type II error.
• Design Consideration: Power calculations should reflect realistic effect sizes
• Interpretation Caution: Non-significant results may indicate low power
• Planning Importance: Adequate power crucial for meaningful studies