Confidence interval for slope: An interval estimate that captures the true population slope with a specified level of confidence.
- Identify sample slope (b) and standard error (SE_b)
- Determine confidence level and calculate α
- Calculate degrees of freedom: df = n - 2
- Find critical t-value for the desired confidence level
- Apply formula: CI = b ± t*(SE_b)
- Interpret the resulting interval
Sample slope (b) = 2.8
Standard error of slope (SE_b) = 0.65
Sample size (n) = 25
Confidence level = 95%
df = n - 2 = 25 - 2 = 23
For 95% confidence level, α = 0.05, α/2 = 0.025
t₀.₀₂₅,₂₃ = 2.069
Margin of error = t*(SE_b) = 2.069 × 0.65 = 1.345
Lower bound = b - margin of error = 2.8 - 1.345 = 1.455
Upper bound = b + margin of error = 2.8 + 1.345 = 4.145
CI = (1.455, 4.145)
We are 95% confident that the true population slope falls between 1.455 and 4.145.
The 95% confidence interval for the population slope is (1.455, 4.145). We are 95% confident that for every additional hour of study, exam scores increase by between 1.455 and 4.145 points.
• CI formula: b ± t*(SE_b)
• Degrees of freedom: df = n - 2
• Interpretation: Confidence level indicates reliability
• If we repeatedly sampled and constructed CIs, 95% would contain the true slope
• The interval does not contain 0, suggesting a significant relationship
• The range indicates precision of our estimate
Higher confidence level: Increases the certainty that the interval contains the true parameter, but results in a wider interval.
Sample slope (b) = 2.8
Standard error of slope (SE_b) = 0.65
Sample size (n) = 25
New confidence level = 99%
df = n - 2 = 25 - 2 = 23
For 99% confidence level, α = 0.01, α/2 = 0.005
t₀.₀₀₅,₂₃ = 2.807
Margin of error = t*(SE_b) = 2.807 × 0.65 = 1.825
Lower bound = 2.8 - 1.825 = 0.975
Upper bound = 2.8 + 1.825 = 4.625
CI = (0.975, 4.625)
95% CI: (1.455, 4.145)
99% CI: (0.975, 4.625)
99% CI is wider than 95% CI
The 99% confidence interval is (0.975, 4.625), which is wider than the 95% CI (1.455, 4.145). The higher confidence level increases certainty but decreases precision.
• Confidence level trade-off: Higher confidence = wider interval
• Increased certainty: More likely to contain true parameter
• Decreased precision: Less specific estimate
• 95% CI: More precise but less certain
• 99% CI: More certain but less precise
• Balance depends on application requirements
Sample size effect: Larger samples generally produce narrower confidence intervals, increasing precision of estimates.
df = 40 - 2 = 38
t₀.₀₂₅,₃₈ ≈ 2.024
Margin of error = 2.024 × 0.4 = 0.810
CI = 1.5 ± 0.810 = (0.690, 2.310)
df = 15 - 2 = 13
t₀.₀₂₅,₁₃ = 2.160
Margin of error = 2.160 × 0.7 = 1.512
CI = 1.5 ± 1.512 = (-0.012, 3.012)
n=40: (0.690, 2.310) - Width = 1.620
n=15: (-0.012, 3.012) - Width = 3.024
Larger sample produces narrower CI
The larger sample (n=40) provides a more precise estimate of the slope
The smaller sample CI includes 0, suggesting possible non-significance
Smaller samples require more caution in interpretation
Increasing sample size improves precision significantly
The 95% CI for n=40 is (0.690, 2.310), while for n=15 it's (-0.012, 3.012). Larger sample size produces a narrower, more precise confidence interval.
• Sample size effect: Larger n → smaller SE → narrower CI
• Precision: Narrower CI = more precise estimate
• Significance: CI including 0 suggests non-significant relationship
• Precision increases with larger samples
• Confidence intervals become narrower
• Statistical power increases
Confidence interval: An interval estimate that provides a range of plausible values for an unknown population parameter with a specified level of confidence.
Population slope (β): The true slope parameter in the population regression line that we aim to estimate.
Sample slope (b): The estimated slope from the sample data, used as a point estimate for the population slope.
Standard error of slope (SE_b): Measures the variability of the slope estimate across different samples.
Confidence level: The percentage of confidence intervals that would contain the true parameter if we repeated the sampling process many times.
- Verify conditions: Check linearity, independence, normality, and equal variance assumptions
- Extract parameters: Identify sample slope (b) and its standard error (SE_b)
- Determine confidence level: Choose desired confidence level (e.g., 90%, 95%, 99%)
- Calculate degrees of freedom: df = n - 2 for simple linear regression
- Find critical t-value: Look up t-value for α/2 and df
- Calculate margin of error: ME = t*(SE_b)
- Construct interval: Lower bound = b - ME, Upper bound = b + ME
- Interpret results: State the interval in context with confidence level
• Interval interpretation: We are X% confident the true slope falls within this range
• Significance: If CI excludes 0, the relationship is statistically significant
• Practical significance: Consider whether the range represents meaningful relationships
• Precision: Narrower intervals indicate more precise estimates
• Confidence intervals do not prove causation
• Extrapolation beyond data range is risky
• Assumptions must be met for valid inference
• Outliers can affect both slope and CI
Comparing CIs: Evaluating whether confidence intervals from different studies overlap, indicating similar or different relationships.
df = 30 - 2 = 28
t₀.₀₂₅,₂₈ = 2.048
ME = 2.048 × 0.15 = 0.307
CI_A = 0.78 ± 0.307 = (0.473, 1.087)
df = 45 - 2 = 43
t₀.₀₂₅,₄₃ ≈ 2.017
ME = 2.017 × 0.12 = 0.242
CI_B = 0.82 ± 0.242 = (0.578, 1.062)
CI_A: (0.473, 1.087)
CI_B: (0.578, 1.062)
Intervals overlap significantly
Study B has narrower CI due to larger sample size
Both studies suggest positive relationships
Both studies indicate similar positive relationships
Study B provides more precise estimate
Both confidence intervals suggest positive relationships between exercise and health scores. Study B provides a more precise estimate with a narrower interval due to the larger sample size.
• Comparison: Overlapping CIs suggest similar relationships
• Sample size: Larger n leads to narrower CI
• Consistency: Both studies support similar conclusions
Practical significance: Whether the magnitude of the relationship is meaningful in real-world applications, beyond statistical significance.
df = 100 - 2 = 98
For large df, t₀.₀₂₅ ≈ 1.984
ME = 1.984 × 0.008 = 0.016
CI = 0.023 ± 0.016 = (0.007, 0.039)
CI does not contain 0, so relationship is statistically significant
Slope suggests 0.023 unit increase per unit of x
Whether this is meaningful depends on context
For some applications, this might be too small to be useful
Statistically significant but may lack practical importance
The 95% confidence interval is (0.007, 0.039), indicating a statistically significant relationship. However, the small slope magnitude may limit practical significance.
• Statistical vs practical: Distinguish between the two
• Significance assessment: CI not containing 0 = statistical significance
• Context matters: Practical importance depends on application
Simple linear regression: A statistical method that models the relationship between one independent variable and one dependent variable using a straight line.
Point estimate: A single value (the sample slope b) used to estimate the population parameter (β).
Interval estimate: A range of values (confidence interval) that likely contains the population parameter.
Sampling distribution: The distribution of all possible values of the sample slope across different samples.
Standard error: The standard deviation of the sampling distribution of the slope estimator.
- Model verification: Confirm that linear regression assumptions are met
- Parameter extraction: Obtain slope estimate and its standard error from regression output
- Confidence level selection: Choose appropriate level based on application needs
- Degree of freedom calculation: df = n - 2 for simple regression
- Critical value determination: Use t-distribution with appropriate df
- Interval calculation: Apply CI formula with correct multiplier
- Assumption checking: Verify that assumptions hold for validity
- Interpretation in context: State results in terms of the original research question
- Practical assessment: Evaluate whether results have real-world significance
• Confidence interval: CI = b ± t*(SE_b)
• Degrees of freedom: df = n - 2
• Standard error: SE_b = s/[s_x√(n-1)]
• Critical value: t_{α/2, df}
• Significance: CI excluding 0 = significant relationship
• Confidence intervals are symmetric around the point estimate
• The t-distribution approaches normal distribution as df increases
• Multiple regression extends these concepts to multiple predictors
• Prediction intervals are different from confidence intervals