Regression slope: The change in the dependent variable (y) for each unit increase in the independent variable (x).
- State null and alternative hypotheses
- Calculate test statistic: t = (b - β₀) / SE_b
- Determine degrees of freedom: df = n - 2
- Find critical value or p-value
- Make decision
- Draw conclusion
H₀: β = 0 (no linear relationship)
H₁: β ≠ 0 (linear relationship exists)
t = (b - β₀) / SE_b = (3.4 - 0) / 0.8 = 4.25
df = n - 2 = 20 - 2 = 18
For α = 0.05, two-tailed test, df = 18
t_critical = ±2.101
|t| = 4.25 > 2.101, so we reject H₀
We reject the null hypothesis. There is sufficient evidence to conclude that there is a significant linear relationship between hours studied and exam scores at α = 0.05.
• Test statistic: t = (sample slope - hypothesized slope) / standard error
• Degrees of freedom: df = n - 2 for simple linear regression
• Decision rule: Reject H₀ if |t| > critical value
Confidence interval: An interval estimate that captures the true population parameter with a specified level of confidence.
Sample slope (b) = 0.75
Standard error (SE_b) = 0.15
n = 25
Confidence level = 95%
df = n - 2 = 25 - 2 = 23
For 95% confidence, α = 0.05, α/2 = 0.025
t₀.₀₂₅,₂₃ = 2.069
CI = b ± t*(SE_b)
CI = 0.75 ± 2.069(0.15)
CI = 0.75 ± 0.310
CI = (0.440, 1.060)
We are 95% confident that the true population slope is between 0.440 and 1.060.
The 95% confidence interval for the population slope is (0.440, 1.060). We are 95% confident that the true slope falls within this range.
• CI formula: b ± t*(SE_b)
• Degrees of freedom: df = n - 2
• Interpretation: Confidence level indicates reliability
One-tailed test: A hypothesis test where the alternative hypothesis specifies a direction (positive or negative).
H₀: β ≤ 0 (calorie intake has no positive effect or negative effect)
H₁: β > 0 (calorie intake has positive effect)
t = (b - β₀) / SE_b = (0.08 - 0) / 0.03 = 2.67
df = n - 2 = 18 - 2 = 16
For α = 0.01, one-tailed test, df = 16
t_critical = 2.583
t = 2.67 > 2.583, so we reject H₀
There is sufficient evidence to support the claim that calorie intake positively affects weight gain.
We reject the null hypothesis. There is sufficient evidence at α = 0.01 to conclude that daily calorie intake has a positive effect on weight gain.
• One-tailed test: Critical value is only on one side
• Directional hypothesis: Specifies positive or negative relationship
• Decision rule: Compare test statistic with one-sided critical value
Population slope (β): The true slope parameter in the population regression line.
Sample slope (b): The estimated slope from the sample data.
Standard error of slope (SE_b): Measures the variability of the slope estimate.
Simple linear regression: A model that relates one independent variable to one dependent variable using a straight line.
- Verify conditions: Linearity, independence, normality, equal variance
- State hypotheses: H₀: β = β₀ vs H₁: β ≠ β₀ (or directional)
- Calculate test statistic: t = (b - β₀) / SE_b
- Determine degrees of freedom: df = n - 2
- Find critical value or p-value
- Make decision: Compare t-statistic with critical value
- Draw conclusion: Interpret in context of the problem
• Linearity: Relationship between x and y is linear
• Independence: Observations are independent
• Normality: Residuals are normally distributed
• Equal variance: Constant variance of residuals (homoscedasticity)
P-value approach: Compare the p-value with the significance level α to make a decision.
H₀: β = 1.0
H₁: β ≠ 1.0
t = (b - β₀) / SE_b = (1.8 - 1.0) / 0.65 = 1.23
df = n - 2 = 30 - 2 = 28
This is a two-tailed test
p-value = 2 × P(T > |1.23|) = 2 × P(T > 1.23)
Using t-table with df = 28: p-value ≈ 0.229
p-value = 0.229 > α = 0.05
We fail to reject H₀
There is insufficient evidence to conclude that the slope differs from 1.0.
We fail to reject the null hypothesis. There is insufficient evidence at α = 0.05 to conclude that the slope differs from 1.0.
• P-value method: Compare p-value with α
• Decision rule: Reject H₀ if p-value ≤ α
• Two-tailed test: Multiply probability by 2
Comparing slopes: Testing whether two regression lines have significantly different slopes.
H₀: β_A = β_B (slopes are equal)
H₁: β_A ≠ β_B (slopes are different)
SE_diff = √(SE_bA² + SE_bB²) = √(0.18² + 0.22²) = √(0.0324 + 0.0484) = √0.0808 = 0.284
t = (b_A - b_B) / SE_diff = (0.92 - 1.05) / 0.284 = -0.13 / 0.284 = -0.458
df = n_A + n_B - 4 = 22 + 25 - 4 = 43
For α = 0.05, two-tailed test, df = 43
t_critical ≈ ±2.017
|t| = 0.458 < 2.017
We fail to reject H₀
We fail to reject the null hypothesis. There is insufficient evidence at α = 0.05 to conclude that the slopes for the two groups are significantly different.
• Comparing slopes: SE_diff = √(SE_b1² + SE_b2²)
• Degrees of freedom: df = n₁ + n₂ - 4
• Decision rule: Compare |t| with critical value
Linear regression: A statistical method that models the relationship between a dependent variable and one or more independent variables using a linear equation.
Population regression line: The true linear relationship in the population: μ_y = α + βx.
Sample regression line: The estimated relationship from sample data: ŷ = a + bx.
Residuals: The differences between observed and predicted values: e_i = y_i - ŷ_i.
R-squared: The proportion of variance in the dependent variable explained by the independent variable.
- Check conditions: Verify linearity, independence, normality, and equal variance
- Fit regression line: Calculate sample slope (b) and intercept (a)
- Calculate standard error: Determine SE_b for the slope
- Formulate hypotheses: Define H₀ and H₁ about the population slope
- Calculate test statistic: Use t = (b - β₀) / SE_b
- Determine critical value: Find t-value based on α and df
- Make decision: Compare test statistic with critical value
- Construct confidence interval: Calculate b ± t*(SE_b)
- Interpret results: State conclusion in context
• Test statistic: t = (b - β₀) / SE_b
• Degrees of freedom: df = n - 2
• Confidence interval: b ± t*(SE_b)
• Standard error: SE_b = s/[s_x√(n-1)]
• Decision rule: Reject H₀ if |t| > t_critical