Between-group variation: Measures the variation between the group means and the overall mean.
- Calculate group means and overall mean
- Calculate sum of squares between groups (SSB)
- Calculate sum of squares within groups (SSW)
- Calculate degrees of freedom
- Calculate mean squares
- Calculate F-statistic
- Construct ANOVA table
Group A: (10+12+14+16)/4 = 13
Group B: (15+17+19+21)/4 = 18
Group C: (20+22+24+26)/4 = 23
Overall mean: (13+18+23)/3 = 18
SSB = Σn_i(ȳ_i - ȳ)²
SSB = 4(13-18)² + 4(18-18)² + 4(23-18)²
SSB = 4(25) + 4(0) + 4(25) = 100 + 0 + 100 = 200
Group A: (10-13)² + (12-13)² + (14-13)² + (16-13)² = 9+1+1+9 = 20
Group B: (15-18)² + (17-18)² + (19-18)² + (21-18)² = 9+1+1+9 = 20
Group C: (20-23)² + (22-23)² + (24-23)² + (26-23)² = 9+1+1+9 = 20
SSW = 20 + 20 + 20 = 60
df_between = k - 1 = 3 - 1 = 2
df_within = N - k = 12 - 3 = 9
df_total = N - 1 = 12 - 1 = 11
MSB = SSB/df_between = 200/2 = 100
MSW = SSW/df_within = 60/9 = 6.67
F = MSB/MSW = 100/6.67 = 15
Between-group variation (SSB) = 200, Within-group variation (SSW) = 60, F-statistic = 15. The large F-value suggests significant differences between groups.
• SSB formula: SSB = Σn_i(ȳ_i - ȳ)²
• SSW formula: SSW = ΣΣ(y_ij - ȳ_i)²
• F-statistic: F = MSB/MSW
• SSB = 200, df = 2, MSB = 100
• SSW = 60, df = 9, MSW = 6.67
• F = 15, df = (2, 9)
Unequal sample sizes: When groups have different numbers of observations, calculations adjust for sample size weights.
Group 1: (5+7+9)/3 = 7
Group 2: (10+12+14+16+18)/5 = 14
Group 3: (20+22)/2 = 21
Total observations: N = 3+5+2 = 10
Overall mean: (3×7 + 5×14 + 2×21)/10 = (21+70+42)/10 = 13.3
SSB = Σn_i(ȳ_i - ȳ)²
SSB = 3(7-13.3)² + 5(14-13.3)² + 2(21-13.3)²
SSB = 3(39.69) + 5(0.49) + 2(59.29) = 119.07 + 2.45 + 118.58 = 240.1
Group 1: (5-7)² + (7-7)² + (9-7)² = 4 + 0 + 4 = 8
Group 2: (10-14)² + (12-14)² + (14-14)² + (16-14)² + (18-14)² = 16+4+0+4+16 = 40
Group 3: (20-21)² + (22-21)² = 1 + 1 = 2
SSW = 8 + 40 + 2 = 50
df_between = k - 1 = 3 - 1 = 2
df_within = N - k = 10 - 3 = 7
MSB = 240.1/2 = 120.05
MSW = 50/7 = 7.14
F = 120.05/7.14 = 16.82
Between-group variation (SSB) = 240.1, Within-group variation (SSW) = 50, F-statistic = 16.82. Sample sizes are properly weighted in calculations.
• Weighted means: Larger groups contribute more to overall mean
• Unequal n: Formula adjusts for different sample sizes
• DF calculation: df = n_i - 1 for each group
• SSB = 240.1, df = 2, MSB = 120.05
• SSW = 50, df = 7, MSW = 7.14
• F = 16.82, df = (2, 7)
ANOVA table: Organized summary of ANOVA calculations showing sources of variation, degrees of freedom, sum of squares, mean squares, and F-statistic.
Group A: (8+10+12)/3 = 10
Group B: (14+16+18)/3 = 16
Group C: (20+22+24)/3 = 22
Group D: (26+28+30)/3 = 28
Overall mean: (10+16+22+28)/4 = 19
SSB = 3(10-19)² + 3(16-19)² + 3(22-19)² + 3(28-19)²
SSB = 3(81) + 3(9) + 3(9) + 3(81) = 243 + 27 + 27 + 243 = 540
Group A: (8-10)² + (10-10)² + (12-10)² = 4 + 0 + 4 = 8
Group B: (14-16)² + (16-16)² + (18-16)² = 4 + 0 + 4 = 8
Group C: (20-22)² + (22-22)² + (24-22)² = 4 + 0 + 4 = 8
Group D: (26-28)² + (28-28)² + (30-28)² = 4 + 0 + 4 = 8
SSW = 8 + 8 + 8 + 8 = 32
SST = SSB + SSW = 540 + 32 = 572
df_between = 4 - 1 = 3
df_within = 12 - 4 = 8
df_total = 12 - 1 = 11
MSB = 540/3 = 180
MSW = 32/8 = 4
F = 180/4 = 45
| Source | df | SS | MS | F |
|---|---|---|---|---|
| Between Groups | 3 | 540 | 180 | 45 |
| Within Groups | 8 | 32 | 4 | |
| Total | 11 | 572 |
The complete ANOVA table shows between-group variation of 540 and within-group variation of 32, with F-statistic = 45 indicating significant differences between groups.
• Table organization: Clear source, df, SS, MS, F columns
• Relationships: df_total = df_between + df_within
• SS relationships: SST = SSB + SSW
• SSB = 540, df = 3, MSB = 180
• SSW = 32, df = 8, MSW = 4
• F = 45, df = (3, 8)
Sum of squares between (SSB): The variation between group means and the overall mean, weighted by sample sizes.
Sum of squares within (SSW): The variation within each group around its own mean.
Total sum of squares (SST): The total variation in the data around the overall mean.
Degrees of freedom: The number of independent pieces of information in a calculation.
Mean squares: Sum of squares divided by degrees of freedom, representing variance estimates.
F-statistic: The ratio of between-group variance to within-group variance.
- Calculate group statistics: Means and sample sizes for each group
- Calculate overall mean: Weighted average of all observations
- Calculate SSB: Sum of squares between groups using group means
- Calculate SSW: Sum of squares within groups using individual deviations
- Verify relationship: Check that SST = SSB + SSW
- Calculate degrees of freedom: For between, within, and total
- Calculate mean squares: Divide SS by respective df
- Calculate F-statistic: Ratio of mean squares
- Construct table: Organize all components in ANOVA table
• SSB calculation: SSB = Σn_i(ȳ_i - ȳ)²
• SSW calculation: SSW = ΣΣ(y_ij - ȳ_i)²
• DF relationships: df_total = N-1, df_between = k-1, df_within = N-k
• MS calculation: MS = SS/df
• F-statistic: F = MSB/MSW
• SST = SSB + SSW (always true)
• df_total = df_between + df_within (always true)
• F = MSB/MSW (always non-negative)
• If groups are identical, F = 1
ANOVA relationships: Fundamental mathematical relationships that must hold in any ANOVA calculation.
Group 1: Mean = 4, Group 2: Mean = 10, Group 3: Mean = 16
Overall mean: (4+10+16)/3 = 10
SSB = 3(4-10)² + 3(10-10)² + 3(16-10)²
SSB = 3(36) + 3(0) + 3(36) = 108 + 0 + 108 = 216
Group 1: (2-4)² + (4-4)² + (6-4)² = 4 + 0 + 4 = 8
Group 2: (8-10)² + (10-10)² + (12-10)² = 4 + 0 + 4 = 8
Group 3: (14-16)² + (16-16)² + (18-16)² = 4 + 0 + 4 = 8
SSW = 8 + 8 + 8 = 24
SST = (2-10)² + (4-10)² + (6-10)² + (8-10)² + (10-10)² + (12-10)² + (14-10)² + (16-10)² + (18-10)²
SST = 64 + 36 + 16 + 4 + 0 + 4 + 16 + 36 + 64 = 240
SSB + SSW = 216 + 24 = 240 = SST ✓
df_between = 3 - 1 = 2
df_within = 9 - 3 = 6
df_total = 9 - 1 = 8
df_between + df_within = 2 + 6 = 8 = df_total ✓
MSB = 216/2 = 108
MSW = 24/6 = 4
F = 108/4 = 27
All ANOVA relationships are verified: SST = SSB + SSW and df_total = df_between + df_within. The F-statistic is 27, indicating significant differences between groups.
• Verification: Always check fundamental relationships
• Mathematical identity: SST = SSB + SSW is always true
• DF identity: df relationships must hold
Practical interpretation: Understanding what the ANOVA results mean in the context of the research question.
Method A: (75+78+72)/3 = 75
Method B: (82+85+80)/3 = 82.33
Method C: (88+90+86)/3 = 88
Method D: (70+74+71)/3 = 71.67
Overall mean: (75+82.33+88+71.67)/4 = 79.25
SSB = 3(75-79.25)² + 3(82.33-79.25)² + 3(88-79.25)² + 3(71.67-79.25)²
SSB = 3(18.06) + 3(9.49) + 3(76.56) + 3(57.76) = 54.18 + 28.47 + 229.68 + 173.28 = 485.61
Method A: (75-75)² + (78-75)² + (72-75)² = 0 + 9 + 9 = 18
Method B: (82-82.33)² + (85-82.33)² + (80-82.33)² = 0.11 + 7.11 + 5.44 = 12.66
Method C: (88-88)² + (90-88)² + (86-88)² = 0 + 4 + 4 = 8
Method D: (70-71.67)² + (74-71.67)² + (71-71.67)² = 2.79 + 5.44 + 0.44 = 8.67
SSW = 18 + 12.66 + 8 + 8.67 = 47.33
df_between = 4 - 1 = 3
df_within = 12 - 4 = 8
MSB = 485.61/3 = 161.87
MSW = 47.33/8 = 5.92
F = 161.87/5.92 = 27.34
The large F-statistic (27.34) suggests significant differences between teaching methods
Between-group variation (485.61) is much larger than within-group variation (47.33)
The differences in mean scores (75, 82.33, 88, 71.67) appear statistically significant
The F-statistic of 27.34 indicates highly significant differences between teaching methods. Method C (mean = 88) appears most effective, while Method D (mean = 71.67) appears least effective.
• Relative magnitude: Compare SSB to SSW to assess differences
• Practical significance: Consider real-world implications
• Statistical significance: Large F suggests differences exist
Analysis of Variance: A statistical method that partitions total variation into components attributable to different sources.
Between-group variation: The portion of total variation that can be attributed to differences between treatment groups.
Within-group variation: The portion of total variation that represents random error or individual differences within groups.
Mean squares: Sum of squares divided by degrees of freedom, providing unbiased variance estimates.
Statistical inference: Using sample statistics to make inferences about population parameters.
Experimental design: The plan for collecting data that allows for valid statistical inference.
- Design consideration: Plan the experiment to allow for valid ANOVA
- Data organization: Structure data in appropriate format for analysis
- Descriptive analysis: Calculate preliminary statistics and visualize data
- Component calculation: Compute all ANOVA components systematically
- Relationship verification: Check that mathematical identities hold
- Assumption checking: Verify ANOVA assumptions are met
- Statistical inference: Conduct hypothesis test using F-statistic
- Practical interpretation: Connect statistical results to research question
• Variance partitioning: ANOVA decomposes total variance into components
• Ratio comparison: F-statistic compares systematic to random variation
• Weighted averages: Sample sizes affect the contribution of each group
• Mathematical consistency: All relationships must hold algebraically
• Statistical inference: Connect sample statistics to population parameters
• ANOVA assumes independence, normality, and equal variances
• Large sample sizes help meet normality assumption
• Outliers can significantly affect results
• Consider effect size measures along with significance tests