Solved Exercises on Practical Applications of ANOVA

Master practical applications of ANOVA: experimental design, real-world scenarios, and interpretation of results through these 5 detailed exercises.

Solution: Exercises 1 to 3
1 Scientific Experiment
Exercise 1
A pharmaceutical company tests three drug formulations on blood pressure reduction. Formulation A: 15, 18, 12, 16, 14; Formulation B: 22, 25, 20, 23, 21; Formulation C: 19, 17, 21, 18, 20. Test at α = 0.05 whether the formulations differ significantly in effectiveness.
Definition:

One-way ANOVA: A statistical method to compare means of three or more independent groups to determine if at least one differs significantly.

Experimental Design Methodology:
  1. State null and alternative hypotheses
  2. Verify ANOVA assumptions (normality, equal variance, independence)
  3. Calculate group means and overall mean
  4. Compute sum of squares between and within groups
  5. Calculate mean squares and F-statistic
  6. Determine critical value or p-value
  7. Make statistical decision
  8. Draw practical conclusion
Step 1: State hypotheses

H₀: μ_A = μ_B = μ_C (all formulations equally effective)

H₁: At least one mean differs

Step 2: Calculate group means

Formulation A: (15+18+12+16+14)/5 = 15

Formulation B: (22+25+20+23+21)/5 = 22.2

Formulation C: (19+17+21+18+20)/5 = 19

Step 3: Calculate overall mean

Overall mean: (15 + 22.2 + 19)/3 = 18.73

Step 4: Calculate SSB (Sum of Squares Between)

SSB = 5(15-18.73)² + 5(22.2-18.73)² + 5(19-18.73)²

SSB = 5(13.83) + 5(12.04) + 5(0.07) = 69.15 + 60.2 + 0.35 = 129.7

Step 5: Calculate SSW (Sum of Squares Within)

Formulation A: (15-15)² + (18-15)² + (12-15)² + (16-15)² + (14-15)² = 0 + 9 + 9 + 1 + 1 = 20

Formulation B: (22-22.2)² + (25-22.2)² + (20-22.2)² + (23-22.2)² + (21-22.2)² = 0.04 + 7.84 + 4.84 + 0.64 + 1.44 = 14.8

Formulation C: (19-19)² + (17-19)² + (21-19)² + (18-19)² + (20-19)² = 0 + 4 + 4 + 1 + 1 = 10

SSW = 20 + 14.8 + 10 = 44.8

Step 6: Calculate degrees of freedom

df_between = k - 1 = 3 - 1 = 2

df_within = N - k = 15 - 3 = 12

Step 7: Calculate mean squares

MSB = SSB/df_between = 129.7/2 = 64.85

MSW = SSW/df_within = 44.8/12 = 3.73

Step 8: Calculate F-statistic

F = MSB/MSW = 64.85/3.73 = 17.39

Step 9: Determine critical value

For α = 0.05, df = (2, 12)

F_critical = 3.89

Step 10: Make decision

Since F = 17.39 > 3.89, we reject H₀

F = 17.39 > 3.89, reject H₀ at α = 0.05
Final answer:

We reject the null hypothesis. There are significant differences in blood pressure reduction effectiveness among the three drug formulations at α = 0.05.

Applied rules:

• Decision rule: Reject H₀ if F > F_critical

• ANOVA assumptions: Verify normality and equal variance

• Statistical significance: Large F-value indicates differences

Scientific application insights:

• Formulation B appears most effective (mean = 22.2)

• Significant differences justify further post-hoc analysis

• Results support drug development decisions

2 Educational Research
Exercise 2
A school district compares reading comprehension scores for three teaching methods: Traditional (85, 87, 82, 88, 86, 84), Interactive (90, 92, 88, 91, 89, 90), and Digital (88, 91, 89, 93, 87, 92). Test at α = 0.01 whether there are significant differences in effectiveness.
Definition:

Educational ANOVA: Application of ANOVA to compare educational interventions, teaching methods, or curriculum effectiveness.

Step 1: Calculate group means

Traditional: (85+87+82+88+86+84)/6 = 85.33

Interactive: (90+92+88+91+89+90)/6 = 90.00

Digital: (88+91+89+93+87+92)/6 = 90.00

Step 2: Calculate overall mean

Overall mean: (85.33 + 90.00 + 90.00)/3 = 88.44

Step 3: Calculate SSB

SSB = 6(85.33-88.44)² + 6(90.00-88.44)² + 6(90.00-88.44)²

SSB = 6(9.71) + 6(2.44) + 6(2.44) = 58.26 + 14.64 + 14.64 = 87.54

Step 4: Calculate SSW

Traditional: (85-85.33)² + ... + (84-85.33)² = 23.33

Interactive: (90-90)² + ... + (90-90)² = 10.00

Digital: (88-90)² + ... + (92-90)² = 22.00

SSW = 23.33 + 10.00 + 22.00 = 55.33

Step 5: Calculate degrees of freedom

df_between = 3 - 1 = 2

df_within = 18 - 3 = 15

Step 6: Calculate mean squares

MSB = 87.54/2 = 43.77

MSW = 55.33/15 = 3.69

Step 7: Calculate F-statistic

F = 43.77/3.69 = 11.86

Step 8: Find critical value

For α = 0.01, df = (2, 15)

F_critical = 6.36

Step 9: Make decision

Since F = 11.86 > 6.36, we reject H₀

Step 10: Draw conclusion

There are significant differences in reading comprehension effectiveness among the three teaching methods.

F = 11.86 > 6.36, reject H₀ at α = 0.01
Final answer:

We reject the null hypothesis. There are significant differences in reading comprehension effectiveness among the three teaching methods at α = 0.01. Both Interactive and Digital methods appear superior to Traditional.

Applied rules:

• Stricter significance: α = 0.01 requires stronger evidence

• Practical implications: Results inform educational policy

• Sample size effect: Equal sample sizes simplify calculations

Educational application insights:

• Interactive and Digital methods show similar effectiveness

• Both outperform Traditional method significantly

• Supports modernization of teaching approaches

3 Industrial Quality Control
Exercise 3
A manufacturer tests three assembly line configurations for defect rates: Configuration 1: 2, 3, 1, 4, 2; Configuration 2: 5, 4, 6, 5, 4; Configuration 3: 3, 2, 4, 3, 3. Test at α = 0.05 whether configurations differ in quality control effectiveness.
Definition:

Industrial ANOVA: Application of ANOVA in manufacturing and quality control to compare process effectiveness, defect rates, or efficiency metrics.

Step 1: Calculate group statistics

Config 1: Mean = 2.4, n = 5

Config 2: Mean = 4.8, n = 5

Config 3: Mean = 3.0, n = 5

Overall mean: (2.4 + 4.8 + 3.0)/3 = 3.4

Step 2: Calculate SSB

SSB = 5(2.4-3.4)² + 5(4.8-3.4)² + 5(3.0-3.4)²

SSB = 5(1) + 5(1.96) + 5(0.16) = 5 + 9.8 + 0.8 = 15.6

Step 3: Calculate SSW

Config 1: (2-2.4)² + (3-2.4)² + (1-2.4)² + (4-2.4)² + (2-2.4)² = 0.16 + 0.36 + 1.96 + 2.56 + 0.16 = 5.2

Config 2: (5-4.8)² + (4-4.8)² + (6-4.8)² + (5-4.8)² + (4-4.8)² = 0.04 + 0.64 + 1.44 + 0.04 + 0.64 = 2.8

Config 3: (3-3.0)² + (2-3.0)² + (4-3.0)² + (3-3.0)² + (3-3.0)² = 0 + 1 + 1 + 0 + 0 = 2.0

SSW = 5.2 + 2.8 + 2.0 = 10.0

Step 4: Calculate mean squares

df_between = 3 - 1 = 2

df_within = 15 - 3 = 12

MSB = 15.6/2 = 7.8

MSW = 10.0/12 = 0.83

Step 5: Calculate F-statistic

F = 7.8/0.83 = 9.40

Step 6: Determine critical value

For α = 0.05, df = (2, 12)

F_critical = 3.89

Step 7: Make statistical decision

Since F = 9.40 > 3.89, we reject H₀

Step 8: Practical interpretation

Configuration 2 has the highest defect rate (mean = 4.8)

Configuration 1 appears most effective (mean = 2.4)

Significant differences suggest process optimization opportunities

F = 9.40 > 3.89, reject H₀
Final answer:

We reject the null hypothesis. There are significant differences in defect rates among the three assembly line configurations at α = 0.05. Configuration 1 is the most effective, while Configuration 2 has the highest defect rate.

Applied rules:

• Quality control: Lower defect rates indicate better performance

• Cost implications: Statistical differences may have significant economic impact

• Process optimization: Results guide operational improvements

Industrial application insights:

• Configuration 1 should be adopted company-wide

• Configuration 2 needs immediate process review

• Statistical evidence supports management decisions

ANOVA Application Concepts and Fields
\( F = \frac{MS_{between}}{MS_{within}} = \frac{\frac{SS_{between}}{df_{between}}}{\frac{SS_{within}}{df_{within}}} \)
ANOVA F-Statistic Formula
Total Variation
\( SST = SSB + SSW \)
Decomposition of variance
Degrees of Freedom
\( df_{total} = df_{between} + df_{within} \)
Partitioning of information
Effect Size
\( \eta^2 = \frac{SSB}{SST} \)
Proportion of variance explained
Mean Squares
\( MS = \frac{SS}{df} \)
Variance estimates
Key definitions:

Experimental design: The framework for organizing data collection to enable valid statistical analysis.

Factor: An independent variable in an experiment that is manipulated to observe its effect.

Level: The different values or categories of a factor.

Treatment: A specific combination of factor levels.

Block: A group of similar experimental units.

Randomization: Assigning treatments to experimental units randomly to reduce bias.

Replication: Repeating treatments to increase precision and estimate error.

Blocking: Grouping similar units to control for extraneous variation.

Complete Application Methodology:
  1. Problem identification: Define the research question and objectives
  2. Factor selection: Identify independent variables to test
  3. Level determination: Specify treatment conditions
  4. Design selection: Choose appropriate experimental design
  5. Sample size planning: Determine adequate sample sizes
  6. Data collection: Execute experiment according to design
  7. Assumption verification: Check ANOVA assumptions
  8. ANOVA computation: Calculate all ANOVA components
  9. Statistical inference: Test hypotheses and make decisions
  10. Practical interpretation: Connect results to research objectives
  11. Implementation: Apply findings to real-world context
Tip 1: Always consider practical significance alongside statistical significance.
Tip 2: Randomization is crucial for valid causal inference.
Tip 3: Equal sample sizes simplify calculations and increase power.
Tip 4: Consider blocking to control for confounding variables.

Tip 5: Post-hoc tests are needed to identify specific differences after ANOVA.

Common applications: Agriculture, medicine, manufacturing, psychology, education, marketing, environmental science.
Advanced considerations: Factorial designs, repeated measures, randomized blocks, nested designs.
Field-specific applications:

• Medical: Drug efficacy studies, treatment comparisons, clinical trials

• Psychology: Behavioral studies, therapy comparisons, cognitive experiments

• Agriculture: Crop variety testing, fertilizer comparisons, pest control methods

• Education: Teaching method evaluations, curriculum comparisons, assessment tools

• Industry: Quality control, process optimization, product testing

Design considerations:

• Control for confounding variables

• Ensure randomization and blinding when appropriate

• Consider ethical implications in human studies

• Plan for adequate sample size and power

Solution: Exercises 4 to 5
4 Agricultural Experiment
Exercise 4
A farmer tests four different fertilizer types on corn yield: Type A: 120, 125, 118, 122; Type B: 130, 135, 128, 132; Type C: 125, 128, 123, 126; Type D: 115, 118, 112, 116. Test at α = 0.05 whether fertilizers differ in effectiveness.
Definition:

Agricultural ANOVA: Application of ANOVA in farming and agricultural research to compare crop yields, fertilizer effectiveness, or farming techniques.

Step 1: Calculate group means

Type A: (120+125+118+122)/4 = 121.25

Type B: (130+135+128+132)/4 = 131.25

Type C: (125+128+123+126)/4 = 125.5

Type D: (115+118+112+116)/4 = 115.25

Step 2: Calculate overall mean

Overall mean: (121.25 + 131.25 + 125.5 + 115.25)/4 = 123.31

Step 3: Calculate SSB

SSB = 4(121.25-123.31)² + 4(131.25-123.31)² + 4(125.5-123.31)² + 4(115.25-123.31)²

SSB = 4(4.25) + 4(63.20) + 4(4.79) + 4(65.03) = 17.0 + 252.8 + 19.16 + 260.12 = 549.08

Step 4: Calculate SSW

Type A: (120-121.25)² + (125-121.25)² + (118-121.25)² + (122-121.25)² = 1.56 + 14.06 + 10.56 + 0.56 = 26.74

Type B: (130-131.25)² + (135-131.25)² + (128-131.25)² + (132-131.25)² = 1.56 + 14.06 + 10.56 + 0.56 = 26.74

Type C: (125-125.5)² + (128-125.5)² + (123-125.5)² + (126-125.5)² = 0.25 + 6.25 + 6.25 + 0.25 = 13.0

Type D: (115-115.25)² + (118-115.25)² + (112-115.25)² + (116-115.25)² = 0.06 + 7.56 + 10.56 + 0.56 = 18.74

SSW = 26.74 + 26.74 + 13.0 + 18.74 = 85.22

Step 5: Calculate degrees of freedom

df_between = 4 - 1 = 3

df_within = 16 - 4 = 12

Step 6: Calculate mean squares

MSB = 549.08/3 = 183.03

MSW = 85.22/12 = 7.10

Step 7: Calculate F-statistic

F = 183.03/7.10 = 25.78

Step 8: Determine critical value

For α = 0.05, df = (3, 12)

F_critical = 3.49

Step 9: Make decision

Since F = 25.78 > 3.49, we reject H₀

Step 10: Practical interpretation

Type B fertilizer shows highest yield (mean = 131.25)

Type D shows lowest yield (mean = 115.25)

Significant differences justify changing fertilizer practices

F = 25.78 > 3.49, reject H₀
Final answer:

We reject the null hypothesis. There are significant differences in corn yield among the four fertilizer types at α = 0.05. Type B fertilizer appears most effective while Type D is least effective.

Applied rules:

• Agricultural significance: Yield differences translate to economic impact

• Decision support: Results guide farming practices

• Replication: Multiple plots per treatment increase reliability

Agricultural application insights:

• Type B fertilizer increases yield by ~10 units

• Economic analysis should follow statistical results

• Consider environmental impact of most effective fertilizer

5 Medical Study
Exercise 5
A medical study compares cholesterol reduction for three medications: Medication 1: 15, 18, 16, 14, 17; Medication 2: 22, 20, 24, 21, 23; Medication 3: 19, 17, 20, 18, 16. Test at α = 0.01 whether medications differ in effectiveness.
Definition:

Medical ANOVA: Application of ANOVA in clinical research to compare treatment effectiveness, drug efficacy, or therapeutic outcomes.

Step 1: Calculate group means

Medication 1: (15+18+16+14+17)/5 = 16

Medication 2: (22+20+24+21+23)/5 = 22

Medication 3: (19+17+20+18+16)/5 = 18

Step 2: Calculate overall mean

Overall mean: (16 + 22 + 18)/3 = 18.67

Step 3: Calculate SSB

SSB = 5(16-18.67)² + 5(22-18.67)² + 5(18-18.67)²

SSB = 5(7.13) + 5(11.11) + 5(0.45) = 35.65 + 55.55 + 2.25 = 93.45

Step 4: Calculate SSW

Med 1: (15-16)² + (18-16)² + (16-16)² + (14-16)² + (17-16)² = 1 + 4 + 0 + 4 + 1 = 10

Med 2: (22-22)² + (20-22)² + (24-22)² + (21-22)² + (23-22)² = 0 + 4 + 4 + 1 + 1 = 10

Med 3: (19-18)² + (17-18)² + (20-18)² + (18-18)² + (16-18)² = 1 + 1 + 4 + 0 + 4 = 10

SSW = 10 + 10 + 10 = 30

Step 5: Calculate degrees of freedom

df_between = 3 - 1 = 2

df_within = 15 - 3 = 12

Step 6: Calculate mean squares

MSB = 93.45/2 = 46.73

MSW = 30/12 = 2.5

Step 7: Calculate F-statistic

F = 46.73/2.5 = 18.69

Step 8: Determine critical value

For α = 0.01, df = (2, 12)

F_critical = 6.93

Step 9: Make decision

Since F = 18.69 > 6.93, we reject H₀

Step 10: Clinical interpretation

Medication 2 shows greatest cholesterol reduction (mean = 22)

Results are statistically significant at α = 0.01

Findings support clinical decision-making

F = 18.69 > 6.93, reject H₀ at α = 0.01
Final answer:

We reject the null hypothesis. There are significant differences in cholesterol reduction among the three medications at α = 0.01. Medication 2 appears most effective for cholesterol reduction.

Applied rules:

• Medical significance: Results inform patient care decisions

• Stricter significance: α = 0.01 reflects importance of medical decisions

• Regulatory implications: Results may affect drug approval

Medical application insights:

• Medication 2 reduces cholesterol by 6 units more than average

• Statistical significance supports clinical relevance

• Further research needed for safety profile

Advanced Concepts and Applications
\( \eta^2 = \frac{SS_{between}}{SS_{total}}, \quad \omega^2 = \frac{SS_{between} - (df_{between} \cdot MS_{within})}{SS_{total} + MS_{within}} \)
Effect Size Formulas
Key definitions:

Effect size: A quantitative measure of the magnitude of the experimental effect, independent of sample size.

Power: The probability of correctly rejecting a false null hypothesis.

Randomized block design: An experimental design that controls for variability by grouping similar experimental units.

Factorial design: An experimental design that tests multiple factors simultaneously.

Interaction effect: When the effect of one factor depends on the level of another factor.

Main effect: The effect of a factor averaged over all levels of other factors.

Advanced Application Methodology:
  1. Design planning: Select appropriate experimental design for the research question
  2. Sample size calculation: Determine adequate sample size for desired power
  3. Randomization scheme: Plan for proper randomization to avoid bias
  4. Data collection protocol: Establish procedures to ensure data quality
  5. Assumption verification: Check all ANOVA assumptions before analysis
  6. Statistical analysis: Perform ANOVA and post-hoc tests if needed
  7. Effect size calculation: Determine practical significance
  8. Power analysis: Evaluate the study's ability to detect effects
  9. Practical interpretation: Connect statistical results to real-world implications
  10. Report writing: Communicate results clearly and completely
Tip 1: Always report effect sizes along with significance tests.
Tip 2: Consider ethical implications in human subjects research.
Tip 3: Use blocking to control for known sources of variation.

Tip 4: Plan for missing data and dropouts in advance.

Tip 5: Consider multiple comparison corrections when comparing many groups.

Emerging applications: Genomics, proteomics, environmental monitoring, climate research, sports analytics.
Future directions: Machine learning integration, big data applications, real-time analysis, personalized medicine.
Ethical and practical considerations:

• Human subjects: Obtain proper consent and protect privacy

• Animal studies: Follow ethical guidelines for animal welfare

• Environmental impact: Consider ecological consequences of applications

• Equity: Ensure research benefits are accessible to all populations

• Transparency: Report all relevant details and limitations

Advanced design considerations:

• Repeated measures designs for longitudinal studies

• Nested designs for hierarchical data structures

• Split-plot designs for complex experimental constraints

• Response surface methodology for optimization

Questions & Answers

Question: How do I choose the appropriate significance level (α) for different applications?

Answer: The choice of significance level depends on the consequences of Type I and Type II errors:

  • Standard α = 0.05: Common in most research contexts
  • Stricter α = 0.01: For high-stakes decisions (medical, safety, legal)
  • More lenient α = 0.10: For exploratory research or screening studies

Consider the relative costs of false positives versus false negatives:

  • Medical testing: Often use α = 0.01 due to serious consequences
  • Marketing research: May use α = 0.05 or 0.10
  • Quality control: Depends on cost of defective products

The significance level should be determined before conducting the analysis based on the context and potential consequences.

In some fields, multiple testing corrections are applied to maintain family-wise error rates.

Always consider the practical significance alongside statistical significance.

Question: What are the key differences between ANOVA applications in experimental versus observational studies?

Answer: The key differences lie in design control and causal inference:

  • Experimental studies: Researcher controls treatment assignment, allows causal inference
  • Observational studies: Treatments occur naturally, limited to associative conclusions

Experimental advantages:

  • Randomization eliminates confounding
  • Establishes cause-and-effect relationships
  • Greater control over variables

Observational advantages:

  • More natural setting
  • Often more ethical
  • More practical for certain research questions

Both use the same ANOVA formulas, but interpretation differs significantly. Experimental studies can claim causation while observational studies can only suggest association.

Observational studies require more careful consideration of confounding variables.

In observational studies, ANOVA results should be interpreted with more caution regarding causality.

Question: How do I interpret ANOVA results in the context of business decision-making?

Answer: Business interpretation requires connecting statistical results to practical implications:

  • Effect size: Consider whether differences are large enough to matter financially
  • Cost-benefit: Evaluate if implementation costs justify potential benefits
  • Scalability: Consider if results will hold when implemented broadly

Steps for business interpretation:

  • Quantify the practical impact of differences
  • Consider implementation feasibility
  • Assess risks and uncertainties
  • Plan for pilot testing

For example, if ANOVA shows a new marketing strategy significantly increases sales by 2%, consider whether the 2% increase justifies the implementation costs.

Always present results with confidence intervals and effect sizes, not just p-values.

Consider the business context: a 2% improvement in conversion might be worth millions in revenue.