p-value > α → Fail to Reject H₀
0 in CI → No Significant Difference
Statistical Significance: Evidence that observed difference is unlikely due to chance alone
Practical Significance: Whether observed difference is meaningful in real-world context
Effect Size: Magnitude of difference between groups
Power: Probability of detecting true differences
Confidence Level: Percentage of confidence in the interval estimate
Direction of Effect: Which group has higher/lower values
1. Statistical Significance: Is p-value ≤ α?
2. Direction: Which group is higher/lower?
3. Magnitude: What is the size of the difference?
4. Practical Relevance: Is the difference meaningful?
5. Confidence: How certain are we about the estimate?
CI: (2.1, 4.3) days for μA - μB
Interpretation Context: Recovery time difference
Systematic approach to interpreting confidence intervals
Interval (2.1, 4.3) does NOT contain 0
Therefore, there is a statistically significant difference
Since the interval is entirely positive (2.1 to 4.3), μA - μB > 0
This means μA > μB: Medication A has longer recovery time than B
Point estimate: (2.1 + 4.3)/2 = 3.2 days difference
Medication A takes 2.1 to 4.3 days longer to recover than B
3.2 days difference may be clinically meaningful
Medication B appears superior for faster recovery
We are 95% confident that Medication A takes 2.1 to 4.3 days longer to recover than Medication B
There is a statistically significant difference in recovery times.
Medication B has faster recovery (2.1 to 4.3 days faster than A).
• Zero in CI: If 0 is in interval, no significant difference
• Sign Direction: Positive interval means first group is larger
• Confidence Level: 95% confidence in the interval estimate
p-value: 0.003
CI: (-1.2, 0.8) for μ₁ - μ₂
Confidence Level: 99%
p-value = 0.003 < α = 0.01 (99% confidence)
Would reject H₀ at α = 0.01 level
CI (-1.2, 0.8) DOES contain 0
This suggests no significant difference at 99% confidence level
p-value vs CI discrepancy occurs because different confidence levels are used
p-value is based on α = 0.05, CI is 99% (α = 0.01)
Since CI contains 0, fail to reject H₀ at α = 0.01
No significant difference at 99% confidence level
Interval includes both negative and positive values
Method 1 could be 1.2 points lower or 0.8 points higher than Method 2
No significant difference between teaching methods at 99% confidence
Any difference is likely small and not practically meaningful
At 99% confidence level, there is no significant difference between teaching methods.
Any difference is likely small (between -1.2 and 0.8 points).
• Consistency Check: P-value and CI must use same α level
• CI Interpretation: If 0 is in CI, no significant difference
• Confidence Level: Higher confidence level makes it harder to detect differences
p-value: 0.12
CI: (-0.5, 2.3) for μA - μB
Confidence Level: 95%
p-value = 0.12 > α = 0.05
Fail to reject H₀: No significant difference in defect rates
CI (-0.5, 2.3) contains 0
Consistent with p-value: No significant difference
Interval includes both negative and positive values
Line A could have 0.5% fewer or 2.3% more defects than Line B
Maximum possible difference is 2.3%
This may or may not be practically significant depending on industry standards
p-value = 0.12 is relatively close to 0.05
May need larger sample size to detect smaller differences
No statistically significant difference in defect rates between production lines
Both lines appear equally effective for quality control
There is no statistically significant difference in defect rates between the production lines.
Either line can be used without significant quality concerns.
• Consistency: P-value and CI should agree when using same α level
• Practical vs Statistical: Consider both significance levels
• Power Considerations: P-value near α may indicate need for larger sample
Test Statistic: t = 2.45, df = 48
p-value: 0.018
CI: (0.3, 2.1) for μ₁ - μ₂
p-value = 0.018 < α = 0.05
Reject H₀: There is a significant difference in satisfaction scores
CI (0.3, 2.1) does NOT contain 0
Consistent with p-value: Significant difference exists
Since interval is entirely positive (0.3 to 2.1), μ₁ > μ₂
Store 1 has higher satisfaction scores than Store 2
Point estimate: (0.3 + 2.1)/2 = 1.2 points higher
Store 1 scores 0.3 to 2.1 points higher than Store 2
1.2 point difference may be meaningful depending on scale
Could represent 12% difference if scale is 0-10
95% confidence means we're 95% sure the true difference is between 0.3 and 2.1
There is a statistically significant difference in customer satisfaction.
Store 1 has significantly higher satisfaction scores than Store 2.
• Multiple Evidence: P-value and CI should support same conclusion
• Directionality: Positive interval means first group is larger
• Effect Size: Consider both statistical and practical significance
p-value: 0.001
CI: (-8.2, -1.8) for μ_new - μ_old
Sample Sizes: n₁ = n₂ = 100
p-value = 0.001 < α = 0.05
Highly significant difference: Reject H₀
CI (-8.2, -1.8) does NOT contain 0
Consistent with p-value: Significant difference exists
Since interval is entirely negative (-8.2 to -1.8), μ_new - μ_old < 0
This means μ_new < μ_old: New drug results in lower blood pressure
Point estimate: (-8.2 + -1.8)/2 = -5.0 mmHg difference
New drug reduces BP by 1.8 to 8.2 mmHg compared to old drug
Reduction of 5.0 mmHg is clinically meaningful
Even 1.8 mmHg reduction is considered beneficial
Large sample size (n=100 per group) provides good power
Results are robust and reliable
New drug appears superior for blood pressure reduction
Effect is both statistically and clinically significant
The new drug significantly reduces blood pressure compared to the old drug.
The reduction is both statistically significant (p = 0.001) and clinically meaningful (5.0 mmHg average reduction).
• Clinical vs Statistical: Both types of significance matter in medicine
• Direction Interpretation: Negative difference means new is lower/better
• Sample Size Impact: Larger samples increase reliability of results