Solved Exercises on Introduction to Sampling Distributions

Master sampling distributions: sample mean, sample proportion, and properties through these 5 detailed exercises.

Solution: Exercises 1 to 3
1 Sample Mean Distribution
Exercise 1
A population has mean μ = 50 and standard deviation σ = 10. Samples of size n = 25 are taken. Find the mean and standard deviation of the sampling distribution of the sample mean.
Definition:

Sampling Distribution: The probability distribution of a statistic (such as the sample mean) computed from samples of the same size drawn from the same population.

Sampling distribution properties:
  1. Mean of sampling distribution: μₓ̄ = μ
  2. Standard deviation of sampling distribution: σₓ̄ = σ/√n
  3. This is the standard error of the mean
Population mean
μ = 50
Population std dev
σ = 10
Sample size
n = 25
Std error
σ/√n = 10/5 = 2
Step 1: Identify the parameters

Population mean μ = 50, population standard deviation σ = 10, sample size n = 25.

Step 2: Find mean of sampling distribution

For the sampling distribution of x̄: μₓ̄ = μ = 50. The mean of sample means equals the population mean.

Step 3: Find standard deviation of sampling distribution

Standard deviation of x̄: σₓ̄ = σ/√n = 10/√25 = 10/5 = 2. This is the standard error of the mean.

μₓ̄ = 50, σₓ̄ = 2
Final answer:

The sampling distribution of the sample mean has mean μₓ̄ = 50 and standard deviation σₓ̄ = 2.

Applied rules:

• Sampling distribution mean: μₓ̄ = μ

• Sampling distribution std dev: σₓ̄ = σ/√n

• Standard error: The standard deviation of a sampling distribution

2 Sample Proportion Distribution
Exercise 2
In a population, 30% of individuals have a certain characteristic. Samples of size n = 100 are taken. Find the mean and standard deviation of the sampling distribution of the sample proportion.
Definition:

Sample Proportion: The proportion of successes in a sample. For sampling distribution of p̂: μₚ̂ = p and σₚ̂ = √[p(1-p)/n], where p is the population proportion.

Population prop
p = 0.3
Sample size
n = 100
Mean
μₚ̂ = p = 0.3
Std dev
√[0.3×0.7/100]
Step 1: Identify the parameters

Population proportion p = 0.3, sample size n = 100.

Step 2: Find mean of sampling distribution

For the sampling distribution of p̂: μₚ̂ = p = 0.3.

Step 3: Find standard deviation of sampling distribution

Standard deviation of p̂: σₚ̂ = √[p(1-p)/n] = √[0.3(1-0.3)/100] = √[0.3×0.7/100] = √0.0021 ≈ 0.0458.

μₚ̂ = 0.3, σₚ̂ ≈ 0.0458
Final answer:

The sampling distribution of the sample proportion has mean μₚ̂ = 0.3 and standard deviation σₚ̂ ≈ 0.0458.

Applied rules:

• Sample proportion mean: μₚ̂ = p

• Sample proportion std dev: σₚ̂ = √[p(1-p)/n]

• Standard error of proportion: √[p(1-p)/n]

3 Effect of Sample Size
Exercise 3
For the population in Exercise 1 (μ = 50, σ = 10), compare the standard error of the sample mean for samples of size n = 25 and n = 100.
Definition:

Effect of Sample Size: As sample size increases, the standard error decreases. Specifically, σₓ̄ = σ/√n, so the standard error is inversely proportional to the square root of the sample size.

n=25
σ/√25 = 10/5 = 2
n=100
σ/√100 = 10/10 = 1
Comparison
2 vs 1
Change
Reduction by half
Step 1: Calculate standard error for n = 25

σₓ̄ = σ/√n = 10/√25 = 10/5 = 2.

Step 2: Calculate standard error for n = 100

σₓ̄ = σ/√n = 10/√100 = 10/10 = 1.

Step 3: Compare the results

When sample size quadruples from 25 to 100, the standard error halves from 2 to 1. This demonstrates the inverse relationship with √n.

n=25: σₓ̄=2, n=100: σₓ̄=1
Final answer:

For n = 25, standard error = 2. For n = 100, standard error = 1. Increasing sample size from 25 to 100 reduces the standard error by half.

Applied rules:

• Standard error decreases: As n increases, σₓ̄ = σ/√n decreases

• Quadrupling n: Reduces standard error by factor of 2

• Sample size effect: Larger samples provide more precise estimates

Rules and methods, laws,...
\(\bar{X} \sim N\left(\mu, \frac{\sigma}{\sqrt{n}}\right)\)
Sampling Distribution of Sample Mean
Sample Mean
μₓ̄ = μ, σₓ̄ = σ/√n
Population mean and std error
Sample Proportion
μₚ̂ = p, σₚ̂ = √[p(1-p)/n]
Population proportion and std error
Standard Error
SE = σ/√n
Uncertainty of sample estimate
Central Limit Theorem
X̄ approaches normal for large n
Approximate normality
Key definitions:

Sampling Distribution: The probability distribution of a sample statistic (like sample mean or proportion) across all possible samples of the same size from the same population.

Standard Error: The standard deviation of a sampling distribution. It measures the variability of the sample statistic.

Sample Mean Distribution: The sampling distribution of x̄ has mean μₓ̄ = μ and standard deviation σₓ̄ = σ/√n.

Sample Proportion Distribution: The sampling distribution of p̂ has mean μₚ̂ = p and standard deviation σₚ̂ = √[p(1-p)/n].

Central Limit Theorem: For large sample sizes, the sampling distribution of the sample mean is approximately normal regardless of the population distribution.

Complete methodology:
  1. Identify the parameter: Determine if working with mean or proportion
  2. Identify population parameters: Find μ, σ, or p
  3. Determine sample size: Identify n
  4. Select appropriate formulas: Use mean or proportion formulas
  5. Calculate sampling distribution parameters: Find mean and standard error
  6. Assess normality: Check if CLT applies for probability calculations
Tip 1: The mean of sampling distribution always equals the population parameter (μₓ̄ = μ, μₚ̂ = p).
Tip 2: Standard error decreases as sample size increases (σₓ̄ = σ/√n).
Tip 3: For proportions, ensure np ≥ 5 and n(1-p) ≥ 5 for normal approximation.
Tip 4: The Central Limit Theorem typically applies for n ≥ 30.
Common errors: Confusing population parameters with sampling distribution parameters, forgetting to divide by √n for standard error, misapplying CLT conditions.
Key insight: Sampling distributions describe how sample statistics vary across different samples.
Essential formulas:

• Sample mean: μₓ̄ = μ, σₓ̄ = σ/√n

• Sample proportion: μₚ̂ = p, σₚ̂ = √[p(1-p)/n]

• Standard error of mean: SE = σ/√n

• Standard error of proportion: SE = √[p(1-p)/n]

• Normal approximation: X̄ ~ N(μ, σ/√n) for large n

Solution: Exercises 4 to 5
4 Normal Approximation
Exercise 4
A manufacturing process produces items with 15% defect rate. For samples of size n = 200, can we use normal approximation for the sampling distribution of the sample proportion? If so, find the parameters.
Definition:

Normal Approximation Conditions: For sample proportions, use normal approximation if both np ≥ 5 and n(1-p) ≥ 5. This ensures the distribution is not too skewed.

Given
p=0.15, n=200
np check
200×0.15=30 ≥ 5
n(1-p) check
200×0.85=170 ≥ 5
Parameters
μₚ̂=0.15, σₚ̂=0.0252
Step 1: Check conditions for normal approximation

np = 200 × 0.15 = 30 ≥ 5 ✓ and n(1-p) = 200 × 0.85 = 170 ≥ 5 ✓. Both conditions are satisfied.

Step 2: Find parameters of normal approximation

Mean: μₚ̂ = p = 0.15. Standard deviation: σₚ̂ = √[p(1-p)/n] = √[0.15(0.85)/200] = √0.0006375 ≈ 0.0252.

Step 3: State the normal approximation

Under normal approximation: p̂ ~ N(0.15, 0.0252²).

Yes, normal approx applies: N(0.15, 0.0252²)
Final answer:

Yes, we can use normal approximation. The sampling distribution of p̂ is approximately normal with mean μₚ̂ = 0.15 and standard deviation σₚ̂ ≈ 0.0252.

Applied rules:

• Normal approximation conditions: np ≥ 5 and n(1-p) ≥ 5

• Sampling distribution parameters: μₚ̂ = p, σₚ̂ = √[p(1-p)/n]

• Validity check: Verify conditions before applying normal approximation

5 Comparing Sample Sizes
Exercise 5
A population has mean μ = 100 and standard deviation σ = 15. Compare the sampling distributions of the sample mean for samples of size n₁ = 25 and n₂ = 100. Which sample size provides more precise estimates?
Definition:

Estimation Precision: The precision of an estimator is inversely related to its standard error. Smaller standard error indicates more precise estimates.

n₁=25
σₓ̄ = 15/√25 = 3
n₂=100
σₓ̄ = 15/√100 = 1.5
Comparison
3 vs 1.5
Conclusion
n₂=100 is better
Step 1: Calculate standard error for n₁ = 25

σₓ̄ = σ/√n₁ = 15/√25 = 15/5 = 3.

Step 2: Calculate standard error for n₂ = 100

σₓ̄ = σ/√n₂ = 15/√100 = 15/10 = 1.5.

Step 3: Compare precision

The standard error for n₂ = 100 (σₓ̄ = 1.5) is smaller than for n₁ = 25 (σₓ̄ = 3). A smaller standard error indicates more precise estimates.

Step 4: Quantify improvement

The standard error decreased by 50% (from 3 to 1.5) when sample size increased from 25 to 100 (quadrupled).

n=100: σₓ̄=1.5, More precise
Final answer:

For n₁ = 25: σₓ̄ = 3. For n₂ = 100: σₓ̄ = 1.5. The sample size of n = 100 provides more precise estimates since it has a smaller standard error.

Applied rules:

• Standard error comparison: Smaller SE indicates more precise estimates

• Sample size effect: Quadrupling n halves the standard error

• Trade-off: Larger samples are more precise but costlier to obtain

Comprehensive Summary: Introduction to Sampling Distributions
\(\bar{X} \sim N\left(\mu, \frac{\sigma}{\sqrt{n}}\right) \quad \text{and} \quad \hat{p} \sim N\left(p, \sqrt{\frac{p(1-p)}{n}}\right)\)
Sampling Distribution Formulas
Key definitions:

Sampling Distribution: The probability distribution of a sample statistic (like sample mean or proportion) across all possible samples of the same size from the same population.

Sample Mean Distribution: The distribution of all possible sample means from samples of size n. Has mean μₓ̄ = μ and standard deviation σₓ̄ = σ/√n.

Sample Proportion Distribution: The distribution of all possible sample proportions from samples of size n. Has mean μₚ̂ = p and standard deviation σₚ̂ = √[p(1-p)/n].

Standard Error: The standard deviation of a sampling distribution. Measures the variability of the sample statistic.

Central Limit Theorem: For large sample sizes, the sampling distribution of the sample mean approaches a normal distribution regardless of the population distribution.

Standard Error: The standard deviation of a sampling distribution, representing the precision of the sample statistic.

Complete methodology:
  1. Identify the statistic: Determine if working with sample mean or proportion
  2. Identify population parameters: Find μ, σ, or p
  3. Determine sample size: Identify n
  4. Select appropriate formulas: Use mean or proportion formulas
  5. Calculate sampling distribution parameters: Find mean and standard error
  6. Assess normality: Check if CLT applies for probability calculations
  7. Interpret results: Understand the implications for estimation
Tip 1: The mean of the sampling distribution always equals the population parameter.
Tip 2: Standard error decreases as sample size increases (σₓ̄ = σ/√n).
Tip 3: For proportions, ensure np ≥ 5 and n(1-p) ≥ 5 for normal approximation.
Tip 4: The Central Limit Theorem typically applies for n ≥ 30.
Tip 5: Larger samples provide more precise estimates but at higher cost.
Common errors: Confusing population parameters with sampling distribution parameters, forgetting to divide by √n for standard error, misapplying CLT conditions, mixing up standard deviation with standard error.
Memorization aid: "Sampling distribution mean = Population parameter, SE = SD/√n".
Advanced insight: Sampling distributions form the foundation for statistical inference and hypothesis testing.
Essential formulas and properties:

• Sample mean: μₓ̄ = μ, σₓ̄ = σ/√n

• Sample proportion: μₚ̂ = p, σₚ̂ = √[p(1-p)/n]

• Standard error of mean: SE = σ/√n

• Standard error of proportion: SE = √[p(1-p)/n]

• CLT applies for: n ≥ 30 (sample mean), np ≥ 5 and n(1-p) ≥ 5 (proportion)

• Normal approximation: X̄ ~ N(μ, σ/√n) and p̂ ~ N(p, √[p(1-p)/n]) for large n

Example progression (Simple to Complex):

• Simple: Calculating sampling distribution parameters

• Intermediate: Assessing normal approximation conditions

• Advanced: Comparing precision of different sample sizes

• Complex: Statistical inference applications

Key takeaways for memorization:

• Sampling distributions describe variability of sample statistics

• Mean of sampling distribution equals population parameter

• Standard error measures precision of estimates

• Larger samples = smaller standard error = more precise estimates

• CLT enables normal-based inference for large samples

Questions & Answers

Question: What's the difference between population standard deviation and standard error?

Answer: These are different concepts:

  • Population standard deviation (σ): Measures variability of individual observations in the population
  • Standard error (SE): Measures variability of a sample statistic (like x̄) across different samples

For sample mean: SE = σ/√n. The standard error is always smaller than the population standard deviation (for n > 1) because sample means are less variable than individual observations.

Question: Why does increasing sample size make estimates more precise?

Answer: Larger samples provide more information about the population:

  • More observations tend to "average out" extreme values
  • Sample mean becomes closer to population mean
  • Standard error decreases as σ/√n

Think of it like taking multiple measurements - the average of many measurements is more reliable than a single measurement.

Question: When can I use the normal approximation for sampling distributions?

Answer: For different statistics, different conditions apply:

  • Sample mean: Normal approximation applies for n ≥ 30 (Central Limit Theorem)
  • Sample proportion: Normal approximation applies if both np ≥ 5 and n(1-p) ≥ 5
  • Population distribution: If population is normal, sampling distribution is normal for any n

These conditions ensure the sampling distribution is not too skewed to be approximated by a normal distribution.