Solved Exercises on Central Limit Theorem Introduction in Grade 12

Master central limit theorem: sampling distributions, normal approximation, sample means, and probability calculations through these 5 detailed exercises.

Solution: Exercises 1 to 3
1 Sample mean distribution
Exercise 1
The population of SAT scores has mean μ = 1050 and standard deviation σ = 200. If we take samples of size n = 25, what is the mean and standard deviation of the sampling distribution of the sample mean?
Definition:

Sampling distribution of the sample mean: The distribution of all possible sample means from samples of size n drawn from a population with mean μ and standard deviation σ

Method:
  1. Identify the population parameters: μ and σ
  2. Identify the sample size: n
  3. Calculate the mean of the sampling distribution: μₓ̄ = μ
  4. Calculate the standard deviation of the sampling distribution: σₓ̄ = σ/√n
Given
μ = 1050, σ = 200, n = 25
Mean
μₓ̄ = 1050
Std Dev
σₓ̄ = 200/√25 = 40
Step 1: Identify population parameters

Population mean μ = 1050, Population standard deviation σ = 200

Step 2: Apply the central limit theorem properties

The mean of the sampling distribution equals the population mean: μₓ̄ = μ = 1050

Step 3: Calculate standard deviation of sampling distribution

The standard deviation of the sampling distribution is: σₓ̄ = σ/√n = 200/√25 = 200/5 = 40

Step 4: Interpret the results

The sampling distribution of the sample mean has mean 1050 and standard deviation 40

μₓ̄ = 1050, σₓ̄ = 40
Final answer:

The sampling distribution of the sample mean has mean μₓ̄ = 1050 and standard deviation σₓ̄ = 40

Applied rules:

• Mean property: μₓ̄ = μ (sampling distribution mean equals population mean)

• Standard deviation property: σₓ̄ = σ/√n (standard error decreases as sample size increases)

• Central limit theorem: As n increases, sampling distribution approaches normality

Key notes:

• The standard deviation of the sampling distribution is called the standard error

• Larger sample sizes lead to smaller standard errors

• The sampling distribution becomes more concentrated around the population mean as n increases

2 Normal approximation
Exercise 2
The heights of adult males in a city are normally distributed with μ = 175 cm and σ = 8 cm. If we take a sample of n = 64 men, what is the probability that the sample mean is greater than 177 cm?
Definition:

Normal approximation: When n ≥ 30, the sampling distribution of the sample mean is approximately normal regardless of the population distribution shape

Given
μ = 175, σ = 8, n = 64, X̄ > 177
Standard Error
σₓ̄ = 8/√64 = 1
Z-score
z = (177-175)/1 = 2
Step 1: Calculate parameters of sampling distribution

μₓ̄ = μ = 175, σₓ̄ = σ/√n = 8/√64 = 8/8 = 1

Step 2: Standardize using z-score formula

z = (X̄ - μₓ̄)/σₓ̄ = (177 - 175)/1 = 2/1 = 2

Step 3: Find P(Z > 2)

P(Z > 2) = 1 - P(Z ≤ 2) = 1 - 0.9772 = 0.0228

Step 4: Interpret the result

There is a 2.28% chance that the sample mean exceeds 177 cm

P(X̄ > 177) = 0.0228 or 2.28%
Final answer:

The probability that the sample mean is greater than 177 cm is 0.0228 or 2.28%

Applied rules:

• Z-score formula: z = (X̄ - μₓ̄)/σₓ̄ for standardizing sample means

• Standard error: σₓ̄ = σ/√n reduces uncertainty with larger samples

• Normal distribution: Use standard normal table for probabilities

Key notes:

• Even though we started with a normal population, the sampling distribution is also normal

• The probability is small because 177 cm is 2 standard errors above the mean

• Z-scores tell us how many standard errors a sample mean is from the population mean

3 Large sample CLT
Exercise 3
A population has mean μ = 50 and standard deviation σ = 15. If we take samples of size n = 100, find the probability that a sample mean falls between 48 and 52.
Definition:

Central Limit Theorem: For large samples (n ≥ 30), the sampling distribution of the sample mean approaches a normal distribution regardless of the population distribution shape

Parameters
μ = 50, σ = 15, n = 100
Std Error
σₓ̄ = 15/√100 = 1.5
Z-scores
z₁ = -1.33, z₂ = 1.33
Step 1: Determine sampling distribution parameters

μₓ̄ = μ = 50, σₓ̄ = σ/√n = 15/√100 = 15/10 = 1.5

Step 2: Calculate z-scores for boundaries

For X̄ = 48: z₁ = (48 - 50)/1.5 = -2/1.5 = -1.33

For X̄ = 52: z₂ = (52 - 50)/1.5 = 2/1.5 = 1.33

Step 3: Find probability using standard normal table

P(48 < X̄ < 52) = P(-1.33 < Z < 1.33) = P(Z < 1.33) - P(Z < -1.33)

= 0.9082 - 0.0918 = 0.8164

Step 4: Interpret the result

There is an 81.64% chance that the sample mean falls between 48 and 52

P(48 < X̄ < 52) = 0.8164 or 81.64%
Final answer:

The probability that the sample mean falls between 48 and 52 is 0.8164 or 81.64%

Applied rules:

• CLT condition: n = 100 ≥ 30, so normal approximation is valid

• Standardization: Convert sample means to z-scores using σₓ̄ = σ/√n

• Probability calculation: P(a < X̄ < b) = P(z₁ < Z < z₂)

Key notes:

• The interval [48, 52] is symmetric around the population mean μ = 50

• With n = 100, the standard error is quite small (1.5), making the sampling distribution tight

• The CLT allows us to use normal distribution even if the original population isn't normal

Central Limit Theorem Rules and Methods
\( \mu_{\bar{X}} = \mu \)
Mean of Sampling Distribution
\( \sigma_{\bar{X}} = \frac{\sigma}{\sqrt{n}} \)
Standard Error
\( Z = \frac{\bar{X} - \mu}{\sigma/\sqrt{n}} \)
Z-Score for Sample Mean
Condition
n ≥ 30
Sample Size Requirement
Shape
Approaches Normal
As n Increases
Accuracy
Better Approximation
With Larger n
Key definitions:

Central Limit Theorem (CLT): For sufficiently large samples, the sampling distribution of the sample mean approaches a normal distribution

Sampling Distribution: Distribution of all possible sample statistics for a given sample size

Standard Error: Standard deviation of the sampling distribution

Complete methodology:
  1. Verify CLT conditions: Check if n ≥ 30 (or population is normal)
  2. Identify parameters: μ, σ, and n
  3. Calculate sampling distribution parameters: μₓ̄ = μ and σₓ̄ = σ/√n
  4. Standardize: Use z-score formula for probabilities
  5. Calculate probability: Use standard normal table
Tip 1: The CLT works even if the original population is not normally distributed.
Tip 2: Larger sample sizes provide better normal approximations.
Tip 3: The standard error decreases as the sample size increases.
Tip 4: Always check that n ≥ 30 before applying the CLT.
Key insight: The CLT is fundamental for statistical inference and hypothesis testing.
Practical application: Used to make probability statements about sample statistics.
CLT Properties:

• Mean of sampling distribution: μₓ̄ = μ

• Standard deviation of sampling distribution: σₓ̄ = σ/√n

• Shape approaches normal as n increases

• Works for any population distribution when n ≥ 30

Solution: Exercises 4 to 5
4 Comparing sample sizes
Exercise 4
A population has mean μ = 100 and standard deviation σ = 20. Compare the standard errors for samples of size n₁ = 25 and n₂ = 100. What does this tell you about precision?
Definition:

Standard Error: σₓ̄ = σ/√n measures the variability of sample means around the population mean

Given
μ = 100, σ = 20
n₁ = 25
σₓ̄₁ = 4
n₂ = 100
σₓ̄₂ = 2
Step 1: Calculate standard error for n₁ = 25

σₓ̄₁ = σ/√n₁ = 20/√25 = 20/5 = 4

Step 2: Calculate standard error for n₂ = 100

σₓ̄₂ = σ/√n₂ = 20/√100 = 20/10 = 2

Step 3: Compare the standard errors

σₓ̄₂ = 2 is half of σₓ̄₁ = 4

Step 4: Interpret the comparison

Increasing sample size from 25 to 100 reduces standard error by 50%, improving precision

σₓ̄₁ = 4, σₓ̄₂ = 2, Precision improves with larger samples
Final answer:

For n₁ = 25: σₓ̄₁ = 4; For n₂ = 100: σₓ̄₂ = 2. Larger samples provide more precise estimates.

Applied rules:

• Standard error formula: σₓ̄ = σ/√n shows inverse relationship with √n

• Precision improvement: Doubling sample size reduces standard error by √2 ≈ 1.41

• Statistical efficiency: Larger samples yield more reliable estimates

Key notes:

• The relationship between sample size and precision follows the square root law

• To halve the standard error, you need to quadruple the sample size

• This demonstrates why larger samples are preferred in statistical studies

5 Real-world application
Exercise 5
The average commute time in a city is 30 minutes with a standard deviation of 10 minutes. If a sample of 50 commuters is taken, what is the probability that the sample mean commute time is less than 28 minutes?
Definition:

Real-world application: Using CLT to make inferences about population parameters from sample statistics

Given
μ = 30, σ = 10, n = 50, X̄ < 28
Std Error
σₓ̄ = 1.41
Z-score
z = -1.41
Step 1: Verify CLT conditions

n = 50 ≥ 30, so normal approximation is valid

Step 2: Calculate sampling distribution parameters

μₓ̄ = μ = 30, σₓ̄ = σ/√n = 10/√50 = 10/7.07 ≈ 1.41

Step 3: Standardize the sample mean

z = (X̄ - μₓ̄)/σₓ̄ = (28 - 30)/1.41 = -2/1.41 ≈ -1.41

Step 4: Find the probability

P(X̄ < 28) = P(Z < -1.41) = 0.0793

Step 5: Interpret the result

There is a 7.93% chance that the sample mean is less than 28 minutes

P(X̄ < 28) = 0.0793 or 7.93%
Final answer:

The probability that the sample mean commute time is less than 28 minutes is 0.0793 or 7.93%

Applied rules:

• CLT applicability: n = 50 is large enough for normal approximation

• Standard error calculation: σₓ̄ = σ/√n accounts for sample size effect

• Probability interpretation: Small probability indicates unusual sample mean

Key notes:

• A sample mean of 28 minutes is about 1.41 standard errors below the population mean

• This relatively low probability suggests such a sample would be somewhat unusual

• The CLT allows us to quantify how unusual this sample mean would be

Central Limit Theorem Laws, Methods, Rules, and Definitions
\( \mu_{\bar{X}} = \mu \)
Mean Property
\( \sigma_{\bar{X}} = \frac{\sigma}{\sqrt{n}} \)
Standard Error Formula
\( Z = \frac{\bar{X} - \mu}{\sigma/\sqrt{n}} \)
Standardization
Key definitions:

Central Limit Theorem (CLT): The sampling distribution of the sample mean approaches a normal distribution as the sample size increases, regardless of the population distribution shape

Sampling Distribution: The probability distribution of a statistic obtained from repeated sampling of a population

Standard Error: The standard deviation of the sampling distribution of a statistic

Sample Mean: The average of observations in a sample, denoted as X̄

Complete methodology:
  1. Verify conditions: Ensure n ≥ 30 (or population is normal) for CLT application
  2. Identify parameters: Determine μ (population mean), σ (population SD), and n (sample size)
  3. Calculate sampling distribution parameters: μₓ̄ = μ and σₓ̄ = σ/√n
  4. Standardize the sample mean: Use z-score formula z = (X̄ - μ)/(σ/√n)
  5. Compute probabilities: Use standard normal table or calculator
Tip 1: The CLT is robust - it works even when the original population is heavily skewed or non-normal.
Tip 2: For highly skewed populations, larger sample sizes (n > 50) may be needed for good approximation.
Tip 3: The CLT applies to sample means, not individual observations.
Tip 4: Always verify that n ≥ 30 before applying the CLT unless the population is known to be normal.
Tip 5: The standard error decreases as √n, so quadrupling the sample size halves the standard error.
Common errors: Forgetting to divide by √n when calculating standard error, misapplying CLT to small samples, confusing population and sample parameters.
Exam preparation: Memorize the CLT properties, practice standardization with sample means, understand the relationship between sample size and precision.
Key insight: The CLT is fundamental to statistical inference, allowing us to make probability statements about sample statistics.
CLT Formulas and Properties:

• Mean of sampling distribution: μₓ̄ = μ (unbiased estimator)

• Standard deviation of sampling distribution: σₓ̄ = σ/√n (standard error)

• Shape approaches normal as n increases (regardless of population shape)

• Rule of thumb: n ≥ 30 ensures adequate normal approximation

• Z-score for sample mean: z = (X̄ - μ)/(σ/√n)

Questions & Answers

Question: I don't understand why the standard deviation of the sampling distribution is σ/√n instead of just σ. Can you explain the intuition behind this formula?

Answer: Great question! The key insight is that sample means are less variable than individual observations. Here's the intuition:

  • Individual observations can vary widely around the population mean
  • Sample means, however, represent averages of multiple observations
  • Averaging tends to cancel out extreme values, making sample means cluster more closely around the population mean

Think of it this way: if you flip a coin once, you might get heads or tails (high variability). But if you flip it 100 times and calculate the proportion of heads, you're much more likely to get close to 0.5 (lower variability).

The √n factor comes from mathematical derivation showing that when you average n independent random variables, the variance gets divided by n, so the standard deviation gets divided by √n.

This is why larger samples provide more precise estimates - the standard error decreases as √n increases.

Question: When exactly do I need to apply the Central Limit Theorem? Do I always use it when dealing with sample means?

Answer: The Central Limit Theorem applies under specific conditions:

  • Large sample size: When n ≥ 30, the sampling distribution of the sample mean is approximately normal regardless of the population distribution
  • Small sample size: If n < 30, you can only assume normality if the population itself is normally distributed

You don't always need to use the CLT. If the population is known to be normal, then the sampling distribution of the sample mean is normal for any sample size. The CLT is specifically needed when the population distribution is unknown or non-normal.

For example, if you're sampling from a normal population with n = 15, you can use normal probability calculations directly. But if you're sampling from an unknown population with n = 15, you cannot rely on normality without additional assumptions.

Always check the sample size condition: n ≥ 30 for the CLT to apply.

Question: I have trouble distinguishing between the population parameters (μ, σ) and the sampling distribution parameters (μₓ̄, σₓ̄). Can you clarify this?

Answer: Here's a clear distinction between these parameters:

  • Population parameters (μ, σ): Describe the entire population
    • μ = population mean (center of the population distribution)
    • σ = population standard deviation (spread of individual values in the population)
  • Sampling distribution parameters (μₓ̄, σₓ̄): Describe the distribution of sample means
    • μₓ̄ = mean of sampling distribution = μ (same as population mean)
    • σₓ̄ = standard deviation of sampling distribution = σ/√n (also called standard error)

Think of it this way: The population has a certain average and spread. When you take samples and calculate their means, those sample means also have an average and spread, but the spread of sample means (σₓ̄) is always smaller than the spread of individual values (σ).

For example, if individual heights vary by σ = 10 cm, then sample means based on n = 25 people would vary by σₓ̄ = 10/√25 = 2 cm.

Question: How does the sample size affect the accuracy of probability calculations using the CLT?

Answer: Sample size affects both the validity and accuracy of CLT applications:

Validity: The CLT requires n ≥ 30 for the normal approximation to be reasonable. Smaller samples may not provide accurate probability calculations.

Accuracy: Larger samples provide better approximations:

  • For n = 30: Moderate approximation quality
  • For n = 50: Better approximation quality
  • For n = 100+: Very good approximation quality

Additionally, larger samples result in smaller standard errors (σₓ̄ = σ/√n), which means sample means cluster more tightly around the population mean. This makes probability statements more precise.

For example, with n = 30, there's more uncertainty in where the sample mean falls compared to n = 100, where the sample mean is much more predictable.

The relationship is: larger n → smaller σₓ̄ → more precise estimates → more accurate probability calculations.

Question: What happens to the sampling distribution when the population distribution is already normal? Does the CLT still apply?

Answer: This is an important special case! When the population is normally distributed:

  • The sampling distribution of the sample mean is exactly normal for any sample size
  • The CLT is not needed as a justification for normality
  • The sampling distribution properties still hold: μₓ̄ = μ and σₓ̄ = σ/√n

So if X ~ N(μ, σ²), then X̄ ~ N(μ, σ²/n) exactly, regardless of the value of n.

The CLT is primarily useful when the population distribution is unknown or non-normal. In those cases, we need a large sample size (n ≥ 30) to guarantee approximate normality of the sampling distribution.

However, even when the population is normal, the CLT results (μₓ̄ = μ and σₓ̄ = σ/√n) still describe the sampling distribution perfectly.

This is why problems sometimes specify that the population is normal - it allows exact probability calculations even for small samples.