Normal Distribution Calculations (Z-Scores)

Master z-scores: standardization, probability, percentiles, and comparisons with 5 detailed exercises.

Exercise Solutions 1-3
1 Z-Score Calculation
Exercise 1
The heights of adult males are normally distributed with mean 70 inches and standard deviation 3 inches. Calculate the z-score for a height of 76 inches. Interpret the result.
Key Definitions:

Z-Score: Number of standard deviations a value is from the mean (z = (x - μ) ÷ σ)

Standardization: Converting raw scores to z-scores to compare different normal distributions

Positive Z-Score: Value is above the mean

Negative Z-Score: Value is below the mean

Z-Score Calculation Method:
  1. Identify the raw score (x), mean (μ), and standard deviation (σ)
  2. Substitute values into the z-score formula: z = (x - μ) ÷ σ
  3. Calculate the result
  4. Interpret the meaning of the z-score
Step 1: Identify the parameters

Raw score (x) = 76 inches, Mean (μ) = 70 inches, Standard deviation (σ) = 3 inches

Step 2: Apply the z-score formula

z = (76 - 70) ÷ 3 = 6 ÷ 3 = 2.0

Step 3: Interpret the result

A z-score of 2.0 means the height of 76 inches is 2 standard deviations above the mean

Z-score = 2.0
76 inches = μ + 2σ
Above average by 2σ
Final Answer:

The z-score for a height of 76 inches is 2.0. This means that 76 inches is exactly 2 standard deviations above the mean height of 70 inches. A z-score of 2.0 is considered quite high, as it falls in the top 2.5% of the distribution according to the empirical rule.

Applied Rules:

• Z-score formula: z = (x - μ) ÷ σ

• Positive z-score: Value is above the mean

• Empirical rule: 2σ corresponds to top 2.5% of distribution

2 Comparing Different Distributions
Exercise 2
Student A scores 85 on a test with mean 80 and standard deviation 5. Student B scores 92 on a test with mean 88 and standard deviation 4. Which student performed better relative to their class?
Key Definitions:

Relative Performance: How well someone performs compared to others in their group

Standardized Comparison: Using z-scores to compare across different scales

Comparative Analysis Method:
  1. Calculate z-score for each student
  2. Compare the z-scores
  3. Higher z-score indicates better relative performance
Step 1: Calculate z-score for Student A

z_A = (85 - 80) ÷ 5 = 5 ÷ 5 = 1.0

Step 2: Calculate z-score for Student B

z_B = (92 - 88) ÷ 4 = 4 ÷ 4 = 1.0

Step 3: Compare and conclude

Both students have the same z-score of 1.0, meaning they performed equally well relative to their respective classes

Student A: z = 1.0
Student B: z = 1.0
Equal relative performance
Final Answer:

Both students performed equally well relative to their classes. Student A scored 1.0 standard deviation above their class mean, and Student B also scored 1.0 standard deviation above their class mean. Although Student B had a higher raw score (92 vs 85), both students performed at the same relative level within their respective groups.

Applied Rules:

• Standardization: Allows fair comparison across different scales

• Relative comparison: Z-scores enable comparison across different distributions

• Equal z-scores: Indicate equal relative performance

3 Finding Raw Scores from Z-Scores
Exercise 3
SAT scores are normally distributed with mean 1000 and standard deviation 200. What SAT score corresponds to a z-score of -1.5? What does this tell us about the performance?
Key Definitions:

Reverse Z-Score Calculation: Converting z-scores back to raw scores using x = μ + zσ

Negative Z-Score: Indicates below-average performance

Reverse Standardization Method:
  1. Identify the z-score, mean (μ), and standard deviation (σ)
  2. Rearrange the z-score formula: x = μ + zσ
  3. Substitute values and calculate the raw score
Step 1: Identify parameters

Z-score (z) = -1.5, Mean (μ) = 1000, Standard deviation (σ) = 200

Step 2: Apply reverse standardization formula

x = μ + zσ = 1000 + (-1.5)(200) = 1000 - 300 = 700

Step 3: Interpret the result

A z-score of -1.5 means the score is 1.5 standard deviations below the mean

Raw score = 700
x = μ + zσ = 700
Below average by 1.5σ
Final Answer:

The SAT score corresponding to a z-score of -1.5 is 700. This score is 1.5 standard deviations below the mean of 1000, indicating below-average performance. According to the empirical rule, approximately 6.7% of test-takers score below this level (since 34% are between mean and -1σ, and 13.5% are between -1σ and -2σ, giving 34% + 13.5% = 47.5% below the mean, and adding the 16% below -1σ gives 50% - 6.7% = 43.3% above this score).

Applied Rules:

• Reverse formula: x = μ + zσ

• Negative z-score: Indicates below-mean performance

• Empirical rule: Helps interpret the percentile

Exercise Solutions 4-5
4 Percentile and Z-Score Relationship
Exercise 4
Cholesterol levels in adults are normally distributed with mean 200 mg/dL and standard deviation 30 mg/dL. What z-score corresponds to the 97.5th percentile? What cholesterol level does this represent?
Key Definitions:

Percentile: Value below which a given percentage of observations fall

97.5th Percentile: Value below which 97.5% of data falls

Empirical Rule Connection: 97.5th percentile ≈ 2 standard deviations above mean

Percentile-to-Z-Score Method:
  1. Identify the percentile and relate to empirical rule
  2. Determine the corresponding z-score
  3. Convert z-score to raw score using x = μ + zσ
Step 1: Identify the percentile

97.5th percentile means 97.5% of values fall below this point

Step 2: Apply empirical rule knowledge

According to the 68-95-99.7 rule, 95% of data falls within 2 standard deviations

This means 2.5% falls above +2σ and 2.5% falls below -2σ

So 97.5% falls below +2σ, making the z-score approximately 2.0

Step 3: Convert to raw score

x = μ + zσ = 200 + (2.0)(30) = 200 + 60 = 260 mg/dL

Z-score ≈ 2.0
Cholesterol level = 260 mg/dL
97.5th percentile
Final Answer:

The z-score corresponding to the 97.5th percentile is approximately 2.0. The cholesterol level at the 97.5th percentile is 260 mg/dL. This means that 97.5% of adults have cholesterol levels below 260 mg/dL, and only 2.5% have levels above this value.

Applied Rules:

• Empirical rule: 95% within 2σ means 2.5% in each tail

• Percentile interpretation: 97.5th percentile = top 2.5%

• Conversion formula: x = μ + zσ

5 Complex Z-Score Problem
Exercise 5
Weights of bags of flour are normally distributed with mean 5 pounds and standard deviation 0.2 pounds. What is the probability that a randomly selected bag weighs between 4.7 and 5.3 pounds? Express your answer using z-scores.
Key Definitions:

Interval Probability: Probability that a value falls within a specific range

Standardization of Intervals: Converting both endpoints to z-scores

Interval Probability Method:
  1. Convert both interval endpoints to z-scores
  2. Identify the range of z-scores
  3. Use empirical rule to find the probability
Step 1: Convert lower endpoint to z-score

z₁ = (4.7 - 5) ÷ 0.2 = -0.3 ÷ 0.2 = -1.5

Step 2: Convert upper endpoint to z-score

z₂ = (5.3 - 5) ÷ 0.2 = 0.3 ÷ 0.2 = 1.5

Step 3: Determine probability

We need P(-1.5 < Z < 1.5)

Using empirical rule: approximately 87% of data falls within 1.5 standard deviations of the mean

Lower z-score = -1.5
Upper z-score = 1.5
Probability ≈ 87%
Final Answer:

The probability that a randomly selected bag weighs between 4.7 and 5.3 pounds is approximately 87%. The z-scores for these weights are -1.5 and 1.5, respectively, meaning we're looking at the probability of being within 1.5 standard deviations of the mean.

Applied Rules:

• Interval standardization: Convert both endpoints to z-scores

• Empirical rule: Interpolate between known values

• Interval probability: P(a < X < b) = P(z₁ < Z < z₂)

Comprehensive Summary: Z-Scores
z = \(\frac{x - \mu}{\sigma}\)
Z-Score Formula
z > 0
Above mean
z = 0
At mean
z < 0
Below mean
|z| > 2
Unusual
Conversion Formulas:

Forward: z = (x - μ) ÷ σ

Reverse: x = μ + zσ

Key Concepts:

Z-Score (Standard Score): A measure of how many standard deviations a data point is from the mean of a distribution. It standardizes values across different normal distributions.

Standardization: The process of converting raw scores to z-scores, allowing comparison between different distributions with different means and standard deviations.

Standard Normal Distribution: A normal distribution with mean μ = 0 and standard deviation σ = 1. All z-scores follow this distribution.

Core Methods and Procedures:
  1. Z-Score Calculation: Use z = (x - μ) ÷ σ to standardize any raw score
  2. Raw Score Conversion: Use x = μ + zσ to convert z-scores back to original units
  3. Comparison: Compare z-scores to determine relative performance
  4. Percentile Estimation: Use empirical rule to estimate percentiles from z-scores
Tip 1: Remember: z-score = (observed value - mean) ÷ standard deviation. The numerator tells you the distance from the mean, the denominator normalizes by the spread.
Tip 2: Positive z-scores indicate above-average performance; negative z-scores indicate below-average performance.
Tip 3: Z-scores greater than 2 or less than -2 are considered unusual in most normal distributions.
Tip 4: The mean of z-scores is always 0, and the standard deviation of z-scores is always 1.
Common errors: Forgetting to subtract the mean before dividing, confusing positive/negative interpretation, mixing up formulas for forward and reverse conversions.
Memorization aids: "Z is for Zero mean" (standardized), "Z tells you how far" (in standard deviations), "X is original, Z is standardized".
Essential Rules:

• Z-score formula: z = (x - μ) ÷ σ

• Reverse formula: x = μ + zσ

• Standard normal: Mean = 0, Standard deviation = 1

• Interpretation: z > 0 (above mean), z = 0 (at mean), z < 0 (below mean)

Detailed Course Content: Z-Scores
Standardized Score = \(\frac{Raw Score - Mean}{Standard Deviation}\)
Z-Score Concept
Z-Score
z = \(\frac{x - \mu}{\sigma}\)
Standardization
Raw Score
x = μ + zσ
Reverse conversion
Empirical Rule
68-95-99.7%
Standard deviations
Detailed Definitions:

Standardization Process: Converting raw scores to z-scores creates a new scale where the mean is 0 and the standard deviation is 1. This allows direct comparison across different distributions.

Relative Standing: Z-scores indicate where a particular value stands relative to the distribution. A z-score of 1.5 means the value is 1.5 standard deviations above the mean.

Outlier Detection: Values with |z| > 2 are often considered potential outliers, and values with |z| > 3 are considered extreme outliers.

Advanced Problem-Solving Techniques:
  1. Pattern Recognition: Identify if the problem requires standardization or reverse conversion
  2. Unit Analysis: Keep track of original units vs. standardized units
  3. Comparison Strategy: When comparing across distributions, always standardize first
  4. Empirical Rule Application: Use 68-95-99.7 rule for probability estimation
  5. Verification: Check if the z-score makes logical sense given the original data
Advanced Tip 1: For probability problems, sketch the normal curve and shade the area of interest to visualize the problem.
Advanced Tip 2: Remember that z-scores can be used with any normal distribution, not just standard normal.
Advanced Tip 3: The sum of z-scores for all data points in a sample is always 0.
Advanced Tip 4: For hypothesis testing, z-scores are used to determine how unusual a sample statistic is.
Real-world applications: IQ tests, standardized exams, quality control, medical measurements, financial analysis.
Statistical inference: Foundation for t-tests, confidence intervals, and regression analysis.

Questions & Answers

Question: Why do we need z-scores? Can't we just compare raw scores directly?

Answer: Great question! Raw scores can be misleading when comparing across different scales or distributions. For example, scoring 80 on a test with a mean of 70 and SD of 5 is much better than scoring 80 on a test with a mean of 70 and SD of 15. The first score is 2 standard deviations above the mean (z = 2.0), while the second is only 0.67 standard deviations above the mean (z = 0.67). Z-scores standardize different scales to a common metric, allowing fair comparisons. They tell us how exceptional a score is relative to its own distribution, not just its numerical value.

Question: What does it mean when a z-score is negative? Is that bad?

Answer: A negative z-score simply means the value is below the mean of the distribution - it's not inherently "bad." The interpretation depends on the context. In test scores, a negative z-score indicates below-average performance. But in something like cholesterol levels or crime rates, a negative z-score would indicate a desirable outcome (below the average, which is good). The magnitude of the z-score (absolute value) indicates how unusual the observation is, regardless of whether it's positive or negative.

Question: How do I know if a z-score is considered "unusual"? What's the threshold?

Answer: The definition of "unusual" can vary by context, but common thresholds include:

  • |z| > 2: Generally considered unusual (falls in top/bottom 2.5%)
  • |z| > 2.5: Often considered significantly unusual
  • |z| > 3: Considered extreme or highly unusual (falls in top/bottom 0.15%)

These thresholds come from the empirical rule. For instance, 95% of data falls within 2 standard deviations, so values beyond that occur only 5% of the time, making them unusual. In formal statistical testing, |z| > 1.96 (approximately 2) is often used as the threshold for statistical significance.