Solved Exercises on Differential Approximations and Error Estimation

Master differential approximations: error propagation, sensitivity analysis, and uncertainty quantification through these 5 detailed exercises.

Differential Approximation Fundamentals & Exercises 1-3
\(dy = f'(x)dx\)
Differential Approximation Formula
Definition:

Differential Approximation: Using \(dy = f'(x)dx\) to estimate the change in function value due to a small change in input.

Differential Approximation Steps:
  1. Identify: The function \(f(x)\) and base point \(x\)
  2. Calculate: The derivative \(f'(x)\)
  3. Determine: The change in input \(dx = \Delta x\)
  4. Apply: The formula \(dy = f'(x)dx\) to estimate \(\Delta y\)
Tip 1: Differential approximation is most accurate for small changes in input.
Tip 2: The relative error can be estimated as \(\frac{|dy - \Delta y|}{|\Delta y|}\).
1 Area of Circle Error
Exercise 1
If the radius of a circle is measured as 10 cm with a possible error of 0.1 cm, estimate the maximum error in the calculated area.
Problem Setup:

Area function: \(A(r) = \pi r^2\)

Base radius: \(r = 10\) cm

Measurement error: \(dr = 0.1\) cm

Error Propagation Process:

Formula: \(dA = A'(r)dr\)

Function
\(A(r) = \pi r^2\)
Derivative
\(A'(r) = 2\pi r\)
Differential
\(dA = 2\pi r \cdot dr\)
Step 1: Set up the area function

\(A(r) = \pi r^2\)

Step 2: Find the derivative

\(A'(r) = 2\pi r\)

Step 3: Apply the differential formula

\(dA = A'(r)dr = 2\pi r \cdot dr\)

Step 4: Substitute known values

\(dA = 2\pi (10)(0.1) = 2\pi = 6.28\) cm²

Step 5: Calculate relative error

Original area: \(A = \pi (10)^2 = 100\pi \approx 314.16\) cm²

Relative error: \(\frac{6.28}{314.16} \approx 0.02 = 2\%\)

Maximum error ≈ 6.28 cm² (2% relative error)
Results:

Maximum error in area: 6.28 cm²

Relative error: 2%

The area is sensitive to radius measurement errors!

Applied Rules:

• Power Rule: \(\frac{d}{dr}[r^n] = nr^{n-1}\)

• Error Propagation: \(dA = A'(r)dr\)

• Sensitivity: Area is twice as sensitive as radius

2 Volume of Sphere Error
Exercise 2
A sphere has a measured radius of 5 cm with possible error of 0.05 cm. Estimate the maximum error in volume calculation and the relative error.
Problem Setup:

Volume function: \(V(r) = \frac{4}{3}\pi r^3\)

Base radius: \(r = 5\) cm

Measurement error: \(dr = 0.05\) cm

Function
\(V(r) = \frac{4}{3}\pi r^3\)
Derivative
\(V'(r) = 4\pi r^2\)
Differential
\(dV = 4\pi r^2 \cdot dr\)
Step 1: Set up the volume function

\(V(r) = \frac{4}{3}\pi r^3\)

Step 2: Find the derivative

\(V'(r) = 4\pi r^2\)

Step 3: Apply the differential formula

\(dV = V'(r)dr = 4\pi r^2 \cdot dr\)

Step 4: Substitute known values

\(dV = 4\pi (5)^2(0.05) = 4\pi (25)(0.05) = 5\pi \approx 15.71\) cm³

Step 5: Calculate relative error

Original volume: \(V = \frac{4}{3}\pi (5)^3 = \frac{500\pi}{3} \approx 523.60\) cm³

Relative error: \(\frac{15.71}{523.60} \approx 0.03 = 3\%\)

Maximum error ≈ 15.71 cm³ (3% relative error)
Results:

Maximum error in volume: 15.71 cm³

Relative error: 3%

Volume is even more sensitive to radius errors than area!

Applied Rules:

• Power Rule: \(\frac{d}{dr}[r^3] = 3r^2\)

• Constant Multiple: \(\frac{d}{dr}[cf(r)] = c \cdot f'(r)\)

• Higher Sensitivity: Cubic functions are more sensitive than quadratic

3 Compound Interest Error
Exercise 3
If the interest rate is 5% per year compounded annually with possible error of 0.1%, estimate the error in the amount after 10 years for a principal of $1000.
Problem Setup:

Compound interest function: \(A(r) = P(1+r)^t\)

Parameters: \(P = 1000\), \(t = 10\), \(r = 0.05\)

Rate error: \(dr = 0.001\)

Function
\(A(r) = 1000(1+r)^{10}\)
Derivative
\(A'(r) = 10000(1+r)^9\)
Differential
\(dA = 10000(1+r)^9 \cdot dr\)
Step 1: Set up the compound interest function

\(A(r) = 1000(1+r)^{10}\)

Step 2: Find the derivative

\(A'(r) = 1000 \cdot 10(1+r)^9 = 10000(1+r)^9\)

Step 3: Apply the differential formula

\(dA = A'(r)dr = 10000(1+r)^9 \cdot dr\)

Step 4: Substitute known values

\(dA = 10000(1.05)^9(0.001) = 10(1.05)^9\)

\(dA = 10 \times 1.5513 \approx 15.51\) dollars

Step 5: Calculate relative error

Original amount: \(A = 1000(1.05)^{10} \approx 1628.89\) dollars

Relative error: \(\frac{15.51}{1628.89} \approx 0.0095 = 0.95\%\)

Maximum error ≈ $15.51 (0.95% relative error)
Results:

Maximum error in final amount: $15.51

Relative error: 0.95%

Even small interest rate errors can affect long-term investments!

Applied Rules:

• Chain Rule: \(\frac{d}{dr}[(1+r)^t] = t(1+r)^{t-1}\)

• Exponential Growth: Small errors compound over time

• Financial Sensitivity: Long-term investments are sensitive to rate changes

Differential Approximation: Theory & Properties
\(dy = f'(x)dx\)
Differential Approximation Formula
Key Definitions:

Differential: \(dx\) and \(dy\) represent infinitesimal changes in \(x\) and \(y\)

Increment: \(\Delta x\) and \(\Delta y\) represent finite changes in \(x\) and \(y\)

Error Estimation: Quantifying uncertainty in computed quantities

Error Analysis Methods:

Absolute error: \(|dy|\) estimates \(|\Delta y|\)

Relative error: \(\frac{|dy|}{|f(x)|}\) indicates percentage uncertainty

Differential
\(dy = f'(x)dx\)
Linear approximation
Relative Error
\(\frac{dy}{y} = \frac{f'(x)}{f(x)}dx\)
Percentage uncertainty
Error Bound
\(E = \frac{M}{2}(dx)^2\)
Quadratic error term
Advantages: Simple calculation, provides error bounds, useful for sensitivity analysis.
Limitations: Only accurate for small changes, assumes smooth behavior.
Tip 1: Always verify that the change dx is small relative to the base value x.
Tip 2: For multiplicative functions, use logarithmic differentiation for relative errors.
Tip 3: The larger the derivative magnitude, the more sensitive the function is to input changes.
Tip 4: Relative error is often more meaningful than absolute error.
Conditions for Accuracy:

• Continuity: \(f\) and \(f'\) must be continuous near the base point

• Small change: \(|dx|\) should be much smaller than \(|x|\)

• Smooth behavior: Function should not have rapid oscillations

• First-order approximation: Higher-order terms should be negligible

Advanced Error Estimation: Exercises 4-5
4 Product Error Analysis
Exercise 4
Two sides of a rectangle are measured as 10 cm and 15 cm with possible errors of 0.1 cm each. Estimate the maximum error in the area calculation.
Problem Setup:

Area function: \(A(l,w) = lw\)

Dimensions: \(l = 10\) cm, \(w = 15\) cm

Errors: \(dl = 0.1\) cm, \(dw = 0.1\) cm

Function
\(A(l,w) = lw\)
Partial Derivatives
\(\frac{\partial A}{\partial l} = w, \frac{\partial A}{\partial w} = l\)
Total Differential
\(dA = w \cdot dl + l \cdot dw\)
Step 1: Set up the area function

\(A(l,w) = lw\)

Step 2: Find partial derivatives

\(\frac{\partial A}{\partial l} = w = 15\)

\(\frac{\partial A}{\partial w} = l = 10\)

Step 3: Apply the total differential formula

\(dA = \frac{\partial A}{\partial l}dl + \frac{\partial A}{\partial w}dw = w \cdot dl + l \cdot dw\)

Step 4: Substitute known values

\(dA = 15(0.1) + 10(0.1) = 1.5 + 1.0 = 2.5\) cm²

Step 5: Calculate relative error

Original area: \(A = 10 \times 15 = 150\) cm²

Relative error: \(\frac{2.5}{150} \approx 0.0167 = 1.67\%\)

Maximum error ≈ 2.5 cm² (1.67% relative error)
Results:

Maximum error in area: 2.5 cm²

Relative error: 1.67%

Both dimension errors contribute to the total area error!

Applied Rules:

• Partial Derivatives: \(\frac{\partial}{\partial l}[lw] = w\), \(\frac{\partial}{\partial w}[lw] = l\)

• Total Differential: Sum of individual contributions

• Error Addition: Independent errors add linearly

5 Complex Error Propagation
Exercise 5
The period of a pendulum is given by \(T = 2\pi\sqrt{\frac{L}{g}}\). If \(L = 1\) m with error 0.01 m and \(g = 9.8\) m/s² with error 0.1 m/s², estimate the maximum error in T.
Problem Setup:

Period function: \(T(L,g) = 2\pi\sqrt{\frac{L}{g}}\)

Parameters: \(L = 1\) m, \(g = 9.8\) m/s²

Errors: \(dL = 0.01\) m, \(dg = 0.1\) m/s²

Function
\(T(L,g) = 2\pi\sqrt{\frac{L}{g}}\)
Partial Derivatives
\(\frac{\partial T}{\partial L} = \frac{\pi}{\sqrt{Lg}}, \frac{\partial T}{\partial g} = -\frac{\pi\sqrt{L}}{g^{3/2}}\)
Total Differential
\(dT = \frac{\pi}{\sqrt{Lg}}dL - \frac{\pi\sqrt{L}}{g^{3/2}}dg\)
Step 1: Set up the period function

\(T(L,g) = 2\pi\sqrt{\frac{L}{g}}\)

Step 2: Find partial derivatives

\(\frac{\partial T}{\partial L} = 2\pi \cdot \frac{1}{2\sqrt{\frac{L}{g}}} \cdot \frac{1}{g} = \frac{\pi}{\sqrt{Lg}}\)

\(\frac{\partial T}{\partial g} = 2\pi \cdot \frac{1}{2\sqrt{\frac{L}{g}}} \cdot \left(-\frac{L}{g^2}\right) = -\frac{\pi\sqrt{L}}{g^{3/2}}\)

Step 3: Apply the total differential formula

\(dT = \frac{\partial T}{\partial L}dL + \frac{\partial T}{\partial g}dg\)

Step 4: Calculate each term

\(\frac{\partial T}{\partial L} = \frac{\pi}{\sqrt{1 \cdot 9.8}} = \frac{\pi}{\sqrt{9.8}} \approx \frac{3.1416}{3.1305} \approx 1.003\)

\(\frac{\partial T}{\partial g} = -\frac{\pi\sqrt{1}}{9.8^{3/2}} = -\frac{\pi}{9.8\sqrt{9.8}} \approx -\frac{3.1416}{30.68} \approx -0.102\)

Step 5: Calculate total error

\(dT = 1.003(0.01) + (-0.102)(0.1) = 0.01003 - 0.0102 = -0.00017\)

Maximum error: \(|dT| = 0.00017\) seconds

Maximum error ≈ 0.00017 seconds
Analysis:

Maximum error in period: 0.00017 seconds

The gravitational acceleration error nearly cancels the length error!

This demonstrates how different parameter errors can interact.

Error Analysis:

• Chain Rule: For composite functions, use partial derivatives

• Error Cancellation: Opposite-signed errors can partially cancel

• Dimensional Analysis: Check units of each error contribution

Differential Approximation: Comprehensive Guide
\(dy = f'(x)dx\)
Differential Approximation Formula
Key definitions:

Differential Approximation: The process of estimating the change in a function's output due to small changes in its inputs using the derivative.

Total Differential: For functions of multiple variables, the sum of all partial derivatives times their respective input changes.

Error Propagation: The process of determining how uncertainties in input variables affect the uncertainty in the output.

Complete methodology:
  1. Identify the function: Determine \(f(x)\) or \(f(x_1, x_2, ..., x_n)\) and all relevant variables
  2. Calculate derivatives: Find \(f'(x)\) or all partial derivatives \(\frac{\partial f}{\partial x_i}\)
  3. Determine input errors: Identify all possible errors \(dx_i\) in the input variables
  4. Apply differential formula: Use \(df = \sum \frac{\partial f}{\partial x_i}dx_i\) for multiple variables
  5. Analyze results: Calculate absolute and relative errors, interpret significance
Tip 1: For products of variables, consider using logarithmic differentiation to find relative errors.
Tip 2: Always check that your error estimates are reasonable compared to the actual values.
Tip 3: When variables have different units, focus on relative errors rather than absolute errors.
Tip 4: The sensitivity of a function to input changes is proportional to the magnitude of its derivative.

Common errors: Using incorrect derivative formulas, not accounting for all variables, confusing absolute and relative errors.
Exam preparation: Practice derivative calculations, memorize common differential formulas, understand error cancellation effects.
Important formulas:

• Single variable: \(dy = f'(x)dx\)

• Multiple variables: \(df = \sum_{i=1}^{n} \frac{\partial f}{\partial x_i}dx_i\)

• Relative error: \(\frac{df}{f} = \frac{f'(x)}{f(x)}dx\)

• Error bound: \(E = \frac{M}{2}(dx)^2\) where \(M = \max|f''(t)|\)

Visualization: Error Propagation in Physical Systems
Exercise 6: Sensitivity Analysis
Compare how different functions respond to the same input error:
  • Linear: \(f(x) = x\) (error amplification factor = 1)
  • Quadratic: \(f(x) = x^2\) (error amplification factor = 2x)
  • Exponential: \(f(x) = e^x\) (error amplification factor = e^x)

Sensitivity analysis: Different functions have different sensitivities to input errors.

  • Linear functions have constant sensitivity
  • Quadratic functions become more sensitive as x increases
  • Exponential functions become extremely sensitive quickly

Questions & Answers

Question: Why do we use differentials instead of calculating exact changes? What's the advantage of the approximation?

Answer: There are several compelling reasons to use differential approximations:

1. Simplicity: Computing exact changes \(\Delta y = f(x + \Delta x) - f(x)\) often involves complex calculations, especially for complicated functions.

2. Sensitivity Analysis: The differential \(dy = f'(x)dx\) tells us how sensitive the output is to changes in input - the derivative \(f'(x)\) is the sensitivity factor.

3. Error Propagation: For functions of multiple variables, differential approximations make it straightforward to combine errors from various sources.

4. Real-world Applications: In engineering and science, measurements have inherent uncertainties, and differentials provide a systematic way to quantify how these uncertainties affect results.

The approximation is extremely accurate for small changes, making it ideal for practical applications where precision is important but exact calculations would be unnecessarily complex.

Question: How do I know if my error estimate is reasonable? When might differential approximation fail?

Answer: Here are key ways to assess reasonableness and potential failures:

Reasonableness checks:

  • Compare the error magnitude to the actual function value - relative error should be small
  • Verify that the input change is indeed small compared to the base value
  • Consider the physical context - does the error magnitude make sense?

When differential approximation fails:

  • Input changes are not small (large \(dx\))
  • The function has discontinuities or sharp corners near the point
  • The second derivative is very large (high curvature)
  • The function oscillates rapidly
  • The derivative doesn't exist at the point of interest

Always verify that the conditions for linear approximation are met: continuity, differentiability, and small input changes.

Question: What's the difference between absolute error and relative error, and when should I use each?

Answer: These are two different ways to express uncertainty:

Absolute Error: \(|dy|\) or \(|\Delta y|\) - the actual magnitude of the error in the same units as the quantity being measured.

Relative Error: \(\frac{|dy|}{|f(x)|}\) - the error expressed as a fraction of the actual value, often converted to percentage.

When to use each:

  • Absolute error: When comparing errors in quantities with the same units, or when the actual magnitude matters
  • Relative error: When comparing the quality of measurements across different scales, or when the proportional accuracy is important

For example, an error of 1 cm in measuring a 100 cm object (1% relative error) is much better than an error of 1 cm in measuring a 2 cm object (50% relative error), even though the absolute errors are the same.

Question: How does error propagate when I have a function that depends on multiple variables?

Answer: For a function of multiple variables \(f(x_1, x_2, ..., x_n)\), the total differential accounts for errors in all variables:

\(df = \frac{\partial f}{\partial x_1}dx_1 + \frac{\partial f}{\partial x_2}dx_2 + ... + \frac{\partial f}{\partial x_n}dx_n\)

Each term \(\frac{\partial f}{\partial x_i}dx_i\) represents the contribution to the total error from uncertainty in variable \(x_i\).

Key principles:

  • Independent errors add linearly in the differential
  • Variables with larger partial derivatives contribute more to the total error
  • Errors can potentially cancel if they have opposite signs
  • The sensitivity to each variable is given by the corresponding partial derivative

This framework allows you to identify which measurements need the most precision to minimize overall error.

Question: Are there higher-order approximations beyond the first-order differential? When would I use them?

Answer: Yes! The full Taylor series expansion includes higher-order terms:

\(\Delta f \approx df + \frac{1}{2}d^2f + \frac{1}{6}d^3f + ...\)

Where \(d^2f = f''(x)(dx)^2\) is the second-order term.

When to use higher-order approximations:

  • When first-order approximation is insufficiently accurate
  • When the first derivative is zero at the point of interest
  • For functions with high curvature (large second derivatives)
  • In scientific applications requiring very high precision
  • When analyzing the quality of first-order approximations

However, first-order differential approximation remains the workhorse because it's simple, usually sufficient, and captures the dominant behavior for small changes. Higher-order terms are typically used for refinement or error analysis.