Solved Exercises on Geometric Interpretation of Eigenvalues/Eigenvectors

Master geometric interpretation of eigenvalues and eigenvectors: visualizing transformations, scaling, and directional invariance through these 5 detailed exercises.

Solution: Exercises 1 to 3
1 Scaling Transformation
Exercise 1
Consider the scaling matrix S = \(\begin{bmatrix} 3 & 0 \\ 0 & 2 \end{bmatrix}\). Find its eigenvalues and eigenvectors and interpret geometrically.
Definition:

Scaling transformation: Stretches or compresses space along coordinate axes

Method:
  1. Find characteristic equation: det(S - λI) = 0
  2. Solve for eigenvalues
  3. Find eigenvectors for each eigenvalue
  4. Interpret geometrically
Eigenvalues
λ₁ = 3, λ₂ = 2
Eigenvectors
v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\)
Step 1: Find characteristic equation

S - λI = \(\begin{bmatrix} 3-λ & 0 \\ 0 & 2-λ \end{bmatrix}\)

det(S - λI) = (3-λ)(2-λ) = 0

So: λ₁ = 3, λ₂ = 2

Step 2: Find eigenvector for λ₁ = 3

(S - 3I)v = 0

\(\begin{bmatrix} 0 & 0 \\ 0 & -1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: y = 0, x can be any value

So v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) (x-axis direction)

Step 3: Find eigenvector for λ₂ = 2

(S - 2I)v = 0

\(\begin{bmatrix} 1 & 0 \\ 0 & 0 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: x = 0, y can be any value

So v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\) (y-axis direction)

Step 4: Geometric interpretation

For λ₁ = 3: Vectors along x-axis are stretched by factor 3

For λ₂ = 2: Vectors along y-axis are stretched by factor 2

All other directions are changed by the transformation

Step 5: Verify with example

For v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\): Sv₁ = \(\begin{bmatrix} 3 & 0 \\ 0 & 2 \end{bmatrix} \begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} 3 \\ 0 \end{bmatrix} = 3\begin{bmatrix} 1 \\ 0 \end{bmatrix} = λ₁v₁\) ✓

Eigenvalues: λ₁ = 3, λ₂ = 2
Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\)
Final answer:

For scaling matrix S, the coordinate axes are eigenvectors with scaling factors as eigenvalues

Applied rules:

• Diagonal matrix property: Eigenvalues are diagonal entries

• Standard basis: Eigenvectors are standard basis vectors

• Scaling interpretation: Eigenvalues represent scaling factors

2 Rotation Transformation
Exercise 2
Consider the 90° rotation matrix R = \(\begin{bmatrix} 0 & -1 \\ 1 & 0 \end{bmatrix}\). Find its eigenvalues and eigenvectors and interpret geometrically.
Definition:

Rotation transformation: Preserves length but changes direction, typically has complex eigenvalues

Eigenvalues
λ₁ = i, λ₂ = -i
Eigenvectors
Complex eigenvectors
Step 1: Find characteristic equation

R - λI = \(\begin{bmatrix} -λ & -1 \\ 1 & -λ \end{bmatrix}\)

det(R - λI) = λ² + 1 = 0

So: λ² = -1, which gives λ₁ = i, λ₂ = -i

Step 2: Find eigenvector for λ₁ = i

(R - iI)v = 0

\(\begin{bmatrix} -i & -1 \\ 1 & -i \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: -ix - y = 0, so y = -ix

Choose x = 1: v₁ = \(\begin{bmatrix} 1 \\ -i \end{bmatrix}\)

Step 3: Find eigenvector for λ₂ = -i

(R + iI)v = 0

\(\begin{bmatrix} i & -1 \\ 1 & i \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: ix - y = 0, so y = ix

Choose x = 1: v₂ = \(\begin{bmatrix} 1 \\ i \end{bmatrix}\)

Step 4: Geometric interpretation

Since eigenvalues are complex, no real vector maintains its direction

Rotation by 90° changes direction of every real vector

Complex eigenvalues indicate pure rotation without stretching

Step 5: Verify with example

For v = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\): Rv = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\)

The result is perpendicular to the original vector, confirming no direction is preserved

Step 6: Physical significance

For real matrices with complex eigenvalues, there are no real eigenvectors

This corresponds to the fact that rotations in 2D don't preserve any real direction

Eigenvalues: λ₁ = i, λ₂ = -i
Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ -i \end{bmatrix}\), v₂ = \(\begin{bmatrix} 1 \\ i \end{bmatrix}\)
Final answer:

Rotation matrix has complex eigenvalues, indicating no preserved real directions

Applied rules:

• Complex eigenvalues: Indicate rotation without direction preservation

• Real matrices: Complex eigenvalues come in conjugate pairs

• Rotation property: Preserves length but changes all directions

3 Shear Transformation
Exercise 3
Consider the horizontal shear matrix H = \(\begin{bmatrix} 1 & 2 \\ 0 & 1 \end{bmatrix}\). Find its eigenvalues and eigenvectors and interpret geometrically.
Definition:

Shear transformation: Shifts one coordinate proportionally to another, preserves area

Eigenvalues
λ₁ = 1 (multiplicity 2)
Eigenvectors
Only one independent eigenvector
Step 1: Find characteristic equation

H - λI = \(\begin{bmatrix} 1-λ & 2 \\ 0 & 1-λ \end{bmatrix}\)

det(H - λI) = (1-λ)² = 0

So: λ₁ = λ₂ = 1 (algebraic multiplicity 2)

Step 2: Find eigenvectors

(H - I)v = 0

\(\begin{bmatrix} 0 & 2 \\ 0 & 0 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: 2y = 0, so y = 0

x can be any value, so all eigenvectors are of the form \(\begin{bmatrix} x \\ 0 \end{bmatrix}\)

Only one linearly independent eigenvector: v = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\)

Step 3: Geometric interpretation

Only the x-axis (horizontal direction) is preserved

Every point (x,y) gets mapped to (x+2y, y)

The x-axis is stretched by factor 1 (unchanged)

Other directions are changed by the shearing effect

Step 4: Verify with example

For v = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\): Hv = \(\begin{bmatrix} 1 & 2 \\ 0 & 1 \end{bmatrix} \begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} 1 \\ 0 \end{bmatrix} = 1\begin{bmatrix} 1 \\ 0 \end{bmatrix} = λv\) ✓

Step 5: Analyze geometric effect

Points move horizontally based on their y-coordinate

Points with larger y-values shift more to the right

Area is preserved (det(H) = 1), but shapes are distorted

Eigenvalue: λ = 1 (multiplicity 2)
Eigenvector: v = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) (only one independent)
Final answer:

Shear transformation has only one direction preserved (x-axis) with eigenvalue 1

Applied rules:

• Defective matrix: Geometric multiplicity < algebraic multiplicity

• Shear property: Preserves area but distorts shapes

• Single eigenvector: Only one direction preserved

Geometric Interpretation of Eigenvalues/Eigenvectors
A\vec{v} = \lambda\vec{v}
Eigenvalue Equation
Interpretation
\lambda > 1
Stretching
Interpretation
0 < \lambda < 1
Compression
Interpretation
\lambda < 0
Reversal
Direction invariance: Eigenvectors represent directions that remain unchanged
Scaling factor: Eigenvalues represent the amount of stretching/compression
Principal directions: Eigenvectors are the "principal axes" of transformation
Solution: Exercises 4 to 5
4 Reflection Transformation
Exercise 4
Consider the reflection across x-axis matrix F = \(\begin{bmatrix} 1 & 0 \\ 0 & -1 \end{bmatrix}\). Find its eigenvalues and eigenvectors and interpret geometrically.
Definition:

Reflection transformation: Flips space across a line or plane, has eigenvalues ±1

Eigenvalues
λ₁ = 1, λ₂ = -1
Eigenvectors
v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\)
Step 1: Find characteristic equation

F - λI = \(\begin{bmatrix} 1-λ & 0 \\ 0 & -1-λ \end{bmatrix}\)

det(F - λI) = (1-λ)(-1-λ) = 0

So: λ₁ = 1, λ₂ = -1

Step 2: Find eigenvector for λ₁ = 1

(F - I)v = 0

\(\begin{bmatrix} 0 & 0 \\ 0 & -2 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: y = 0, x can be any value

So v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) (x-axis direction)

Step 3: Find eigenvector for λ₂ = -1

(F + I)v = 0

\(\begin{bmatrix} 2 & 0 \\ 0 & 0 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: x = 0, y can be any value

So v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\) (y-axis direction)

Step 4: Geometric interpretation

For λ₁ = 1: Vectors along x-axis remain unchanged (reflected to themselves)

For λ₂ = -1: Vectors along y-axis are reversed (reflected to opposite direction)

The x-axis is the line of reflection (fixed points)

The y-axis is perpendicular to the line of reflection

Step 5: Verify with example

For v₁ = \(\begin{bmatrix} 2 \\ 0 \end{bmatrix}\): Fv₁ = \(\begin{bmatrix} 1 & 0 \\ 0 & -1 \end{bmatrix} \begin{bmatrix} 2 \\ 0 \end{bmatrix} = \begin{bmatrix} 2 \\ 0 \end{bmatrix} = 1\begin{bmatrix} 2 \\ 0 \end{bmatrix}\) ✓

For v₂ = \(\begin{bmatrix} 0 \\ 3 \end{bmatrix}\): Fv₂ = \(\begin{bmatrix} 1 & 0 \\ 0 & -1 \end{bmatrix} \begin{bmatrix} 0 \\ 3 \end{bmatrix} = \begin{bmatrix} 0 \\ -3 \end{bmatrix} = (-1)\begin{bmatrix} 0 \\ 3 \end{bmatrix}\) ✓

Eigenvalues: λ₁ = 1, λ₂ = -1
Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \end{bmatrix}\)
Final answer:

Reflection has eigenvalues 1 and -1: preserved and reversed directions

Applied rules:

• Reflection property: Eigenvalues are always ±1

• Fixed directions: Eigenvalue 1 corresponds to preserved directions

• Reversed directions: Eigenvalue -1 corresponds to flipped directions

5 General 2D Transformation
Exercise 5
Consider A = \(\begin{bmatrix} 2 & 1 \\ 1 & 2 \end{bmatrix}\). Find eigenvalues and eigenvectors and visualize the geometric transformation.
Definition:

General transformation: Can combine stretching, rotation, and shearing effects

Eigenvalues
λ₁ = 3, λ₂ = 1
Eigenvectors
v₁ = \(\begin{bmatrix} 1 \\ 1 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)
Step 1: Find characteristic equation

A - λI = \(\begin{bmatrix} 2-λ & 1 \\ 1 & 2-λ \end{bmatrix}\)

det(A - λI) = (2-λ)² - 1 = 4 - 4λ + λ² - 1 = λ² - 4λ + 3

λ² - 4λ + 3 = 0

(λ - 3)(λ - 1) = 0

So: λ₁ = 3, λ₂ = 1

Step 2: Find eigenvector for λ₁ = 3

(A - 3I)v = 0

\(\begin{bmatrix} -1 & 1 \\ 1 & -1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: -x + y = 0, so y = x

Choose x = 1: v₁ = \(\begin{bmatrix} 1 \\ 1 \end{bmatrix}\)

Step 3: Find eigenvector for λ₂ = 1

(A - I)v = 0

\(\begin{bmatrix} 1 & 1 \\ 1 & 1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: x + y = 0, so y = -x

Choose x = 1: v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)

Step 4: Geometric interpretation

Along direction v₁ = \(\begin{bmatrix} 1 \\ 1 \end{bmatrix}\): vectors are stretched by factor 3

Along direction v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\): vectors are unchanged (stretched by factor 1)

This is a combination of stretching in different directions

Step 5: Verify and visualize

The transformation stretches more in the direction (1,1) than in direction (1,-1)

For unit vectors: A\(\begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} 2 \\ 1 \end{bmatrix}\) and A\(\begin{bmatrix} 0 \\ 1 \end{bmatrix} = \begin{bmatrix} 1 \\ 2 \end{bmatrix}\)

The unit square becomes a parallelogram with area = det(A) = 3

Eigenvalues: λ₁ = 3, λ₂ = 1
Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ 1 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)
Final answer:

The transformation stretches by factor 3 along (1,1) and by factor 1 along (1,-1)

Applied rules:

• Principal directions: Eigenvectors define the principal axes of transformation

• Stretching factors: Eigenvalues determine how much to stretch in each direction

• Area scaling: det(A) = product of eigenvalues

Geometric Interpretation: Comprehensive Guide
A\vec{v} = \lambda\vec{v}
Eigenvalue Equation
Key definitions:

Eigenvector: Non-zero vector that maintains its direction under the transformation

Geometric interpretation: The directions that remain invariant under the linear transformation

Principal axes: The fundamental directions of stretching/compression

Complete methodology:
  1. Find eigenvalues: Solve det(A - λI) = 0
  2. Find eigenvectors: For each eigenvalue λ, solve (A - λI)v = 0
  3. Interpret geometrically: Understand how the transformation affects space
  4. Visualize: Draw before/after transformations
Tip 1: Positive eigenvalue > 1 means stretching in that direction.
Tip 2: Positive eigenvalue < 1 means compression in that direction.
Tip 3: Negative eigenvalue means reversal of direction plus scaling.
Tip 4: Complex eigenvalues indicate rotation combined with scaling.
Common errors: Forgetting to consider direction, misinterpreting negative eigenvalues, ignoring complex eigenvalues.
Exam preparation: Practice visualizing different transformation types, memorize key geometric interpretations.
Properties to know by heart:

• Direction preservation: Eigenvectors maintain their direction

• Scaling factor: Eigenvalues determine the amount of scaling

• Principal axes: Eigenvectors define fundamental directions

• Rotation indicator: Complex eigenvalues indicate rotation

• Reflection indicator: Eigenvalues of ±1 indicate reflection

• Area scaling: det(A) = product of eigenvalues

Geometric Interpretation Visualization
Exercise 6: Transformation Analysis
Visual analysis of geometric interpretations:
• Direction preservation properties
• Scaling factor visualization
• Complex eigenvalue effects

Analysis: The visualization shows how different eigenvalues affect geometric transformations.

  • Positive eigenvalues indicate stretching/compression
  • Negative eigenvalues indicate reversal plus scaling
  • Complex eigenvalues indicate rotation

Questions & Answers

Question: Why do eigenvectors represent "special" directions in a transformation? What makes them different from other vectors?

Answer: Eigenvectors are "special" because they are the only directions that remain unchanged by the transformation:

Direction invariance:

  • For a general vector v, the transformation Av usually points in a different direction than v
  • For an eigenvector v, the transformation Av points in exactly the same (or opposite) direction as v
  • The transformation only scales the eigenvector by the eigenvalue λ

Physical significance:

These are the "natural" or "principal" directions of the transformation. They reveal the fundamental structure of how the transformation acts on space.

Analogy:

Think of stretching a rubber sheet - the directions that stretch uniformly (without shearing) are the eigenvector directions.

This is why eigenvectors are fundamental to understanding the geometric nature of linear transformations.

Question: What does it mean when eigenvalues are negative? How does this affect the geometric interpretation?

Answer: Negative eigenvalues indicate a reversal of direction:

Geometric effect:

  • Positive eigenvalue λ > 0: Vector maintains direction, scaled by |λ|
  • Negative eigenvalue λ < 0: Vector reverses direction, scaled by |λ|
  • For example, λ = -2: Vector reverses direction and doubles in length

Examples:

In a reflection across the origin, eigenvalues are -1, indicating complete reversal.

In a transformation with λ = -0.5, vectors reverse direction but shrink by half.

Physical interpretation:

Negative eigenvalues often correspond to mirror symmetries or time-reversal operations in physical systems.

The eigenvector direction is still preserved geometrically, but with opposite orientation.

Question: What are practical applications of the geometric interpretation of eigenvalues and eigenvectors?

Answer: Geometric interpretation has numerous practical applications:

  • Principal Component Analysis (PCA): Finds principal axes of data variation
  • Structural engineering: Determines principal stress directions in materials
  • Quantum mechanics: Eigenvalues represent measurable quantities
  • Image processing: Image compression and feature extraction
  • Machine learning: Dimensionality reduction and data analysis
  • Physics: Normal modes of vibration in mechanical systems

Specific examples:

In facial recognition, eigenfaces are the principal directions of variation among faces.

In structural analysis, principal stress directions indicate where forces act most strongly.

In data science, principal components reveal the most important directions of variation in high-dimensional datasets.

The geometric interpretation helps understand the fundamental structure of transformations in all these applications.