Solved Exercises on Eigenvalues and Eigenvectors Introduction

Master eigenvalues and eigenvectors: finding eigenvalues, eigenvectors, and geometric interpretations through these 5 detailed exercises.

Solution: Exercises 1 to 3
1 Finding Eigenvalues
Exercise 1
Find the eigenvalues of A = \(\begin{bmatrix} 3 & 1 \\ 0 & 2 \end{bmatrix}\) by solving det(A - λI) = 0.
Definition:

Eigenvalue: Scalar λ such that Av = λv for some non-zero vector v

Method:
  1. Form the characteristic matrix: A - λI
  2. Calculate the characteristic polynomial: det(A - λI)
  3. Solve the characteristic equation: det(A - λI) = 0
Characteristic matrix
A - λI = \(\begin{bmatrix} 3-λ & 1 \\ 0 & 2-λ \end{bmatrix}\)
Eigenvalues
λ₁ = 3, λ₂ = 2
Step 1: Form A - λI

A - λI = \(\begin{bmatrix} 3 & 1 \\ 0 & 2 \end{bmatrix} - λ\begin{bmatrix} 1 & 0 \\ 0 & 1 \end{bmatrix}\)

= \(\begin{bmatrix} 3-λ & 1 \\ 0 & 2-λ \end{bmatrix}\)

Step 2: Calculate det(A - λI)

det(A - λI) = (3-λ)(2-λ) - (1)(0)

= (3-λ)(2-λ)

= 6 - 3λ - 2λ + λ²

= λ² - 5λ + 6

Step 3: Solve the characteristic equation

λ² - 5λ + 6 = 0

Factor: (λ - 3)(λ - 2) = 0

So λ₁ = 3, λ₂ = 2

Step 4: Verify using trace and determinant

Trace(A) = 3 + 2 = 5 = λ₁ + λ₂ ✓

det(A) = (3)(2) - (1)(0) = 6 = λ₁ × λ₂ ✓

λ₁ = 3, λ₂ = 2
Final answer:

The eigenvalues are λ₁ = 3 and λ₂ = 2

Applied rules:

• Characteristic equation: det(A - λI) = 0

• Trace property: Sum of eigenvalues equals trace

• Determinant property: Product of eigenvalues equals determinant

2 Finding Eigenvectors
Exercise 2
Find the eigenvectors corresponding to each eigenvalue of A = \(\begin{bmatrix} 3 & 1 \\ 0 & 2 \end{bmatrix}\) from Exercise 1.
Definition:

Eigenvector: Non-zero vector v such that Av = λv for some eigenvalue λ

For λ₁ = 3
v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\)
For λ₂ = 2
v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)
Step 1: Find eigenvector for λ₁ = 3

Solve (A - 3I)v = 0

\(\begin{bmatrix} 3-3 & 1 \\ 0 & 2-3 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

\(\begin{bmatrix} 0 & 1 \\ 0 & -1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: y = 0, and x can be any value

So v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) (normalized)

Step 2: Find eigenvector for λ₂ = 2

Solve (A - 2I)v = 0

\(\begin{bmatrix} 3-2 & 1 \\ 0 & 2-2 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

\(\begin{bmatrix} 1 & 1 \\ 0 & 0 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: x + y = 0, so y = -x

So v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\) (normalized)

Step 3: Verify the eigenvector equations

For λ₁ = 3, v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\):

Av₁ = \(\begin{bmatrix} 3 & 1 \\ 0 & 2 \end{bmatrix} \begin{bmatrix} 1 \\ 0 \end{bmatrix} = \begin{bmatrix} 3 \\ 0 \end{bmatrix} = 3\begin{bmatrix} 1 \\ 0 \end{bmatrix} = λ₁v₁\) ✓

Step 4: Verify for λ₂ = 2, v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)

Av₂ = \(\begin{bmatrix} 3 & 1 \\ 0 & 2 \end{bmatrix} \begin{bmatrix} 1 \\ -1 \end{bmatrix} = \begin{bmatrix} 2 \\ -2 \end{bmatrix} = 2\begin{bmatrix} 1 \\ -1 \end{bmatrix} = λ₂v₂\) ✓

Step 5: Geometric interpretation

For λ₁ = 3: Vector \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) is stretched by factor 3 along x-axis

For λ₂ = 2: Vector \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\) is stretched by factor 2 along that direction

v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\)
Final answer:

Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ 0 \end{bmatrix}\) for λ₁ = 3, v₂ = \(\begin{bmatrix} 1 \\ -1 \end{bmatrix}\) for λ₂ = 2

Applied rules:

• Eigenvector equation: (A - λI)v = 0

• Null space: Solve homogeneous system to find eigenspace

• Normalization: Choose simplest form of eigenvector

3 Diagonal Matrix
Exercise 3
Find the eigenvalues and eigenvectors of the diagonal matrix D = \(\begin{bmatrix} 5 & 0 & 0 \\ 0 & -2 & 0 \\ 0 & 0 & 1 \end{bmatrix}\).
Definition:

Diagonal matrix: Matrix with non-zero entries only on the main diagonal

Eigenvalues
λ₁ = 5, λ₂ = -2, λ₃ = 1
Eigenvectors
v₁ = \(\begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix}\), v₃ = \(\begin{bmatrix} 0 \\ 0 \\ 1 \end{bmatrix}\)
Step 1: Find eigenvalues for diagonal matrix

For a diagonal matrix, eigenvalues are simply the diagonal entries

So: λ₁ = 5, λ₂ = -2, λ₃ = 1

Alternatively, solve det(D - λI) = 0:

det\(\begin{bmatrix} 5-λ & 0 & 0 \\ 0 & -2-λ & 0 \\ 0 & 0 & 1-λ \end{bmatrix} = (5-λ)(-2-λ)(1-λ) = 0\)

This confirms: λ₁ = 5, λ₂ = -2, λ₃ = 1

Step 2: Find eigenvector for λ₁ = 5

Solve (D - 5I)v = 0

\(\begin{bmatrix} 0 & 0 & 0 \\ 0 & -7 & 0 \\ 0 & 0 & -4 \end{bmatrix} \begin{bmatrix} x \\ y \\ z \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \end{bmatrix}\)

This gives: -7y = 0 and -4z = 0, so y = 0, z = 0

x can be any value, so v₁ = \(\begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}\)

Step 3: Find eigenvector for λ₂ = -2

Solve (D - (-2)I)v = 0

\(\begin{bmatrix} 7 & 0 & 0 \\ 0 & 0 & 0 \\ 0 & 0 & 3 \end{bmatrix} \begin{bmatrix} x \\ y \\ z \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \end{bmatrix}\)

This gives: 7x = 0 and 3z = 0, so x = 0, z = 0

y can be any value, so v₂ = \(\begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix}\)

Step 4: Find eigenvector for λ₃ = 1

Solve (D - 1I)v = 0

\(\begin{bmatrix} 4 & 0 & 0 \\ 0 & -3 & 0 \\ 0 & 0 & 0 \end{bmatrix} \begin{bmatrix} x \\ y \\ z \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \\ 0 \end{bmatrix}\)

This gives: 4x = 0 and -3y = 0, so x = 0, y = 0

z can be any value, so v₃ = \(\begin{bmatrix} 0 \\ 0 \\ 1 \end{bmatrix}\)

Step 5: Verify results

For diagonal matrices, the standard basis vectors are eigenvectors

Each diagonal entry is an eigenvalue with the corresponding standard basis vector as its eigenvector

Eigenvalues: λ₁ = 5, λ₂ = -2, λ₃ = 1
Eigenvectors: v₁ = \(\begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}\), v₂ = \(\begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix}\), v₃ = \(\begin{bmatrix} 0 \\ 0 \\ 1 \end{bmatrix}\)
Final answer:

For diagonal matrices, eigenvalues are diagonal entries and eigenvectors are standard basis vectors

Applied rules:

• Diagonal matrix property: Eigenvalues are diagonal entries

• Standard basis: Eigenvectors of diagonal matrix are standard basis vectors

• Verification: Direct computation confirms results

Eigenvalues and Eigenvectors: Key Concepts
A\vec{v} = \lambda\vec{v}
Eigenvalue Equation
Formula
\text{det}(A - \lambda I) = 0
Characteristic Equation
Property
\text{tr}(A) = \sum \lambda_i
Trace Property
Property
\text{det}(A) = \prod \lambda_i
Determinant Property
Geometric meaning: Eigenvectors are directions that remain unchanged by the transformation
Algebraic meaning: Eigenvalues are roots of the characteristic polynomial
Physical meaning: Eigenvalues often represent principal stresses, frequencies, or growth rates
Solution: Exercises 4 to 5
4 Rotation Matrix
Exercise 4
Find the eigenvalues of the rotation matrix R = \(\begin{bmatrix} \cos θ & -\sin θ \\ \sin θ & \cos θ \end{bmatrix}\) where θ ≠ 0, π.
Definition:

Rotation matrix: Orthogonal matrix that preserves length and orientation

Characteristic equation
λ² - 2λ cos θ + 1 = 0
Eigenvalues
λ = cos θ ± i sin θ
Step 1: Form the characteristic matrix

R - λI = \(\begin{bmatrix} \cos θ - λ & -\sin θ \\ \sin θ & \cos θ - λ \end{bmatrix}\)

Step 2: Calculate det(R - λI)

det(R - λI) = (cos θ - λ)² - (-sin θ)(sin θ)

= (cos θ - λ)² + sin² θ

= cos² θ - 2λ cos θ + λ² + sin² θ

= λ² - 2λ cos θ + (cos² θ + sin² θ)

= λ² - 2λ cos θ + 1

Step 3: Solve the characteristic equation

λ² - 2λ cos θ + 1 = 0

Using quadratic formula: λ = \(\frac{2\cos θ ± \sqrt{4\cos² θ - 4}}{2}\)

= \(\frac{2\cos θ ± \sqrt{4(\cos² θ - 1)}}{2}\)

= \(\frac{2\cos θ ± \sqrt{-4\sin² θ}}{2}\)

= \(\frac{2\cos θ ± 2i\sin θ}{2}\)

= cos θ ± i sin θ

Step 4: Express in exponential form

Using Euler's formula: e^(iθ) = cos θ + i sin θ

So the eigenvalues are: λ₁ = e^(iθ) and λ₂ = e^(-iθ)

Step 5: Analyze the result

Since |e^(iθ)| = 1, the eigenvalues lie on the unit circle

For real matrices, complex eigenvalues come in conjugate pairs

This confirms that rotation matrices have complex eigenvalues unless θ = 0 or π

λ₁ = cos θ + i sin θ, λ₂ = cos θ - i sin θ
Final answer:

Rotation matrix has complex eigenvalues: λ = cos θ ± i sin θ

Applied rules:

• Complex eigenvalues: Real matrices can have complex eigenvalues

• Conjugate pairs: Complex eigenvalues of real matrices are conjugates

• Unit modulus: Rotation eigenvalues have magnitude 1

5 Symmetric Matrix
Exercise 5
Find the eigenvalues and eigenvectors of the symmetric matrix S = \(\begin{bmatrix} 4 & 2 \\ 2 & 1 \end{bmatrix}\).
Definition:

Symmetric matrix: Matrix where Aᵀ = A, has real eigenvalues and orthogonal eigenvectors

Eigenvalues
λ₁ = 5, λ₂ = 0
Eigenvectors
v₁ = \(\begin{bmatrix} 2 \\ 1 \end{bmatrix}\), v₂ = \(\begin{bmatrix} -1 \\ 2 \end{bmatrix}\)
Step 1: Find the characteristic equation

S - λI = \(\begin{bmatrix} 4-λ & 2 \\ 2 & 1-λ \end{bmatrix}\)

det(S - λI) = (4-λ)(1-λ) - (2)(2)

= (4-λ)(1-λ) - 4

= 4 - 4λ - λ + λ² - 4

= λ² - 5λ

= λ(λ - 5)

Step 2: Solve for eigenvalues

λ(λ - 5) = 0

So: λ₁ = 5, λ₂ = 0

Step 3: Find eigenvector for λ₁ = 5

(S - 5I)v = 0

\(\begin{bmatrix} 4-5 & 2 \\ 2 & 1-5 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} -1 & 2 \\ 2 & -4 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: -x + 2y = 0, so x = 2y

Choose y = 1, so x = 2: v₁ = \(\begin{bmatrix} 2 \\ 1 \end{bmatrix}\)

Step 4: Find eigenvector for λ₂ = 0

(S - 0I)v = 0, so Sv = 0

\(\begin{bmatrix} 4 & 2 \\ 2 & 1 \end{bmatrix} \begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix}\)

This gives: 4x + 2y = 0, so 2x + y = 0, thus y = -2x

Choose x = 1, so y = -2: v₂ = \(\begin{bmatrix} 1 \\ -2 \end{bmatrix}\)

Step 5: Verify orthogonality

For symmetric matrices, eigenvectors corresponding to different eigenvalues are orthogonal

v₁ · v₂ = (2)(1) + (1)(-2) = 2 - 2 = 0 ✓

This confirms that the eigenvectors are orthogonal

λ₁ = 5, v₁ = \(\begin{bmatrix} 2 \\ 1 \end{bmatrix}\); λ₂ = 0, v₂ = \(\begin{bmatrix} 1 \\ -2 \end{bmatrix}\)
Final answer:

For symmetric matrix: eigenvalues λ₁ = 5, λ₂ = 0; eigenvectors are orthogonal

Applied rules:

• Symmetric matrix property: Real eigenvalues

• Orthogonal eigenvectors: Eigenvectors for different eigenvalues are orthogonal

• Zero eigenvalue: Indicates singularity (det = 0)

Eigenvalues and Eigenvectors: Comprehensive Guide
\text{det}(A - \lambda I) = 0
Characteristic Equation
Key definitions:

Eigenvalue: Scalar λ such that Av = λv for non-zero vector v

Eigenvector: Non-zero vector v that satisfies Av = λv

Eigenspace: Set of all eigenvectors corresponding to an eigenvalue, plus zero vector

Complete methodology:
  1. Find eigenvalues: Solve det(A - λI) = 0
  2. Find eigenvectors: For each eigenvalue λ, solve (A - λI)v = 0
  3. Verify results: Check that Av = λv for each pair
  4. Analyze properties: Check trace/determinant relationships
Tip 1: For 2×2 matrices, characteristic polynomial is λ² - (trace)λ + (determinant) = 0.
Tip 2: Symmetric matrices always have real eigenvalues and orthogonal eigenvectors.
Tip 3: If det(A) = 0, then 0 is an eigenvalue.
Tip 4: Complex eigenvalues come in conjugate pairs for real matrices.
Common errors: Forgetting to normalize eigenvectors, miscalculating characteristic polynomial, missing complex eigenvalues.
Exam preparation: Master 2×2 case, understand geometric interpretations, practice verification.
Properties to know by heart:

• Characteristic equation: det(A - λI) = 0

• Trace property: Sum of eigenvalues = trace(A)

• Determinant property: Product of eigenvalues = det(A)

• Real symmetric matrices: Have real eigenvalues and orthogonal eigenvectors

• Zero eigenvalue: Implies matrix is singular

• Positive definite: All eigenvalues positive

Eigenvalue Properties Visualization
Exercise 6: Property Analysis
Visual analysis of eigenvalue properties:
• Real vs complex eigenvalues
• Symmetric matrix properties
• Trace and determinant relationships

Analysis: The visualization shows how different matrix properties affect eigenvalue behavior.

  • Symmetric matrices have real eigenvalues
  • Rotation matrices have complex eigenvalues
  • Trace equals sum of eigenvalues

Questions & Answers

Question: What does it mean geometrically when a vector is an eigenvector? Why is this concept important?

Answer: Geometrically, an eigenvector is a vector whose direction remains unchanged by the linear transformation:

Direction preservation:

  • If v is an eigenvector of transformation A, then Av points in the same (or opposite) direction as v
  • The transformation only scales the vector by the eigenvalue λ
  • If λ > 0, direction preserved; if λ < 0, direction reversed; if λ = 0, vector collapses to origin

Geometric interpretation:

Eigenvectors represent the "principal directions" of the transformation. They are the special directions along which the transformation acts by pure scaling (stretching or compressing).

Importance:

  • Principal component analysis: In statistics and machine learning
  • Vibration analysis: Natural frequencies and modes in physics
  • Google PageRank: Web page importance algorithm
  • Quantum mechanics: Observable quantities and states

Eigenvectors reveal the intrinsic geometric structure of linear transformations.

Question: Why do we solve det(A - λI) = 0 to find eigenvalues? What's the connection?

Answer: The connection comes from the fundamental definition of eigenvectors:

Starting point:

We want non-zero vectors v such that Av = λv

Reorganizing: Av = λv → Av = λIv → Av - λIv = 0 → (A - λI)v = 0

The key insight:

We need non-zero solutions to (A - λI)v = 0. For a homogeneous system to have non-trivial solutions, the coefficient matrix must be singular (not invertible).

Singularity condition:

A matrix is singular if and only if its determinant is zero.

So: det(A - λI) = 0

Result:

The eigenvalues are precisely the values of λ that make A - λI singular, which means (A - λI)v = 0 has non-zero solutions (the eigenvectors).

This is why solving det(A - λI) = 0 gives us the eigenvalues.

Question: What are practical applications of eigenvalues and eigenvectors?

Answer: Eigenvalues and eigenvectors have extensive practical applications:

  • Principal Component Analysis (PCA): Dimensionality reduction in data science
  • Structural engineering: Finding natural frequencies and mode shapes of structures
  • Quantum mechanics: Energy levels and quantum states
  • Google's PageRank: Web page ranking algorithm
  • Image compression: JPEG and other compression algorithms
  • Stability analysis: Control systems and dynamical systems
  • Face recognition: Eigenfaces method

Specific examples:

In mechanical engineering, eigenvalues represent natural frequencies of vibration, and eigenvectors represent the mode shapes.

In finance, eigenvalues can indicate the volatility structure of asset returns.

In computer graphics, eigenvectors help determine the principal axes of objects for efficient rendering.

The concept is fundamental because it identifies the most important directions in data or systems, providing a way to understand complex behaviors in terms of simpler, fundamental components.