Linear Combinations and Span - Comprehensive Summary
Linear Combination: A sum of vectors, each multiplied by a scalar: \(c_1\vec{v_1} + c_2\vec{v_2} + ... + c_n\vec{v_n}\)
Span: The set of all possible linear combinations of a given set of vectors
Linear Independence: Vectors are independent if no vector can be written as a linear combination of others
• Scalars determine weights in linear combinations
• Span includes all possible linear combinations
• Independent vectors span larger subspaces
• Dependent vectors span smaller subspaces
1. Set up linear system equation
2. Solve for coefficients
3. Check for consistency
4. Determine span membership
• Check if vectors span entire space
• Verify linear independence
• Use matrix methods for efficiency
• Visualize in 2D/3D when possible
Linear Combination: A sum of vectors, each multiplied by a scalar: \(c_1\vec{v_1} + c_2\vec{v_2} + ... + c_n\vec{v_n}\)
- Multiply each vector by its corresponding scalar
- Perform vector addition/subtraction component-wise
- Simplify the result
\(2\vec{v_1} = 2 \cdot \begin{pmatrix} 1 \\ 2 \end{pmatrix} = \begin{pmatrix} 2 \\ 4 \end{pmatrix}\)
\(-3\vec{v_2} = -3 \cdot \begin{pmatrix} 3 \\ 1 \end{pmatrix} = \begin{pmatrix} -9 \\ -3 \end{pmatrix}\)
\(2\vec{v_1} - 3\vec{v_2} = \begin{pmatrix} 2 \\ 4 \end{pmatrix} + \begin{pmatrix} -9 \\ -3 \end{pmatrix} = \begin{pmatrix} 2-9 \\ 4-3 \end{pmatrix}\)
\(2\vec{v_1} - 3\vec{v_2} = \begin{pmatrix} -7 \\ 1 \end{pmatrix}\)
\(2\vec{v_1} - 3\vec{v_2} = \begin{pmatrix} -7 \\ 1 \end{pmatrix}\)
• Scalar multiplication: Multiply each component by the scalar
• Component-wise addition: Add corresponding components
• Sign handling: Pay attention to negative scalars
Span Membership: A vector \(\vec{b}\) is in span\(\{\vec{v_1}, \vec{v_2}\}\) if there exist scalars \(c_1, c_2\) such that \(\vec{b} = c_1\vec{v_1} + c_2\vec{v_2}\)
We need to find \(c_1, c_2\) such that: \(\begin{pmatrix} 7 \\ 5 \end{pmatrix} = c_1\begin{pmatrix} 1 \\ 2 \end{pmatrix} + c_2\begin{pmatrix} 3 \\ 1 \end{pmatrix}\)
\(\begin{cases} c_1 + 3c_2 = 7 \quad \text{(equation 1)} \\ 2c_1 + c_2 = 5 \quad \text{(equation 2)} \end{cases}\)
From equation 2: \(c_2 = 5 - 2c_1\)
Substitute into equation 1: \(c_1 + 3(5 - 2c_1) = 7\)
\(c_1 + 15 - 6c_1 = 7\)
\(-5c_1 = -8\)
\(c_1 = \frac{8}{5}\)
Then: \(c_2 = 5 - 2(\frac{8}{5}) = 5 - \frac{16}{5} = \frac{25-16}{5} = \frac{9}{5}\)
\(\frac{8}{5}\begin{pmatrix} 1 \\ 2 \end{pmatrix} + \frac{9}{5}\begin{pmatrix} 3 \\ 1 \end{pmatrix} = \begin{pmatrix} \frac{8}{5} \\ \frac{16}{5} \end{pmatrix} + \begin{pmatrix} \frac{27}{5} \\ \frac{9}{5} \end{pmatrix} = \begin{pmatrix} \frac{35}{5} \\ \frac{25}{5} \end{pmatrix} = \begin{pmatrix} 7 \\ 5 \end{pmatrix}\)
Yes, \(\vec{b}\) is in the span of \(\{\vec{v_1}, \vec{v_2}\}\) with coefficients \(c_1 = \frac{8}{5}\) and \(c_2 = \frac{9}{5}\)
• Span definition: Express target vector as linear combination
• System solving: Solve for coefficients using substitution/elimination
• Verification: Substitute back to confirm the solution
Multi-vector Linear Combination: Extends to any number of vectors: \(\sum_{i=1}^{n} c_i\vec{v_i}\)
\(3\vec{u} = 3 \cdot \begin{pmatrix} 1 \\ 0 \\ -1 \end{pmatrix} = \begin{pmatrix} 3 \\ 0 \\ -3 \end{pmatrix}\)
\(-2\vec{v} = -2 \cdot \begin{pmatrix} 2 \\ 1 \\ 3 \end{pmatrix} = \begin{pmatrix} -4 \\ -2 \\ -6 \end{pmatrix}\)
\(\vec{w} = \begin{pmatrix} 0 \\ -1 \\ 2 \end{pmatrix}\)
\(3\vec{u} - 2\vec{v} + \vec{w} = \begin{pmatrix} 3 \\ 0 \\ -3 \end{pmatrix} + \begin{pmatrix} -4 \\ -2 \\ -6 \end{pmatrix} + \begin{pmatrix} 0 \\ -1 \\ 2 \end{pmatrix}\)
\(= \begin{pmatrix} 3-4+0 \\ 0-2-1 \\ -3-6+2 \end{pmatrix} = \begin{pmatrix} -1 \\ -3 \\ -7 \end{pmatrix}\)
First: \(3-4+0 = -1\)
Second: \(0-2-1 = -3\)
Third: \(-3-6+2 = -7\)
\(3\vec{u} - 2\vec{v} + \vec{w} = \begin{pmatrix} -1 \\ -3 \\ -7 \end{pmatrix}\)
• Extension to higher dimensions: Rules apply to n-dimensional vectors
• Sequential operations: Perform scalar multiplication first, then addition
• Component-wise operations: Apply operations to each component separately
3D Span Membership: Check if there exist scalars \(c_1, c_2, c_3\) such that \(\vec{b} = c_1\vec{v_1} + c_2\vec{v_2} + c_3\vec{v_3}\)
We need to find \(c_1, c_2, c_3\) such that: \(\begin{pmatrix} 1 \\ 2 \\ 3 \end{pmatrix} = c_1\begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix} + c_2\begin{pmatrix} 0 \\ 1 \\ 1 \end{pmatrix} + c_3\begin{pmatrix} 1 \\ 1 \\ 0 \end{pmatrix}\)
\(\begin{cases} c_1 + 0c_2 + c_3 = 1 \quad \text{(equation 1)} \\ 0c_1 + c_2 + c_3 = 2 \quad \text{(equation 2)} \\ c_1 + c_2 + 0c_3 = 3 \quad \text{(equation 3)} \end{cases}\)
From equation 1: \(c_1 = 1 - c_3\)
From equation 2: \(c_2 = 2 - c_3\)
Substitute into equation 3: \((1 - c_3) + (2 - c_3) = 3\)
\(3 - 2c_3 = 3\)
\(-2c_3 = 0\)
\(c_3 = 0\)
Therefore: \(c_1 = 1 - 0 = 1\) and \(c_2 = 2 - 0 = 2\)
\(1\begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix} + 2\begin{pmatrix} 0 \\ 1 \\ 1 \end{pmatrix} + 0\begin{pmatrix} 1 \\ 1 \\ 0 \end{pmatrix} = \begin{pmatrix} 1 \\ 0 \\ 1 \end{pmatrix} + \begin{pmatrix} 0 \\ 2 \\ 2 \end{pmatrix} + \begin{pmatrix} 0 \\ 0 \\ 0 \end{pmatrix} = \begin{pmatrix} 1 \\ 2 \\ 3 \end{pmatrix}\)
Yes, \(\vec{b}\) is in the span of \(\{\vec{v_1}, \vec{v_2}, \vec{v_3}\}\) with coefficients \(c_1 = 1\), \(c_2 = 2\), \(c_3 = 0\)
• System extension: More vectors mean more equations
• Consistent solution: A unique solution means the vector is in the span
• Verification: Always substitute back to confirm
Linear Independence: Vectors are linearly independent if the only solution to \(c_1\vec{v_1} + c_2\vec{v_2} + c_3\vec{v_3} = \vec{0}\) is \(c_1 = c_2 = c_3 = 0\)
We need to solve: \(c_1\begin{pmatrix} 1 \\ 2 \\ 1 \end{pmatrix} + c_2\begin{pmatrix} 2 \\ 1 \\ 3 \end{pmatrix} + c_3\begin{pmatrix} 3 \\ 4 \\ 5 \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \\ 0 \end{pmatrix}\)
\(\begin{cases} c_1 + 2c_2 + 3c_3 = 0 \quad \text{(equation 1)} \\ 2c_1 + c_2 + 4c_3 = 0 \quad \text{(equation 2)} \\ c_1 + 3c_2 + 5c_3 = 0 \quad \text{(equation 3)} \end{cases}\)
From equation 1: \(c_1 = -2c_2 - 3c_3\)
Substitute into equation 2: \(2(-2c_2 - 3c_3) + c_2 + 4c_3 = 0\)
\(-4c_2 - 6c_3 + c_2 + 4c_3 = 0\)
\(-3c_2 - 2c_3 = 0\)
So: \(c_2 = -\frac{2}{3}c_3\)
Substitute into equation 3: \((-2(-\frac{2}{3}c_3) - 3c_3) + 3(-\frac{2}{3}c_3) + 5c_3 = 0\)
\((\frac{4}{3}c_3 - 3c_3) - 2c_3 + 5c_3 = 0\)
\(\frac{4}{3}c_3 - 3c_3 - 2c_3 + 5c_3 = 0\)
\(\frac{4}{3}c_3 = 0\)
Therefore: \(c_3 = 0\), which gives \(c_2 = 0\) and \(c_1 = 0\)
Since the only solution is \(c_1 = c_2 = c_3 = 0\), the vectors are linearly independent.
The vectors \(\vec{v_1}\), \(\vec{v_2}\), and \(\vec{v_3}\) are linearly independent.
• Homogeneous system: Set linear combination equal to zero vector
• Trivial solution: Only zero coefficients indicate independence
• Non-trivial solution: Non-zero coefficients indicate dependence
Linear Combination: A weighted sum of vectors using scalar coefficients
Span: The set of all possible linear combinations of a given set of vectors
Linear Independence: A set of vectors where no vector can be expressed as a linear combination of others
- For span membership: Set up system of equations with unknown coefficients
- For linear independence: Solve homogeneous system for zero vector
- For linear combinations: Apply scalar multiplication followed by vector addition
- Verify solutions: Always substitute back to confirm
• Every vector space contains the zero vector
• Span is always a subspace of the original vector space
• Linearly independent sets have unique representations
• The maximum number of linearly independent vectors in \(\mathbb{R}^n\) is \(n\)
• Basis vectors are linearly independent and span the entire space
Geometric Interpretation: The span of two linearly independent vectors in \(\mathbb{R}^2\) creates the entire plane, allowing any vector in \(\mathbb{R}^2\) to be expressed as a linear combination of these vectors.
- \(\vec{v_1} = \begin{pmatrix} 1 \\ 0 \end{pmatrix}\) (unit vector along x-axis)
- \(\vec{v_2} = \begin{pmatrix} 0 \\ 1 \end{pmatrix}\) (unit vector along y-axis)
- Any vector \(\vec{w} = \begin{pmatrix} a \\ b \end{pmatrix} = a\vec{v_1} + b\vec{v_2}\)