No history yet

Eigenvalues and Eigenvectors

The Unchanging Direction

Linear transformations stretch, compress, and rotate vector spaces. Think of a transformation as a gust of wind blowing across a field of arrows. Most arrows will be knocked off their original line, pointing in new directions. But some special arrows, the eigenvectors, will only be stretched or shrunk. They keep pointing along their original line.

The term "eigen" is German for "own" or "characteristic." So, an eigenvector is a characteristic vector of a transformation. It represents an axis that remains unchanged in direction. The amount by which this eigenvector is scaled is its corresponding eigenvalue, a scalar often denoted by the Greek letter lambda (λλ).

Av=λvA\vec{v} = \lambda\vec{v}

eigenvector

noun

A non-zero vector that changes by only a scalar factor when a linear transformation is applied to it. Its direction remains unchanged.

eigenvalue

noun

The scalar factor by which an eigenvector is stretched or compressed after a linear transformation is applied.

Visualizing the Effect

Let's visualize this. Imagine a matrix that stretches everything horizontally by a factor of 3 and does nothing vertically. Any horizontal vector is an eigenvector because it stays on the x-axis, just gets longer. Its eigenvalue is 3. Any vertical vector is also an eigenvector; it stays on the y-axis and isn't scaled, so its eigenvalue is 1. A vector pointing diagonally, however, will be tilted and point in a new direction. It's not an eigenvector.

The eigenvalue tells you the story of the scaling. An eigenvalue greater than 1 means the eigenvector is stretched. If it's between 0 and 1, the vector is compressed. A negative eigenvalue means the vector is flipped to point in the opposite direction.

Eigenvectors provide the stable axes of a transformation, while eigenvalues tell us the magnitude of the action along those axes.

How to Find Them

Finding these special vectors and scalars is a core task in linear algebra. It involves a bit of algebraic manipulation. We start with the defining equation and rearrange it.

Av=λvAvλv=0AvλIv=0(AλI)v=0\begin{aligned} A\vec{v} &= \lambda\vec{v} \\ A\vec{v} - \lambda\vec{v} &= 0 \\ A\vec{v} - \lambda I\vec{v} &= 0 \\ (A - \lambda I)\vec{v} &= 0 \end{aligned}

For the equation (AλI)v=0(A - \lambda I)\vec{v} = 0 to have a non-zero solution for v\vec{v} (remember, eigenvectors can't be zero vectors), the matrix (AλI)(A - \lambda I) must be singular. This means its determinant must be zero. This gives us a way to find the eigenvalues first.

Step 1: Find the Eigenvalues (λ) Solve the characteristic equation: det(AλI)=0\det(A - \lambda I) = 0. This will be a polynomial equation in λ\lambda. The roots of this polynomial are the eigenvalues.

Step 2: Find the Eigenvectors (v) For each eigenvalue λ\lambda you found, plug it back into the equation (AλI)v=0(A - \lambda I)\vec{v} = 0 and solve for the vector v\vec{v}. The set of all solutions for a given λ\lambda forms a subspace called the eigenspace.

Let's walk through an example. Consider the matrix A=(2314)A = \begin{pmatrix} 2 & 3 \\ 1 & 4 \end{pmatrix}.

First, we set up the characteristic equation.

det(AλI)=det(2λ314λ)=(2λ)(4λ)(3)(1)=86λ+λ23=λ26λ+5=0\begin{aligned} \det(A - \lambda I) &= \det \begin{pmatrix} 2-\lambda & 3 \\ 1 & 4-\lambda \end{pmatrix} \\ &= (2-\lambda)(4-\lambda) - (3)(1) \\ &= 8 - 6\lambda + \lambda^2 - 3 \\ &= \lambda^2 - 6\lambda + 5 = 0 \end{aligned}

Factoring the polynomial, we get (λ5)(λ1)=0(\lambda - 5)(\lambda - 1) = 0. So, our eigenvalues are λ1=5\lambda_1 = 5 and λ2=1\lambda_2 = 1.

Now, we find the eigenvector for each eigenvalue.

For λ1=5\lambda_1 = 5:

(253145)(xy)=(00)    (3311)(xy)=(00)\begin{pmatrix} 2-5 & 3 \\ 1 & 4-5 \end{pmatrix} \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \end{pmatrix} \implies \begin{pmatrix} -3 & 3 \\ 1 & -1 \end{pmatrix} \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \end{pmatrix}

Any vector where the x and y components are equal, like (11)\begin{pmatrix} 1 \\ 1 \end{pmatrix} or (33)\begin{pmatrix} -3 \\ -3 \end{pmatrix}, is an eigenvector for λ=5\lambda = 5. A common choice is the simplest non-zero vector, so we'll pick v1=(11)\vec{v}_1 = \begin{pmatrix} 1 \\ 1 \end{pmatrix}.

For λ2=1\lambda_2 = 1:

(213141)(xy)=(00)    (1313)(xy)=(00)\begin{pmatrix} 2-1 & 3 \\ 1 & 4-1 \end{pmatrix} \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \end{pmatrix} \implies \begin{pmatrix} 1 & 3 \\ 1 & 3 \end{pmatrix} \begin{pmatrix} x \\ y \end{pmatrix} = \begin{pmatrix} 0 \\ 0 \end{pmatrix}

An eigenvector for λ=1\lambda = 1 could be (31)\begin{pmatrix} -3 \\ 1 \end{pmatrix}. So, v2=(31)\vec{v}_2 = \begin{pmatrix} -3 \\ 1 \end{pmatrix}.

Eigenvalues and eigenvectors form the foundation for many advanced techniques. They reveal the deep, underlying structure of a linear transformation.