Linear AlgebraEigenvalues and Eigenvectors4 of 7
Eigenvalues and Eigenvectors · 4

Diagonalization: Working in the Eigenbasis

Multiplying a vector by a matrix, or multiplying a matrix by itself many times, usually mixes the coordinates together, so we want a coordinate grid where the matrix only stretches.

1

Stretching Along the Eigenbasis

We want to see why a matrix like [3113]\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}, which mixes xx and yy at every step, is geometrically doing the same stretches as the diagonal matrix [4002]\begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}, just along tilted axes.

Stretching Along the Eigenbasis
[4002]10=  ?\begin{bmatrix} \htmlClass{lc-green}{4} & 0 \\ 0 & \htmlClass{lc-pink}{2} \end{bmatrix}^{10} = \;?
[3113]10=  ?\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}^{10} = \;?
standard grid\text{standard grid}
eigenbasis grid\text{eigenbasis grid}
[xy]↦[3x+yx+3y]\begin{bmatrix} x \\ y \end{bmatrix} \mapsto \begin{bmatrix} 3x + y \\ x + 3y \end{bmatrix}
ı^\hat{\imath}
ȷ^\hat{\jmath}
[31]\begin{bmatrix} 3 \\ 1 \end{bmatrix}
[13]\begin{bmatrix} 1 \\ 3 \end{bmatrix}
v1\htmlClass{lc-green}{v_1}
v2\htmlClass{lc-pink}{v_2}
4v1\htmlClass{lc-green}{4v_1}
2v2\htmlClass{lc-pink}{2v_2}

In standard xx-yy coordinates, [3113]\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix} mixes both entries, while along its two eigenvector directions it stretches without any mixing at all:

[3113][11]=4[11],[3113][1−1]=2[1−1]\displaystyle \begin{aligned} \begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}\vone{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} &= \vone{4\begin{bmatrix} 1 \\ 1 \end{bmatrix}}, \\ \begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}\vtwo{\begin{bmatrix} 1 \\ -1 \end{bmatrix}} &= \vtwo{2\begin{bmatrix} 1 \\ -1 \end{bmatrix}} \end{aligned}
2

The Three-Step Detour Through the Eigenbasis

We want to compute [3113][42]\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}\vecx{\begin{bmatrix} 4 \\ 2 \end{bmatrix}} by switching into the eigenbasis v1=[11]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} and v2=[1−1]\vtwo{v_2} = \vtwo{\begin{bmatrix} 1 \\ -1 \end{bmatrix}}, where the transformation is a simple diagonal stretch.

The Three-Step Detour Through the Eigenbasis
[42]\htmlClass{lc-blue}{\begin{bmatrix} 4 \\ 2 \end{bmatrix}}
v1\htmlClass{lc-green}{v_1}
v2\htmlClass{lc-pink}{v_2}
[3113][42]=  ?\displaystyle \begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}\htmlClass{lc-blue}{\begin{bmatrix} 4 \\ 2 \end{bmatrix}} = \;?
Text solution
1. Switch from ordinary coordinates to eigenbasis coordinatesWrite [42]\vecx{\begin{bmatrix} 4 \\ 2 \end{bmatrix}} as a combination of the eigenvectors v1=[11]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} and v2=[1−1]\vtwo{v_2} = \vtwo{\begin{bmatrix} 1 \\ -1 \end{bmatrix}} to see how much of each eigenvector it takes.
[42]=3[11]+1[1−1]  ⟹  [31]⏟eigenbasiscoordinates\displaystyle \vecx{\begin{bmatrix} 4 \\ 2 \end{bmatrix}} = \vone{3\begin{bmatrix} 1 \\ 1 \end{bmatrix}} + \vtwo{1\begin{bmatrix} 1 \\ -1 \end{bmatrix}} \implies \underbrace{\begin{bmatrix} \vone{3} \\ \vtwo{1} \end{bmatrix}}_{\substack{\text{eigenbasis} \\ \text{coordinates}}}
2. Stretch each eigenbasis coordinate by its eigenvalueMultiply by the diagonal matrix of eigenvalues [4002]\begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix} so the first coordinate stretches by 4\vone{4} and the second stretches by 2\vtwo{2}.
[4002][31]=[122]\displaystyle \begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}\begin{bmatrix} \vone{3} \\ \vtwo{1} \end{bmatrix} = \begin{bmatrix} \vone{12} \\ \vtwo{2} \end{bmatrix}
3. Translate back to ordinary coordinatesCombine the eigenvectors using the stretched eigenbasis coordinates as weights to get the final vector in standard xx-yy coordinates.
12[11]+2[1−1]=[12+212−2]=[1410]\displaystyle \vone{12\begin{bmatrix} 1 \\ 1 \end{bmatrix}} + \vtwo{2\begin{bmatrix} 1 \\ -1 \end{bmatrix}} = \begin{bmatrix} \vone{12} + \vtwo{2} \\ \vone{12} - \vtwo{2} \end{bmatrix} = \vecx{\begin{bmatrix} 14 \\ 10 \end{bmatrix}}

Pick any vector x\vecx{x} in the plane: [3113]\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix} mixes its standard xx and yy coordinates, while its two components along the eigenvector lines [11]\vone{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} and [1−1]\vtwo{\begin{bmatrix} 1 \\ -1 \end{bmatrix}} simply stretch by 4\vone{4} and 2\vtwo{2} to land on [3113]x\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}\vecx{x}.

While this matrix mixes standard x and y coordinates together, on the eigenvector grid it simply stretches one tilted component by 4 and the other by 2.
3

Diagonalization: A=PDP−1A = PDP^{-1} and Matrix Powers

Diagonalization writes the three-step detour through the eigenbasis as a single matrix product A=PDP−1\amap{A} = P\amap{D}P^{-1}, which lets us raise a matrix to any power Ak\amap{A^k} without mixing coordinates at every step.

Remember that putting the new basis vectors into the columns of a matrix PP translates from new basis coordinates into ordinary coordinates, while its inverse P−1P^{-1} translates the other way, from ordinary coordinates into the new basis.

Diagonalization: A = PDP⁻¹ and Matrix Powers
ordinarycoordinates\begin{gathered}\text{ordinary}\\[-3pt]\text{coordinates}\end{gathered}
eigenbasiscoordinates\begin{gathered}\text{eigenbasis}\\[-3pt]\text{coordinates}\end{gathered}
[42]\htmlClass{lc-blue}{\begin{bmatrix} 4 \\ 2 \end{bmatrix}}
[3113]\begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}
[1410]\htmlClass{lc-blue}{\begin{bmatrix} 14 \\ 10 \end{bmatrix}}
1\htmlClass{lc-mute}{1}
[31]\begin{bmatrix} \htmlClass{lc-green}{3} \\ \htmlClass{lc-pink}{1} \end{bmatrix}
[4002]\begin{bmatrix} \htmlClass{lc-green}{4} & 0 \\ 0 & \htmlClass{lc-pink}{2} \end{bmatrix}
2\htmlClass{lc-mute}{2}
[122]\begin{bmatrix} \htmlClass{lc-green}{12} \\ \htmlClass{lc-pink}{2} \end{bmatrix}
3\htmlClass{lc-mute}{3}
??
??

When PDP−1P\amap{D}P^{-1} multiplies a vector x\vecx{x}, the three matrices act in order from right to left:

A\displaystyle \amap{A} =P⏟to ordinarycoordinatesD⏟stretch ineigenbasisP−1⏟to eigenbasiscoordinates\displaystyle = \underbrace{P}_{\substack{\text{to ordinary} \\ \text{coordinates}}} \underbrace{\amap{D}}_{\substack{\text{stretch in} \\ \text{eigenbasis}}} \underbrace{P^{-1}}_{\substack{\text{to eigenbasis} \\ \text{coordinates}}}
Text solution
1. Put the eigenvectors into PP and the eigenvalues into D\amap{D}Put the eigenvectors into the columns of PP and place each matching eigenvalue into the same column of the diagonal matrix D\amap{D}.
P=[111−1],D=[4002]\displaystyle P = \begin{bmatrix} \vone{1} & \vtwo{1} \\ \vone{1} & \vtwo{-1} \end{bmatrix}, \qquad \amap{D} = \begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}
2. Invert PP to complete A=PDP−1\amap{A} = P\amap{D}P^{-1}Find P−1P^{-1} for the step that translates into the eigenbasis, giving A=PDP−1\amap{A} = P\amap{D}P^{-1}.
P−1=[121212−12]  ⟹  [3113]=[111−1][4002][121212−12]\displaystyle \begin{aligned} P^{-1} &= \begin{bmatrix} \tfrac{1}{2} & \tfrac{1}{2} \\[4pt] \tfrac{1}{2} & -\tfrac{1}{2} \end{bmatrix} \\ \implies \begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix} &= \begin{bmatrix} \vone{1} & \vtwo{1} \\ \vone{1} & \vtwo{-1} \end{bmatrix}\begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix} \\ &\quad \begin{bmatrix} \tfrac{1}{2} & \tfrac{1}{2} \\[4pt] \tfrac{1}{2} & -\tfrac{1}{2} \end{bmatrix} \end{aligned}
3. Cancel matching P−1PP^{-1}P pairs to find Ak\amap{A^k}Write out PDP−1P\amap{D}P^{-1} multiplied by itself and cancel each inner P−1PP^{-1}P pair to the identity matrix, so only the diagonal matrix D\amap{D} is raised to the kk-th power.
A3=(PDP−1)(PDP−1)(PDP−1)=PD(P−1P)D(P−1P)DP−1=PD3P−1\displaystyle \begin{aligned} \amap{A^3} &= (P\amap{D}P^{-1})(P\amap{D}P^{-1})(P\amap{D}P^{-1}) \\ &= P\amap{D}(P^{-1}P)\amap{D}(P^{-1}P)\amap{D}P^{-1} \\ &= P\amap{D^3}P^{-1} \end{aligned}
Ak\displaystyle \amap{A^k} =PDkP−1\displaystyle = P\amap{D^k}P^{-1}
4

Diagonalizing a 3×33\times 3 Matrix with a Repeated Eigenvalue

Now we want to diagonalize the 3×33\times 3 matrix A=[311020113]\amap{A} = \begin{bmatrix} 3 & 1 & 1 \\ 0 & 2 & 0 \\ 1 & 1 & 3 \end{bmatrix} as A=PDP−1\amap{A} = P\amap{D}P^{-1}, where a repeated eigenvalue has to give us two linearly independent eigenvectors to fill the three columns of PP.

Diagonalizing a 3×3 Matrix with a Repeated Eigenvalue
A=[311020113]P=[0?00?00?0]\displaystyle \begin{aligned} \htmlClass{lc-violet}{A} &= \begin{bmatrix} 3 & 1 & 1 \\ 0 & 2 & 0 \\ 1 & 1 & 3 \end{bmatrix} \\[14pt] P &= \begin{bmatrix} \hspace{0.4em} \htmlStyle{display:inline-block;border:1.5px dashed var(--lc-mute);border-radius:6px;padding:0 .3em;vertical-align:middle}{\begin{matrix} \phantom{0} \\ \htmlClass{lc-mute}{?} \\ \phantom{0} \end{matrix}} & \htmlStyle{display:inline-block;border:1.5px dashed var(--lc-mute);border-radius:6px;padding:0 .3em;vertical-align:middle}{\begin{matrix} \phantom{0} \\ \htmlClass{lc-mute}{?} \\ \phantom{0} \end{matrix}} & \htmlStyle{display:inline-block;border:1.5px dashed var(--lc-mute);border-radius:6px;padding:0 .3em;vertical-align:middle}{\begin{matrix} \phantom{0} \\ \htmlClass{lc-mute}{?} \\ \phantom{0} \end{matrix}} \hspace{0.4em} \end{bmatrix} \end{aligned}
Text solution
1. Find the eigenvalues from det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0Expand the determinant along the middle row and factor to find the roots and how many times each root repeats.
det⁡[3−λ1102−λ0113−λ]=(2−λ)((3−λ)2−1)=(2−λ)(λ2−6λ+8)=(2−λ)(λ−2)(λ−4)=0\displaystyle \begin{aligned} &\det\begin{bmatrix} 3 - \lambda & 1 & 1 \\ 0 & 2 - \lambda & 0 \\ 1 & 1 & 3 - \lambda \end{bmatrix} \\ &= (2 - \lambda)\big((3 - \lambda)^2 - 1\big) \\ &= (2 - \lambda)(\lambda^2 - 6\lambda + 8) \\ &= (2 - \lambda)(\lambda - 2)(\lambda - 4) = 0 \end{aligned}
λ\displaystyle \lambda =2,2⏟algebraicmultiplicity 2,4⏟algebraicmultiplicity 1\displaystyle = \underbrace{2, 2}_{\substack{\text{algebraic} \\ \text{multiplicity } 2}}, \quad \underbrace{4}_{\substack{\text{algebraic} \\ \text{multiplicity } 1}}
2. Find two independent eigenvectors from the repeated eigenvalue λ=2\lambda = 2Row-reduce A−2I\amap{A} - 2I to get the plane equation x+y+z=0\eigsp{x + y + z = 0}, then set the two free variables (y,z)(\vone{y}, \vtwo{z}) to (1,0)(1, 0) and (0,1)(0, 1) in turn.
A−2I=[111000111]→row-reduce[111000000]  ⟹  x+y+z=0  ⟹  x=−y−z\displaystyle \begin{aligned} \amap{A} - 2I &= \begin{bmatrix} 1 & 1 & 1 \\ 0 & 0 & 0 \\ 1 & 1 & 1 \end{bmatrix} \\ &\xrightarrow{\text{row-reduce}} \begin{bmatrix} 1 & 1 & 1 \\ 0 & 0 & 0 \\ 0 & 0 & 0 \end{bmatrix} \\ &\implies \eigsp{x + y + z = 0} \\ &\implies x = -\vone{y} - \vtwo{z} \end{aligned}
y=1,  z=0  ⟹  v1=[−110],y=0,  z=1  ⟹  v2=[−101]\displaystyle \begin{aligned} \vone{y} = 1, \; \vtwo{z} = 0 &\implies \vone{v_1} = \vone{\begin{bmatrix} -1 \\ 1 \\ 0 \end{bmatrix}}, \\ \vone{y} = 0, \; \vtwo{z} = 1 &\implies \vtwo{v_2} = \vtwo{\begin{bmatrix} -1 \\ 0 \\ 1 \end{bmatrix}} \end{aligned}
3. Find the third eigenvector from λ=4\lambda = 4Plug λ=4\lambda = 4 into A−λI\amap{A} - \lambda I, solve the row equations for xx and yy in terms of the free variable zz, and set z=1z = 1.
A−4I=[−1110−2011−1]  ⟹  −2y=0  ⟹  y=0,−x+z=0  ⟹  x=z  ⟹  v3=[101]\displaystyle \begin{aligned} \amap{A} - 4I &= \begin{bmatrix} -1 & 1 & 1 \\ 0 & -2 & 0 \\ 1 & 1 & -1 \end{bmatrix} \\ &\implies -2y = 0 \implies y = 0, \\ &\quad -x + z = 0 \implies x = z \\ &\implies \vthree{v_3} = \vthree{\begin{bmatrix} 1 \\ 0 \\ 1 \end{bmatrix}} \end{aligned}
4. Put together PP and D\amap{D} in matching column order and compute P−1P^{-1}Place v1,v2,v3\vone{v_1}, \vtwo{v_2}, \vthree{v_3} into the columns of PP, put their matching eigenvalues 2,2,4\vone{2}, \vtwo{2}, \vthree{4} on the diagonal of D\amap{D}, and invert PP.
P=[−1−11100011],D=[200020004],P−1=[010−12−1212121212]\displaystyle \begin{aligned} P &= \begin{bmatrix} \vone{-1} & \vtwo{-1} & \vthree{1} \\ \vone{1} & \vtwo{0} & \vthree{0} \\ \vone{0} & \vtwo{1} & \vthree{1} \end{bmatrix}, \\ \amap{D} &= \begin{bmatrix} \vone{2} & 0 & 0 \\ 0 & \vtwo{2} & 0 \\ 0 & 0 & \vthree{4} \end{bmatrix}, \\ P^{-1} &= \begin{bmatrix} 0 & 1 & 0 \\ -\tfrac{1}{2} & -\tfrac{1}{2} & \tfrac{1}{2} \\[4pt] \tfrac{1}{2} & \tfrac{1}{2} & \tfrac{1}{2} \end{bmatrix} \end{aligned}
[311020113]=[−1−11100011][200020004][010−12−1212121212]\displaystyle \begin{aligned} \begin{bmatrix} 3 & 1 & 1 \\ 0 & 2 & 0 \\ 1 & 1 & 3 \end{bmatrix} &= \begin{bmatrix} \vone{-1} & \vtwo{-1} & \vthree{1} \\ \vone{1} & \vtwo{0} & \vthree{0} \\ \vone{0} & \vtwo{1} & \vthree{1} \end{bmatrix} \\ &\quad \begin{bmatrix} \vone{2} & 0 & 0 \\ 0 & \vtwo{2} & 0 \\ 0 & 0 & \vthree{4} \end{bmatrix} \\ &\quad \begin{bmatrix} 0 & 1 & 0 \\ -\tfrac{1}{2} & -\tfrac{1}{2} & \tfrac{1}{2} \\[4pt] \tfrac{1}{2} & \tfrac{1}{2} & \tfrac{1}{2} \end{bmatrix} \end{aligned}

You can put the eigenvectors into the columns of PP in any order you like, as long as column ii of D\amap{D} has the eigenvalue that goes with column ii of PP.

Every vector in the eigenspace plane x+y+z=0\eigsp{x + y + z = 0} stretches by 2\eigsp{2} along its own line. So long as we pick v2\vtwo{v_2} in that plane, not on the same line as v1=[−110]\vone{v_1} = \vone{\begin{bmatrix} -1 \\ 1 \\ 0 \end{bmatrix}}, it teams up with v1\vone{v_1} and v3=[101]\vthree{v_3} = \vthree{\begin{bmatrix} 1 \\ 0 \\ 1 \end{bmatrix}} to make a full 3D eigenbasis grid where PDP−1=AP\amap{D}P^{-1} = \amap{A}. If we line v2\vtwo{v_2} up with v1\vone{v_1}, the 3D grid collapses into a plane and PP has no inverse.

Every direction on the eigenspace plane stretches by two, and any second vector on that plane not lined up with the first completes a full 3D eigenbasis to diagonalize the matrix.
5

When Is a Matrix Diagonalizable?

An n×nn\times n matrix is diagonalizable when it has nn linearly independent eigenvectors to form a complete coordinate grid for nn-dimensional space and make PP invertible.

When Is a Matrix Diagonalizable?
A=P D P−1P=[v1v2v3]for every matrix?\displaystyle \begin{gathered} \begin{aligned} \htmlClass{lc-violet}{A} &= P\,\htmlClass{lc-violet}{D}\,P^{-1} \\[6pt] P &= \begin{bmatrix} \htmlClass{lc-green}{v_1} & \htmlClass{lc-pink}{v_2} & \htmlClass{lc-violet}{v_3} \end{bmatrix} \end{aligned} \\[12pt] \text{for every matrix?} \end{gathered}

If an n×nn\times n matrix has nn different real eigenvalues, their eigenvectors automatically point in linearly independent directions, so the matrix is guaranteed to be diagonalizable without checking any eigenspaces. When an eigenvalue repeats, we check whether the matrix B=[210020004]\amap{B} = \begin{bmatrix} 2 & 1 & 0 \\ 0 & 2 & 0 \\ 0 & 0 & 4 \end{bmatrix} still has enough independent eigenvectors:

Text solution
1. Read the eigenvalues and their algebraic multiplicities from the diagonalBecause B\amap{B} is upper-triangular, its eigenvalues are the diagonal entries.
λ\displaystyle \lambda =2,2⏟algebraicmultiplicity 2,4⏟algebraicmultiplicity 1\displaystyle = \underbrace{2, 2}_{\substack{\text{algebraic} \\ \text{multiplicity } 2}}, \quad \underbrace{4}_{\substack{\text{algebraic} \\ \text{multiplicity } 1}}
2. Find the eigenspace dimension for the repeated root λ=2\lambda = 2Subtract 2I2I from B\amap{B} and solve (B−2I)v=0(\amap{B} - 2I)v = 0 to see how many variables are free.
B−2I=[010000002]  ⟹  1y=0,  2z=0  ⟹  [x00]=x[100](dimension 1⏟geometricmultiplicity 1)\displaystyle \begin{aligned} \amap{B} - 2I &= \begin{bmatrix} 0 & 1 & 0 \\ 0 & 0 & 0 \\ 0 & 0 & 2 \end{bmatrix} \\ &\implies 1y = 0, \; 2z = 0 \\ &\implies \vone{\begin{bmatrix} x \\ 0 \\ 0 \end{bmatrix}} = \vone{x\begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}} \\ &\quad (\eigsp{\underbrace{\text{dimension } 1}_{\substack{\text{geometric} \\ \text{multiplicity } 1}}}) \end{aligned}
3. Compare geometric multiplicity with algebraic multiplicityBecause λ=2\lambda = 2 has algebraic multiplicity 22 but only gives a 1\eigsp{1}-dimensional line of eigenvectors, B\amap{B} has only two independent eigenvectors in total and cannot fill the three columns of PP.
geometric multiplicity (1)<algebraic multiplicity (2)  ⟹  B is not diagonalizable\displaystyle \begin{aligned} &\eigsp{\text{geometric multiplicity } (1)} \\ &\lack{<} \text{algebraic multiplicity } (2) \\ &\implies \amap{B} \text{ is not diagonalizable} \end{aligned}

Under the 2D shear matrix [1101]\begin{bmatrix} 1 & 1 \\ 0 & 1 \end{bmatrix} with double eigenvalue λ=1\lambda = 1, every unit vector v\vecx{v} off the horizontal axis is pushed sideways off its own line, leaving only the line along [10]\vone{\begin{bmatrix} 1 \\ 0 \end{bmatrix}} on its own line and no second independent eigenvector direction to build a 2D coordinate grid.

Even though its eigenvalue repeats twice, this shear pushes every vector off the horizontal axis away from its own line, leaving only one eigenvector direction instead of the two needed for a 2D grid.

Key concepts

Diagonalizing an n×nn\times n matrix A\amap{A} writes it as a three-step detour through its eigenbasis, A=PDP−1\amap{A} = P\amap{D}P^{-1}. The columns of PP are nn linearly independent eigenvectors, and the diagonal entries of D\amap{D} are the matching eigenvalues in the same column order (for A=[3113]\amap{A} = \begin{bmatrix} 3 & 1 \\ 1 & 3 \end{bmatrix}, P=[111−1]P = \begin{bmatrix} \vone{1} & \vtwo{1} \\ \vone{1} & \vtwo{-1} \end{bmatrix} and D=[4002]\amap{D} = \begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}). When A\amap{A} multiplies a vector x\vecx{x}, P−1xP^{-1}\vecx{x} translates ordinary coordinates into eigenbasis coordinates, DP−1x\amap{D}P^{-1}\vecx{x} stretches each coordinate independently, and PDP−1xP\amap{D}P^{-1}\vecx{x} translates back to ordinary coordinates. When you raise A\amap{A} to a power, every P−1PP^{-1}P in the middle cancels out, so Ak=PDkP−1\amap{A^k} = P\amap{D^k}P^{-1} only raises the diagonal entries of D\amap{D} to the kk-th power. And if a matrix is already diagonal, like [4002]10=[41000210]\begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}^{10} = \begin{bmatrix} \vone{4^{10}} & 0 \\ 0 & \vtwo{2^{10}} \end{bmatrix}, its coordinates already don't mix, so no basis change is needed.

To see if an n×nn\times n matrix is diagonalizable, start with the roots of det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0. If all nn eigenvalues are real and different (like λ=1,4,−2\lambda = 1, 4, -2 for a 3×33\times 3 matrix), you can stop right there: eigenvectors from different eigenvalues are automatically linearly independent, so the matrix is diagonalizable without solving for any eigenspaces. You only need to check A−λI\amap{A} - \lambda I when an eigenvalue repeats. Then the matrix is diagonalizable when every repeated eigenvalue has as many free variables in A−λI\amap{A} - \lambda I (its geometric multiplicity) as the number of times that root repeats (its algebraic multiplicity), like λ=2\lambda = 2 giving two free variables in x+y+z=0\eigsp{x + y + z = 0} versus only one free variable in [010000002]\begin{bmatrix} 0 & 1 & 0 \\ 0 & 0 & 0 \\ 0 & 0 & 2 \end{bmatrix}.

6

Practice

1

A 2×22\times 2 matrix A\amap{A} has eigenvectors v1=[12]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 2 \end{bmatrix}} with eigenvalue λ1=5\vone{\lambda_1} = \vone{5} and v2=[11]\vtwo{v_2} = \vtwo{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} with eigenvalue λ2=3\vtwo{\lambda_2} = \vtwo{3}. Use the three-step detour through the eigenbasis to compute Ax\amap{A}\vecx{x} for x=[35]\vecx{x} = \vecx{\begin{bmatrix} 3 \\ 5 \end{bmatrix}}: (a) find the eigenbasis coordinates P−1xP^{-1}\vecx{x}, (b) multiply by D\amap{D} to find DP−1x\amap{D}P^{-1}\vecx{x}, and (c) translate back to ordinary coordinates to find Ax\amap{A}\vecx{x}.

For (a), ask how many of v1=[12]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 2 \end{bmatrix}} and how many of v2=[11]\vtwo{v_2} = \vtwo{\begin{bmatrix} 1 \\ 1 \end{bmatrix}} add up to [35]\vecx{\begin{bmatrix} 3 \\ 5 \end{bmatrix}}.

(a) Write x=[35]\vecx{x} = \vecx{\begin{bmatrix} 3 \\ 5 \end{bmatrix}} as a combination of v1\vone{v_1} and v2\vtwo{v_2}:
[35]=2[12]+1[11]  ⟹  P−1x=[21]\displaystyle \vecx{\begin{bmatrix} 3 \\ 5 \end{bmatrix}} = \vone{2\begin{bmatrix} 1 \\ 2 \end{bmatrix}} + \vtwo{1\begin{bmatrix} 1 \\ 1 \end{bmatrix}} \implies P^{-1}\vecx{x} = \begin{bmatrix} \vone{2} \\ \vtwo{1} \end{bmatrix}
(b) Multiply the eigenbasis coordinates P−1xP^{-1}\vecx{x} by D=[5003]\amap{D} = \begin{bmatrix} \vone{5} & 0 \\ 0 & \vtwo{3} \end{bmatrix} (don't multiply the original coordinates [35]\vecx{\begin{bmatrix} 3 \\ 5 \end{bmatrix}} by D\amap{D}, which gives the wrong vector [1515]\begin{bmatrix} 15 \\ 15 \end{bmatrix}):
DP−1x=[5003][21]=[103]\displaystyle \amap{D}P^{-1}\vecx{x} = \begin{bmatrix} \vone{5} & 0 \\ 0 & \vtwo{3} \end{bmatrix}\begin{bmatrix} \vone{2} \\ \vtwo{1} \end{bmatrix} = \begin{bmatrix} \vone{10} \\ \vtwo{3} \end{bmatrix}
(c) Use the stretched eigenbasis coordinates as weights on v1\vone{v_1} and v2\vtwo{v_2} to return to ordinary coordinates (don't stop at [103]\begin{bmatrix} \vone{10} \\ \vtwo{3} \end{bmatrix}, which is still in eigenbasis coordinates):
Ax=10[12]+3[11]=[1323]\displaystyle \amap{A}\vecx{x} = \vone{10\begin{bmatrix} 1 \\ 2 \end{bmatrix}} + \vtwo{3\begin{bmatrix} 1 \\ 1 \end{bmatrix}} = \begin{bmatrix} 13 \\ 23 \end{bmatrix}
2

Diagonalize A=[6−240]\amap{A} = \begin{bmatrix} 6 & -2 \\ 4 & 0 \end{bmatrix} as A=PDP−1\amap{A} = P\amap{D}P^{-1}, and use Ak=PDkP−1\amap{A^k} = P\amap{D^k}P^{-1} to find A10\amap{A^{10}} (leave powers of 44 and 22 in exponent form).

Find the eigenvalues from det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0, match each eigenvector column in PP with its eigenvalue column in D\amap{D}, and multiply PD10P−1P\amap{D^{10}}P^{-1}.

Solve the characteristic equation det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0:
(6−λ)(0−λ)−(−2)(4)=λ2−6λ+8=(λ−4)(λ−2)=0  ⟹  λ=4,2\displaystyle \begin{aligned} & (6 - \lambda)(0 - \lambda) - (-2)(4) = \lambda^2 \\ &\quad - 6\lambda + 8 \\ &\quad = (\lambda - 4)(\lambda - 2) = 0 \\ &\quad \implies \lambda = 4, 2 \end{aligned}
For λ=4\lambda = 4, (A−4I)v=[2−24−4][xy]=[00](\amap{A} - 4I)v = \begin{bmatrix} 2 & -2 \\ 4 & -4 \end{bmatrix}\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix} gives x=yx = y, so v1=[11]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 1 \end{bmatrix}}. For λ=2\lambda = 2, (A−2I)v=[4−24−2][xy]=[00](\amap{A} - 2I)v = \begin{bmatrix} 4 & -2 \\ 4 & -2 \end{bmatrix}\begin{bmatrix} x \\ y \end{bmatrix} = \begin{bmatrix} 0 \\ 0 \end{bmatrix} gives y=2xy = 2x, so v2=[12]\vtwo{v_2} = \vtwo{\begin{bmatrix} 1 \\ 2 \end{bmatrix}}. Putting these into PP and D\amap{D} and inverting PP gives:
P=[1112],D=[4002],P−1=[2−1−11]\displaystyle \begin{aligned} P &= \begin{bmatrix} \vone{1} & \vtwo{1} \\ \vone{1} & \vtwo{2} \end{bmatrix}, \\ \amap{D} &= \begin{bmatrix} \vone{4} & 0 \\ 0 & \vtwo{2} \end{bmatrix}, \\ P^{-1} &= \begin{bmatrix} 2 & -1 \\ -1 & 1 \end{bmatrix} \end{aligned}
Compute A10=PD10P−1\amap{A^{10}} = P\amap{D^{10}}P^{-1} with PP on the left and P−1P^{-1} on the right (swapping PP and P−1P^{-1} to P−1D10PP^{-1}\amap{D^{10}}P gives the wrong answer [2⋅410−2102⋅410−2⋅210−410+210−410+2⋅210]\begin{bmatrix} 2\cdot 4^{10} - 2^{10} & 2\cdot 4^{10} - 2\cdot 2^{10} \\ -4^{10} + 2^{10} & -4^{10} + 2\cdot 2^{10} \end{bmatrix}, and raising the entries of A\amap{A} directly to the 10th power gives [610(−2)104100]\begin{bmatrix} 6^{10} & (-2)^{10} \\ 4^{10} & 0 \end{bmatrix}):
A10=[1112][41000210][2−1−11]=[4102104102⋅210][2−1−11]=[2⋅410−210−410+2102⋅410−2⋅210−410+2⋅210]\displaystyle \begin{aligned} & \amap{A^{10}} \\ &= \begin{bmatrix} \vone{1} & \vtwo{1} \\ \vone{1} & \vtwo{2} \end{bmatrix}\begin{bmatrix} \vone{4^{10}} & 0 \\ 0 & \vtwo{2^{10}} \end{bmatrix}\begin{bmatrix} 2 & -1 \\ -1 & 1 \end{bmatrix} \\ &= \begin{bmatrix} \vone{4^{10}} & \vtwo{2^{10}} \\ \vone{4^{10}} & \vtwo{2\cdot 2^{10}} \end{bmatrix}\begin{bmatrix} 2 & -1 \\ -1 & 1 \end{bmatrix} \\ &= \begin{bmatrix} 2\cdot 4^{10} - 2^{10} & -4^{10} + 2^{10} \\ 2\cdot 4^{10} - 2\cdot 2^{10} & -4^{10} + 2\cdot 2^{10} \end{bmatrix} \end{aligned}
3

Diagonalize the 3×33\times 3 matrix A=[−1−22010−4−45]\amap{A} = \begin{bmatrix} -1 & -2 & 2 \\ 0 & 1 & 0 \\ -4 & -4 & 5 \end{bmatrix} by finding PP, D\amap{D}, and P−1P^{-1} such that A=PDP−1\amap{A} = P\amap{D}P^{-1}.

Expand det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0 along the middle row, then solve (A−λI)v=0(\amap{A} - \lambda I)v = 0 for the two free variables at the repeated eigenvalue.

Expanding det⁡(A−λI)=0\det(\amap{A} - \lambda I) = 0 along the middle row gives:
(1−λ)((−1−λ)(5−λ)−(2)(−4))=(1−λ)(λ2−4λ+3)=(1−λ)(λ−1)(λ−3)=0\displaystyle \begin{aligned} & (1 - \lambda)\big((-1 - \lambda)(5 \\ &\quad - \lambda) - (2)(-4)\big) \\ &\quad = (1 - \lambda)(\lambda^2 - 4\lambda + 3) \\ &\quad = (1 - \lambda)(\lambda - 1)(\lambda - 3) = 0 \end{aligned}
So λ=1\lambda = 1 has algebraic multiplicity 22 and λ=3\lambda = 3 has algebraic multiplicity 11. For λ=1\lambda = 1, row-reducing A−I\amap{A} - I gives:
A−I=[−2−22000−4−44]→row-reduce[11−1000000]  ⟹  x+y−z=0  ⟹  z=x+y\displaystyle \begin{aligned} \amap{A} - I &= \begin{bmatrix} -2 & -2 & 2 \\ 0 & 0 & 0 \\ -4 & -4 & 4 \end{bmatrix} \\ &\xrightarrow{\text{row-reduce}} \begin{bmatrix} 1 & 1 & -1 \\ 0 & 0 & 0 \\ 0 & 0 & 0 \end{bmatrix} \\ &\implies \eigsp{x + y - z = 0} \\ &\implies z = \vone{x} + \vtwo{y} \end{aligned}
Setting (x,y)=(1,0)(\vone{x}, \vtwo{y}) = (1, 0) and (0,1)(0, 1) gives v1=[101]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 0 \\ 1 \end{bmatrix}} and v2=[011]\vtwo{v_2} = \vtwo{\begin{bmatrix} 0 \\ 1 \\ 1 \end{bmatrix}}.
For λ=3\lambda = 3, A−3I=[−4−220−20−4−42]\amap{A} - 3I = \begin{bmatrix} -4 & -2 & 2 \\ 0 & -2 & 0 \\ -4 & -4 & 2 \end{bmatrix} gives y=0y = 0 and −4x+2z=0  ⟹  z=2x-4x + 2z = 0 \implies z = 2x, so setting x=1x = 1 gives v3=[102]\vthree{v_3} = \vthree{\begin{bmatrix} 1 \\ 0 \\ 2 \end{bmatrix}}. Putting together PP, D\amap{D}, and P−1P^{-1} gives:
P=[101010112],D=[100010003],P−1=[21−1010−1−11]\displaystyle \begin{aligned} P &= \begin{bmatrix} \vone{1} & \vtwo{0} & \vthree{1} \\ \vone{0} & \vtwo{1} & \vthree{0} \\ \vone{1} & \vtwo{1} & \vthree{2} \end{bmatrix}, \\ \amap{D} &= \begin{bmatrix} \vone{1} & 0 & 0 \\ 0 & \vtwo{1} & 0 \\ 0 & 0 & \vthree{3} \end{bmatrix}, \\ P^{-1} &= \begin{bmatrix} 2 & 1 & -1 \\ 0 & 1 & 0 \\ -1 & -1 & 1 \end{bmatrix} \end{aligned}
4

Determine whether each matrix is diagonalizable by comparing algebraic and geometric multiplicities: (a) A=[41203500−1]\amap{A} = \begin{bmatrix} 4 & 1 & 2 \\ 0 & 3 & 5 \\ 0 & 0 & -1 \end{bmatrix} and (b) B=[301032003]\amap{B} = \begin{bmatrix} 3 & 0 & 1 \\ 0 & 3 & 2 \\ 0 & 0 & 3 \end{bmatrix}.

Both matrices are upper-triangular. Read the eigenvalues off the diagonal first and check whether any eigenvalue repeats.

(a) Reading the diagonal entries of A\amap{A} gives three different eigenvalues, λ=4,3,−1\lambda = 4, 3, -1, so A\amap{A} automatically has 33 linearly independent eigenvectors: A\amap{A} is diagonalizable.
(b) Reading the diagonal entries of B\amap{B} gives λ=3\lambda = 3 with algebraic multiplicity 33 (don't assume B\amap{B} is already diagonal just because all three diagonal entries are 33, since the non-zero entries in the last column still mix zz into xx and yy). Checking B−3I\amap{B} - 3I:
B−3I=[001002000]  ⟹  z=0(x and y free)\displaystyle \amap{B} - 3I = \begin{bmatrix} 0 & 0 & 1 \\ 0 & 0 & 2 \\ 0 & 0 & 0 \end{bmatrix} \implies z = 0 \quad (\vone{x} \text{ and } \vtwo{y} \text{ free})
Because only x\vone{x} and y\vtwo{y} are free, the eigenspace has geometric multiplicity 2<3\eigsp{2} \lack{<} 3: B\amap{B} is not diagonalizable.
5

For what value(s) of kk is M=[2k5020004]\amap{M} = \begin{bmatrix} 2 & k & 5 \\ 0 & 2 & 0 \\ 0 & 0 & 4 \end{bmatrix} diagonalizable? For that value of kk, find PP and D\amap{D} such that M=PDP−1\amap{M} = P\amap{D}P^{-1}.

The repeated eigenvalue λ=2\lambda = 2 has algebraic multiplicity 22, so look at M−2I\amap{M} - 2I and see what value of kk leaves two free variables.

Because M\amap{M} is upper-triangular, its eigenvalues are λ=2\lambda = 2 (algebraic multiplicity 22) and λ=4\lambda = 4 (algebraic multiplicity 11). Subtracting 2I2I gives:
M−2I=[0k5000002]\displaystyle \amap{M} - 2I = \begin{bmatrix} 0 & k & 5 \\ 0 & 0 & 0 \\ 0 & 0 & 2 \end{bmatrix}
The third row forces 2z=0  ⟹  z=02z = 0 \implies z = 0, which reduces the first row to ky=0ky = 0. To get a 2D eigenspace with both x\vone{x} and y\vtwo{y} free, we need k=0k = 0.
When k=0k = 0, setting (x,y)=(1,0)(\vone{x}, \vtwo{y}) = (1, 0) and (0,1)(0, 1) with z=0z = 0 gives v1=[100]\vone{v_1} = \vone{\begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}} and v2=[010]\vtwo{v_2} = \vtwo{\begin{bmatrix} 0 \\ 1 \\ 0 \end{bmatrix}}. For λ=4\lambda = 4, M−4I=[−2050−20000]\amap{M} - 4I = \begin{bmatrix} -2 & 0 & 5 \\ 0 & -2 & 0 \\ 0 & 0 & 0 \end{bmatrix} gives y=0y = 0 and −2x+5z=0  ⟹  2x=5z-2x + 5z = 0 \implies 2x = 5z, so setting z=2z = 2 gives v3=[502]\vthree{v_3} = \vthree{\begin{bmatrix} 5 \\ 0 \\ 2 \end{bmatrix}} (don't read −2x+5z=0-2x + 5z = 0 directly as x=−2,z=5x = -2, z = 5 or x=2,z=5x = 2, z = 5, which gives the wrong third column [−205]\begin{bmatrix} -2 \\ 0 \\ 5 \end{bmatrix} or [205]\begin{bmatrix} 2 \\ 0 \\ 5 \end{bmatrix}):
k=0,P=[105010002],D=[200020004]\displaystyle \begin{aligned} k &= 0, \\ P &= \begin{bmatrix} \vone{1} & \vtwo{0} & \vthree{5} \\ \vone{0} & \vtwo{1} & \vthree{0} \\ \vone{0} & \vtwo{0} & \vthree{2} \end{bmatrix}, \\ \amap{D} &= \begin{bmatrix} \vone{2} & 0 & 0 \\ 0 & \vtwo{2} & 0 \\ 0 & 0 & \vthree{4} \end{bmatrix} \end{aligned}