The Invertible Matrix Theorem: One Fact, Many Faces
We have met determinants, inverses, span, linear independence, null space, and rank as separate tests, and now we want to see how they all connect for a square matrix.
1
One Fact, Many Faces
The Invertible Matrix Theorem says that for an n×n square matrix, all of those tests ask the exact same geometric question: does the matrix keep n-dimensional space whole, or does it squish space into a lower dimension?
Here is why matching the input and output dimensions leaves only those two possibilities, and why undoing a square matrix from just one side is enough.
No Squish Means Invertible
Because a square matrix cannot squish space into a lower dimension and then be un-squished back to full dimension, finding a matrix that undoes A from just one side proves that A does not squish space, so the same matrix automatically works on the other side too:
CA=IorAB=I⟹A−1 exists and C=B=A−1
2
Determinants and the Columns of A
Now we want to spot whether a square matrix squishes space by checking a single number, its determinant, or by looking at where its columns land.
Determinants and the Columns of A
Text solution
Independent columns keep the grid openIn matrix A, the two columns point in different directions, so the parallelogram between them has nonzero area and the output still fills 2 dimensions.
A=[2112],det(A)=0,Rank(A)=2
Dependent columns squish the grid onto a lineIn matrix B, the second column is twice the first column, so both grid lines collapse onto the same line and the area drops to zero.
B=[2142],[42]=2[21],det(B)=0,Rank(B)=1
Now try dragging the second column around the plane to see the exact moment the grid collapses.
The 2D grid covers the whole plane unless the second column lands on the first column's line and squishes everything flat.
When the n columns of an n×n matrix point in n independent directions, no dimension is lost and the columns reach every vector in Rn:
det(A)=0⟺columns of Aare linearlyindependent, span Rn, and forma basis for Rn⟺Rank(A)=n
3
Solving Ax=b and the Null Space
Next, we want to know how many solutions the equation Ax=b has for a target vector b, and which inputs get crushed into the origin when b=0.
Solving Ax = b and the Null Space
Try moving the target vector b on both grids to see when Ax=b has one solution, no solution, or a whole line of solutions.
An open grid reaches every output point with exactly one input, while a squished grid misses points off the line and crowds a whole line of inputs onto each point on the line.
Because the origin x=0 always maps to 0, checking Ax=0 tells us whether any other vectors also land on the origin, which decides whether Ax=b has a unique solution everywhere:
Ax=0⟹x=0(Null(A)={0},Nullity(A)=0)⟺A is one-to-oneand onto⟺Ax=bhas a uniquesolution for every b∈Rn
4
Pivots, Row Reduction, and the Rows of A
For a 3×3 or larger matrix, we usually cannot tell just by looking whether one column is a combination of the others, so we row reduce A to see whether every dimension survives as a pivot.
Remember that transposing a square matrix flips its rows into columns without changing the determinant:
det(AT)=det(A)
A squished dimension shows up as a row of all zeros during row reduction, and det(AT)=det(A) guarantees that the rows of A behave the exact same way as its columns.
Pivots, Row Reduction, and the Rows of A
Text solution
Clear below the first pivotUse the top-left pivot 1 to eliminate the entries below it in the first column.
Eliminate below the second pivot to expose a zero rowSubtracting R2 from R3 turns the bottom row into all zeros, leaving only 2 pivots and showing that 3D space got squished onto a 2D plane.
1002111−1−1R3←R3−R21002101−10
Compare with three surviving pivotsWhen the bottom-right entry of the starting matrix is 2 instead of 0, row reduction produces 3 pivots, one in every row and column, and simplifies all the way to the identity matrix I.
On a test, some questions look like a lot of algebra while others take a single check. We use the Invertible Matrix Theorem to answer several slow questions with one pivot count, or to figure out everything a square matrix does from a single clue, even when we aren't given any entries of the matrix.
Three Ways to Use the Theorem
v1=121
v2=253
v3=112
(a) span R3?
(b) independent?
(c) Ax=7−311: unique?
(d) Null(A)=?
Text solution
Answer four vector questions with one pivot countPlacing v1=⟨1,2,1⟩,v2=⟨2,5,3⟩, and v3=⟨1,1,2⟩ into the columns of a 3×3 matrix A gives 3 pivots (no squish), which immediately answers every part without using ⟨7,−3,11⟩.
A=121253112 has 3 pivots⟹span R3, independent,unique xfor Ax=7−311, and Null(A)={0}
Deduce every property from a no-squish clue (4×4 matrix A)Knowing that Ax=0 has only the solution x=0 tells us that no dimension was crushed, so every statement in the theorem holds for A.
⟹Null(A)={0}Ax=bsolvable for all b∈R4,Rank(A)=4,rows independent (AT invertible),RREF(A)=I4
Deduce every failure from a squish clue (5×5 matrix M)Knowing that the columns of M are linearly dependent tells us that 5D space collapsed into at most 4 dimensions, so every statement in the theorem fails together.
⟹Dependent columnsdet(M)=0,Rank(M)≤4(zero row in RREF),Mx=0 has ∞ solutions,Mx=b has 0 or ∞ solutions
Watch out for a common exam trap when a square matrix M squishes space: Mx=0 never has "no solution." Because x=0 always works, squishing a dimension means an entire line or plane of nonzero vectors lands on 0, so Mx=0 jumps straight from one solution to infinitely many solutions.
6
Why the Matrix Must Be Square
Before using the Invertible Matrix Theorem, we must check that the matrix is square (n×n). For a rectangular m×n matrix (m=n), the input and output spaces have different dimensions, so "not squishing" (one-to-one) and "filling the output space" (onto) split apart.
One-to-one: no squish,
but not onto R3
T
3×2
R2
R3
Onto R2, but not one-to-one:
squishes a dimension
W
2×3
R3
R2
Let's see how a tall 3×2 matrix and a wide 2×3 matrix break the link between one-to-one and onto, and then put the two cases for a square matrix side by side.
Why the Matrix Must Be Square
T=100010
W=[100123]
3×2
2×3
one-to-one?
onto?
one-to-one?
onto?
Text solution
Tall 3×2 matrix T (one-to-one, but not onto)The two columns of T point along the x- and y-axes without collapsing, so Tx=0 has only the trivial solution x=0, but the bottom row of zeros forces every output to have z=0, so the columns cannot span R3.
Wide 2×3 matrix W (onto, but not one-to-one)The first two columns of W already span all of R2, which puts the third column ⟨2,3⟩ in the same 2D plane and forces a dimension of 3D input space to be squished.
Before using the theorem on a problem, look at the size of the matrix. If the matrix is rectangular (m×n with m=n), do not use the Invertible Matrix Theorem. Check one-to-one and onto separately, because a tall matrix like T=100010 can have independent columns (Tx=0⟹x=0) without spanning R3, and a wide matrix like W=[100123] can span R2 while forcing its three columns in 2D to be dependent.
When the matrix A is square (n×n), pick whichever test is fastest to decide which of the two cases you are in:
For a 2×2 matrix
check whether one column is a multiple of the other, like ⟨4,2⟩=2⟨2,1⟩ in B=[2142], or compute det(A).
For a 3×3 or larger matrix of numbers
row reduce just far enough to count pivots: n pivots (such as 1002101−12) means no squish, whereas a row of all zeros means space got squished.
For a conceptual clue without entries
check which of the two cases the clue puts you in:
⟺⟺⟺No squish (all hold):A−1 exists (CA=I or AB=I)det(A)=det(AT)=0n pivots (RREF(A)=I,Rank(A)=n)Null(A)={0}(Nullity(A)=0)
When A does not squish space, both the columns and the rows of A are linearly independent, span Rn, and form a basis for Rn,AT is invertible, and A is one-to-one and onto (Ax=b has a unique solution for every b∈Rn).
⟺⟺⟺Squish (all fail):A not invertibledet(A)=det(AT)=0Rank(A)<n(zero row in RREF)Nullity(A)≥1(Ax=0 has ∞ solutions)
When A squishes space, the columns and rows are linearly dependent and fail to span Rn,AT is not invertible, and Ax=b has either 0 solutions (when b is off the squished output space) or ∞ solutions (when b is on it), never a unique solution.
7
Practice
1
Consider the matrix A=[3−1−62]. By looking at its columns without row reducing, decide whether A squishes 2D space, and find det(A), whether the columns of A form a basis for R2, and Rank(A).
Compare the second column ⟨−6,2⟩ with the first column ⟨3,−1⟩: is one a scalar multiple of the other?
The second column ⟨−6,2⟩ is −2 times the first column ⟨3,−1⟩, so both columns lie on the same line and A squishes 2D space onto a 1D line. Therefore det(A)=0, and the columns do not form a basis for R2 (they are linearly dependent and do not span R2). Be careful not to say Rank(A)=0 just because det(A)=0: the area of the parallelogram collapsed to 0, but the grid squished onto a 1D line rather than a single point, so Rank(A)=1.
2
Let v1=⟨1,2,−1⟩,v2=⟨2,5,1⟩, and v3=⟨1,3,3⟩, and let A be the 3×3 matrix with columns v1,v2, and v3. Row reduce A to count its pivots, and use the result to answer all four questions: (a) Do v1,v2,v3 span R3? (b) Are v1,v2,v3 linearly independent? (c) Does Ax=⟨4,−9,7⟩ have a unique solution? (d) What is Null(A)?
Place v1,v2,v3 as the columns of A and eliminate below the first two pivots. Do you need to include ⟨4,−9,7⟩ in the row reduction to know whether the solution is unique?
Placing the vectors into the columns gives A=12−1251133. Applying R2←R2−2R1 and R3←R3+R1 (watch the sign on R3+R1: subtracting R1 instead of adding would leave −2 in the bottom-left entry instead of 0) gives 100213114, and then R3←R3−3R2 gives 100210111, which has 3 pivots (no squish). By the Invertible Matrix Theorem: (a) Yes, they span R3. (b) Yes, they are linearly independent. (c) Yes, Ax=⟨4,−9,7⟩ has a unique solution. (d) Null(A)={0} (write the set containing the zero vector {0}, not the number 0, which is Nullity(A)).
3
Suppose A is a 4×4 matrix whose reduced row echelon form is I4. Without knowing any entries of A, find: (a) whether Ax=b is solvable for every b∈R4, (b) Nullity(A), (c) whether AT is invertible, and (d) whether the rows of A form a basis for R4.
Don't confuse nullity with rank and answer 4: all 4 dimensions survived as Rank(A)=4, so 0 dimensions were crushed into the null space.
Count the pivots of I4 to see whether A squishes R4, and use det(AT)=det(A) for the questions about AT and the rows of A.
Since RREF(A)=I4,A has 4 pivots and does not squish R4. Therefore: (a) Yes, Ax=b has a unique solution for every b∈R4. (b) Nullity(A)=0 (don't confuse nullity with rank and answer 4: all 4 dimensions survived as Rank(A)=4, so 0 dimensions were crushed into the null space). (c) Yes, AT is invertible because det(AT)=det(A)=0. (d) Yes, the rows of A are linearly independent, span R4, and form a basis for R4.
4
Suppose M is a 5×5 matrix whose columns are linearly dependent. Determine: (a) det(M), (b) what can be said about Rank(M) and the bottom row of RREF(M), (c) how many solutions Mx=0 has, and (d) how many solutions Mx=b can have for a vector b∈R5.
Dependent columns mean M squishes 5D space into a lower dimension. What happens to the subspace of inputs that gets crushed into 0, and what happens when a target b lies off versus on the squished output space?
Dependent columns mean M squishes 5D space into a lower dimension, so every statement of the Invertible Matrix Theorem fails together: (a) det(M)=0. (b) Rank(M)≤4 (strictly less than 5), and RREF(M) has at least one row of all zeros at the bottom. (c) Mx=0 has infinitely many solutions (watch out for the mistake of answering "zero solutions": x=0 always works, and squishing space crushes an entire line or higher-dimensional subspace of nonzero vectors into the origin). (d) Mx=b has either zero solutions (if b lies off the squished output space) or infinitely many solutions (if b lies on it); it can never have a unique solution.
5
Suppose A and C are 4×4 matrices such that CA=I4. Do you need to check whether AC=I4 to know if A is invertible? Explain using the grid picture, state what AC equals, and state how many solutions Ax=b has for each b∈R4.
Follow any vector x∈R4 as A acts on it first and C acts on it second to produce CAx=x: could C bring every vector back to x if A had squished R4?
No, you do not need to check AC=I4 (thinking you still need to multiply AC is only true for non-square matrices; for a square matrix, a one-sided inverse automatically works on both sides). Because A is square, CA=I4 means applying A followed by C returns every vector x in R4 back to x, which would be impossible if A squished R4 into a lower dimension. Thus A does not squish space, so A is invertible, C=A−1 works on both sides so AC=I4, and Ax=b has a unique solution for every b∈R4.
6
Consider the tall 3×2 matrix T=100010 and the wide 2×3 matrix W=[1001−24]. (a) A student checks that Tx=0 has only the trivial solution x=0 and concludes by the Invertible Matrix Theorem that the columns of T must span R3. Is the student right? (b) The student sees that the columns of W span R2 and concludes that W must be one-to-one. Is the student right?
Check the dimensions of T and W before linking "one-to-one" with "onto": can a 2D plane fill 3D space, or can 3D space fit into a 2D plane without squishing a dimension?
Neither conclusion is right; the student's mistake is applying the Invertible Matrix Theorem to non-square matrices where input and output dimensions do not match. (a) T is 3×2: its two columns are linearly independent and T is one-to-one (it does not squish the 2D input plane), but a 2D plane inside 3D space (z=0) cannot fill R3, so its columns do not span R3 and T is not onto. (b) W is 2×3: its first two columns ⟨1,0⟩ and ⟨0,1⟩ already span R2 so W is onto, but mapping 3D space into 2D space forces at least one dimension to be squished (the third column ⟨−2,4⟩ is a combination of the first two in the same 2D plane), so W has dependent columns and is not one-to-one.