Rank-Nullity and Conditions for Invertibility

Part 1, Chapter 1: Linear Algebra Toolkit

Learning objectives

  • State the Rank-Nullity Theorem rank(A)+nullity(A)=n\operatorname{rank}(A) + \operatorname{nullity}(A) = n
  • Use the equivalence between invertibility, non-zero determinant, full rank, and trivial kernel
  • Predict consequences of any one condition by reading off all the others
  • Resolve practical questions of solvability of Ax=bA \mathbf{x} = \mathbf{b}

The Key Theorem of Linear Algebra is not a single equation, it is a tightly woven web of equivalences that ties together every concept in the chapter. Rank, nullity, determinant, invertibility, kernel, image, columns-as-basis, unique solvability: for square matrices, these are all the same condition, just dressed in different language. Mastering one of them unlocks all the others. This is why an exam question that looks like it requires a long calculation often dissolves into a one-line answer once you spot which piece of the web is being tested.

The Rank-Nullity Theorem

For any mtimesnm \times n matrix AA, or equivalently any linear transformation T:mathbbRntomathbbRmT : \mathbb{R}^n \to \mathbb{R}^m:

dimker(A)+dimoperatornameim(A)=n\dim \ker(A) + \dim \operatorname{im}(A) = n

Here operatornamerank(A)=dimoperatornameim(A)\operatorname{rank}(A) = \dim \operatorname{im}(A) counts the pivot columns after row-reduction, and operatornamenullity(A)=dimker(A)\operatorname{nullity}(A) = \dim \ker(A) counts the free variables. They must sum to the number of input columns. This is the geometric content of "what goes in, must come out either as image or as kernel collapse".

The web of equivalences for square matrices

For an ntimesnn \times n matrix AA, the following statements are all equivalent:

  • AA is invertible.
  • detAneq0\det A \neq 0.
  • operatornamerank(A)=n\operatorname{rank}(A) = n (full rank).
  • kerA=mathbf0\ker A = \{\mathbf{0}\} (trivial kernel).
  • The columns of AA form a basis for mathbbRn\mathbb{R}^n.
  • Amathbfx=mathbfbA \mathbf{x} = \mathbf{b} has a unique solution for every mathbfb\mathbf{b}.
  • 00 is not an eigenvalue of AA.
  • The reduced row echelon form of AA is the identity matrix InI_nn.

    Any one of these conditions implies all the others. Learn one, and the rest come for free.

    Where this shows up
    • Solving structural-engineering systems: A finite-element model of a bridge produces a stiffness matrix. If detKneq0\det K \neq 0, the system is uniquely solvable for any load vector; if detK=0\det K = 0, the structure has rigid-body modes (kernel directions) and the engineer must add boundary constraints before solving.
    • Least-squares regression: Fitting mathbfy=Xboldsymbolbeta\mathbf{y} = X \boldsymbol{\beta} has a unique solution iff XTXX^T X is invertible, i.e. XX has full column rank. If columns are dependent (multicollinearity), the regression coefficients are not identifiable, pure Rank-Nullity at work.
    • Control systems and observability: A linear control system dotmathbfx=Amathbfx+Bmathbfu\dot{\mathbf{x}} = A \mathbf{x} + B \mathbf{u} is controllable iff the controllability matrix has full rank. Engineers literally check rank to decide whether a satellite's attitude is steerable from the available thrusters.

    Pause and think: Suppose AA is a 5times55 \times 5 matrix and you know that Amathbfx=mathbf0A \mathbf{x} = \mathbf{0} has a non-zero solution. Without doing any further calculation, what can you say about detA\det A? About the rank? About whether Amathbfx=mathbfbA \mathbf{x} = \mathbf{b} might have many solutions for some choices of mathbfb\mathbf{b}?

    Try it

    • A 4times64 \times 6 matrix has rank 3. Before computing, predict the nullity. Then verify with Rank-Nullity.
    • A linear map T:mathbbR5tomathbbR3T : \mathbb{R}^5 \to \mathbb{R}^3 is surjective. Predict the nullity by reading off the rank (= 3) and applying the theorem.
    • A 5times55 \times 5 matrix has trivial kernel. Predict its rank, invertibility, and the number of solutions to Amathbfx=mathbfbA \mathbf{x} = \mathbf{b}, without any explicit row reduction.
    • Can a 3times53 \times 5 matrix have rank 4? Predict before justifying. (Hint: rank is bounded by both the row count and the column count.)
    • Given detA=0\det A = 0 for a 3times33 \times 3 matrix, predict whether the columns of AA can form a basis of mathbbR3\mathbb{R}^3. Justify by walking through the web of equivalences.

    A trap to watch for

    The web of equivalences holds ONLY for square matrices. Students sometimes try to apply "detAneq0\det A \neq 0 implies invertible" to a non-square matrix, but determinants are only defined for square matrices. A 3times53 \times 5 matrix cannot have a determinant; the right question is whether the 3times53 \times 5 matrix has full row rank (necessary for surjectivity) or full column rank (necessary for injectivity), and these need not coincide. Rank-Nullity itself works for any rectangular matrix; the rich web of equivalences only collapses on square matrices.

    What you now know

    You can move freely between rank, nullity, determinant, invertibility, kernel, and image, reading off any one from any other. The next section (§1.7) introduces matrix similarity, which captures when two matrices describe the same linear map in different coordinates, the conceptual bridge to eigenvalues and diagonalization.

    Mark section complete →

    References

    • Garrity, T. (2002). All the Mathematics You Missed. Cambridge University Press, ch. 1, §1.6.
    • Strang, G. (2016). Introduction to Linear Algebra (5th ed.). Wellesley-Cambridge, ch. 3 (rank, dimension).
    • Axler, S. (2015). Linear Algebra Done Right (3rd ed.). Springer, ch. 3 (Rank-Nullity Theorem).
    • Hoffman, K., Kunze, R. (1971). Linear Algebra (2nd ed.). Prentice-Hall, ch. 3 (the dimension theorem).
    • Lay, D. C. (2015). Linear Algebra and Its Applications (5th ed.). Pearson, ch. 2 (Invertible Matrix Theorem).

    This page is prerendered for SEO and accessibility. The interactive widgets above hydrate on JavaScript load.