Given a real matrix
, there are four associated vector subspaces which are known colloquially as its fundamental subspaces, namely the column spaces and the null spaces of the matrices
and its transpose
. These four subspaces are important for a number of reasons, one of which is the crucial role they play in the so-called fundamental theorem of linear algebra.
The above figure summarizes some of the interactions between the four fundamental matrix subspaces for a real matrix
including whether the spaces in question are subspaces of
or
, which subspaces are orthogonal to one another, and how the matrix
maps various vectors
relative to the subspace in which
lies.
In the event that , all four of the fundamental matrix subspaces are lines in
. In this case, one can write
for some
vectors
, whereby the directions of the four lines correspond to
,
,
, and
. An elementary fact from linear algebra is that these directions are also represented by the eigenvectors of
and
(Strang 2008); this is one of the reasons why the four fundamental subspaces of
are often associated with the eigenvalues and the singular value decompositions of
and
in many presentations of the fundamental theorem of linear algebra (Strang 2012).