Supp 2 Determinants
Supp 2 Determinants
Axiom 2. Invariance under row addition. If matrix B is obtained from matrix A by adding
one row, says the kth row, of A to another row, says the ith row, of A, then d(B) =
d(A), i.e.,
d(A1 , . . . , Ai + Ak , . . . , Ak , . . . , An ) = d(A1 , . . . , Ai , . . . , Ak , . . . , An ).
The primary purpose of this supplement is to show that there exists such a determinant
function d of order n and it is unique. Before being able to do so, we will derive important
properties of such a determinant function d if exists.
1
Professor Chung-Chin Lu for EE203001 Linear Algebra 2
Although the above theorem states that a determinant function d is unique if exists, we
do not settle down the existence question yet. But for a 1 × 1 matrix A = [a11 ], the mapping
d(A) = a11
satisfies the three axioms and is the unique determinant function of order 1. It"is clear that
#
a11 a12
d is a linear function of the single row vector of A. And for a 2 × 2 matrix A = ,
a21 a22
it is easy to check that the following definition
satisfies the three axioms and thus gives the unique determinant function of order 2. When
we regard the determinant function d of order 2 as a scalar function of two 2-dimensional
row vectors, we have the following additive property in each row:
d(A1 + A01 , A2 ) = (a11 + a011 )a22 − (a12 + a012 )a21 = (a11 a22 − a12 a21 ) + (a011 a22 − a012 a21 )
= d(A1 , A2 ) + d(A01 , A2 )
0
d(A1 , A2 + A2 ) = a11 (a22 + a022 ) − a12 (a21 + a021 ) = (a11 a22 − a12 a21 ) + (a11 a022 − a12 a021 )
= d(A1 , A2 ) + d(A1 , A02 ).
for any scalars α, β, which says that d is a linear function of one row when the other row is
held fixed. We call d to be 2-linear. In the next section, we will show that if a determinant
function d of order (n − 1) exists and is (n − 1)-linear, then a determinant function d1 of
order n also exists and is n-linear. Thus by induction, there is a unique determinant function
d of order n for every n and d is n-linear.
1
While we have a little bit abused the notation, we are able to distinguish different determinant function
d for different order n in the context.
Professor Chung-Chin Lu for EE203001 Linear Algebra 6
Let B be the matrix obtained from matrix A by multiplying the kth row Ak of A by a
scalar α. Then we have
n
(−1)i+j bij d(Bij )
X
Ej (B) = Ej (A1 , . . . , αAk , . . . , An ) =
i=1
n
= (−1)k+j (αakj )d(Akj ) + (−1)i+j aij (αd(Aij ))
X
i=1
i6=k
n
(−1)i+j aij d(Aij ) = αEj (A1 , . . . , Ak , . . . , An ) = αEj (A),
X
= α
i=1
where (1) the k, j minor Bkj of B is the same as the k, j minor Akj of A and (2) for all
1 ≤ i ≤ n, i 6= k, the i, j minor Bij of B is obtained by multiplying the kth row or (k − 1)th
row (i > k or i < k) of the i, j minor Aij of A by scalar α. Thus the function Ej satisfies
Axiom 1.
Now let B be the matrix obtained from matrix A by adding the lth row to the kth row
of A. Then we have
n
(−1)i+j bij d(Bij )
X
Ej (B) = Ej (A1 , . . . , Ak + Al , . . . , Al , . . . , An ) =
i=1
n
= (−1)k+j (akj + alj )d(Akj ) + (−1)l+j alj (d(Alj ) + d(Âlj )) + (−1)i+j aij d(Aij )
X
i=1
i6=k,l
n
= (−1)k+j alj d(Akj ) + (−1)l+j+|k−l|−1 alj d(Akj ) + (−1)i+j aij d(Aij )
X
i=1
= Ej (A1 , . . . , Ak , . . . , Al , . . . , An ) = Ej (A),
where (1) the k, j minor Bkj of B is the same as the k, j minor Akj of A, (2) the l, j minor
(j)
Blj of B is obtained by adding the shortened (n − 1)-dimensional row vector Al (obtained
from the lth row vector Al of A by removing its jth component) to the shortened (n − 1)-
(j)
dimensional row vector Ak of the l, j minor Alj of A and then from the (n − 1)-linearity
Professor Chung-Chin Lu for EE203001 Linear Algebra 7
of d, d(Blj ) = d(Alj ) + d(Âlj ) with Âlj being the matrix obtained from Alj by replacing the
(j) (j)
shortened row vector Ak with the shortened row vector Al , and (3) for all 1 ≤ i ≤ n,
(j)
i 6= k, l, the i, j minor Bij of B is obtained by adding the shortened row vector Al of the
(j)
i, j minor Aij of A to the shortened row Ak of Aij . Note that matrix Âlj can be obtained
(j)
from the k, j minor Akj of A by exchanging the shortened row vector Al of Akj with the
adjacent row vector |k − l| − 1 times and then d(Âlj ) = (−1)|k−l|−1 d(Akj ). Thus the function
Ej satisfies Axiom 2.
For A = In×n , we have
which says that Ej satisfies Axiom 3. Then by Theorem 6, Ej is the unique determinant
function of order n, also denoted as d, and
n
(−1)i+j aij d(Aij ), ∀ A ∈ Mn×n ,
X
d(A) = (4)
i=1
d(A1 , . . . , Ak + A0k , . . . , An )
n
(j) (j) (j) 0(j)
= (−1)k+j (akj + a0kj )d(. . . , Ak−1 , Ak+1 , . . .) + (−1)i+j aij d(. . . , Ak + Ak , . . .)
X
i=1
i6=k
n
k+j (j) (j) (j)
(−1)i+j aij d(. . . , Ak , . . .)
X
=
(−1) akj d(. . . , Ak−1 , Ak+1 , . . .) +
i=1
i6=k
n
k+j 0 (j) (j) 0(j)
(−1)i+j aij d(. . . , Ak , . . .)
X
+
(−1) akj d(. . . , Ak−1 , Ak+1 , . . .) +
i=1
i6=k
= d(A1 , . . . , Ak , . . . , An ) + d(A1 , . . . , A0k , . . . , An ),
Theorem 7 [Existence Theorem] For every positive integer n, there is a unique determinant
function of order n. Furthermore, this function is n-linear.
Professor Chung-Chin Lu for EE203001 Linear Algebra 8
This unique function is frequently denoted as det. The expansion formula in (4) is called
the expansion of the determinant det(A) of A by the jth column minors, rewritten here as
n
(−1)i+j aij det(Aij ).
X
det(A) = (5)
i=1
We next show that the determinant det(A) of matrix A can be expanded by minors in a row.
For each i, 1 ≤ i ≤ n, consider the ith row Ai of an n × n matrix A,
where I1 = (1, 0, . . . , 0), . . . , In = (0, . . . , 0, 1) are standard row vectors. Then we have
n
X
det(A) = d(A1 , . . . , Ai−1 , aij Ij , Ai+1 , . . . , An )
j=1
n
X
= aij d(A1 , . . . , Ai−1 , Ij , Ai+1 , . . . , An )
j=1
n
aij det(A0ij )
X
= (6)
j=1
By adding a multiple −akj Ij of the ith row Ij of A0ij to the kth row Ak of A0ij for each k,
1 ≤ k ≤ n and k 6= i, we obtain the matrix
··· 0 · · · a1n
a11
.. .. .. . . ..
. . . . .
ai−1,1 ··· 0 · · · ai−1,n
A00ij
=
0 ··· 1 ··· 1
ai+1,1
··· 0 · · · ai+1,n
.. ... .. . . ..
. . . .
an1 · · · 0 · · · ann
and by Theorem 2,
det(A00ij ) = det(A0ij ). (7)
Professor Chung-Chin Lu for EE203001 Linear Algebra 9
With the expansion of the determinant d(A00ij ) by the jth column minors in (5), we have
det(A00ij ) = (−1)i+j det(Aij ) (8)
since the i, j minor of A00ij is equal to the the i, j minor Aij of A. By (6)–(8), we have
n
(−1)i+j aij det(Aij ),
X
det(A) = (9)
j=1
which is called the expansion of the determinant det(A) of A by the ith row minors.
The next theorem is an application of the multilinearity of the determinant function det.
Theorem 8 If the rows of an n × n matrix A are linearly dependent, then det(A) = 0.
Proof. Suppose there exist scalars c1 , c2 , . . . , cn , not all zeros and says ck 6= 0, such that
Pn Pn
i=1 ci Ai = 0. Then we have Ak = i=1,i6=k ti Ai , where ti = −ci /ck . Thus
n
X
det(A) = d(. . . , Ak−1 , ti Ai , Ak+1 , . . .)
i=1
i6=k
n
X
= ti d(. . . , Ak−1 , Ai , Ak+1 , . . .).
i=1
i6=k
But for each i 6= k, row Ai is equal to at least one of the rows A1 , . . . , Ak−1 , Ak+1 , . . . , An
and hence
d(. . . , Ak−1 , Ai , Ak+1 , . . .) = 0
by Theorem 4. Thus det(A) = 0. 2
The next theorem is an application of the expansion formulas in (5) and (9).
Theorem 9 An n × n matrix A and its transpose At have the same determinants, i.e.,
det(A) = det(At ).
Proof. The proof is by induction on n, the size of the matrix A. For n = 1, we have
A = At = [a11 ] and det(A) = det(At ) = a11 trivially. Assume that the theorem is true for
(n − 1). Let A = [aij ] be an n × n matrix and B = At = [bij ]. Then bij = aji . By expanding
det(B) by the ith row minors, we have
n
(−1)i+j bij det(Bij ).
X
det(B) =
j=1
The i, j minor Bij of B is equal to the transpose of the j, i minor Aji of A, i.e., Bij = Atji .
And by the induction step, det(Aji ) = det(Atji ). Hence we have
n
(−1)j+i aji det(Aji ) = det(A)
X
det(B) =
j=1
from the expansion of det(A) by the ith column minors. We conclude that
det(A) = det(At ). 2
Professor Chung-Chin Lu for EE203001 Linear Algebra 10
Since the row vectors (At )i of At is just the transpose (ai )t of the column vectors ai of
A, we have
which implies that we can regard the determinant function det as a scalar function of n n-
dimensional column vectors a1 , a2 , . . . an . Thus by Theorem 9, all the row properties of the
determinant function in Theorems 1–4 and 7–8 have the corresponding versions for columns
as stated in the following corollary.
Corollary 10 The determinant function det(A) = d(a1 , . . . , ai , . . . , an ) of an n × n matrix
A = [a1 a2 . . . an ], where a1 , a2 , . . . an are n column vectors of A, has the following column
properties:
1. It is n-linear with respect to column vectors, i.e., for each i, 1 ≤ i ≤ n,
d(a1 , . . . , ak , . . . , ai , . . . , an ) = (−1)d(a1 , . . . , ai , . . . , ak , . . . , an ).
The n × n matrix
cof A = [cof aij ]ni,j=1
is called the cofactor matrix of A.
Consider the product A(cof A)t of A and the transpose of the cofactor matrix of A. The
i, j entry of the product is
n n
(A(cof A)t )ij = (−1)j+k aik det(Ajk ) = d(. . . , Aj−1 , Ai , Aj+1 , . . .)
X X
aik cof ajk =
k=1 k=1
Professor Chung-Chin Lu for EE203001 Linear Algebra 11
i.e.,
· · · β1n
β11 β12
β21 β22 · · · β2n
[e1 e2 · · · en ] = [a1 a2 · · · an ] .. .. .. . ,
. . . ..
βn1 βn2 . . . βnn
i.e.,
In×n = AB.
By the product formula, we have det(A) det(B) = det(In×n ) = 1 and then det(A) 6= 0.
Secondly assume that A has n linearly independent row vectors. Then At has n linearly
independent column vectors. As proved in above, det(At ) 6= 0. Thus we have det(A) 6= 0
since det(A) = det(At ). 2
Combined with Theorem 13 and Corollary 15, we have the following corollary.
Corollary 16 An n × n matrix A is invertible if and only if A has n linearly independent
rows (columns). 2
Note that Corollary 16 can be proved directly without the concept of determinants.