1.5 Elementary Matrices and A Method For Finding A - 1
1.5 Elementary Matrices and A Method For Finding A - 1
Elementary Matrices
In Section 1.1 we defined three elementary row operations on a matrix 𝐴:
It should be evident that if we let 𝐵 be the matrix that results from 𝐴 by performing one of
the operations in this list, then the matrix 𝐴 can be recovered from 𝐵 by performing the
corresponding operation in the following list:
Definition 1
Matrices 𝐴 and 𝐵 are said to be row equivalent if either (hence each) can be obtained
from the other by a sequence of elementary row operations.
Our next goal is to show how matrix multiplication can be used to carry out an ele-
mentary row operation.
Definition 2
Listed below are four elementary matrices and the operations that produce them.
⎡1 0 0 0⎤
1 0 ⎢0 0 0 1⎥ ⎡1 0 3⎤ ⎡1 0 0⎤
[ ] ⎢ ⎥ ⎢0 1 0⎥ ⎢0 1 0⎥
0 −3 ⎢0 0 1 0⎥ ⎢ ⎥ ⎢ ⎥
⎢0 0 1⎥ ⎢0 0 1⎥
⎢ ⎥ ⎣ ⎦ ⎣ ⎦
⎣0 1 0 0⎦
The following theorem, whose proof is left as an exercise, shows that when a matrix 𝐴
is multiplied on the left by an elementary matrix 𝐸, the effect is to perform an elementary
row operation on 𝐴.
We know from the discussion at the beginning of this section that if 𝐸 is an elementary
matrix that results from performing an elementary row operation on an identity matrix
𝐼, then there is a second elementary row operation, which when applied to 𝐸 produces 𝐼
back again. Table 1 lists these operations. The operations on the right side of the table are
called the inverse operations of the corresponding operations on the left.
TA B L E 1
In each of the following, an elementary row operation is applied to the 2 × 2 identity matrix
to obtain an elementary matrix 𝐸, then 𝐸 is restored to the identity matrix by applying the
inverse row operation.
1 0 1 0 1 0
[ ] ⟶ [ ] ⟶ [ ]
0 1 0 7 0 1
1 0 0 1 1 0
[ ] ⟶ [ ] ⟶ [ ]
0 1 1 0 0 1
Interchange the first Interchange the first
and second rows. and second rows.
1 0 1 5 1 0
[ ] ⟶ [ ] ⟶ [ ]
0 1 0 1 0 1
Add 5 times the Add −5 times the
second row to second row to the
the first. first.
The next theorem is a key result about invertibility of elementary matrices. It will be
a building block for many results that follow.
Theorem 1.5.2
Every elementary matrix is invertible, and the inverse is also an elementary matrix.
𝐸0 𝐸 = 𝐼 and 𝐸𝐸0 = 𝐼
Equivalence Theorem
One of our objectives as we progress through this text is to show how seemingly diverse
ideas in linear algebra are related. The following theorem, which relates results we have
obtained about invertibility of matrices, homogeneous linear systems, reduced row ech-
elon forms, and elementary matrices, is our first step in that direction. As we study new
topics, more statements will be added to this theorem.
Theorem 1.5.3
Equivalent Statements
If 𝐴 is an n × n matrix, then the following statements are equivalent, that is, all true
or all false.
(a) 𝐴 is invertible.
(b) 𝐴x = 0 has only the trivial solution.
(c) The reduced row echelon form of 𝐴 is 𝐼n .
(d) 𝐴 is expressible as a product of elementary matrices.
November 12, 2018 13:09 C01 Sheet number 57 Page number 57 cyan magenta yellow black © 2018, Anton Textbooks, Inc., All rights rese
Proof We will prove the equivalence by establishing the chain of implications: The following figure
(a) ⇒ (b) ⇒ (c) ⇒ (d) ⇒ (a). illustrates that the sequence
of implications
(a) ⇒ (b) Assume 𝐴 is invertible and let x0 be any solution of 𝐴x = 0. Multiplying both (a) ⇒ (b) ⇒ (c) ⇒ (d) ⇒ (a)
sides of this equation by 𝐴−1 gives implies that
(𝐴−1 𝐴)x0 = 𝐴−1 0
(d) ⇒ (c) ⇒ (b) ⇒ (a)
from which it follows that x0 = 0, so 𝐴x = 0 has only the trivial solution.
and hence that
(a) ⇔ (b) ⇔ (c) ⇔ (d)
(b) ⇒ (c) Let 𝐴x = 0 be the matrix form of the system
(see Appendix A).
a11 x 1 + a12 x 2 + ⋅ ⋅ ⋅ + a1n x n = 0
(a)
a21 x 1 + a22 x 2 + ⋅ ⋅ ⋅ + a2n x n = 0
.. .. .. .. (1)
. . . .
an1 x 1 + an2 x 2 + ⋅ ⋅ ⋅ + ann x n = 0 (d) (b)
and assume that the system has only the trivial solution. If we solve by Gauss–Jordan
elimination, then the system of equations corresponding to the reduced row echelon form
(c)
of the augmented matrix will be
x1 =0
x2 =0 (2)
..
.
xn = 0
Thus, the augmented matrix
a a12 ⋅⋅⋅ a1n 0
⎡ 11 ⎤
⎢ a21 a22 ⋅⋅⋅ a2n 0⎥
⎢ .. .. .. .. ⎥
⎢ . . . .⎥
⎣ an1 an2 ⋅⋅⋅ ann 0⎦
for (1) can be reduced to the augmented matrix
1 0 0 0 ⋅⋅⋅ 0
⎡ ⎤
⎢0 1 0 0⎥⋅⋅⋅ 0
⎢0 0 1 0⎥⋅⋅⋅ 0
⎢ ⎥
⎢ .. .. .. .. ⎥ ..
⎢. . . .⎥ .
⎣0 0 0
⋅ ⋅ ⋅ 1 0⎦
for (2) by a sequence of elementary row operations. If we disregard the last column (all
zeros) in each of these matrices, we can conclude that the reduced row echelon form of 𝐴
is 𝐼n .
(c) ⇒ (d ) Assume that the reduced row echelon form of 𝐴 is 𝐼n , so that 𝐴 can be reduced
to 𝐼n by a finite sequence of elementary row operations. By Theorem 1.5.1, each of these
operations can be accomplished by multiplying on the left by an appropriate elementary
matrix. Thus we can find elementary matrices 𝐸1 , 𝐸2 , . . . , 𝐸k such that
𝐸k ⋅ ⋅ ⋅ 𝐸2 𝐸1 𝐴 = 𝐼n (3)
By Theorem 1.5.2, 𝐸1 , 𝐸2 , . . . , 𝐸k are invertible. Multiplying both sides of Equation (3) on
the left successively by 𝐸k−1 , . . . , 𝐸2−1 , 𝐸1−1 we obtain
(d ) ⇒ (a) If 𝐴 is a product of elementary matrices, then from Theorems 1.4.6 and 1.5.2,
the matrix 𝐴 is a product of invertible matrices and hence is invertible.
November 12, 2018 13:09 C01 Sheet number 58 Page number 58 cyan magenta yellow black © 2018, Anton Textbooks, Inc., All rights rese
𝐴−1 = 𝐸k ⋅ ⋅ ⋅ 𝐸2 𝐸1 𝐼n
But this equation tells us that the same sequence of row operations that reduces 𝐴 to 𝐼n will
transform 𝐼n to 𝐴−1 . Thus, we have established the following result.
A simple method for carrying out this procedure is given in the following example.
Solution We want to reduce 𝐴 to the identity matrix by row operations and simultaneously
apply these operations to 𝐼 to produce 𝐴−1 . To accomplish this we will adjoin the identity
matrix to the right side of 𝐴, thereby producing a partitioned matrix of the form
[𝐴 ∣ 𝐼]
Then we will apply row operations to this matrix until the left side is reduced to 𝐼; these
operations will convert the right side to 𝐴−1 , so the final matrix will have the form
[𝐼 ∣ 𝐴−1 ]
The computations are as follows:
1 2 3 1 0 0
⎡ ⎤
⎢2 5 3 0 1 0⎥
⎢ ⎥
⎣1 0 8 0 0 1⎦
1 2 3 1 0 0
⎡ ⎤
⎢0 1 −3 −2 1 0⎥ We added −2 times the first
⎢ ⎥ row to the second and −1 times
⎣0 −2 5 −1 0 1⎦ the first row to the third.
1 2 3 1 0 0
⎡ ⎤
⎢0 1 −3 −2 1 0⎥ We added 2 times the
⎢ ⎥ second row to the third.
⎣0 0 −1 −5 2 1⎦
1 2 3 1 0 0
⎡ ⎤
⎢0 1 −3 −2 1 0⎥ We multiplied the
⎢ ⎥ third row by −1.
⎣0 0 1 5 −2 −1⎦
November 12, 2018 13:09 C01 Sheet number 59 Page number 59 cyan magenta yellow black © 2018, Anton Textbooks, Inc., All rights rese
1 2 0 −14 6 3
⎡ ⎤
⎢0 1 0 13 −5 −3⎥ We added 3 times the third
⎢ ⎥ row to the second and −3 times
⎣0 0 1 5 −2 −1⎦ the third row to the first.
1 0 0 −40 16 9
⎡ ⎤
⎢0 1 0 13 −5 −3⎥ We added −2 times the
⎢ ⎥ second row to the first.
⎣0 0 1 5 −2 −1⎦
Thus,
−40 16 9
𝐴−1 = [ 13 −5 −3]
5 −2 −1
1 6 4 1 0 0
[ 0 −8 −9 −2 1 0] We added −2 times the first
row to the second and added
0 8 9 1 0 1 the first row to the third.
1 6 4 1 0 0
[ 0 −8 −9 −2 1 0] We added the second
row to the third.
0 0 0 −1 1 1
Since we have obtained a row of zeros on the left side, 𝐴 is not invertible.
Use Theorem 1.5.3 to determine whether the given homogeneous system has nontrivial
solutions.
(a) x 1 + 2x 2 + 3x 3 = 0 (b) x 1 + 6x 2 + 4x 3 = 0
2x 1 + 5x 2 + 3x 3 = 0 2x 1 + 4x 2 − x 3 = 0
x1 + 8x 3 = 0 −x 1 + 2x 2 + 5x 3 = 0
Solution From parts (a) and (b) of Theorem 1.5.3 a homogeneous linear system has only
the trivial solution if and only if its coefficient matrix is invertible. From Examples 4 and 5
the coefficient matrix of system (a) is invertible and that of system (b) is not. Thus, system
(a) has only the trivial solution while system (b) has nontrivial solutions.
November 12, 2018 13:09 C01 Sheet number 60 Page number 60 cyan magenta yellow black © 2018, Anton Textbooks, Inc., All rights rese
In Exercises 19–20, find the inverse of each of the following 4 × 4 32. Prove that if 𝐴 is an invertible matrix and 𝐵 is row equivalent
matrices, where k1 , k2 , k3 , k4 , and k are all nonzero. to 𝐴, then 𝐵 is also invertible.
0 0 0 k1 k 0 0 0
⎡ ⎤ ⎡ ⎤ True-False Exercises
⎢0 0 k2 0⎥ ⎢1 k 0 0⎥
20. a. ⎢ b. ⎢
⎢0 k3 0 0⎥ ⎥ ⎢0 1 k 0⎥⎥
TF. In parts (a)–(g) determine whether the statement is true or
false, and justify your answer.
⎣k4 0 0 0⎦ ⎣0 0 1 k⎦
a. The product of two elementary matrices of the same size
In Exercises 21–22, find all values of c, if any, for which the given must be an elementary matrix.
matrix is invertible.
c c c c 1 0 b. Every elementary matrix is invertible.
21. [1 c c] 22. [1 c 1] c. If 𝐴 and 𝐵 are row equivalent, and if 𝐵 and 𝐶 are row
1 1 c 0 1 c equivalent, then 𝐴 and 𝐶 are row equivalent.
In Exercises 23–26, express the matrix and its inverse as products of d. If 𝐴 is an n × n matrix that is not invertible, then the lin-
elementary matrices. ear system 𝐴x = 0 has infinitely many solutions.
−3 1 1 0
23. [ ] 24. [ ] e. If 𝐴 is an n × n matrix that is not invertible, then the
2 2 −5 2
matrix obtained by interchanging two rows of 𝐴 cannot
1 0 −2 1 1 0 be invertible.
25. [0 4 3] 26. [1 1 1]
f. If 𝐴 is invertible and a multiple of the first row of 𝐴
0 0 1 0 1 1 is added to the second row, then the resulting matrix is
invertible.
In Exercises 27–28, show that the matrices 𝐴 and 𝐵 are row equiv-
alent by finding a sequence of elementary row operations that pro- g. An expression of an invertible matrix 𝐴 as a product of
duces 𝐵 from 𝐴, and then use that result to find a matrix 𝐶 such elementary matrices is unique.
that 𝐶𝐴 = 𝐵.
1 2 3 1 0 5
27. 𝐴 = [1 4 1], 𝐵 = [0 2 −2] Working with Technology
2 1 9 1 1 4 T1. It can be proved that if the partitioned matrix
2 1 0 6 9 4
28. 𝐴 = [−1 1 0], 𝐵 = [−5 −1 0] 𝐴 𝐵
[ ]
3 0 −1 −1 −2 −1 𝐶 𝐷