UE22MA241B LINEAR ALGEBRA AND ITS APPLICATIONS

.Unit 3: Orthogonalization, Eigen Values and Eigen Vectors

Orthogonal Vectors and Subspaces, Orthogonal Bases, Cosines and Projections onto Lines,
Projections and Least Squares. Orthogonalization -The Gram-Schmidt Orthogonalization,
Introduction to Eigenvalues and Eigenvectors, Properties of Eigenvalues and Eigenvectors,
Cayley-Hamilton theorem(Statement only), Applications.

Class Portions to be covered

No.
37-38 Rotations, Reflections and Projections
39-40 Orthogonal Vectors and Subspaces, Orthogonal Bases
41-42 Cosines and Projections onto Lines, Projections and Least Squares
43-44 Matlab Class Number 5,6 –Span of Column space & Four
fundamental Subspaces of A
45-46 Orthogonalization - Orthogonal Matrices, Properties, Rectangular
Matrices with orthonormal columns
47-48 The Gram- Schmidt Orthogonalization, A = QR Factorization
49-50 Introduction to Eigen values and Eigenvectors
51-52 Properties of eigenvalues and eigenvectors, Cayley-Hamilton
theorem(Statement only)
53 Matlab Class Number 7-The Gram- Schmidt process, A=QR
Factorization
54 Applications

Classwork problems:

1. Find the image of these points after applying the transformation given:
(i)Rotate (-1,3) counter clockwise through 30o line.
(ii)Reflect (2,3) across 90o line and then project on x-axis.
−3−√3 −1+3√3
Answer: (i) ( , ) (ii) (-2,0)
2 2
2. (i) Find the lengths, inner product & cosine of the angle between
u=(1,2,-1,3) , v=(0,0,-1,-2).
(ii) Produce all vectors in ℝ3 that are orthogonal to both
u=(1,2,1), v=(1.-1,1). Produce an orthonormal basis from these
mutually orthogonal vectors.
−1
Answer: (i)-5, (ii) (1,0,-1)
√3
3. If S is the subspace of R4 containing only the zero vector, what is 𝑆 ⊥ ? If
S is spanned by (1,1,1,1), what is 𝑆 ⊥ ? If S is spanned by (2,0,0,0),
(0,4,0, 0)and (0,0,0,3), what is 𝑆 ⊥ ?
Answer: R4; {(-1,1,0,0), (-1,0,1,0), (-1,0,0,1)}; {(0,0,1,0)}
4. Let P be the plane in ℝ3 with equation x-2y+3z =0. What is the basis for
𝑃⊥ ? what matrix has the plane P as its null space?
Answer: Basis for 𝑃⊥ ={(1,-2,3)}, A.
5. What point on the plane x+y-z=0 is closest to b=(2,1,0)?
Answer: (1,0,1)
6. Find the projection of w=(0,1,0,-1) onto the column space of V spanned
by v1=(1,1,0,1), v2=(0,0,1,0) .Which space does p belong to? Find a basis
of the orthogonal complement 𝑉 ⊥ of V. Find the projection matrix from
w onto V and also the vector in V closest to the vector w in 𝑉 ⊥ . Split
the vector w=v+u such that v is in C(VT) and u is a vector in N(V).
Answer: p=(0,0,0,0), {(-,1,1,0,0), (-1,0,0,1)}
7. Find the matrix P that projects every point in ℝ3 onto the line of
intersection of the planes x-2y+3z=0 and y-z=0. What are the column
space and row space of this matrix.
Answer: C(P) and C(PT) is a line in R3.
8. Let A=[3 1 -1] and let V be the nullspace of A. Find (i)a basis for V
and a basis for 𝑉 ⊥ (ii)a projection matrix P1 onto 𝑉 ⊥ (iii)the projection
matrix P2 onto V.
Answer: {(-1,3,0), (1,0,3)}; {(3,1,-1)}
9. Find ‖𝐸‖ = ‖𝐴𝑥 − 𝑏‖2 and solve the normal equations
𝐴𝑇 𝐴𝑥̂ = 𝐴𝑇 𝑏. Find the solution 𝑥̂ and the projection 𝑝.
2 1 3
1 0 1
𝐴=( ) 𝑏=( )
0 -1 2
-1 1 -1
Answer: x=(1/17)(24,-8)
10. Let S be the 2-dimensional subspace of R3 with orthonormal basis
2 −1 −2 1 1
{v1 = ( , , ) , v2 = ( , 0, )} and let v=(2,1,3). Write v as v=u+w
3 3 3 √2 √2
with w in S and u in 𝑺⊥ .
1 2 1 11 1 19
Answer: 𝑢 = ( , , ) 𝑢 = ( , , )
6 3 6 6 3 6
11. 3 1 1
√11 √11 √11
If 𝑄 = ( -1 2 1) find a third row so that the matrix 𝑄𝑇 is
√6 √6 √6
-- -- --
orthogonal.
−1 −4 7
Answer : ( 66 , , )
√ √66 √66
12. Find an orthonormal set q1, q2, q3 for which q1 and q2 span the column space
of
2 4
𝐴 = (-5 -1)
1 2
Which fundamental subspace contains q3 ? What is the least squares
solution of Ax = b if b = ( 10, 3, 5 ) ? Also find A = QR factorization.
2 −5 1 2 1 1
Answer : q2 = ( 30 , 30 , 30) q3 = ( 6 , 6 , 6) . x = ( 1, 2)
√ √ √ √ √ √
13. Use the Gram – Schmidt process to find a set of orthonormal vectors from
the independent vectors a1 = ( 1, 1, 1, 1 ) , a2 = ( 1, 1, 2, 4 ) and
a3 = ( 1, 2, -4, -3).
1 1 1 1 −1 −1 2 1 3
Answer : ( , , , ),( , , 0, ),(2 , 2 , −3, 1 )
2 2 2 2 √6 √6 √6
14. Find the eigen values and eigen vectors of the following matrices:
2 1 2 0 -1 0 1 2 2
(2 2 -2 ) (1 0 0) (1 2 -1)
3 1 1 0 1 0 -1 1 4
Answer : (i)-1,2,4 (ii) 0,i,-I (iii)1,3
15. Obtain the characteristic equation and hence find the inverse of
1 1 2
A = (0 3 2) using Cayley-Hamilton theorem.
1 3 9
16. A person’s natural orientation is tested for which a subject is put in a
special room and kept there for a certain length of time. He is then asked
to find a way out of maze from this recorded data :
Time in Room 1 2 3 4 5 6
(hours):
Time to find way out 0.8 2.1 2.6 2.0 3.1 3.3
of maze(minutes):
Then (a)find the least squares line relating x and y.(b)hence estimate the
time it will take the subject to find his way out of the maze after 10
hours in the room.
Answer : (a)y=0.426x+0.827; (b)5.087 hours.