BMS COLLEGE OF ENGINEERING, BENGALURU - 560 019

Autonomous institute, Affiliated to VTU

DEPARTMENT OF MATHEMATICS

Course: Linear Algebra and Optimization Course Code: 23MA4BSLAO

Unit 3: Inner Product Spaces
I. Inner product spaces, angle between vectors, Length and Orthogonality:
1. Verify that R n with , defined as the dot product is an inner product space. Also
Expand 5u1 + 8u2 ,6v1 − 7u2 and 2u − 3v .
2

2. If u = (1,3, −4, 2) , v = ( 4, −2, 2,1) and w = ( 5, −1, −2,6) in R4 then verify that
3u − 2v, w = 3 u, w − 2 v, w
3. Let V = M be a vector space of all matrices of size m  n , then prove that A, B = tr ( BT A )
is an inner product.
4. Let V = R 2 be a vector space with u = ( u1 , u2 ) and v = ( v1 , v2 ) . Then prove that
u, v = u1v1 − u1v2 − u2v1 + 4u2v2 is an inner product.
5. Consider u = (1, 2, 4) , v = ( 2, −3,5) , w = ( 4, 2, −3) in R 3 , find u.v , u.w , v.w , ( u + v ) .w ,
u and v .

6. Consider f ( t ) = 3t − 5 , g ( t ) = t 2 in P ( t ) then the inner product is defined as

1
p, q =  p ( t ) q ( t ) dt . Find f , g , f and g .
0

7. Consider f ( t ) = t + 2 , g ( t ) = 3t − 2 and h ( t ) = t 2 − 2t − 3 in P ( t ) with the inner product

1
defined as p, q =  p ( t ) q ( t ) dt . Find f , g , f , h , f and g . Normalize f and g .
0

8. If u = (1,3, −4, 2) , v = ( 4, −2, 2,1) in R 4 then prove the following:

a) triangular inequality: u + v  u + v ,
 u , u v, v or u, v  u v .
2
b) Schwartz inequality: u , v

c) Parallelogram law: u + v + u − v = 2 u + v
2 2
( 2 2
)
9. Find the angle between the vectors
a) u ( 2,3,5) and v = (1, −4,3) in R 3 w.r.t the usual inner product.
b) u = (1,3, −5, 4) and v = ( 2, −3, 4,1) in R 4 .
9 8 7  1 2 3
c) A=  and B =   where A, B = Tr B A .
T
( )
 6 5 4   4 5 6 
1
d) f ( t ) = 3t − 5 and g ( t ) = t 2 in P ( t ) with p, q =  p ( t ) q ( t ) dt .
0

10. Check whether f ( t ) = sin (t ) and g ( t ) = cos ( t ) in C  a, b with f , g =  f ( t ) g (t ) dt
−

are orthogonal.

Dept. of Mathematics, BMSCE Page 1

 Linear Algebra and Optimization(23MA4BSLAO) Unit 3: Inner Product Spaces

1 2 1  1 2
11. Consider a matrix A =  2 5 4  and the vectors u =   and v =  2  . The inner product
1 4 6   1   3 
u, v = uT Av . Find the value of  if it is known that the vectors u and v are orthogonal
and hence find the length of u .
12. Find a nonzero vector that is orthogonal to (1, 2,1) and ( 2,5, 4 ) in R 3 .
II. Orthogonal complements and orthogonal basis:
1. Let W be a subspace of R 5 spanned by u = (1, 2,3, −1, 2) and v = ( 2, 4,7, 2, −1) . Find a
basis of W ⊥.
2. Find a basis of W of R 4 orthogonal to u1 = (1, −2,3, 4) and u2 = ( 3, −5,7,8) .

3. Find an orthogonal basis for w ⊥ where w = (1, 2,3,1) .

4. Find an orthogonal basis for w ⊥ where w = (1, −2, −1,3) .

5. Show that S = u1 = (1,1,0, −1) , u2 = (1, 2,1,3) , u3 = (1,1, −9, 2) , u4 = (16, −13,1,3) is
orthogonal and a basis of R 4 . Find the coordinates of the arbitrary vector v = ( a, b, c, d ) in
R 4 relative the basis S .
6. Show that S = u1 = (1,1,1,1) , u2 = (1,1, −1, −1) , u3 = (1, −1,1, −1) , u4 = (1, −1, −1,1) is
orthogonal and a basis of R 4 . Express v = (1,3, −5,6) as a linear combination of the vectors
of S . Find the coordinates of the arbitrary vector v = ( a, b, c, d ) in R 4 relative the basis S .
1
7. P2 ( t ) is the vector space of polynomials of degree  2 with f , g =  f ( t ) g ( t ) dt . Find a
0

basis of the subspace W orthogonal to h ( t ) = 2t + 1 .

III. Projections.
1. Find the projection of the vector v along w or W = span ( wi ) :
a) v = (1, −2,3, 4) along w = (1, 2,1, 2) in R 4 .
b) v = (1,3,1, 2) along w = (1, −2,7, 4) in R 4 .
c) v = (1, 2,3, 4,6) along W = span(1, 2,1, 2,1) , (1, −1, 2, −1,1) in R 5 .
d) v = (1,3,5,7 ) along W = span (1,1,1,1) , (1, −3, 4, −2) in R 4 .
1
e) v = t along w = t + 3 in P ( t ) with f , g =  f ( t ) g ( t ) dt .
2

1 2  1 1 
v= along w =   in M 22 with A, B = tr ( B A ) .
T
f) 
 3 4   5 5 
IV. Gram-Schmidt orthogonalization:
1. Find an orthogonal basis and hence an orthonormal basis of the subspace W spanned by
the following vectors
a) v1 = (1,1,1,1) , v2 = (1, 2, 4,5) and v3 = (1, − 3, − 4, − 2) of R 4 .
b) v1 = (1,1,1,1) , v2 = (1,1, 2, 4) and v3 = (1, 2, − 4, − 3) of R 4 .

Dept. of Mathematics, BMSCE Page 2

 Linear Algebra and Optimization(23MA4BSLAO) Unit 3: Inner Product Spaces

c) v1 = (1,1,1,1) , v2 = (1, −1, 2, 2) and v3 = (1, 2, − 3, − 4) of R 4 .

S = 1, t , t 2  of P2 ( t ) given f , g =  f ( t ) g ( t ) dt .
1
d)
0
1

e) S = 1, t , t , t
2 3
 of P ( t ) given
3 f,g =  f ( t ) g ( t ) dt .
−1

1 2 2
2. Find an orthogonal matrix P whose first row is u1 =  , ,  .
3 3 3
3. Find an orthogonal matrix P whose first two rows are linear combination of u1 = (1,1,1)
and u2 = (1, −2,3) .
V. QR factorization:
1. Obtain the QR factorization of the following matrices:
1 −1 −1  1 0 −1
1 0 0 
d) A =  2 −3 3  .
a) A=  .
1 −1 0   −1 2 4 
 
0 1 −1 1 2
 2 −1 e) A =  −1 −2  .
b) A =  −1 3  .  1 1 
 0 1 

 1 0 2
c) A =  −1 2 0  .
 −1 −2 2 

2 3 7 
2. Solve the system of equations AX = B where A =  2 4  and B =  3  by QR
 
 1 1  1 
factorization method.
 3 −2  2 
 2 −3   −1
   
3. Solve the system of equations AX = B where A =  1 −1 and B = 0  by QR
   
2 3  1 
 3 4  0 
factorization method.
VI. Least square method:
1. Solve the following system of equations AX = b by the method of least squares and hence
find the least square error:
2 1 3 
1 0 1 
a) A=   and b =   .
 0 −1 2 
   
 −1 1   −1

Dept. of Mathematics, BMSCE Page 3

Linear Algebra and Optimization(23MA4BSLAO) Unit 3: Inner Product Spaces

 3 −2  2 
 2 −3   −1
    done another of C sec
b) A =  1 −1 and b =  0  .
   
2 3  1 
 3 4   0 

2. In an experiment designed to determine the extent of a person’s natural orientation, a

subject is put in a special room and kept there for a certain length of time. He is then asked
to find a way of a maze and record is made of the time it takes the subject to accomplish
this task. The following data are obtained.
Time in Room (hours) 1 2 3 4 5 6
Time to find Way out of maze(minutes) 0.8 2.1 2.6 2.0 3.1 3.3

Let x denote the number of hours in the room and let y denote the number of minutes that
it takes the subject to find his way out.
a. Find the least squares line of the form y = a + bx .
b. Use the equation obtained in (a) to estimate the time it will take the subject to find his
way out of the maze after 10 hours in the room.
3. Find the least squares line of the form y = a + bx for the data ( 0, −1) , (1,3) , ( 2,5) and
( 3, 7 ) .
4. A steel producer gathers the following data.
Year 1997 1998 1999 2000 2001 2002
Annual Sales (millions of dollars) 1.2 2.3 3.2 3.6 3.8 5.1

Represent the years 1997,…2002 as 0,1,2,3,4,5 respectively and let x denote the year. Let y
denote the annual sales (in millions of dollars).
a. Find the least squares line of the form y = ax + b .
b. Use the equation obtained in (a) to estimate the annual sales for the year 2006.
5. A sales organisation obtains the following data relating the number of salespersons to
annual sales.
Number of salespersons 5 6 7 8 9 10
Annual Sales (millions of dollars) 2.3 3.2 4.1 5.0 6.1 7.2

Let x denote the number of salespersons and let y denote the annual sales (in millions of
dollars).
a. Find the least squares line of the form y = a + bx .
b. Use the equation in (a) to estimate the annual sales when there are 14 salespersons.
6. Find the least square parabola of the form y = a + bx + cx2 for the data (1, 1), (2, 4), (3, 7)
and (4, 5).
7. Find the least square parabola of the form y = a + bx + cx2 for the data (1, 1), (2, 1), (3, 2)
and (4, 5).

Dept. of Mathematics, BMSCE Page 4