Lect 5 & 6 Vector & Matrix_Equations, Linear Independence & Transformation
Lect 5 & 6 Vector & Matrix_Equations, Linear Independence & Transformation
2 1
u = , v = ,
1 2
2 1 2 + 1 3
If , u = , v = , then u + v = =
1 2 1 + 2 3
Vector Multiplication
➢A number (scalar) can also be
multiplied to vectors. For example;
c (x1, x2, ..., xn) = (cx1, cx2, ..., cxn).
➢For example, given two vectors in u and real
number c, the scalar multiple of u by c is the
vector cu obtained by multiplying each entry
in u by c.
2 2 10
If u = , c = 5, then cu = 5 =
1 1 5
Examples
Let u = (1, 2), v = (3, 4), w = (5, 6), And
x = (1, 0, -3), y = (2, -1, 5). Then
u + v = (1 + 3, 2 + 4) = (4, 6)
3u = (3×1, 3×2) = (3, 6)
u + v + w = (1 + 3 + 5, 2 + 4 + 6) = (9, 12)
3u - 4v + w = (3×1 - 4×3 + 5, 3×2 - 4×4 + 6) = (-4, -4)
x + y = (1 + 2, 0 - 1, -3 + 5) = (3, -1, 2)
-2x = (-2×1, -2×0, -2×(-3)) = (-2, 0, 6)
-2x + 3y = (-2×1 + 3×2, -2×0 + 3×(-1), -2×(-3) + 3×5) = (4, -3, 21)
❑Moreover, because the dimension of u, v, w is
different from the dimension of x, y, expressions
such as u + x, 2v + 3y are meaningless.
Vectors: Addition & Multiplication (Contd.)
Geometrically, the addition is described by
parallelogram, and the scalar multiplication is the
stretching/shrinking and sometimes reversing (for
negative scalars) of vectors. For example;
Parallelogram Rule for Addition
• Let us look at the addition of two vectors (red and
blue in the picture) in R2. The green vector is
constructed from the parallelogram.
And x1 + 2 x2 7
− 2 x + 5 x = 4
1 2 ---------- (Eq:2)
− 5 x1 + 6 x2 − 3
Now the vectors on left and right sides of Eq:2 are equal, if and only if
their corresponding entries are both equal. That is, x1 & x2 makes the
vector equation 1 true if and only if x1 & x2 satisfy the system
x1 + 2 x2 = 7
− 2 x1 + 5 x2 = 4 ---------- (Eq:3)
− 5 x1 + 6 x2 = −3
Example: 1 (Contd.)
1 2 7
Augmented matrix of the system − 2 5 4
(Eq:3) can be written as
− 5 6 − 3
1 0 3
Now performing Gauss-Jordan elimination 0 1 2
to obtain reduced echelon form
0 0 0
2 - 3 2 − 3 8 − 21 − 13
8 0 4 = 4 8 + 7 0 = 32 + 0 = 32
7
- 5 2 − 5 2 − 20 14 − 6
The Matrix Equation (Ax = b)
➢ Even though the equation Ax = b involves two vectors
as well as a matrix (A), it is referred as matrix equation
to distinguish it from vector equation
➢Thus given a m x n matrix A, with columns
v1,….,vn, and given b in Rm, the matrix equation
Ax = b
has the same solution set as a vector equation
x1v1 + x2v2 + ... + xnvn = b
which in turn has the same solution set as the linear
system whose augmented matrix is
[v1 v2 ….. vn b]
Exercise
Write the following system of linear equations
as (a) vector equation (b) Matrix equation
x1 + 2 x2 − x3 = 4
− 5 x2 + 3 x3 = 1
Now here.
1 2 − 1 4
v1 = , v2 = , v3 = , and b =
0 − 5 3 1
Since Vector equation is : x1v1 + x2v2 + ... + xnvn = b
1 2 − 1 4
x1 + x2 + x3 = - - - -- Eq : 1
0 − 5 3 1
Exercise (Contd.)
Now lets consider three vectors on the left hand side of
Eq:1 as the column of a matrix (A)
1 2 - 1
A=
0 - 5 3
Now using the definition of a matrix times a vector, Eq: 1
can be rewritten in the form Ax = b
x1
1 2 - 1 4
0 - 5 3 x2 = 1
x3
Linear Combination in Matrix & vector
equation from
A x = b
Linear Combination in Matrix & vector
equation from
A x = b
an1 an 2 ann
This matrix can be viewed as an ordered set of column
vectors: A = v1 v2 vn
a11 a12
a a
Where v1 =
21
v2 = , 22
, etc.
an1 an 2
Linear independence: Definition
A set of vectors is linearly dependent, if and only if we
can find a set of scalars (i.e. weights) , x1 , x2 ,, xn (not
all of which are zero) such that
x1v1 + x2 v2
x2 + + xn xn = 0 − − (vector equation of homogenous system)
1 4 2 0 -2R +R 1 4 2 0 -1/3 R 1 4 2 0
2 5 1 0 → 1 2
0 - 3 - 3 0 → 2 0 1 1 0
-3R1+R3
3 6 0 0 0 - 6 - 6 0 6R2+R3 0 0 0 0
Example: 1 (Contd.)
From row echelon form matrix it can be seen that:
1 4 2 0 -4R +R 1 0 -2 0
0 1 1 0 →
2 1
0 1 1 0 Thus x = 2 x & x = -x
1 3 2 3
3 - 3 6 0 1/3 R1 1 - 1 2 0 -1/6 R3 1 - 1 0 0 1 0 0 0
0 2 4 0 → 0 1 2 0 → 0 1 0 0 R2→ +R1
0 1 0 0
1/2 R -2R3+R2
0 3 0 0 2
0 0 - 6 0 0 0 1 0 0 0 1 0
-3R +R2 3 -2R +R
3 1
1 - 2 8 0
0 1 - 2 0 x1, x2 : basic variables
x3: free variable
0 0 0 0
1 1 1/3 0
0 1 2/3 0 x1, x2 , x3 : basic
variables
0 0 1 0
Since, it can be seen from row echelon form that this matrix can be
row reduced to obtain x1=x2=x3=0 i.e. Trivial solution only, implying
given set of vectors {v1, v2, v3} is linearly independent.
Linear independence of Matrix
columns
➢ Suppose that we begin with a matrix A={V1,…,Vn}
instead of a set of vectors as in previous problems.
The matrix equation Ax = 0 can be written as:
x1v1 + x2 x2 + + xn xn = 0 − − (vector equation of homogenous system)
1 2 -1 0
0 1 4 0
x1, x2 , x3 : basic
variables
0 0 1 0
Since, it can be seen from row echelon form that this matrix can be
row reduced to obtain x1=x2=x3=0 i.e. Trivial solution only, implying
columns of A are linearly independent.
Exercise: 1
Determine if the columns (i.e. vectors) of matrix A are linearly
independent
1 3 - 2 0
A = 3 10 - 7 1
Solution
− 5 - 5 3 7
Using row operations on the associated augmented matrix of Ax=0
yields reduced row echelon matrix given below
1 0 0 -2 0
0 1 0 0 0
x1, x2 , x3 : basic
variables
0 0 1 -1 0 x4: free variable
1 -3 5
2
T (u ) = Au = 3 5 = 1
− 1 7 -1
− 9
Example: 1 (Contd.)
b . Find an x in R2 whose image under T is b
1 -3 3
3 5 x1 , = 2
x
− 1 7 2
5
Now using the matrix equation [v1 v2 …vn b] and row
reducing the augmented matrix yields
1 -3 3 The third equation 0 = - 35 implies
0 1 2 system is inconsistent. So, c is not in
0 0 - 35 the range of T
Example: 2
Suppose that T: R5 -> R2, and T(x) = Ax for some matrix
A and each x in R5. How many rows and column does A
have?
➢ Since, the column dimension of the “lead” matrix (A) must be
equal to the row dimension of the “lag” (x) matrix , therefore, A
must have 5 columns for Ax to be defined.
➢A must have 2 rows for the range of T to be in R2
5=5
A x
25 51
Ax
21
Exercise: 1
Let A be a 7 x 5 matrix. What must n and m be in order
to define T: Rn -> Rm, by T(x) = Ax?
➢ Since, the column dimension of the “lead” matrix (A) must be
equal to the row dimension of the “lag” (x) matrix , therefore, x
must have 5 columns for Ax to be defined i.e. n = 5.
➢ Ax will have 7 rows as shown below, so m = 7
5=5
A x
75 51
Ax
71
Exercise:2
3 0
For A = , define a transformation T : R2 → R 2 by T(x) = Ax
0 3
1 - 4
Find the images under T of u = and v =
5 - 1
The transf ormation T : R2 → R 2 by T(x) = Ax, is
3 0 x1 3 x1
T ( x) = Ax = =
0 3 2 2
x 3 x
The vector T(u)= Au is called the image of u under the action f T
The vector T(v)= Av is called the image of v under the action f T
3 0 1 3 3 0 − 4 − 12
T (u ) = Au = = & T (v) = Av = 0 3 − 1 = − 3
0 3 5 15
Exercise:3
With T defined by T(x) = Ax, find an x whoseimage under T is b,
and determine if x is unique.
1 0 - 1 0
Let A = 3 1 - 5 , b = − 5
− 4 2 1 − 6
1 0 - 1 x1 0 Since, A has 3
3 1 - 5 x = − 5 columns, so x
2 must contain 3
- 4 2 1 x3 − 6 rows, for Ax to be
defined
Exercise:3 (Contd.)
Now using the matrix equation [v1 v2 …vn b] and row reducing
the augmented matrix yields reduced echelon form
1 0 -1 0 1 0 0 4 4
3 1 -5 -5 − −− 0 1 0 3 − − x = 3
- 4 2 1 - 6 0 0 1 4 4
x1 Since, A has 3
1 0 3 − 4 columns, so x
- 2 x2 =
1 -3 9 must contain 3
x3 rows, for Ax to be
defined
Exercise:4 (Contd.)
Now using the matrix equation [v1 v2 …vn b] and row reducing
the augmented matrix yields reduced echelon form
− 4 − 3 x3
1 0 3 -4 1 0 3 - 4 1 − 3x
- 2 1 - 3 − −− 0 1 3 1 − − x = 3
9 x3
x3 : free variable, say x3 = 0 = x1 = −4 & x2 = 1
5 x3 − 3 x4
1 3 4 -3 0 1 0 -5 3 0
0 1 3 - 2 0 − −− 0 1 3 -2 0 − x = − 3 x3 + 2 x4
x3
3 7 6 - 5 0 0 0 0 0 0
x 4
1 3 4 -3 1 1 3 4 -3 1
0 1 3 - 2 -1 − − 0 1 3 - 2 -1
3 7 6 -5 7
0 0 0 0 2