MAT523 Chapter 3.1 - Vector Space
MAT523 Chapter 3.1 - Vector Space
Definition: u
v w
Let V be an arbitrary nonempty set of vectors on which two
properties are defined: addition and multiplication by scalars.
x y
Subspace V
u w
W
v
x
y
Linear Combination V
x z
𝐰∈𝑉
y
W
w u
t v
i) x = 2u − v + t
= 2 1,2, −1 − 0, −4,5 + −3,1,4
iii) Is 𝐳 = −2,7, −2 a linear combination of u, t and v u = (1,2, −1)
x = (−1,9, −3) 𝐳 = 𝑐1 𝐮 + 𝑐2 𝐯 + 𝑐3 𝐭 v = (0, −4,5)
−2,7, −2 = c1 1,2, −1 + c2 0, −4,5 + c3 −3,1,4 t = (−3,1,4)
1
ii) y = u + v − 2t
3 −2 = 𝑐1 + 0 − 3𝑐3 1 0 0 1 𝑐1 = 1, 𝑐2 = −1, 𝑐3 = 1
1 1 0 −3 −2
= (1,2, −1) + (0, −4,5) − 2 ( −3,1,4 )
𝑅𝑅𝐸𝐹
7 = 2𝑐1 − 4𝑐2 + 𝑐3 2 −4 1 7 0 1 0 −1
3 −1 5 4 −2 0 0 1 1 𝐳=𝐮−𝐯+𝐭
8 26 −2 = −𝑐1 + 5𝑐2 + 4𝑐3
y = (7, , )
3 3 Therefore, 𝐳 is a linear combination of u, v and t
Dr Normi Abdul Hadi (Sept 2019)
Spanning V
S x z
𝑊 𝑆
y
𝑊 𝑊, 𝑊 spans 𝑆
W
u A
𝑆 = span 𝑊 = span 𝑣1 , 𝑣2 , … , 𝑣𝑛
If 𝑆 = 𝑉, then 𝑊 spans 𝑉
t v
Determine whether the vectors 𝐭 = 1,1,2 , 𝐮 = 1,0,1 , 𝐯 = 2,1,3 span the vector space R3
Solution: 𝒘 = 𝑐1 𝐭 + 𝑐2 𝐮 + 𝑐3 𝐯
1 1 2 𝑎 1 1 2 𝑎
In matrix form: 𝑅𝐸𝐹 Why vector A
1 0 1อ 𝑏 0 1 1อ 𝑎 − 𝑏
is not in the set S?
2 1 3 𝑐 0 0 0 𝑐−𝑎−𝑏
The system is inconsistent, thus 𝑐1 , 𝑐2 and 𝑐3 do not exist. Therefore, 𝐭, 𝐮 and 𝐯 do not span 𝑅 3 .
But 𝐭, 𝐮 and 𝐯 span 𝑅 3 if 𝑐 − 𝑎 − 𝑏 = 0 so that the system becomes consistent.
Dr Normi Abdul Hadi (Sept 2019)
Linear Independence V
S x z
𝑊 𝑊 y
W
u A
𝑊 t v
Determine whether the vectors 𝐭 = 1, −2,3 , 𝐮 = 5,6, −1 , 𝐯 = 3,2,1 are linearly independent in R3
Can any vector in W be expressed as
Solution: 𝟎 = 𝑐1 𝒗1 + 𝑐2 𝒗2 + 𝑐3 𝒗3 a linear combination of others?
0,0,0 = 𝑐1 1, −2,3 + 𝑐2 5,6, −1 + 𝑐3 3,2,1 𝐭 = 𝑐1 𝐮 + 𝑐2 𝐯 𝐮 = 𝑐1 𝐭 + 𝑐2 𝐯
1 5 3 0 1 5 3 0 𝐯 = 𝑐1 𝐭 + 𝑐2 𝐮
In matrix form: 𝑅𝐸𝐹
0 1 12 ቮ 0
−2 6 2อ 0
−1 1 0 What can you
3 0 0 0 0 say about 𝐴 ?
The system is consistent but has many solution. Therefore, 𝒗𝟏 , 𝒗𝟐 and 𝒗𝟑 are not linearly independent.
The vectors are linearly independent iff 𝑐1 = 0, 𝑐2 = 0 and 𝑐3 = 0.
Dr Normi Abdul Hadi (Sept 2019)
x y
S
𝒗 𝟏 𝒗𝟐
𝒗𝒓
Linearly Independent Spans
r<n NO
Gauss or Gauss-Jordan
r>n NO
YES if LI
r=n Determinant
YES if Spans A ¹0
Wronskian for Linear Independence
Definition of Wronskian:
If 𝐟1 = 𝑓1 𝑥 , 𝐟2 = 𝑓2 𝑥 , … , 𝐟n = 𝑓𝑛 (𝑥) are functions that are 𝑛 − 1 times differentiable on the intervals (−∞, ∞),
then the determinant
𝑓1 (𝑥) 𝑓2 𝑥 ⋯ 𝑓𝑛 (𝑥)
𝑓1 ′(𝑥) 𝑓2 ′ 𝑥 ⋯ 𝑓𝑛 ′ 𝑥
𝐖 𝑥 =
⋮ ⋮ ⋮
𝑛−1 𝑛−1 𝑛−1
𝑓1 𝑥 𝑓2 𝑥 ⋯ 𝑓𝑛 𝑥
Theorem:
𝐟𝟏 𝐟𝟐 𝑥 sin 𝑥
The Wronskian is, 𝑊 𝑥 = =
𝐟𝟏 ′ 𝐟𝟐 ′ 1 cos 𝑥
= 𝑥 cos 𝑥 − sin 𝑥
𝑥 = 𝜋. Then, 𝑊 𝜋 = 𝜋 −1 − 0 = −𝜋
𝑊(𝑥) ≠ 0
𝑓1 𝑥 𝑓2 𝑥 𝑓3 𝑥
′ 1 𝑒𝑥 𝑒 2𝑥
The Wronskian is, 𝐖 𝑥 = 𝑓1 𝑥 𝑓2′ 𝑥 𝑓3′ 𝑥 = 0 𝑒𝑥 2𝑒 2𝑥 = 2𝑒 3𝑥 Revision: Matrix Determinant
𝑓1 ′′ 𝑥 𝑓2 ′′ 𝑥 𝑓3 ′′ 𝑥 0 𝑒𝑥 4𝑒 2𝑥
𝑊(𝑥) ≠ 0
Basis V
y
x
S
𝒗 𝟏 𝒗𝟐
𝒗𝒏
Example: Show that the vectors 𝐯𝟏 = 1,2,1 , 𝐯𝟐 = 2,9,0 , 𝐯𝟑 = 3,3,4 form a basis for 𝑅3
Solution:
1 2 3
In matrix form: 𝐴 = 2 9 3 and 𝐴 = −1 ≠ 0
1 0 4
Since 𝐴 ≠ 0, the set S has linearly independent vectors (𝒗𝟏 , 𝒗𝟐 , … 𝒗𝒏 ), What can you
and spans vector space, V=𝑅3 . say about 𝐴 ?
Basis = 𝒗𝟏 , 𝒗𝟐 , 𝒗𝟓 or 𝒗𝟏 , 𝒗𝟑 , 𝒗𝟓 or 𝒗𝟏 , 𝒗𝟒 , 𝒗𝟓
Why W cannot
Vectors to be removed = 𝒗𝟐 , 𝒗𝟑 , 𝒗𝟔 or 𝒗𝟑 , 𝒗𝟒 , 𝒗𝟔 or 𝒗𝟐 , 𝒗𝟒 , 𝒗𝟔 form a basis?
Dr Normi Abdul Hadi (Sept 2019)
(i) Can W be a basis for 𝑃2 ? No since number of vectors is 4, greater than the dim(𝑃2)=3. The vectors are linearly dependent.
(ii) Determine the vector(s) in W that can be removed so that the new set can be a basis in 𝑃2 .
SOLUTION
Arrange the vectors in columns.
Basis = 𝐯𝟏 , 𝐯𝟐 , 𝐯𝟑 = 𝑥 2 − 𝑥 + 1, 2𝑥 2 + 3, −𝑥 2 + 2𝑥 + 1
𝐯𝟏 𝐯𝟐 𝐯𝟑 𝐯𝟒 𝐯𝟏 𝐯𝟐 𝐯𝟑 𝐯𝟒
1 2 −1 0 or 𝐯𝟏 , 𝐯𝟐 , 𝐯𝟒 = 𝑥 2 − 𝑥 + 1, 2𝑥 2 + 3, 3𝑥 + 2
𝒙𝟐 1 2 −1 0
𝑅𝐸𝐹
𝐴 = 𝒙𝟏 −1 0 2 −3 0 1 0 2
𝒙𝟎 1 3 1 2 0 0 1 −7
Removed 𝐯𝟒 = 3𝑥 + 2
First leading 1: column 1 (𝐯𝟏 ) or 𝐯𝟑 = −𝑥 2 + 2𝑥 + 1
Second leading 1: column 2(𝐯𝟐 )
Third leading 1: column 3(𝐯𝟑 ) or 4(𝐯𝟒 )
Dr Normi Abdul Hadi (Sept 2019)
(i) Can W be a basis for 𝑀2×2 ? No since number of vectors is 5, greater than the dim(𝑀2×2)=4. The vectors are linearly dependent.
(ii) Determine the vector(s) in W that can be removed so that the new set can be a basis in 𝑀2×2 .
SOLUTION
Arrange the vectors in columns.
𝐯𝟏 𝐯𝟐 𝐯𝟑 𝐯𝟒 𝐯𝟓 Basis = 𝒗𝟏 , 𝒗𝟐 , 𝒗𝟑 , 𝒗𝟒
𝐯𝟏 𝐯𝟐 𝐯𝟑 𝐯𝟒 𝐯𝟓
1 −1 −1 0 0 2 2 1
1 −1 0 2 0 = , , ,
1 −1 0 2 0 𝑅𝐸𝐹
2 0 1 1 −2 −1 −1 0
−1 0 2 1 0 0 1 −2 −3 0 or 𝒗𝟏 , 𝒗𝟐 , 𝒗𝟑 , 𝒗𝟓
𝐴= 0 0 1 3 −2
2 1 −2 −1 1 1 −1 −1 0 0 2 0 0
0 0 0 1 9 = , , ,
0 1 −1 0 −2 −8 2 0 1 1 −2 −1 1 −2
V
Basis (Plus Theorem) Standard basis Span(S)
y
𝒘 𝟏 𝒘𝟐 x
PROCEDURE 𝑆 ∪ 𝐯 𝒘𝒏 z
1. Arrange the vectors in a matrix, A S
- 1 vector is for 1 column 𝒗𝟏 𝒗 𝟐
𝐯 𝒗𝒓
2. Arrange the standard basis on the right hand side of A,
𝐴 standard basis
3. Reduce the system in (2) to a Row Echelon Form
4. Rows (in A) without leading 1 need leading 1 from the standard basis from the same row.
5. On the respected row, choose the column (from standard basis) with a non-zero element and
has zero element below it.
𝐯𝟏 𝐯𝟐 𝐰𝟏 𝐰𝟐 𝐰𝟑
𝐯𝟏 𝐯𝟐 𝐯𝟏 𝐯𝟐 𝐰𝟏 𝐰𝟐 𝐰𝟑 Leading 1
1 0 1 0 1 0 0 1 0 1 0 0
𝑅𝐸𝐹
𝐴= 0 1 0 1อ 0 1 0 0 1อ 0 1 0 Row without Leading 1
1 1 1 1 0 0 1 0 0 −1 −1 1
Non-zero element for row without leading 1
Dr Normi Abdul Hadi (Sept 2019)
Although 𝑅𝑛 , 𝑃𝑛 and 𝑀𝑚×𝑛 have different form, but in matrix the vectors have the same arrangement as identity:
1 0 0
Example of standard basis in 3×3 matrix = 0 1 0
0 0 1
Dr Normi Abdul Hadi (Sept 2019)
SOLUTION 𝒗𝟏 𝒗𝟐
Arrange the vectors in columns. 1 0
𝐴= 0 1 The 3rd row in A does not have leading 1, therefore it needs
1 1 leading 1 from the 3rd row standard basis.
Since the dim(𝑅3 )=3 , we need three standard basis : 𝒘𝟏 = 1,0,0 , 𝒘𝟐 = 0,10 and There are three non-zero elements in the 3rd row in the standard
1 0 0 basis (in blue circles) : 1st column, 2nd column and 3rd column,
𝒘𝟑 = 0,0,1 which form a matrix 0 1 0 but the set W need only 1 vector to be a basis in 𝑅3 (dim = 3).
0 0 1 𝒗𝟏 𝒗𝟐 𝒘𝟏 𝒘𝟐 𝒘𝟑
1 0 1 0 0 Therefore a vector to be added to W to be a basis is
Add the standard basis on the right hand side of A. 0 1อ 0 1 0 - the vector for 1st column which is 𝒘𝟏 OR
1 1 0 0 1 - the vector for 2nd column which is 𝒘𝟐 OR
- the vector for the 3rd column which is 𝒘𝟑 .
Reduce the system to a row echelon form
1 0 0
1 0 1 0 0 1 0 1 0 0 Added vector = 𝒘𝟏 or 𝒘𝟐 or 𝒘𝟑 = 0 or 1 or 0
𝑅𝐸𝐹 0 0 1
0 1อ 0 1 0 0 1อ 0 1 0
Tips: after the addition, 𝑊 ≠ 0
1 1 0 0 1 0 0 −1 −1 1
which confirms that W forms a basis in 𝑅 3
Dr Normi Abdul Hadi (Sept 2019)
SOLUTION 𝒗𝟏 𝒗𝟐
0 1 𝒙𝟐
Arrange the vectors in columns.
𝐴= 1 0 𝒙𝟏 The 3rd row in A does not have leading 1, therefore it needs
1 0 𝒙𝟎 leading 1 from the 3rd row standard basis.
Since the dim(𝑃2 )=3 , we need three standard basis : 𝒘𝟏 = 𝑥 2 , 𝒘𝟐 = 𝑥 and 𝒘𝟑 = 1 There are two non-zero elements in the 3rd row in the standard
1 0 0 basis (in blue circles) : 2nd column and 3rd column,
which form a matrix 0 1 0 but the set W need only 1 vector to be a basis in 𝑃2 (dim = 3).
0 0 1 𝒗𝟏 𝒗𝟐 𝒘𝟏 𝒘𝟐 𝒘𝟑
0 1 1 0 0 𝒙𝟐 Therefore a vector to be added to W to be a basis is
Add the standard basis on the right hand side of A. 1 0อ 0 1 0 𝒙𝟏 - the vector for 2nd column which is 𝒘𝟐 OR
1 0 0 0 1 𝒙𝟎 - the vector for the 3rd column which is 𝒘𝟑 .
The number of vectors is 3, less than the dim(𝑀2×2) = 4. The set does not span 𝑀2×2.
SOLUTION
𝒗𝟏 𝒗𝟐 𝒗𝟑
2 1 3
Arrange the vectors in columns. 0 −1 −2 Add the standard basis on the right hand side of A.
𝐴=
0 −1 −2 𝒗𝟏 𝒗𝟐 𝒗𝟑 𝒘𝟏 𝒘𝟐 𝒘𝟑 𝒘𝟒
−6 −3 −9
2 1 3 1 0 0 0
0 −1 −2 0 1 0 0
ተ
Since the dim(𝑀2×2)=4 , we need four standard basis : 0 −1 −2 0 0 1 0
1 0 0 0 −6 −3 −9 0 0 0 1
1 0 0 1 0 0 0 0
𝑤1 = , w2 = , w3 = , w4 = 0 1 0 0
0 0 0 0 1 0 0 1 which form a matrix
0 0 1 0
0 0 0 1
Basis (Plus Theorem – Example 3/part 2)
Reduce the system to a row echelon form ADDED VECTOR
𝒗𝟏 𝒗𝟐 𝒗𝟑 𝒘𝟏 𝒘𝟐 𝒘𝟑 𝒘𝟒
1 3 1 The 3rd and 4th rows in A does not have leading 1, therefore it needs
2 1 3 1 0 0 0 1 2 2 2
0 0 0
𝑅𝐸𝐹 leading 1 from the 3rd and 4th row in the standard basis.
0 −1 −2 0 1 0 0 0 1 2 0 −1 0 0
ተ
0 −1 −2 0 0 1 0 0 0 0 0 −1 1 0 There are two non-zero elements in the 3rd row (with zero elements below
−6 −3 −9 0 0 0 1 0 0 0 3 0 0 1 it) in the standard basis (in blue circles) : 2nd column and 3rd column
And also there are two non-zero elements in the 4th row in the standard
REMOVED VECTOR basis (in green circles) : 1st column and 4th column
𝑃2
𝑃2
𝑃2
SOLUTION
−1 −2 3 5 1 Standard basis w1 = 1, 𝑤2 = 𝑥, 𝑤3 = 𝑥 2
Arrange the vectors in columns. 𝐴= 0 −5 7 11 −1
2 −1 1 1 −3
𝒗𝟏 𝒗𝟐 𝒗𝟑 𝒗𝟒 𝒗𝟓 𝒘𝟏 𝒘𝟐 𝒘𝟑
−1 −2 3 5 1 1 0 0
Add the standard basis on the right hand side of A.
0 −5 7 11 −1อ 0 1 0
2 −1 1 1 −3 0 0 1
Basis (Plus Theorem – Example 4/part 2)
Reduce the system to a row echelon form
𝐯𝟏 𝐯𝟐 𝐯𝟑 𝐯𝟒 𝐯𝟓 𝐰𝟏 𝐰𝟐 𝐰𝟑
−1 −2 3 5 1 1 0 0
𝑅𝑅𝐸𝐹
0 −5 7 11 −1อ 0 1 0
2 −1 1 1 −3 0 0 1
REMOVED VECTOR
ADDED VECTOR