Lec. 05- Vector Spaces
Lec. 05- Vector Spaces
Linear Algebra
Dr. Muhammad Saad
Chapter 3
Vector Spaces
Lecture 5
Muhammad Saad
EUCLIDIAN VECTOR SPACES
Vectors in the 𝒙𝒚-plane ℝ𝟐
𝑥1
The vector 𝒙 = 𝑥 ∈ ℝ2 is represented
2
Muhammad Saad
graphically by drawing an arrow from
the point (0,0) to 𝑥1 , 𝑥2 .
Muhammad Saad
𝑥3
graphically by drawing an arrow from
the point (0,0,0) to 𝑥1 , 𝑥2 , 𝑥3 .
Muhammad Saad
EUCLIDIAN VECTOR SPACES
Now, we can extend the pervious idea and we can define
the 𝑛-dimentional Euclidean space ℝ𝑛 as follows.
Vectors in the Space ℝ𝒏
Muhammad Saad
𝑥1
𝑥2
ℝ is the set of all vectors of the form
𝑛 , where 𝑥1 ,
⋮
𝑥𝑛
𝑥2 ,…, 𝑥𝑛 are real numbers called the components of the
vector. I.e.
𝑥1
Muhammad Saad
𝑛 𝑥2
ℝ = 𝑥1 , 𝑥2 , … , 𝑥𝑛 ∈ ℝ
⋮
𝑥𝑛
Muhammad Saad
EUCLIDIAN VECTOR SPACES
Vector Operations
There are two vector operations called addition and
scalar multiplication.
Muhammad Saad
𝑎1 𝑏1
𝑎2 𝑏2
Consider two vectors 𝐴 = ⋮ and 𝐵 = in ℝ𝑛 . The
⋮
𝑎𝑛 𝑏𝑛
addition of 𝐴 and 𝐵 is defined as:
𝑎1 + 𝑏1
Muhammad Saad
𝑎2 + 𝑏2
𝐴+𝐵 = .
⋮
𝑎𝑛 + 𝑏𝑛
Muhammad Saad
EUCLIDIAN VECTOR SPACES
Vector Operations
If 𝑘 is a scalar, we define the scaler multiplication of 𝐴
by 𝑘 is defined as:
Muhammad Saad
𝑘𝑎1
𝑘𝑎2
𝑘𝐴 =
⋮
𝑘𝑎𝑛
The vector 𝑘𝐴 represents a vector
in the same direction as 𝐴,
but its length is 𝑘 times
Muhammad Saad
the length of 𝐴.
Muhammad Saad
EUCLIDIAN VECTOR SPACES
𝟏 𝟒
𝟑 𝟓
Problem 01: Consider the vectors 𝑨 = and 𝑩 = in
𝟓 −𝟏
𝟎 𝟑
Muhammad Saad
ℝ . Evaluate 𝑨 + 𝑩, 𝟓𝑨 , – 𝑩 , and 𝟐𝑨 − 𝟑𝑩.
𝟒
Solution
5 5 −4
8 15 −5
𝐴+𝐵 = , 5𝐴 = , −𝐵 =
4 25 1
3 0 −3
Muhammad Saad
4 −12 −8
6 −15 −9
2𝐴 − 3𝐵 = + =
10 3 13
0 −9 −9
Muhammad Saad
VECTOR SPACES
A vector space (or linear space) 𝑉 is a nonempty set of
objects, called vectors defined on it two operations,
called addition and scalar multiplication such that for
Muhammad Saad
every 𝐮, 𝐯, 𝐰 ∈ 𝑉 and scalars 𝛼 and 𝛽, the following
axioms are satisfied:
1. 𝐮 + 𝐯 ∈ 𝑉 (Closed Addition)
2. 𝛼𝐮 ∈ 𝑉 (Closed Multiplication)
3. 𝐮 + 𝐯 = 𝐯 + 𝐮. (Commutative Law)
4. 𝐮 + 𝐯 + 𝐰 = 𝐮 + 𝐯 + 𝐰 (Associative Law)
Muhammad Saad
5. There exists a vector in 𝑉, denoted by 𝐎 and called
the zero vector, such that 𝐮 + 𝐎 = 𝐎 + 𝐮 = 𝐮.
(Additive identity)
Muhammad Saad
VECTOR SPACES
6. For every 𝐮 in 𝑉, there is a vector in 𝑉, denoted by
− 𝐮, such that 𝐮 + −𝐮 = −𝐮 + 𝐮 = 𝐎.
(Additive Inverse)
Muhammad Saad
7. 𝛼 𝐮 + 𝐯 = 𝛼𝐮 + 𝛼𝐯. (Distributive Addition)
8. 8. 𝛼 + 𝛽 𝐮 = 𝛼𝐮 + 𝛽𝐮.
(Distributive Scalar Multiplication)
9. 𝛼 𝛽𝐮 = 𝛼𝛽 𝐮.
(Associative Law of scalar multiplication)
(Scalar Identity)
Muhammad Saad
10. 1𝐮 = 𝐮.
Muhammad Saad
addition and scalar multiplication of vectors forms a
vector space.
2. The set ℝ𝑚×𝑛 of all 𝑚 × 𝑛 matrices, for some 𝑚 and
𝑛, with the usual addition and scalar multiplication of
matrices forms a vector space..
Muhammad Saad
3. The set ℙ𝑛 (𝑥) of all polynomials of degree less than
or equal to 𝑛, for some 𝑛, with the standard addition
and scalar multiplication of polynomials forms a
vector space.
VECTOR SPACES
Problem 02: Let 𝐕 = ℝ+ , the set of positive real
numbers. Define the addition of two elements 𝐱 and 𝐲
in 𝐕 to be their product 𝐱𝐲, and define the scalar
multiplication of the element 𝐱 in 𝐕 by a scalar 𝒄 to be
𝐱 𝒄 . Prove that 𝑽 is a linear space.
Solution
Let 𝐱, 𝐲, 𝐳 ∈ 𝑉 and 𝑐, 𝑑 ∈ ℝ. To avoid confusion, denote
the defined addition by ⨁ and the defined scalar
multiplication by ⊙.
Muhammad Saad
VECTOR SPACES
Therefore
Axiom 1: 𝐱⨁𝐲 = 𝐱𝐲 ∈ 𝑉
Muhammad Saad
Axiom 2: 𝑐 ⊙ 𝐱 = 𝐱 𝑐 ∈ 𝑉
Axiom 3: 𝐱⨁𝐲 = 𝐱𝐲 = 𝐲𝐱 = 𝐲⨁𝐱
Axiom 4: We have
𝐱⨁𝐲 ⨁𝐳 = 𝐱𝐲 ⨁𝐳 = 𝐱𝐲𝐳
Muhammad Saad
and
𝐱⨁ 𝐲⨁𝐳 = 𝐱⨁ 𝐲𝐳 = 𝐱𝐲𝐳.
So, 𝐱⨁𝐲 ⨁𝐳 = 𝐱⨁ 𝐲⨁𝐳 .
Muhammad Saad
VECTOR SPACES
Axiom 5: Indeed 1 ∈ 𝑉 and 𝐱 ⨁ 𝟏 = 𝐱𝟏 = 𝐱. So that 1 is an
additive identify.
1
Muhammad Saad
Axiom 6: For every 𝐱 ∈ 𝑉, there is ∈ 𝑉 and
𝐱
𝟏 𝟏
𝐱 ⊕ = 𝐱 = 𝟏 (our zero vector)
𝐱 𝐱
Axiom 7: We have
𝑐 ⊙ 𝐱⨁𝐲 = 𝑐 ⊙ 𝐱𝐲 = 𝐱𝐲 𝑐
Muhammad Saad
and
𝐱 𝑐 ⨁𝐲 𝑐 = 𝑐 ⊙ 𝐱 ⨁ 𝑐 ⊙ 𝐱 = 𝐱 𝑐 𝐲 𝑐 .
So, 𝑐 ⊙ 𝐱⨁𝐲 = 𝑐 ⊙ 𝐱 ⨁ 𝑐 ⊙ 𝐱 .
Muhammad Saad
VECTOR SPACES
Axiom 8: We have
𝑐 + 𝑑 ⊙ 𝐱 = 𝐱 𝑐+𝑑
Muhammad Saad
and
𝑐 ⊙ 𝐱 ⨁ 𝑑 ⊙ 𝐱 = 𝐱 𝑐 ⨁𝐱 𝑑 = 𝐱 𝑐 𝐱 𝑑 .
Hence, 𝑐 + 𝑑 ⊙ 𝐱 = 𝑐 ⊙ 𝐱 ⨁ 𝑑 ⊙ 𝐱 .
Axiom 9: Indeed
𝑐
𝑐⊙ 𝑑⊙𝐱 =𝑐⊙ 𝐱𝑑 = 𝐱 𝑑
= 𝐱 𝑐𝑑 = 𝑐𝑑 ⊙ 𝐱
Muhammad Saad
Axiom 10: 1⨁𝐱 = 𝐱1 = 𝐱
Therefore V = ℝ+ is a vector space under the defined
addition and scalar multiplication.
Muhammad Saad
VECTOR SPACES
Problem 03: Let 𝑽 = ℝ𝟐 with the usual scalar
multiplication and addition of vectors defined by
𝒙𝟏 𝒚𝟏 𝒙𝟏 + 𝒚𝟏
𝒙𝟐 + 𝒚𝟐 = 𝒙𝟐 𝒚𝟐 .
Muhammad Saad
Determine whether 𝑽 is a vector space or not
Solution
𝑥1 𝑦1 𝑧1
Let 𝐱 = 𝑥 , 𝐲 = 𝑦 , and 𝐳 = 𝑧 be in 𝑉. The axioms
2 2 2
1,2,9 and 10 are trivially satisfied.
Muhammad Saad
Muhammad Saad
VECTOR SPACES
Axiom 3: We have
𝑥1 𝑦1 𝑥1 + 𝑦1
𝐱+𝐲= 𝑥 + 𝑦 = 𝑥 𝑦
2 2 2 2
Muhammad Saad
and
𝑦1 𝑥1 𝑦1 + 𝑥1 𝑥1 + 𝑦1
𝐲+𝐱= 𝑦 + 𝑥 = 𝑦 𝑥 = 𝑥 𝑦
2 2 2 2 2 2
Therefore 𝐱 + 𝐲 = 𝐲 + 𝐱.
Axiom 4: Indeed,
𝑥1 𝑦1 𝑧1 𝑥1 + 𝑦1 𝑧1 𝑥 +𝑦 +𝑧
+ 𝑧 = 1 𝑥 𝑦1 𝑧 1
Muhammad Saad
𝐱+𝐲 +𝐳 = 𝑥2 + 𝑦2 + 𝑧 = 𝑥 𝑦
2 2 2 2 2 2 2
𝑥1 + 𝑦1 + 𝑧1
Similarly, 𝐱 + 𝐲 + 𝐳 = 𝑥2 𝑦2 𝑧2 . Thus,
𝐱+𝐲 +𝐳=𝐱+ 𝐲+𝐳 .
Muhammad Saad
VECTOR SPACES
0
Axiom 5: We have the zero vector 𝐎 = ∈ 𝑽 since, for
1
𝑥1
every 𝐱 = 𝑥 ∈ 𝑽, we have
Muhammad Saad
2
𝑥1 0 𝑥1
𝐱+𝐎= 𝑥 + = 𝑥 =𝐱
2 1 2
2
Axiom 6: Let vector 𝐱 = ∈ 𝑉 has no additive inverse.
0
Thus, 𝑉 is not a vector space.
Muhammad Saad
Muhammad Saad
VECTOR SPACES
Problem 04: Let 𝑽 = ℝ𝟐 with the standard operation of
addition and scalar multiplication defined by
𝒙𝟏 𝜶𝒙𝟏
.
Muhammad Saad
𝜶 𝒙 =
𝟐 𝟎
Determine whether 𝑽 is a vector space or not
Solution
𝑢1
For a vector 𝐮 = 𝑢 ∈ 𝑉, we have
2
Muhammad Saad
𝑢1 𝑢1
1𝐮 = 1 𝑢 = ≠𝐮
2 0
Therefore, 𝑉 is not a vector space since Axiom 10 does
not hold.
Muhammad Saad
VECTOR SPACES
Problem 05: Let 𝑽 be the set of all symmetric matrices of
order 𝒏 under the usual addition and scalar multiplication
of matrices. Show that 𝑽 is a vector space.
Muhammad Saad
Solution.
We do not need to verify the last eight axioms. So, we need
to check only the closure axioms. First, let 𝐴 and 𝐵 be two
matrices of 𝑉 and 𝑐 is a scalar. We have:
𝐴 + 𝐵 𝑇 = 𝐴𝑇 + 𝐵 𝑇 = 𝐴 + 𝐵.
So 𝐴 + 𝐵 is symmetric and in V, that is Axiom 1.
Muhammad Saad
𝑐𝐴 𝑇 = 𝑐𝐴𝑇 = 𝑐𝐴
and 𝑐𝐴 is symmetric and in 𝑉 which means that Axiom 2
holds. Therefore, 𝑉 is a real vector space.
Remember…
Study First!
(Keep Moving Forward)