Linear Algebra Lecture2
Linear Algebra Lecture2
\
|
3
2
1
x
x
x
a
|
|
|
|
|
.
|
\
|
3
2
1
x
x
x
|
|
|
|
|
.
|
\
|
3
2
1
y
y
y
a
a
x
1
x
2
x
3
b
b a+ |
|
|
|
|
.
|
\
|
+
+
+
3 3
2 2
1 1
y x
y x
y x
b
a
a o
|
|
|
|
|
.
|
\
|
3
2
1
x
x
x
o
o
o
Linear operations: Example (1)
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
( )
|
|
|
|
.
|
\
|
|
|
|
|
.
|
\
|
|
|
|
|
.
|
\
|
P
P
+ + = P
3
2
1
3
2
1
2
3
2
1
2
2
3 2 1 2
) (
2
) (
) (
,
y
y
y
x Q
x
x
x
x
x
x
x
x
j
x x x x x x x
( ) ( )
|
|
|
|
|
|
.
|
\
|
|
.
|
\
|
|
.
|
\
|
|
.
|
\
|
+
+
+
+ + + + + = + P
3 3
2 2
1 1
2
3 3 2 2 1 1 2 2
y x
y x
y x
x y x x y x y x x Q x
( )
|
|
|
|
|
|
.
|
\
|
+ + = P
3
2
1
2
3 1 1 2
x
x
x
x x x x x x
o
o
o
o o o o
fixed real numbers
Linear operations: Example (2)
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
Linear Space (Vector Space): Definition
A vector space (over ) consists of a set along with two operations ,,+
and ,, so that
1. If , their vector sum , and
there is zero vector so that
each has an additive inverse so that
2. If scalars) and then each scalar multiple is in , and
1 =
3. distributive laws (connection of ,,+ and ,,)
L y x e , L y x e +
x y y x + = +
( ) ) ( z y x z y x + + = + +
L e 0 L x x x e = + 0
L x e L y e
0 = + y x
L y x e ,
( ) ( ) x s r x rs =
x
x r
( ) x s x r x s r + = +
x
( ) y r x r y x r + = +
R L
R s r e , L
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
1.
|
|
|
|
|
.
|
\
|
= e = n k R x L
k
n
x
x
x
, 1 , :
2
1
with operations
R
x
x
x
y x
y x
y x
n
y
y
y
n
x
x
x
n n n
e =
+
+
= + = =
|
|
|
.
|
\
|
|
|
|
.
|
\
|
|
|
|
|
.
|
\
|
|
|
|
|
.
|
\
|
o
o
o
o , ;
1
,
1 1 1 1
2. { } R a x a x a a x P L
k
n
n n
e + + + = =
; ) (
1
1 1 0 1
with natural operations
addition and scalar
multiplication
1
=
n
D L
n
R L =
Examples of Vector Spaces
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
1. Definition: A subset of a vector space is linearly independent if none of its
elements is a linear combination of the others. Otherwise it is linearly
dependent.
2. Definition: A subset S of a vector space is linearly independent if and only if
for any distinct the only linear relationship among
those vectors
is trivial one:
S x x
m
e , ,
1
m k R x x
k
m m
, 1 , , 0
1 1
= e = + o o o
0
2 1
= = = =
m
o o o
Linear Independence
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
1. The set is linearly independent in
Because
2. In where
linearly dependent
{ } x x + 1 , 1 { } 2 , 1 , 0 ,
2
2
2 1 0
= e + + = k R a x a x a a D
k
0
0
0
2
0 0 0 0 ) ( ) ( ) 1 ( ) 1 (
2 1
2 1
2 1
2 1 2 1 2 1
= =
=
= +
+ + = = + + = + +
o o
o o
o o
o o o o o o x x x x x
|
|
|
.
|
\
|
|
|
|
.
|
\
|
|
|
|
.
|
\
|
= = =
4
4
10
,
2
2
5
,
1
2
3
3 2 1
x x x
{ } = = + +
|
|
|
.
|
\
|
3 2 1 3 2 1
, ,
0
0
0
0 ) 1 ( 2 0 x x x x x x
3
R
Examples
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
Definition: If there exists linearly independent vectors in the linear
space , and arbitrary n+1 vectors in the linear space , are linearly
dependent, then the dimension of is or that is -dimensional space.
Example: The dimension of the set of first order polynomials is 2.
1. 1 and x are linearly independent:
2. for arbitrary the
and
0 0 1
2 1 2 1
= = = + o o o o x
( ) { }
( ) 0 1 0 1 1
, , 1
1 1 0
1 1 0 1
= + +
+ =
|
.
|
\
|
x P x a a
P x x a a x P
n
e e , ,
1
L L
L n L n
is linearly dependent
Dimension of Vector Space
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
Definition: A basis for a vector space is a sequence of vectors
that form a set that is linearly independent and that spans the
space.
Example: This is a basis for
1. It is linearly independent
2. And it spans
for arbitrary .
)
`
|
.
|
\
|
|
.
|
\
|
1
1
,
4
2
2
R
0
0 4
0 2
0
0
4
2
4
2
2 1
2 1
2 1
2 1
= =
|
|
.
|
\
|
= +
= +
|
.
|
\
|
= |
.
|
\
|
+ |
.
|
\
|
o o
o o
o o
o o
2
2 ,
2
4
2
1
1
4
2
2 1
2 2
2 1
2 1
R
y
x
y x c
x y
c
y c c
x c c
y
x
c c
e
=
=
= +
= +
= +
|
|
|
.
|
\
|
|
|
|
.
|
\
|
|
|
|
.
|
\
|
|
|
|
.
|
\
|
2
R
Basis
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
For any { }
k
k
n
e
e e
=
=
|
|
|
|
|
|
|
|
|
.
|
\
|
0
1
0
, ,...,
1
c
where
-th row is the standard
(or natural) basis in
n
R
n
R
Basis
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
Assume is n-dimensional vector space, and -
basis in . Then uniquely represents in the form.
Here th coordinate of the vector in basis.
That is
n
f f ,...,
1
L ae
R x f x a
k
n
k
k k
e
=
=
,
1
a
{ }
n
f f ,...,
1
|
|
|
|
.
|
\
|
n
x
x
a
1
k x
k
L
L
Coordinates
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
Definition: An isomorphism between vector spaces L and M
is a map , that
1. is a correspondence one-to-one and onto
2. preserves linear structure:
if , then
( ) ( ) ( )
( ) ( ) x rf x r f R r and L x
y f x f y x f
= e e
+ = +
M L f e :
L y x e ,
Isomorphism
Synopsys University Courseware
2009 Synopsys, Inc.
Lecture - 2
Developed By: Vazgen Melikyan
1. Arbitrary n-dimensional linear space L is isomorphic to
2. Vector spaces are isomorphic if and only if they have
the same dimension.
|
|
|
|
|
.
|
\
|
= e = n k R
k
x
n
x
x
n
R , 1 , :
1