Definitions
Definitions
Jonathan Lee
February 2, 2010
The aim of this note is to give hopefully more intuitive definitions of some of the linear algebra
concepts covered in class. (Disclaimer: this will be edited more later, with more examples added,
as I’ve just started typing this at 1:00am. Let me know if there are things you’d like added.)
Our setup: we’re in n-dimensional space, also known as Rn , and we’ve placed a remote-controlled
robot named Karel at the origin. The remote control has k buttons, each labelled with a vector
from Rn — for the sake of notation, assume the i-th button is labelled with a given vector vi 2 Rn ,
where 1 i k. Karel has been programmed to move, changing its position by the vector vi , each
time button i is pressed. (Note that the buttons are magically engineered, in the sense that each
can also be pushed a negative or fractional number of times.)
Example 1. Suppose Karel is at the position (3, 4), and a button labelled with (9, 2) is pushed
twice. Then, Karel’s new position will be
Definition 1 (Span — technical). The span of the vectors v1 , v2 , . . . , vk is the set of all possible
values of
c1 v1 + c2 v2 + · · · + ck vk ,
where the ci are arbitrarily chosen real numbers.
Definition 2 (Span — robot). The span of the vectors v1 , v2 , . . . , vk is the set of all points Karel
can reach by having buttons on the remote control pushed, assuming Karel starts at the origin.
Example 2. Suppose Karel is in R3 , currently at the origin. If the remote control has two buttons,
v1 = (1, 0, 0) and v2 = (0, 1, 0), then the set of points Karel can reach is the xy-plane (which is the
span of v1 and v2 ).
c1 v1 + c2 v2 + · · · + ck vk
1
Example 3. Suppose Karel lives in R2 , and there are three remote-control buttons:
Then, these vectors are linearly dependent, since no matter where Karel starts, it’ll return to its
starting position if we push button 1 once, button 2 twice and button 3 negative two times.
The two definitions above have formulations involving a single matrix, instead of numerous
vectors. Keeping our same vectors v1 , v2 , . . . , vk 2 Rn , let A be the n ⇥ k matrix whose i-th column
is the vector vi .
Definition 5 (Matrix-vector product — technical). Let x = [c1 c2 · · · ck ]T be a vector in Rk .
Then the matrix-vector product Ax is the column vector
c1 v1 + c2 v2 + · · · + ck vk .
2
Definition 10 (Nullspace — robot). Let Karel have remote control buttons corresponding to the
matrix A. Then, the nullspace of A is all possible ways of pushing Karel’s buttons so that it
returns to its starting position. (Notationally, the vector (3, 5, 9, . . .) means push the first button 3
times, the second button 5 times, the third button 9 times, and so on.)
Definition 12 (Basis — robot). Let V be a subspace of Rn , and suppose Karel’s remote control
buttons are labelled v1 , v2 , . . . , vk . Then these vectors form a basis for V if Karel cannot leave V ,
and furthermore, for any point in V , there is exactly one way of pushing Karel’s buttons so it ends
up there. (Thus, there is a correspondence between points in V and ways of pushing the buttons.)