Lecture 1

Linear Systems and Matrices

Team
Dr. Inas Taymour
Dr. Ahmed Abdel-Naby
Dr. Mohamed Wafa
Reference
• H. Anton and C. Rorres, “Elementary Linear Algebra,”
11th edition, Wiley, 2014.

• Available at the Egyptian Knowledge Bank

(‫ )بنك المعرفة المصري‬http://ekb.eg

• Sections 1.1 through 1.6.

• This lecture covers Section 1.1.

MTH0001 Algebra 2
Linear Equation (‫)معادلة خطية‬ 𝒚

• 2 unknowns (‫)مجهولين‬:
• For example, 𝑥 + 𝑦 = 1
• The equation represents a line in the 𝒙
plane (‫)المستوى‬.
𝒛

• 3 unknowns (‫)ثالثة مجاهيل‬:

• For example, 2𝑥 + 𝑦 + 𝑧 = 3
• The equation represents a plane in
space (‫)الفراغ‬. 𝒚
𝒙
MTH0001 Algebra 3
Linear Equation (continued)
• In general:
• We have 𝒏 unknowns: 𝑥1 , 𝑥2 , … , and 𝑥𝑛

• 𝑎1 , 𝑎2 , … , 𝑎𝑛 and 𝑏 are real numbers (‫)أعداد حقيقية‬.

• 𝑎1 , 𝑎2 , … , and 𝑎𝑛 are called coefficients (‫)معامالت‬.

• If 𝑏 = 0, we have a homogeneous equation (‫)معادلة متجانسة‬. For

example, 𝑥1 + 𝑥2 − 𝑥3 + 2𝑥4 = 0.
MTH0001 Algebra 4
What is a Linear System?
• A system of linear equations (‫)مجموعة معادالت خطية‬.
• They are widely used in maths, physics, mechanics, economics, etc.

𝒙+ 𝒚 =𝟑
• Ex. 1: equations, unknowns:
𝒙 + 𝟐𝒚 = 𝟓

𝒙 + 𝟐𝒚 + 𝟑𝒛 = 𝟏𝟓
• Ex. 2: equations, unknowns: 𝟑𝒙 + 𝒚 − 𝒛 = −𝟓
𝟐𝒙 − 𝟑𝒚 + 𝟐𝒛 = 𝟎

MTH0001 Algebra 5
Linear Systems
• In general, we have 𝒎 equations and 𝒏 unknowns:
𝒂𝟏𝟏 𝒙𝟏 + 𝒂𝟏𝟐 𝒙𝟐 + ⋯ + 𝒂𝟏𝒏 𝒙𝒏 = 𝒃𝟏
𝒂𝟐𝟏 𝒙𝟏 + 𝒂𝟐𝟐 𝒙𝟐 + ⋯ + 𝒂𝟐𝒏 𝒙𝒏 = 𝒃𝟐
⋮
𝒂𝒎𝟏 𝒙𝟏 + 𝒂𝒎𝟐 𝒙𝟐 + ⋯ + 𝒂𝒎𝒏 𝒙𝒏 = 𝒃𝒎

• Each coefficient 𝒂𝒊𝒋 has two indexes. Each constant 𝒃𝒊 has one index.

MTH0001 Algebra 6
Solving Linear Systems
• A solution is a sequence of values for the unknowns 𝑥1 , 𝑥2 , … , and 𝑥𝑛
which satisfies all 𝒎 equations.

𝒙 + 𝒚 = 𝟑 → (𝟏)
Ex: Verify that 𝒙 = 𝟏 and 𝒚 = 𝟐 is the solution of
𝒙 + 𝟐𝒚 = 𝟓 → (𝟐)

• We will solve linear systems using elimination (‫)الحذف‬.

MTH0001 Algebra 7
 𝒙 + 𝒚 = 𝟑 → (𝟏)
Ex. 1: Solve 𝒙 + 𝟐𝒚 = 𝟓 → (𝟐)
𝒚

MTH0001 Algebra 8
 𝒙 + 𝒚 = 𝟐 → (𝟏)
Ex. 2: Solve 𝟐𝒙 + 𝟐𝒚 = 𝟒 → (𝟐)
𝒚

MTH0001 Algebra 9
 𝒙 + 𝒚 = 𝟐 → (𝟏)
Ex. 3: Solve 𝒙 + 𝒚 = 𝟒 → (𝟐)
𝒚

MTH0001 Algebra 10
2×2 System: 3 Types of Solutions
𝒚 𝒚 𝒚

𝒙 𝒙 𝒙

A unique solution Infinitely many solutions No solution

Consistent system Inconsistent system

(At least one solution)
MTH0001 Algebra 11
 𝒙 + 𝟐𝒚 + 𝟑𝒛 = 𝟏𝟓
Ex. 4: 𝟑𝒙 + 𝒚 − 𝒛 = −𝟓
𝟐𝒙 − 𝟑𝒚 + 𝟐𝒛 = 𝟎

3×3 system: 3 equations in 3 unknowns.

There is a unique solution: 𝒙 = −𝟏, 𝒚 = 𝟐, 𝒛 = 𝟒

Recall: each equation represents a plane in space. The three planes

have one common
point

MTH0001 Algebra 12
 3×3 System: 3 Types of Solutions

A unique solution Infinitely many solutions No solution

Consistent system Inconsistent system

(At least one solution)
MTH0001 Algebra 13
𝒎 × 𝒏 Linear System
• Three types of solutions:
• A unique solution
• Infinitely many solutions
• No solution

MTH0001 Algebra 14
Homogeneous Systems
• A homogeneous system: a linear system (𝒎 equations in 𝒏
unknowns), where all constants are zeros:

𝒂𝟏𝟏 𝒙𝟏 + 𝒂𝟏𝟐 𝒙𝟐 + ⋯ + 𝒂𝟏𝒏 𝒙𝒏 = 𝟎

𝒂𝟐𝟏 𝒙𝟏 + 𝒂𝟐𝟐 𝒙𝟐 + ⋯ + 𝒂𝟐𝒏 𝒙𝒏 = 𝟎
⋯
𝒂𝒎𝟏 𝒙𝟏 + 𝒂𝒎𝟐 𝒙𝟐 + ⋯ + 𝒂𝒎𝒏 𝒙𝒏 = 𝟎

MTH0001 Algebra 15
Example 1
𝒚
𝒙 + 𝒚 = 𝟎 → (𝟏)
Solve the linear system:
𝒙 + 𝟐𝒚 = 𝟎 → (𝟐)

MTH0001 Algebra 16
Example 2
𝒚
𝒙 + 𝒚 = 𝟎 → (𝟏)
Solve the linear system:
𝟐𝒙 + 𝟐𝒚 = 𝟎 → (𝟐)

MTH0001 Algebra 17
Homogeneous System: 2 Types of Solutions
𝒚 𝒚

𝒙 𝒙

A unique solution Infinitely many solutions

Consistent system (At least one solution)

A homogeneous system is always consistent, since

it has the trivial solution at least.
MTH0001 Algebra 18
𝒎 × 𝒏 Linear System
• Non-homogeneous: 3 types of solutions:
• A unique solution
• Infinitely many solutions
• No solution

• Homogeneous: 2 types of solutions:

• A unique solution (which is the trivial solution)
• Infinitely many solutions (which include the trivial solution)

• We will use matrices for solving linear systems.

MTH0001 Algebra 19
Matrices
• Matrix: a rectangular array of real numbers. Examples:
• These numbers are called the entries of the
matrix.
• Use capital letters to denote matrices, e.g., 𝑨.
• The size of a matrix is described by the
number of rows (horizontal lines) and
columns (vertical lines), e.g., 𝑨𝒎×𝒏 has 𝒎
rows and 𝒏 columns.
MTH0001 Algebra 20
The Augmented Matrix
It contains the coefficients and constants of a linear system.
Examples: Linear system Augmented matrix
𝒙+ 𝒚=𝟑
𝒙 + 𝟐𝒚 = 𝟓

𝒙 + 𝟐𝒚 + 𝟑𝒛 = 𝟏𝟓
𝟑𝒙 + 𝒚 − 𝒛 = −𝟓
𝟐𝒙 − 𝟑𝒚 + 𝟐𝒛 = 𝟎
MTH0001 Algebra 21
Augmented Matrix (cont.)
• In general:
Linear system Augmented matrix

𝒂𝟏𝟏 𝒙𝟏 + 𝒂𝟏𝟐 𝒙𝟐 + ⋯ + 𝒂𝟏𝒏 𝒙𝒏 = 𝒃𝟏

𝒂𝟐𝟏 𝒙𝟏 + 𝒂𝟐𝟐 𝒙𝟐 + ⋯ + 𝒂𝟐𝒏 𝒙𝒏 = 𝒃𝟐
⋮
𝒂𝒎𝟏 𝒙𝟏 + 𝒂𝒎𝟐 𝒙𝟐 + ⋯ + 𝒂𝒎𝒏 𝒙𝒏 = 𝒃𝒎

MTH0001 Algebra 22
Augmented Matrix (cont.)
Example: Find the linear system which corresponds to the augmented
𝟏 𝟏 𝟏 𝟐
matrix 𝟏 𝟐 𝟑 อ𝟓 ?
𝟐 𝟑 𝟒 𝟕

The linear system is:

MTH0001 Algebra 23
Solving Linear Systems Using Elimination
We can perform 3 algebraic operations:
1. Multiply an equation by a constant:
𝟐𝒙 + 𝟒𝒚 = 𝟏𝟎 → (𝟏)
𝒙 + 𝒚 = 𝟑 → (𝟐)
2. Interchange two equations:
𝒙 + 𝟐𝒚 = 𝟓 → (𝟏)
𝒙 + 𝒚 = 𝟑 → (𝟐)
3. Add a multiple of one equation to another:
𝒙 + 𝒚 = 𝟑 → (𝟏)
𝒙 + 𝟐𝒚 = 𝟓 → (𝟐)

MTH0001 Algebra 24
Elimination Using the Augmented Matrix
• Each equation in the linear system corresponds to a row in the
augmented matrix.

• Therefore, each algebraic operation on an equation in the system

corresponds to an elementary row operation on a row in the
augmented matrix.

MTH0001 Algebra 25
 Elimination Using the Augmented Matrix
(cont.)
Algebraic operation Corresponding row Notation
operation
Multiply an equation by a Multiply a row by a
constant constant
Interchange two equations Interchange two rows

Add a multiple of one equation Add a multiple of one row

to another to another

MTH0001 Algebra 26
Performing Row Operations
𝟐𝒙 + 𝟒𝒚 = 𝟏𝟎
Example:
𝒙+ 𝒚=𝟑
• The augmented matrix is:

1
• Multiply row 1 by :
2

• Interchange rows 1 and 2:

• Add the negative of row 1 to row 2:

MTH0001 Algebra 27
 𝒙+ 𝒚=𝟒
Ex: Solve the linear System 𝒙 + 𝟐𝒚 = 𝟕

MTH0001 Algebra 28
 𝒙 + 𝟐𝒚 + 𝟑𝒛 = 𝟏𝟓
Example: Solve 𝟑𝒙 + 𝒚 − 𝒛 = −𝟓
𝟐𝒙 − 𝟑𝒚 + 𝟐𝒛 = 𝟎

MTH0001 Algebra 29
 𝒙 + 𝟐𝒚 + 𝟑𝒛 = 𝟏𝟓
Example: Solve 𝟑𝒙 + 𝒚 − 𝒛 = −𝟓 (cont.)
𝟐𝒙 − 𝟑𝒚 + 𝟐𝒛 = 𝟎
Alternatively, we can continue with elimination:
𝟏 𝟐 𝟑 𝟏𝟓
𝟎 𝟏 𝟐 อ 𝟏𝟎
𝟎 𝟎 𝟏 𝟒

MTH0001 Algebra 30
Summary
• A linear system consists of 𝒎 equations in 𝒏 unknowns.
• It can have: (1) a unique solution, (2) infinitely many solutions, or (3) no
solution.

• A homogeneous system consists of 𝒎 homogeneous equations in 𝒏

unknowns (i.e., a linear system where all constants are zeros).
• A homogeneous system always has the trivial solution.
• Therefore, a homogeneous system is always consistent. i.e., it can have:
(1) a unique solution, or (2) infinitely many solutions.

MTH0001 Algebra 31
Summary
• A linear system can be solved using elimination.
• Elimination is carried out by performing elementary row operations
on the augmented matrix: (1) 𝒌𝒓𝒊 → 𝒓𝒊 (2) 𝒓𝒊 ↔ 𝒓𝒋 (3) 𝒌𝒓𝒋 + 𝒓𝒊 → 𝒓𝒊

• We introduced two methods for “systematic” elimination:

1. Gaussian elimination with back substitution.
2. Gauss-Jordan elimination.

• Next lecture: more details on echelon forms (REF and RREF).

MTH0001 Algebra 32