2
2
1
Systems
Dynamical system: any system with an internal state and a rule govering
how the state evolves in time
Example: a car with input being acceleration a(t) and output being velocity
v(t). The evolution of speed is given by
dv
= a(t).
dt
The output is measured by the speedometer sensor. This is an example of
a continuous-time dynamical system.
The field of signal processing studies how to extract desirable features from
given signals, often via design of filters.
2
Continuous Time Systems: Examples
x(t) y(t)
System
Electrical Circuits:
VS = 40V
R6
R7
C3 R4 Q2
R8
C1 C2 R2 C5
R1
Q1 Q3
output y(t)
input x(t) R3
R5 C4
3
Discrete Time Systems: Examples
x[n] y[n]
System
Economy:
Input at day n = federal reserves mortgage rate
Output at day n = inflation rate at day n
Sound Processing:
Input x[n] = input sound
Output y[n] = output sound
4
Important Mathematical Systems
x(t) y(t)
System
5
Properties of Systems: Memoryless
x(t) y(t)
System
6
Properties of Systems: Causality
x(t) y(t)
System
7
Properties of Systems: Invertible
x(t) y(t)
System
8
Properties of Systems: BIBO Stable
x(t) y(t)
System
x[n] y[n]
9
Properties of Systems: Time-Invarying (TI)
We say that a system is TI if for all inputs x(t) (or x[n]) and all time-shifts
t0 (or n0 ) the output to x(t t0 ) (or x[n n0 ]) is y(t t0 ) (or y[n n0 ])
Example 1: Is y(t) = sin(x(t)) Time-Invarying?
Example 2: Is the system y[n] = nx[n] TI?
Clicker Question: Is the system y[n] = x[n]x[n 3] TI?
a. Yes
b. No
10
Properties of Systems: Linear
x(t) y(t)
System
x[n] y[n]
We say that a system is linear if for all x1 (t), x2 (t) (or x1 [n] and x2 [n]) and
all scalars a1 , a2 the response (output) of the system to a1 x1 (t) + a2 x2 (t) is
a1 y1 (t) + a2 y2 (t), where y1 is the response to x1 and y2 is the response to
x1
Rt
Example 1: Is the integrator system x(t) = 1 x(⌧ )d⌧ linear?
Example 2: What about y[n] = (x[2n])2 ?
Clicker Question: Is the system y(t) = (t 1)x(t + 2) linear?
a. Yes
b. No
Rt
Example: Determine the properties of the system y(t) = 1 ⌧ x(⌧ ).
11
Discrete-time LTI Systems
x[n]
1 1 2
12
Discrete-time LTI Systems
By Time-Invariant property:
[n + 1] h[n + 1]
LTI System
[n] h[n]
LTI System
[n 1] h[n 1]
LTI System
..
.
[n k] h[n k]
LTI System
By Linearity:
P1 P1
x[n] = k= 1 x[k] [n k] y[n] = k= 1 x[k]h[n k]
LTI System
Let h[n] be the impulse response of an LTI system. Then for any input x[n],
the output is
1
X
y[n] = x[k]h[n k].
k= 1
The above sum is called the convolution (sum) of x[n] and h[n]. Denote
def
it by y[n] = x[n] ⇤ h[n]
13
Discrete-time LTI Systems
14
Continuous-time LTI Systems
⇢ 1
if t 2 [0, ]
Reminder: Define (t) =
0 else.
1
0
0
(t k ) h (t k )
LTI System
By Linearity:
P1 P1
x̂(t) = k= 1 x(k ) (t k ) ŷ(t) = k= 1 x(k ) h (t k )
LTI System
15
Continuous-time LTI Systems
P1
x(t) ⇡ x̂(t) = k= 1 x(k ) (t k )
2
1
t
2 2
1
2
By LTI property:
P1 P1
x̂(t) = k= 1 x(k ) (t k ) ŷ(t) = k= 1 x(k ) h (t k )
LTI System
Letting ! 0:
– (t) ! (t)
– x̂(t) ! x(t) (piece-wise approximation becomes exact)
R1
– ŷ(t) ! y(t) = 1 x(⌧ )h(t ⌧ )d⌧ (by the Riemann approximation of
the integral),
where h(t) is the response of the system to (t).
16
Continuous-time LTI Systems
Let h(t) be the impulse response of an LTI system. Then for any input
x(t), the output is
Z 1
y(t) = x(⌧ )h(t ⌧ )d⌧.
1
The above integral is called the convolution (integral) of x(t) and h(t).
def
Denote it by y(t) = x(t) ⇤ h(t).
17
MAIN MESSAGE
For LTI systems, it is sufficient to know the impulse response h(t) (or h[n])
to know the response to any arbitrary input x(t) (x[n]).
In other words, we know everything about these systems if we know the
impulse response and hence, the notation:
x(t) y(t)
h(t)
or
x[n] y[n]
h[n]
18
Example
L TI
A. No (incrementally linear ) Yes
B. Yes Yes
C. Yes No
D. No No
19
How to compute convolution?
Fix time n
P
y[n] = 1 k= 1 x[k]h[n k]
As a function of k: h[n k] is h[k] flipped and shifted to the right by n:
3
h[k]
2
1
k
2 2 4
3 3 3
h[ k] h[1 k] h[2 k]
2 2 2
1 1 1
k k k
4 2 2 4 2 2 2 2 4
Output at time n: sample by sample multiply x[k] by h[n k] and then add
Example: What is the output of an LTI system with the impulse response
h[n] = n(u[n] u[n 3]) to the input x[n] = u[n] u[n 3]?
20
Computing convolution: DT
2
x[k]
1.5
1
0.5
k
4 2 2 4
P1
We want to compute y[n] = k= 1 x[k]h[n k] for all n
Let n = 2:
a. imagine h[n k]
b. multiply h[n k] and x[k] point by point
c. add them up
d. the result is the output at time n (y[n])
1
y[n]
0.5
n
2 2
0.5
21
Computing convolution: DT
2
x[k]
1.5
1
0.5
k
4 2 2 4
P1
We want to comput y[n] = k= 1 x[k]h[n k] for all n
For n < 1: no intersection of non-zero parts
1
y[n]
0.5
n
2 2
0.5
22
Computing convolution: DT
2
x[k]
1.5
1
0.5
k
2 2 4
P1
We want to compute y[n] = k= 1 x[k]h[n k] for all n
Let n = 1:
a. imagine h[n k]
b. multiply h[n k] and x[k] point by point
c. add them up
d. the result is the output at time n (y[n])
3
y[n]
2
1
n
2 2
23
Computing convolution: DT
2
x[k]
1.5
1
0.5
k
2 2 4
P1
We want to compute y[n] = k= 1 x[k]h[n k] for all n
Let n = 2:
a. imagine h[n k]
b. multiply h[n k] and x[k] point by point
c. add them up
d. the result is the output at time n (y[n])
3
y[n]
2
1
n
2 2
3
y[n]
2
1
n
2 2 4 6
24
How to compute convolution in CT?
25
Properties of Convolution
Commutative: For any signals x(t) (or x[n]) and h(t) (or h[n]), x(t)⇤h(t) =
h(t) ⇤ x(t) (or x[n] ⇤ h[n] = h[n] ⇤ x[n]).
Proof DT:
1
X 1
X
n k!`
x[n] ⇤ h[n] = x[k]h[n k] = x[n `]h[`] = h[n] ⇤ x[n]
k= 1 `= 1
Proof of CT is similar.
26
Properties of Convolution
Associative: For any three signals x[n], h1 [n], and h2 [n]: (x[n] ⇤ h1 [n]) ⇤
h2 [n] = x[n] ⇤ (h1 [n] ⇤ h2 [n]) and similarly: (x(t) ⇤ h1 (t)) ⇤ h2 (t) = x(t) ⇤
(h1 (t) ⇤ h2 (t)).
Distributive: For any three signals x[n], h1 [n], and h2 [n]: x[n] ⇤ (h1 [n] +
h2 [n]) = x[n] ⇤ h1 [n] + x[n] ⇤ h2 [n] and similarly: (x(t) ⇤ (h1 (t) + h2 (t)) =
x(t) ⇤ h1 (t) + x(t) ⇤ h2 (t)).
What is the system theoretic meaning? (serial and parallel interconnection)
27
Impulse Response
x(t) y(t)
h(t)
28
Memoryless
x(t) y(t)
h(t)
29
Causal
x(t) y(t)
h(t)
30
Invertibility
x(t) y(t)
h(t)
A discrete-time LTI system is invertible if and only if there exists a g[n] such that:
A continuous-time LTI system is invertible if and only if there exists a g(t) such
that:
g(t) ⇤ h(t) = (t).
31
BIBO Stability
x(t) y(t)
h(t)
32
Practice Problem
33
Road map
NO CONVOLUTION!!!
34
Key Idea
Suppose that we can find a rich family of signals vk (t) such that:
vk (t) k vk (t)
h(t)
for a scalar k 2C
And suppose that you can write a signal x(t) as:
1
X
x(t) = ak vk (t).
k= 1
35
Eigenfunctions
for some 2 C.
Can we find an eigenfunction for an LTI system?
Let’s try v(t) = 1:
R1
x(t) = 1 y(t) = 1 h(⌧ )1d⌧
h(t)
R1
So, it is an eigenfunction with = 1 h(⌧ )d⌧
36
Eigenfunctions
We have
Z 1 Z 1
s(t ⌧ )
y(t) = h(⌧ )e d⌧ = h(⌧ )est e s⌧
d⌧
1 1
Z 1
st s⌧
=e h(⌧ )e d⌧
1
R1 s⌧
H(s) = 1 h(⌧ )e d⌧ is called the transfer function of the system
37
Example
38
Road map: Discrete Time
Suppose that we can find a rich family of signals vk [n] such that:
vk [n] k vk [n]
h[n]
for a scalar k 2C
And suppose that you can write a signal x[n] as:
1
X
x[n] = ak vk [n].
k= 1
for some 2 C.
is often called an eigenvalue
39
Eigenfunctions
We have
1
X 1
X
n k
y[n] = h[k]z = h[k]z n z k
k= 1 k= 1
X1
n k
=z h[k]z
k= 1
P1 k
H(z) = k= 1 h[k]z is called the transfer function of the system.
40