Digital Signal Processing

(DSP)
Part 1
(Lecture 1)
Prepared by

Dr. Manal Mohsen Tantawi

 Course Outlines

Fundamentals of DSP
Fourier Transform , its inverse and others
Fast Fourier Transform (FFT)
Discrete Systems (Convolution & Correlation)
Finite Impulse Response (FIR) filters
Infinite Impulse Response (IIR) filters
Fundamentals of Wavelets
Time domain & Frequency Domain Features
Multi-rate Digital Signal Processing
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 References
Books

❖Digital Signal Processing

Principles, Algorithms, and Applications
Third Edition
John G. Proakis, Dimitris G. Manolakis

❖Digital Signal Processing

A practical approach
Third Edition
Emmanuel C. Ifeathor, Barrie W. Jervis
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Grading System

Final Exam : 50 marks

Midterm : 15 marks
Year work (Package) : 20 marks
project : 15 marks

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Part 1 Outlines
Signals, Systems, and Signal Processing
Advantages of Digital over Analog Signal Processing
Applications of DSP
Classification of Signals
The Concept of Frequency in Continuous -Time and
Discrete-Time Signals
Analog- to-Digital and Digital-to-A nalog Conversion
Analog to Digital Conversion (ADC)
Sampling Theorem
Quantization & Coding ( Encoding)
Digital to Analog Conversion (DAC)
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Signals
Signal : is defined as any physical quantity that varies
with time, space, or any other independent variable or
variables. Mathematically, we describe a signal as a function of
one or more independent variables.
Ex: speech , biological signals, image, video, and radar signals
Mathematical representation:
Ex: A(t)=5t
B(X, Y) = 5Y+ 4XY+ 10 X2

All signals can be represented mathematically ?? No

Ex: speech
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
Signals (Speech)

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
Signals (ECG)

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Signals
Associated with natural signals are the means by which
such signals are generated . For example, speech signals are
generated by forcing air through the vocal cords. Images
are obtained by exposing a photographic film to a scene or
an object. This stimulus is called the Signal Source.

A System is defined as the physical device (or software) that

perform operation on the signal and it is characterized by this
operation. Such operation are referred to as Signal Processing
Ex: filtering system
The Filtering operation is signal processing

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Signals
Signal processing can be performed by a number of
mathematical operations in software program or performed by
digital hardware (logic circuits).

General speaking, a system can be implemented as a combination

of both hardware and software, each of which performs its own set
of operations.

The set of rules in the software implementation of the system that

corresponds to the needed mathematical operations is called
Algorithm.

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Signal processing System
Analog Signal Processing (ASP) System

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Signal Processing System
Digital Signal Processing (DSP) System

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Advantages of DSP
It allows the development of powerful, smaller, faster and
cheaper digital computers and special-purpose digital hardware.
Hence, DSP has made it possible to construct highly
sophisticated digital systems capable of performing complex
tasks.

Digital processing hardware allows programmable operations.

Through software, one can more easily modify functions to be
performed by hardware. Thus, it provides a higher degree of
flexibility .

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Drawbacks of DSP
Regarding signals with wide bandwidth (above 100 MHz),
real-time processing is a requirement.

Conversion of an analog signal to digital accomplished by

sampling the signal and then quantizing the samples which
results in distortion that prevents constructing the original
signal back.

Can we control this amount of distortion ?? Yes

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Applications of DSP

Biomedical applications
Image processing
Telecommunications
Speech processing
Military ( radar or sonar processing)
Data compression
Instrumental/ control
ex: noise reduction and spectrum analysis

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

Multi-channel and Multi-dimensional signal

If the signal is generated by multiple sources or sensors, it is
called multi-channel signal. On the other hand, if the signal is
dependant on more than one independent variable it is called
multi-dimensional signal.
Ex: S( X, Y) is a multi-dimension signal S ( S can be a 2D
image),
however,

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

Continuous-time Versus Discrete Signals

Continuous-Time (analog) signals are defined for every value of
time from -∞ to ∞. On the other hand, Discrete-time signals are
defined only at certain values of time (usually equally spaced).
Ex:

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

Continuous-time Versus Discrete Signals

Sampling process is the process of selecting values of an

analog signal at discrete-time instants. National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

Continuous-valued Versus Discrete-valued Signals

The signal is continuous valued, if it can take all possible
values on a finite or infinite range. Alternatively, if the signal
takes on values from a finite set of possible values, it is
called discrete-valued signal.

A discrete-time signal having a set of discrete values is

called a digital signal.

Quantization process is the process of converting continuous

-valued signal into a discrete-valued signal. Is basically an
approximation process.
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

discrete-valued signal

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals

Deterministic Versus Random Signals

Any signal that can be uniquely described by an explicit mathe
matical expression, table of data or a well defined is called
deterministic. Alternatively, a random signal evolves in time in
an unpredictable manner.

Is the classification of real world signals to deterministic or

random a clear task ?? No

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Classification of Signals
Problems
Classify the following signals according to whether they
are (1) one- or multidimensional; (2) single or
multichannel, (3) continuous time or discrete time.
(4) analog or digital (in amplitude).
i) 12 lead ECG recording
One dimension, multichannel, continuous and continuous-valued (analog)
ii) Blood pressure measured every hour for a patient
One dimension, multichannel , discrete time and discrete-valued (digital)
iii) Position of specific object captured every some instant of
time in 3D space
Multi-dimension, single channel discrete time and continuous-valued

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Reminder to
Trigonometric Rules

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Reminder to
Trigonometric Rules

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Reminder to
Trigonometric Rules

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Periodic Signals (Sinusoidal Signals)
The concept of frequency is directly related to the concept
of time. Actually , it has the dimension of inverse time.
Thus, we should expect that the nature of time (continuous or
discrete) would affect the nature of the frequency accordingly.

F= 1/T
T is the period of the signal

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Continuous Sinusoidal Signals

The subscript a used with x(t)

denotes an analog, A is the
amplitude of the sinusoid. Ω is
the frequency in radians per
second (rad/s), and θ is the
phase in radians.
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Continuous Sinusoidal Signals
❑ For every fixed value of the frequency F, Xa(t) is periodic.
Indeed, it can easily be shown using elementary trigonometry
Xa(t + Tp) = Xa(t)
where Tp = 1/F is the fundamental period of the sinusoid al
signal.
❑Continuous-time sinusoidal signals with distinct frequencies
are themselves distinct.
❑ Increasing the frequency F results in an increase in the
rate of oscillation of the signal, in the sense that more
periods are included in a given time interval.
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Negative Frequencies

frequency is an inherently positive physical quantity .

However, only for mathematical convenience, we need to
introduce negative frequencies.

Euler Formula

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Negative Frequencies

As time progresses the

phasors rotate in opposite direct
ions with angular frequencies
±Ω radians per second . Since
a positive frequency corresponds
to counterclockwise uniform
angular motion , a negative
frequency simply corresponds to
clockwise angular motion .

➢ Hence the frequency range for analog sinusoids is -∞ < F < ∞.

National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Discrete Sinusoidal Signals

n is an integer variable called sample number; A is the

amplitude of the discrete sinusoid. w is the frequency in
radians per second (rad/s), and θ is the phase in radians.

The frequency has dimensions of cycles per sample.

National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Discrete Sinusoidal Signals (sampled analog signal)

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Discrete-time Sinusoidal Signals
❑ A discrete-time sinusoid is periodic only if its frequency f is a
rational number.

The smallest value of N for which the equation is true is called

the fundamental period.

This relation is true if and only if there exists an integer k

such that

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Discrete-time Sinusoidal Signals
❑ Discrete-time sinusoids whose frequencies are separated by
an integer multiple of 2π are identical.
For the sinusoidal cos (wo n+ θ) . It easily follows that

For all sinusoidals

where
are identical. Thus, we regard frequencies in the range 0 <= w <2π
or 0 < f < 1 as unique and all frequencies outside this range are
aliases.
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Discrete-time Sinusoidal Signals
❑ The highest rate of oscillation in a discrete-time sinusoidal
is attained when w=π (or w= -π ) or, equivalently , f=1/2 (or f=
-1/2).
To see what happens for π < w< 2π. we consider the sinusoids
with frequencies w1 =w0 and w2 = 2π-w0. Note that as w1 varies
from π to 2π. w2 varies from π to 0. it can be easily seen that

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
w2 is an alias of w1. If we had used a sine function instead
of a cosine function , the result would basically be the same,
except for a 180 phase difference between the sinusoids
x1(n) and x2 (n).

As we increase the relative frequency wo of a discrete-time

sinusoid from π to 2π. its rate of oscillation decreases. For
wo = 2π the result is a constant signal, as in the case for
wo = 0. Obviously , for wo = π (or f = 1/2) we have the
highest rate of oscillation.

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Frequency in Continuous
and Discrete Time Signals
Since discrete-time sinusoidal signals with frequencies that
are separated by an integer multiple of 2π are identical, it
follows that the frequencies in any interval
w1 <= w <= w1+ 2π constitute all the existing discrete-time
sinusoids.

Hence, the frequency range for discrete-time sinusoids is

finite with duration 2π . Usually, we choose the range
-π <= w <= π (-1/2 <= f <= 1/2 ) ,which we call the funda
mental range.

National Chung Hsing University

Department of Electrical Engineering
Bioinformatic Computing & Control Lab
 Part 1 Outlines
Signals, Systems, and Signal Processing
Advantages of Digital over Analog Signal Processing
Applications of DSP
Classification of Signals
The Concept of Frequency in Continuous -Time and
Discrete-Time Signals
Analog- to-Digital and Digital-to-A nalog Conversion
Analog to Digital Conversion (ADC)
Sampling Theorem
Quantization & Coding (Encoding)
Digital to Analog Conversion (DAC)
National Chung Hsing University
Department of Electrical Engineering
Bioinformatic Computing & Control Lab
Thanks for Your Attention