Unit-I Sampling &quantization Sampling:: Sampling Theorem For Low-Pass Signals
Unit-I Sampling &quantization Sampling:: Sampling Theorem For Low-Pass Signals
SAMPLING:
A message signal may originate from a digital or analog source. If the message signal is
analog in nature, then it has to be converted into digital form before it can transmit by digital
means. The process by which the continuous-time signal is converted into a discrete–time
signal is called Sampling. Sampling operation is performed in accordance with the sampling
theorem.
E
C
D
Proof:- Part - I If a signal x(t) does not contain any frequency component beyond W Hz, then
the signal is completely described by its instantaneous uniform samples with sampling
interval (or period ) of Ts < 1/(2W) sec.
Part – II The signal x(t) can be accurately reconstructed (recovered) from the set of uniform
instantaneous samples by passing the samples sequentially through an ideal (brick-wall)
lowpass filter with bandwidth B, where W ≤ B < fs – W and fs = 1/(Ts).
Page 1
EC6501 DIGITAL COMMUNICATION
where x(nTs) = x(t)⎢t =nTs , δ(t) is a unit pulse singularity function and „n‟ is an integer.The
continuous-time signal x(t) is multiplied by an (ideal) impulse train to obtain {x(nTs)} and
can be rewritten as,
Now, let X(f) denote the Fourier Transform F(T) of x(t), i.e.
Now, from the theory of Fourier Transform, we know that the F.T of Σ δ(t- nTs), the
F{Σ δ(t- nTs)} = (1/Ts).Σ δ(f- n/Ts) = fs.Σ δ(f- nfs) -- ----- 1.3
If Xs(f) denotes the Fourier transform of the energy signal xs(t), we can write using Eq.
(1.2.4) and the convolution property:
E
--------------1.4
Nyquist‟s theorems as stated above and also helps to appreciate their practical implications.
Let us note that while writing Eq.(1.4), we assumed that x(t) is an energy signal so that its
Fourier transform exists. With this setting, if we assume that x(t) has no appreciable
frequency component greater than W Hz and if fs > 2W, then Eq.(1.4) implies that Xs(f), the
Fourier Transform of the sampled signal Xs(t) consists of infinite number of replicas of X(f),
centered at discrete frequencies n.fs, -∞ < n < ∞ and scaled by a constant fs= 1/Ts.
Page 2
EC6501 DIGITAL COMMUNICATION
Fig. 1.2.1 indicates that the bandwidth of this instantaneously sampled wave xs(t) is infinite
while the spectrum of x(t) appears in a periodic manner, centered at discrete frequency values
n.fs. Part – I of the sampling theorem is about the condition fs > 2.W i.e. (fs – W) > W and (–
fs + W) < – W. As seen from Fig. 1.2.1, when this condition is satisfied, the spectra of xs(t),
centered at f = 0 and f = ± fs do not overlap and hence, the spectrum of x(t) is present in xs(t)
without any distortion. This implies that xs(t), the appropriately sampled version of x(t),
contains all information about x(t) and thus represents x(t).
E
The second part suggests a method of recovering x(t) from its sampled version xs(t) by using
C
an ideal low pass filter. As indicated by dotted lines in Fig. 1.2.1, an ideal low pass filter (with
D
brick-wall type response) with a bandwidth W ≤ B < (fs – W), when fed with xs (t), will
allow the portion of Xs (f), centered at f = 0 and will reject all its replicas at f = n fs, for n ≠ 0.
This implies that the shape of the continuous time signal xs(t), will be retained at the output
of the ideal filter.
Quantization:
The process of transforming Sampled amplitude values of a message signal into a discrete
amplitude value is referred to as Quantization.
A quantizer is memory less in that the quantizer output is determined only by the value of a
corresponding input sample, independently of earlier analog samples applied to the input.
Page 3
EC6501 DIGITAL COMMUNICATION
Types of Quantizers:
1. Uniform Quantizer
2. Non- Uniform Quantizer
E
C
Uniform Quantizer: In Uniform type, the quantization levels are uniformly spaced, whereas in
non-uniform type the spacing between the levels will be unequal and mostly the relation is logarithmic.
D
Page 4
EC6501 DIGITAL COMMUNICATION
E
C
D
Page 5
EC6501 DIGITAL COMMUNICATION
“The Quantization process introduces an error defined as the difference between the input signal,
x(t) and the output signal, yt). This error is called the Quantization Noise.”
Quantization noise is produced in the transmitter end of a PCM system by rounding off sample
values of an analog base-band signal to the nearest permissible representation levels of the
quantizer. As such quantization noise differs from channel noise in that it is signal dependent.
Let “Δ‟ be the step size of a quantizer and L be the total number of quantization levels. Quantization
levels are 0, ± Δ., ± 2 Δ., ±3 Δ . . . . . . . The Quantization error, Q is a random variable and will
have its sample values bounded by [-(Δ/2) < q < (Δ/2)]. If Δ is small, the quantization error can be
assumed to a uniformly distributed random variable.
X = Quantizer input
Y = Quantizer output
E
Y=Q(x)
which is a staircase function that befits the type of mid tread or mid riser quantizer of interest.
In Non – Uniform Quantizer the step size varies. The use of a non – uniform quantizer is
equivalent to passing the baseband signal through a compressor and then applying the
compressed signal to a uniform quantizer. The resultant signal is then transmitted.
Page 6
EC6501 DIGITAL COMMUNICATION
At the receiver, a device with a characteristic complementary to the compressor called Expander is
used to restore the signal samples to their correct relative level. The Compressor and expander take
together constitute a Compander.
1. Higher average signal to quantization noise power ratio than the uniform quantizer when the
signal pdf is non uniform which is the case in many practical situation.
2. RMS value of the quantizer noise power of a non – uniform quantizer is substantially
proportional to the sampled value and hence the effect of the quantizer noise is reduced.
the signal is first passed through sampler which is sampled at a rate of (fs) where:
The output of the sampler x(nTs) which is discrete in time is fed to a „q‟ level quantizer. The quantizer
compares the input x(nTs) with it's fixed levels. It assigns any one of the digital level to x(nTs) that
E
results in minimum distortion or error. The error is called quantization error, thus the output of the
quantizer is a digital level called q(nTs). The quantized
C
D
signal level q(nTs) is binary encode. The encoder converts the input signal to v digits binary word.The
receiver starts by reshaping the received pulses, removes the noise and then converts the binary bits to
analog.
The received samples are then filtered by a low pass filter; the cut off frequency is at fc. fc= fm.
Page 7
EC6501 DIGITAL COMMUNICATION
It is impossible to reconstruct the original signal x(t) because of the permanent quantization error
introduced during quantization at the transmitter. The quantization error can be reduced by the
increasing quantization levels. This corresponds to the increase of bits per sample(more
information). But increasing bits (v) increases the signaling rate and requires a large transmission
bandwidth. The choice of the parameter for the number of quantization levels must be acceptable
with the quantization noise (quantization error).
Let the quantizer use 'v' number of binary digits to represent each level. Then the number of levels
that can be represented by v digits will
be : q=2v
The number of bits per second is given by : (Number of bits per second) =(Number of bits per
E
samples) x (number of samples per second) = v (bits per sample) x fs (samples per second).
C
The number of bits per second is also called signaling rate of PCM and is Signaling rate= v fs
D
Errors are introduced in the signal because of the quantization process. This error is called
"quantization error".
ε= xq (nTs)- x(nTs)
Let an input signal x(nTs) have an amplitude in the range of xmax to - xmax
If the amplitude range is divided into 'q' levels of quantizer, then the step size 'Δ'. Δ= q/2 X max
If the minimum and maximum values are equal to 1, xmax,=1, - xmax=-1, Δ= q/2.
Page 8
EC6501 DIGITAL COMMUNICATION
Let the normalized signal power is equal to P then the signal to quantization noise will be
given by:
E
C
D
Advantages of PCM
1. Effect of noise is reduced.
2. PCM permits the use of pulse regeneration.
3. Multiplexing of various PCM signals is possible.
Page 9
EC6501 DIGITAL COMMUNICATION
Digital Multiplexers:
Linear prediction is a mathematical operation where future values of a discrete time signal are
D
In digital signal processing, linear prediction is often called linear predictive coding (LPC) and
can thus be viewed as a subset of filter theory.
Filter design is the process of designing a signal processing filter that satisfies a set of
requirements, some of which are contradictory. The purpose is to find a realization of the filter that
meets each of the requirements to a sufficient degree to make it useful.
The filter design process can be described as an optimization problem where each requirement
contributes to an error function which should be minimized. Certain parts of the design process can
be automated, but normally an experienced electrical engineer is needed to get a good result.
optimization is the selection of a best element (with regard to some criteria) from some set of
available alternatives.
In the simplest case, an optimization problem consists of maximizing or minimizing a real function
by systematically choosing input values from within an allowed set and computing the value of the
function. The generalization of optimization theory and techniques to other
Page
10
EC6501 DIGITAL COMMUNICATION
formulations comprises a large area of applied mathematics More generally, optimization includes
finding "best available" values of some objective function given a defined domain or a set of
constraints), including a variety of different types of objective functions and different types of
domains.
LPC starts with the assumption that a speech signal is produced by a buzzer at the end of a tube
(voiced sounds), with occasional added hissing and popping sounds. Although apparently crude,
this model is actually a close approximation of the reality of speech production. The glottis the
space between the vocal folds) produces the buzz, which is characterized by its intensity (loudness)
and frequency (pitch). The vocal tract (the throat and mouth) forms the tube, which is
characterized by its resonances, which give rise to formats, or enhanced frequency bands in the
sound produced. Hisses and pops are generated by the action of the tongue, lips and throat during
sibilants and plosives.
LPC analyzes the speech signal by estimating the formants, removing their effects from the speech
signal, and estimating the intensity and frequency of the remaining buzz. The process of removing
the formants is called inverse filtering, and the remaining signal after the subtraction of the filtered
modeled signal is called the residue.
The numbers which describe the intensity and frequency of the buzz, the formants, and the residue
signal, can be stored or transmitted somewhere else. LPC synthesizes the speech signal by reversing
the process: use the buzz parameters and the residue to create a source signal, use the formants to
create a filter (which represents the tube), and run the source through the filter, resulting in speech.
E
Because speech signals vary with time, this process is done on short chunks of the speech signal,
C
which are called frames; generally 30 to 50 frames per second give intelligible speech with good
D
compression.
It is one of the most powerful speech analysis techniques, and one of the most useful methods for
encoding good quality speech at a low bit rate and provides extremely
accurate estimates of speech parameters.
Page
11
EC6501 DIGITAL COMMUNICATION
where x^(nTs) is the prediction for unquantized sample x(nTs). This predicted
value is produced by using a predictor whose input, consists of a quantized versions of
the input signal x(nTs). The signal e(nTs) is called the prediction error.
By encoding the quantizer output, in this method, we obtain a modified version
of the PCM called differential pulse code modulation (DPCM).
Quantizer output,
v(nTs) = Q[e(nTs)]
= e(nTs) + q(nTs) ---- (3.32)
Predictor input is the sum of quantizer output and predictor output,
u(nTs) = x^(nTs) + v(nTs) ---- (3.33)
Using 3.32 in 3.33,
u(nTs) = x^(nTs) + e(nTs) + q(nTs) ----(3.34)
u(nTs) = x(nTs) + q(nTs) ----(3.35)
The receiver consists of a decoder to reconstruct the quantized error signal.
The quantized version of the original input is reconstructed from the decoder output using
the same predictor as used in the transmitter. In the absence of noise the
encoded signal at the receiver input is identical to the encoded signal at the transmitter
output. Correspondingly the receive output is equal to u(nTs), which differs from the input
x(nts) only by the quantizing error q(nTs).
E
C
D
Page
12
EC6501 DIGITAL COMMUNICATION
DM provides a staircase approximation to the over sampled version of an input base band signal.
D
The difference between the input and the approximation is quantized into only two levels, namely,
±δ corresponding to positive and negative differences, respectively, Thus, if the approximation
falls below the signal at any sampling epoch, it is increased by δ. Provided that the signal does not
change too rapidly from sample to sample, we find that the stair case approximation remains
within ±δ of the input signal. The symbol δ denotes the absolute value of the two representation
levels of the one-bit quantizer used in the DM.
Page
13
EC6501 DIGITAL COMMUNICATION
E
C
D
Let the input signal be x(t) and the staircase approximation to it is u(t).
Page
14
EC6501 DIGITAL COMMUNICATION
In the receiver the stair case approximation u(t) is reconstructed by passing the incoming sequence
of positive and negative pulses through an accumulator in a manner similar to that used in the
transmitter. The out-of –band quantization noise in the high frequency staircase waveform u(t) is
E
rejected by passing it through a low-pass filter with a band-width equal to the original signal
C
Disadvantage of DM: Delta modulation systems are subject to two types of quantization error:
Page
15
EC6501 DIGITAL COMMUNICATION
E
C
D
Page
16
EC6501 DIGITAL COMMUNICATION
coupled. Magnetic recording system or system using transformer coupling are less sensitive to
C
low frequency signal components. Low frequency component may lost, if the presence of dc or
near dc spectral component is significant in the code itself.
D
Self synchronization
Any digital communication system requires bit synchronization. Coherent detector requires carrier
synchronization.
For example Manchester code has a transition at the middle of every bit interval irrespective of
whether a 1 or 0 is being sent This guaranteed transmitter provide a clocking signal at the bit
level.
Error detection
Some codes such as duo binary provide the means of detecting data error without introducing
additional error detection bits into the data sequence.
Some codes such as multilevel codes increase the efficiency of the bandwidth utilization by
allowing a reduction in required bandwidth for a given data rate, thus more information transmitted
per unit band width.
DIFFERENTIAL ENCODING
This technique is useful because it allow the polarity of differentially encoded waveform to be
inverted without affecting the data detection. In communication system where
Page
17
EC6501 DIGITAL COMMUNICATION
NOISE IMMUNITY
For same transmitted energy some codes produces lesser bit detection error than other in the
presence of noise. For ex. The NRZ waveforms have better noise performance than the RZ type.
On aspect of spectrum matching is dc coupling. Also transmission bandwidth of the code musts is
sufficient small compared to channel bandwidth so that ISI is not problem.
TRANSPARENCY
A line doe should be so designed that the receiver does not go out of synchronization for any line
sequence of data symbol. A code is not transparent if for some sequence of symbol, the clock is lost.
Line coding refers to the process of representing the bit stream (1s and 0s) in the form of
voltage or current variations optimally tuned for the specific properties of the physical channel
being used. The selection of a proper line code can help in so many ways: One possibility is to
E
aid in clock recovery at the receiver. A clock signal is recovered by observing transitions in the
C
received bit sequence, and if enough transitions exist, a good recovery of the clock is guaranteed, and
the signal is said to be self-clocking.
D
Another advantage is to get rid of DC shifts. The DC component in a line code is called the
bias or the DC coefficient. Unfortunately, most long-distance communication channels cannot transport
a DC component. This is why most line codes try to eliminate the DC component before being
transmitted on the channel. Such codes are called DC balanced, zero-DC, zero-bias, or DC equalized.
Some common types of line encoding in common-use nowadays are unipolar, polar, bipolar, Manchester,
MLT-3 and Duobinary encoding.
These codes are explained here: 1. Unipolar (Unipolar NRZ and Unipolar RZ): Unipolar
is the simplest line coding scheme possible. It has the advantage of being compatible with TTL logic.
Unipolar coding uses a positive rectangular pulse p(t) to represent binary 1, and the absence of a
pulse (i.e., zero voltage) to represent a binary 0.
Two possibilities for the pulse p(t) exist3:
Non-Return-to-Zero (NRZ) rectangular pulse and Return-to-Zero (RZ) rectangular pulse.
The difference between Unipolar NRZ and Unipolar RZ codes is that the rectangular pulse in NRZ stays at
a positive value (e.g., +5V) for the full duration of the logic 1 bit, while the pule in RZ drops from
+5V to 0V in the middle of the bit time.
A drawback of unipolar (RZ and NRZ) is that its average value is not zero, which means it creates
a significant DC-component at the receiver (see the impulse at zero frequency in the corresponding
power spectral density (PSD) of this line code.
Page
18
EC6501 DIGITAL COMMUNICATION
that polar signals have more power than unipolar signals, and hence have better SNR at the
receiver. Actually, polar NRZ signals have more power compared to polar RZ signals. The
drawback of polar NRZ, however, is that it lacks clock information especially when a long
E
Non-Return-to-Zero, Inverted (NRZI): NRZI is a variant of Polar NRZ. In NRZI there are
D
two possible pulses, p(t) and –p(t). A transition from one pulse to the other happens if the bit
being transmitted is logic 1, and no transition happens if the bit being transmitted is a logic 0.
This is the code used on compact discs (CD), USB ports, and on fiber-based Fast Ethernet at
100-Mbit/s.
Manchester encoding:
In Manchester code each bit of data is signified by at least one transition. Manchester
encoding is therefore considered to be self-clocking, which means that accurate clock
recovery from a data stream is possible. In addition, the DC component of the encoded signal
is zero. Although transitions allow the signal to be self-clocking, it carries significant
overhead as there is a need for essentially twice the bandwidth of a simple NRZ or NRZI
encoding.
Page
19
EC6501 DIGITAL COMMUNICATION
E
C
D
Unipolar most of signal power is centered on origin and there is waste of power due to DC
component that is present.
Polar format most of signal power is centered on origin and they are simple to implement.
• Bipolar format does not have DC component and does not demand more bandwidth, but
power requirement is double than other formats.
• Manchester format does not have DC component but provides proper clocking.
Page
20