Scribd
Upload
52 views

Department of Physics: HETT210: Digital Communication Systems Continuous Assessment 1

This document contains instructions for a digital communication systems assessment with 6 questions: 1. Define key concepts like source coding, channel encoding/decoding, and digital modulation/demodulation. Also describe how a digital communication system's performance is measured. 2. Define mutual information and explain its relationship to entropy for a lossless channel. 3. Find the generator and parity check matrices for a (7,4) cyclic code. 4. Calculate the channel capacity of a channel with infinite bandwidth. 5. Calculate entropies and mutual information for two jointly distributed sources. 6. Construct a Huffman code with minimum variance for a given probability distribution.

Uploaded by

Shawn Moyo
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
52 views

Department of Physics: HETT210: Digital Communication Systems Continuous Assessment 1

This document contains instructions for a digital communication systems assessment with 6 questions: 1. Define key concepts like source coding, channel encoding/decoding, and digital modulation/demodulation. Also describe how a digital communication system's performance is measured. 2. Define mutual information and explain its relationship to entropy for a lossless channel. 3. Find the generator and parity check matrices for a (7,4) cyclic code. 4. Calculate the channel capacity of a channel with infinite bandwidth. 5. Calculate entropies and mutual information for two jointly distributed sources. 6. Construct a Huffman code with minimum variance for a given probability distribution.

Uploaded by

Shawn Moyo
Copyright
© © All Rights Reserved
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 1

Department of Physics:

HETT210: Digital Communication Systems

Continuous Assessment 1:

1.  From your knowledge of a digital communication system, answer the following questions:

(a) What is source coding ? [2]

(b) What is the purpose of the channel encoder and channel decoder ? [2]

(c) What is the purpose of the digital modulator and digital demodulator ? [2]

(d)  Describe how the performance of a digital communication system can be measured and explain the parameters
that can limit the performance of such a system [4]

2. Define Mutual Information. Explain how it is related to entropy for a lossless channel, prove that
H(X/Y) = 0. [10]

3. Find the generator and parity check matrices of a (7, 4) cyclic code with generator polynomial
g( X )  1 X  X 3 . [10]

4. From channel capacity theorem, find the capacity of a channel with infinite bandwidth and explain. [5]

5. Consider that two sources emit messages xl, x2, x3 and y1, y2, y3 with the joint probabilities
p (X, Y) as shown in the matrix form:

3 1 1
 40 40 40 
1 3 1
 
 20 20 20 
1 1 3
 8 8 20 

a) Calculate the entropies of X and Y. [6]

b) Calculate the joint and conditional entropies, H (X,Y), H (X/Y), H(Y/X) between X and Y [9]

c) Calculate the average mutual information I(X;Y). [4]

6. Construct the Huffman code with minimum code variance for the following probabilities and also
determine the code variance and code efficiency: {0.25, 0.25. 0.125, 0.125, 0.125, 0.0625, 0.0625} [10]

You might also like