Tutorial 6
Tutorial 6
Tutorial 6
Part 1
1. Consider a source that produces six messages with probabilities 1/2, 1/4, 1/8, 1/16, 1/32
and 1/32. Determine the average information content in a message.
2. (a) Determine the average capacity that would be required to transmit a high-resolution
black-and-white TV signal at the rate of 32 pictures per second if each picture is made
up of 2x106 picture elements and 16 different brightness levels. All picture elements
are assumed to be independent and all levels have equal likelihood of occurrence.
(b) A colour TV system additionally provides for 64 different shades of colour. Compare
the capacity required for this colour system with that of the black-and-white system.
Symbol s0 s1 s2 s3 s4 s5 s6
Probability 0.25 0.25 0.125 0.125 0.125 0.0625 0.0625
Part 2
4. A computer executes 4 instructions that are designated by the codewords (00, 01, 10, 11).
Assuming that the instructions are used independently with the probability of (0.5, 0.25,
0.125, 0.125), determine whether it is possible to improve the efficiency of the code using
the Shannon-Fano and Huffman coding techniques.
7. For a fixed probability of channel symbol error, the probability of bit error for a
Hamming (15,11) code is worse than that for a Hamming (7,4) code. However, Hamming
(15,11) code is more efficient. Justify your discussion.