Scribd
Upload
22 views

Birla Institute of Technology and Science-Pilani: Coding Theory & Practice EEE G612

This document is the mid-semester examination for a Coding Theory and Practice course. It contains 4 questions assessing students' knowledge of coding theory concepts like error detection capabilities of different codes, channel capacity calculations, entropy calculations for data compression, and constructing and applying Hamming codes. Students are asked to determine properties of specific codes, calculate information measures for given distributions, derive Huffman codes to compress data, and work with generator matrices and decoding arrays for the (7,4) Hamming code.

Uploaded by

RahulGupta
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
22 views

Birla Institute of Technology and Science-Pilani: Coding Theory & Practice EEE G612

This document is the mid-semester examination for a Coding Theory and Practice course. It contains 4 questions assessing students' knowledge of coding theory concepts like error detection capabilities of different codes, channel capacity calculations, entropy calculations for data compression, and constructing and applying Hamming codes. Students are asked to determine properties of specific codes, calculate information measures for given distributions, derive Huffman codes to compress data, and work with generator matrices and decoding arrays for the (7,4) Hamming code.

Uploaded by

RahulGupta
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

BIRLA INSTITUTE OF TECHNOLOGY AND SCIENCE-PILANI

DATE: 05-10-12

IST SEMESTER-2012-13
MID-SEMESTER EXAMINATION
Coding Theory & Practice EEE G612
TIME: 4 -5.30 PM

MAX. MARKS = 25

1. a) Is the codewords {10101, 00010, 01111, 11000} of a code (5, 2, 3). Explain with reason.
[1]
b) Are the given code C1 = 10110, C2 = 00101, C3 = 1101,1 linear code or not. Explain with
reason.
[1]
c) Find the channel capacity for BSC with error probability of 0, 0.5, and 1.
[2]
d) A discrete memoryless source emits a sequence of statistically independent binary digits with
probabilities p(1) = 0.005 and p(0) = 0.995. The digits are taken 10 at a time. Find out the
number of elements in typical set and their probability.
[2]
2. The information X is mapped to Y as shown below
XY
X1 Y1
X2
X3 Y2
X4
X5 Y3
X6
X7 Y4
X8
Assume all the elements of input source X and are Output Y equi-probable. Find
a) H(X) & H(Y)
b) H(XY) & H(YX).
c) H(X;Y)
d) H(Y) H(Y | X).
e) I (X; Y).
f) Draw a Venn diagram for the quantities in parts (a) through (e).
[6]
P.T.O

3. Consider the random variable X and the probabilities are given below
x1
0.49

x2
0.26

x3
0.12

x4
0.04

x5
0.04

x6
0.03

x7
0.02

a) Find a binary Huffman code for X.


b) Find the expected code length for this encoding.
c) Find a ternary Huffman code for X.
[5]
4. Write the (7, 4) Hamming code generator matrix in systematic form. (Show all the steps).
Write he Standard Array for same (7, 4) code. How many errors can be detect and correct by this
code. Find the codeword for 0001 input. Decode the received word of 0001001 by standard
Array.
[8]

****GOOD LUCK****

You might also like