Scribd
Upload
96 views

Unit 2 - Week 1: Assignment 1

Uploaded by

shubham
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
96 views

Unit 2 - Week 1: Assignment 1

Uploaded by

shubham
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Information Theory, Coding and Cryptography - ... https://onlinecourses.nptel.ac.in/noc18_ee39/un...

[email protected] ▼

Courses » Information Theory, Coding and Cryptography

Announcements Course Ask a Question Progress Mentor FAQ

Unit 2 - Week
1

Course
outline
Assignment 1
The due date for submitting this assignment has passed.
How to access As per our records you have not submitted this Due on 2018-08-15, 23:59 IST.
the portal assignment.

Week 1 1) Pick the correct choice 1 point

Introduction to I(X; Y) = H(X) – H(X|Y)


Information
Theory I(X; Y) = H(Y) – H(Y|X)
Entropy, Mutual Both a. and b
Information,
Conditional and None
Joint Entropy
No, the answer is incorrect.
Measures for Score: 0
Continuous
Random Accepted Answers:
Variable, Both a. and b
Relative
Entropy 2) The chain rule is given by 1 point

Quiz :
H(X, Y) = H(X) + H(Y|X)
Assignment 1
H(X, Y) = H(Y) - H(X|Y)
New Lesson
H(X, Y) = H(X) + H(X|Y)
Week 2
None
Week 3
No, the answer is incorrect.
Score: 0
Week 4
Accepted Answers:
Week 5 H(X, Y) = H(X) + H(Y|X)

3) Can differential entropy be negative? 1 point


Week 6

No, never
Week 7
Yes, depends on the choice of the pdf
Week 8

© 2014 NPTEL - Privacy & Terms - Honor Code - FAQs -


A project of In association with

Funded by

1 of 4 Friday 09 November 2018 10:50 AM


Information Theory, Coding and Cryptography - ... https://onlinecourses.nptel.ac.in/noc18_ee39/un...

4) When is H(X|Y) = H(X)


Powered by ? 1 point
Week 12

When X and Y are dependent


Additional
Lectures When X = f(Y)

When X? Y

When X and Y are independent

No, the answer is incorrect.


Score: 0
Accepted Answers:
When X and Y are independent

5) A source, X, has an infinitely large set of outputs with probability of occurrence given by 0 points
P(xi) = 2-i, i = 1, 2, 3, ..... What is the average self information, H(X), of this source?

H(p2) bits

1/p H(p) bits

pH(p) bits

H(p) bits

No, the answer is incorrect.


Score: 0
Accepted Answers:
1/p H(p) bits

6) The Jensen’s inequality given by __________________ where E[.] is the expectation 1 point
operator.

E[f(X)] ≥ f[E(X)]

E[f(X)] < f[E(X)]

E[f(X)] ≤ f[E(X)]

None

No, the answer is incorrect.


Score: 0
Accepted Answers:
E[f(X)] ≥ f[E(X)]

7) Let X denote the number of tosses required for a coin until the first tail appears. The 1 point
entropy H(X) if the probability of getting a tail is p is given by

H(p)

p H(p)

1/p H(p)

p 2 H(p)

No, the answer is incorrect.


Score: 0
Accepted Answers:
1/p H(p)

8) Suppose a source produces independent symbols from the alphabet {a1, a2, a3}, with 1 point
probabilities p1 = 0.4999999, p2 = 0.4999999, and p3 = 0.0000002. The entropy, H(X), of this source is

Less than 1

More than 1

2 of 4 Friday 09 November 2018 10:50 AM


Information Theory, Coding and Cryptography - ... https://onlinecourses.nptel.ac.in/noc18_ee39/un...

Equal to 1

None

No, the answer is incorrect.


Score: 0
Accepted Answers:
More than 1

9) The channel shown below is a 1 point

binary asymmetric channel

binary symmetric channel

ternary symmetric channel

ternary asymmetric channel

No, the answer is incorrect.


Score: 0
Accepted Answers:
binary symmetric channel

10)Which of the following gives the differential entropy, h(X), for the uniformly distributed 1 point
random variable X with the pdf,

log2(2a)

log2(a2)

log2(a)

log2(a–1)

No, the answer is incorrect.


Score: 0
Accepted Answers:
log2(a)

Previous Page End

3 of 4 Friday 09 November 2018 10:50 AM


Information Theory, Coding and Cryptography - ... https://onlinecourses.nptel.ac.in/noc18_ee39/un...

4 of 4 Friday 09 November 2018 10:50 AM

You might also like