Scribd
Upload
24 views4 pages

8-Self Information and Entropy - Part-1!06!01-2024 (1)

ITC

Uploaded by

Yash Raj Dhaker
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
24 views4 pages

8-Self Information and Entropy - Part-1!06!01-2024 (1)

ITC

Uploaded by

Yash Raj Dhaker
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

Corsider a n, times

Tott munber
SPi log ( ) bnK
ke

times Conside
M

lach

ntetsowee ote
Total infomatien
T= (+)
dehinstis, Conteat on Soee
H=
Totad hmaton
Ttal nos
N

H
N (P!
ncentauinity.
vg. hormatior /Ay
Ey
Let

N= 11.
11 (Tota no gombse)
)

Negeatdi s .
H =

el
|3092

Sowee tiere ane three symbs


Ey 2 menoges
For a dischete Detnine
þrobaaluHo dil. values o a
vaatsn for
Ssunce and aketeh it

(-)
bg,()
t.(+()
Rog() +()

4
¢ bit of intomati
defned mesaes
deeond. wRue = yale at whiek
R= x H ahe geuent
H
mesçases X

Second Meclage.
Tufomation Bits /ecend.
sauttdat
baudlimited to B th aud
is
gnatizd bevals. Fack levst
h messags. he þrot
ae
de AamplesJos here are 4
Wygnist nte' mesae
'omnt
oewramee Tate he Sownce
tntomatie
Ptnd tie
on the rult.

1'8
3 )
B H
at
Now as Jsee Ttceodingto
Nggndit rate = Jamjea Sarglin The
dame genates
Med
hfomair Rale i’
34 B

R= 368 bit sc
fRe abo Ve
Comnent:baac We poeoent
PCM The tooansmussion
Binary Digits
Msq binangdaigits.
digibit
mumencel,
Samhing
3/8
3/8
Tioso ne
cgits binant.
hegirel
for evmy mesiage
P4
NoN 1 binit &1 bit o mfomatin Seesnd
4B btt infornatio prr
but we Kave femd nt that the tntmatin rate (R) ==36 B
So. he Curent trasmison scheme o meapes does hot
utlize the comgolee meage casying capabilithes f a PoM.

(4)) - a bits /msage


R= = 4 bits/tee
the as mm y tRe mayyimum
pCM Coing
infomation Gate is acheed if a messaes ae

You might also like