WC_mod 2_PART1
WC_mod 2_PART1
Capacity of channel means, maximum error-free data rate that a channel can
support.
Mutual information :
2
Consider a discrete-time Additive White Gaussian Noise (AWGN) channel with
𝑦 [𝑖] = 𝑥 [𝑖] + 𝑛 [𝑖] , where 𝑥 [𝑖] is the channel input at time 𝑖, 𝑦 [𝑖] is the corresponding
The channel SNR, the power in 𝑥 [𝑖] divided by the power in 𝑛 [𝑖] , is constant and
given by 𝛾= 𝑃 /𝑁0𝐵 , P is transmit power,𝑁0 is the power spectral density of the noise
with unit W/Hz and B is the received signal bandwidth.
3
4
Wireless channels typically exhibit flat or frequency-selective
fading. In the next two sections we consider capacity of flat-
fading and frequency-selective fading channels under different
assumptions regarding what is known about the channel.
5
Channel and System Model
Assume a discrete-time channel with stationary and ergodic time-varying gain
and AWGN 𝑛 [𝑖] .
The channel power gain g[i] follows a given distribution p(g), e.g. for Rayleigh fading,
p(g) is exponential. The channel gain g[i] can change at each time i.
The channel power gain 𝑔 [𝑖] follow a given distribution p(g) and independent of the
channel input.
𝑔 [𝑖] is the fading distribution over the channel.
6
Let P denote the average transmit signal power, 𝑁0/2 denote the noise spectral density of n[i],
7
Capacity defines theoretical rate limit Maximum error free rate a channel can
support.
The capacity of this channel depends on what is known about g[i] at the transmitter and
receiver. We will consider three different scenarios regarding this knowledge: Channel
Distribution Information (CDI), Receiver CSI and Transmitter and Receiver CSI
8
A. First consider the case where the channel gain distribution p(g) or,
Now consider the case where the CSI g[i] is known at the receiver at time i. Equivalently, g[i] is
Assume that both the transmitter and receiver know the distribution of g[i].
In this case, there are two channel capacity definitions that are relevant to system design:
Shannon capacity, also called ergodic capacity, and capacity with outage.
9
For the AWGN channel, Shannon capacity defines the maximum data rate that can be sent over the
Note that for Shannon capacity the rate transmitted over the channel is constant: the transmitter cannot
Capacity with outage is defined as the maximum rate that can be transmitted over a channel with some
outage probability corresponding to the probability that the transmission cannot be decoded with
negligible error probability.
The basic premise of capacity with outage is that a high data rate can be sent over the channel and decoded
correctly except when the channel is in deep fading. By allowing the system to lose some data in the event
of deep fades, a higher data rate can be maintained if all data must be received correctly regardless of the
fading state.
10
Shannon capacity of a fading channel with receiver CSI for an average power constraint P can
be obtained as
This formula is a probabilistic average, i.e. Shannon capacity is equal to Shannon capacity for
an AWGN channel with SNR γ, given by B log2(1 + γ), averaged over the distribution of γ. That
is why Shannon capacity is also called Ergodic capacity.
By Jensen’s inequality,
Here we see that the Shannon capacity of a fading channel with receiver CSI only is less than
the Shannon capacity of an AWGN channel with the same average SNR.
In other words, fading reduces Shannon capacity when only the receiver has CSI.
11
Capacity with outage applies to slowly-varying channels.
Capacity with outage allows bits sent over a given transmission burst to be decoded at the end
of the burst with some probability that these bits will be decoded incorrectly.
If the channel has received SNR 𝛾 during a burst, then data can be sent over the channel at rate
Capacity with outage allows bits sent over a given transmission burst to be decoded at the end
of the burst with some probability that these bits will be decoded incorrectly.
Specifically, the transmitter fixes a minimum received SNR and encodes for a data rate 𝐶 = 𝐵
𝑙𝑜𝑔2( 1 + 𝛾𝑚𝑖𝑛) .
The data is correctly received if the instantaneous received SNR is greater than or equal to 𝛾𝑚𝑖𝑛
.
12
If the received SNR is below pout then the receiver declares an outage.
The average rate correctly received over many transmission bursts is s since data
is only correctly received on 1- pout transmissions.
13
A. When both the transmitter and receiver have CSI, the transmitter can
adapt its transmission strategy relative to this CSI
In this case, there is no notion of capacity versus outage where the transmitter sends bits that
cannot be decoded, since the transmitter knows the channel and thus will not send bits unless
they can be decoded correctly.
14
Let denote Cs the capacity of a particular channel s Ɛ S, and p(s) denote the probability, or
fraction of time, that the channel is in state s. The capacity of this time-varying channel is then
given by,
The capacity of the fading channel with transmitter and receiver side information is
Define the fading channel capacity with average power constraint as,
15
Solving for P(ℽ) with the constraint that P(ℽ) > 0 yields the optimal power adaptation that
If ℽ [i] is below this cutoff then no data is transmitted over the ith time interval, so the
17
The interpretation for power allocation says that, below 𝛾0 there is no transmission.
Very good channels are on extreme right, so they get power approximately,
For better SNRs, increasing level of power allocation.
This power allocation can be interpreted in terms of water filling, because inside the
bowl or basin , when we fill water, the depth of water tells us how much power allocate
for that SNR.
18
Consider a suboptimal transmitter adaptation scheme where the transmitter uses the CSI to
The channel then appears to the encoder and decoder as a time-invariant AWGN channel. This
power adaptation, called channel inversion, is given by P(γ)/P = σ/γ, where σ equals the
constant received SNR that can be maintained with the transmit power constraint given below.
Fading channel capacity with channel inversion is just the capacity of an AWGN channel with
SNR σ
19
The capacity-achieving transmission strategy for this capacity uses a fixed-rate encoder and
This has the advantage of maintaining a fixed data rate over the channel regardless of channel
conditions.
For this reason the channel capacity given in the above equation is called zero-outage capacity,
since the data rate is fixed under all channel conditions and there is no channel outage.
environments.
20
21
The reason zero-outage capacity may be significantly smaller than Shannon capacity on a
fading channel is the requirement to maintain a constant data rate in all fading states.
By suspending transmission in particularly bad fading states (outage channel states), we can
maintain a higher constant data rate in the other states and thereby significantly increase
capacity.
The outage capacity is defined as the maximum rate that can be maintained in all non-outage
Outage capacity is achieved with truncated channel inversion policy for power adaption that
22
The outage capacity associated with a given outage probability Pout and corresponding cutoff γ0
is given by,
23
Consider a time-invariant channel with frequency response H(f).
When the channel is time-invariant it is typically assumed that H(f) is known at both the
Let us first assume that H(f) is block-fading, so that frequency is divided into sub channels
24
25
The capacity of this parallel set of channels is the sum of rates associated with each
This is similar to the capacity and optimal power allocation for a flatfading channel,
with power and rate changing over frequency in a deterministic way rather than over
time in a probabilistic way.
The optimal power allocation is found via the same Lagrangian technique used in the
26
Let, ℽj = |Hj |²P/(N0B) is the SNR associated with the jth channel
The cutoff value is obtained by substituting the power adaptation formula into the power
This capacity is achieved by sending at different rates and powers over each subchannel.
27