Probability Theory and Stochastic Processes (13A04304) n

UNIT-3: RANDOM PROCESSES:TEMPORAL CHARACTERISTICS

The random processes are also called as stochastic processes which deal with
randomly varying time wave forms such as any message signals and noise. They are
described statistically since the complete knowledge about their origin is not known. So
statistical measures are used. Probability distribution and probability density functions give
the complete statistical characteristics of random signals. A random process is a function of
both sample space and time variables. And can be represented as {X x(s,t)}.

Deterministic and Non-deterministic processes: In general a random process may be

deterministic or non deterministic. A process is called as deterministic random process if
future values of any sample function can be predicted from its past values. For example, X(t)
= A sin (ω0t+ϴ), where the parameters A, ω0 and ϴ may be random variables, is deterministic
random process because the future values of the sample function can be detected from its
known shape. If future values of a sample function cannot be detected from observed past
values, the process is called non-deterministic process.

Classification of random process: Random processes are mainly classified into four types
based on the time and random variable X as follows.

1. Continuous Random Process: A random process is said to be continuous if both the

random variable X and time t are continuous. The below figure shows a continuous
random process. The fluctuations of noise voltage in any network is a continuous
random process.

2. Discrete Random Process: In discrete random process, the random variable X has
only discrete values while time, t is continuous. The below figure shows a discrete
random process. A digital encoded signal has only two discrete values a positive level
and a negative level but time is continuous. So it is a discrete random process.

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 1

Probability Theory and Stochastic Processes (13A04304) n
3. Continuous Random Sequence: A random process for which the random variable X is
continuous but t has discrete values is called continuous random sequence. A
continuous random signal is defined only at discrete (sample) time intervals. It is also
called as a discrete time random process and can be represented as a set of random
variables {X(t)} for samples tk, k=0, 1, 2,….

4. Discrete Random Sequence: In discrete random sequence both random variable X and
time t are discrete. It can be obtained by sampling and quantizing a random signal.
This is called the random process and is mostly used in digital signal processing
applications. The amplitude of the sequence can be quantized into two levels or multi
levels as shown in below figure s (d) and (e).

Joint distribution functions of random process: Consider a random process X(t). For a
single random variable at time t1, X1=X(t1), The cumulative distribution function is defined as
FX(x1;t1) = P {(X(t1) x1} where x1 is any real number. The function FX(x1;t1) is known as the
first order distribution function of X(t). For two random variables at time instants t 1 and t2
X(t1) = X1 and X(t2) = X2, the joint distribution is called the second order joint distribution
function of the random process X(t) and is given by

FX(x1, x2 ; t1, t2) = P {(X(t1) x1, X(t2) x2}. In general for N random variables at N time
th
intervals X(ti) = Xi i=1,2,…N, the N order joint distribution function of X(t) is defined as

FX(x1, x2…… xN ; t1, t2,….. tN) = P {(X(t1) x1, X(t2) x2,…. X(tN) xN}.

Joint density functions of random process:: Joint density functions of a random process
can be obtained from the derivatives of the distribution functions.

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 2

Probability Theory and Stochastic Processes (13A04304) www.raveendraforstudentsinfo.i
1. First order density function: fX(x1;t1) = n

2. Second order density function: fX(x1, x2 ; t1, t2) =

th
3. N order density function: fX(x1, x2…… xN ; t1, t2,….. tN) =

Independent random processes: Consider a random process X(t). Let X(ti) = xi, i= 1,2,…N
be N Random variables defined at time constants t1,t2, … t N with density functions fX(x1;t1),
th
fX(x2;t2), … fX(xN ; tN). If the random process X(t) is statistically independent, then the N
order joint density function is equal to the product of individual joint functions of X(t) i.e.

fX(x1, x2…… xN ; t1, t2,….. tN) = fX(x1;t1) fX(x2;t2). . . . fX(xN ; tN). Similarly the joint distribution
will be the product of the individual distribution functions.

Statistical properties of Random Processes: The following are the statistical properties of
random processes.

random process i.e. ̅ (t) = E[X(t)] = ∫

1. Mean: The mean value of a random process X(t) is equal to the expected value of the

2. Autocorrelation: Consider random process X(t). Let X1 and X2 be two random

variables defined at times t1 and t2 respectively with joint density function
fX(x1, x2 ; t1, t2). The correlation of X1 and X2, E[X1 X2] = E[X(t1) X(t2)] is called the
autocorrelation function of the random process X(t) defined as
RXX(t1,t2) = E[X1 X2] = E[X(t1) X(t2)] or

RXX(t1,t2) = ∫

3. Cross correlation: Consider two random processes X(t) and Y(t) defined with
random variables X and Y at time instants t1 and t2 respectively. The joint density
function is fxy(x,y ; t1,t2).Then the correlation of X and Y, E[XY] = E[X(t1) Y(t2)] is
called the cross correlation function of the random processes X(t) and Y(t) which is
defined as
RXY(t1,t2) = E[X Y] = E[X(t1) Y(t2)] or

RXY(t1,t2) = ∫

Stationary Processes: A random process is said to be stationary if all its statistical properties
such as mean, moments, variances etc… do not change with time. The stationarity which
K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 3
Probability
depends onTthe
heory and Sfunctions
density tochastic Phas
rocesses (13A04304)
different n
levels or orders.

1. First order stationary process: A random process is said to be stationary to order

one or first order stationary if its first order density function does not change with
time or shift in time value. If X(t) is a first order stationary process then

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 4

Probability Theory and Stochastic Processes (13A04304) www.raveendraforstudentsinfo.i
fX(x1;t1) = fX(x1;t1+∆t) for any time t1. Where ∆t nis shift in time value. Therefore the

value must be constant at any time instant. i.e. E[X(t)] = ̅ = constant.

condition for a process to be a first order stationary random process is that its mean

2. Second order stationary process: A random process is said to be stationary to order

two or second order stationary if its second order joint density function does not
change with time or shift in time value i.e. fX(x1, x2 ; t1, t2) = fX(x1, x2;t1+∆t, t2+∆t) for
all t1,t2 and ∆t. It is a function of time difference (t2, t1) and not absolute time t. Note
that a second order stationary process is also a first order stationary process. The
condition for a process to be a second order stationary is that its autocorrelation
should depend only on time differences and not on absolute time. i.e. If
RXX(t1,t2) = E[X(t1) X(t2)] is autocorrelation function and τ =t2 –t1 then
RXX(t1,t1+ τ) = E[X(t1) X(t1+ τ)] = RXX(τ) . RXX(τ) should be independent of time t.
3. Wide sense stationary (WSS) process: If a random process X(t) is a second order
stationary process, then it is called a wide sense stationary (WSS) or a weak sense

stationary process are 1. E[X(t)] = ̅ = constant. 2. E[X(t) X(t+τ)] = RXX(τ) is

stationary process. However the converse is not true. The condition for a wide sense

independent of absolute time t.

Joint wide sense stationary process: Consider two random processes X(t) and Y(t). If
they are jointly WSS, then the cross correlation function of X(t) and Y(t) is a function
of time difference τ =t2 –t1only and not absolute time. i.e. RXY(t1,t2) = E[X(t1) Y(t2)] .

process to be joint wide sense stationary are 1. E[X(t)] = ̅ = constant.

If τ =t2 –t1 then RXY(t,t+ τ) = E[X(t) Y(t+ τ)] = RXY(τ). Therefore the conditions for a

2. E[Y(t)] = ̅ = constant 3. E[X(t) Y(t+ τ)] = RXY(τ) is independent of time t.

4. Strict sense stationary (SSS) processes: A random process X(t) is said to be strict
Sense stationary if its Nth order joint density function does not change with time or
shift in time value. i.e.
fX(x1, x2…… xN ; t1, t2,….. tN) = fX(x1, x2…… xN ; t1+∆t, t2+∆t, . . . tN+∆t) for all t1, t2 . . . tN
and ∆t. A process that is stationary to all orders n=1,2,. . . N is called strict sense
stationary process. Note that SSS process is also a WSS process. But the reverse is not
true.

Time Average Function: Consider a random process X(t). Let x(t) be a sample function
which exists for all time at a fixed value in the given sample space S. The average value of

∫
x(t) taken over all times is called the time average of x(t). It is also called mean value of x(t).
It can be expressed as = A[x(t)] =

Time autocorrelation function: Consider a random process X(t). The time average of the

∫
product X(t) and X(t+ τ) is called time average autocorrelation function of x(t) and is denoted
as Rxx(τ) = A[X(t) X(t+τ)] or Rxx(τ) =

.
2

∫
Time mean square function: If τ = 0, the time average of x (t) is called time mean square
2
value of x(t) defined as = A[X (t)] =
K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 5
Probability Theory and Stochastic Processes (13A04304) n
.
Time cross correlation function: Let X(t) and Y(t) be two random processes with sample
functions x(t) and y(t) respectively. The time average of the product of x(t) y(t+ τ) is called

∫
time cross correlation function of x(t) and y(t). Denoted as
Rxy(τ) =

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 6

Probability Theory and Stochastic Processes (13A04304) n

Ergodic Theorem and Ergodic Process: The Ergodic theorem states that for any random

statistical or ensemble averages of X(t). i.e. = ̅ or Rxx(τ) = RXX(τ) . Random processes that
process X(t), all time averages of sample functions of x(t) are equal to the corresponding

satisfy the Ergodic theorem are called Ergodic processes.

Joint Ergodic Process: Let X(t) and Y(t) be two random processes with sample functions
x(t) and y(t) respectively. The two random processes are said to be jointly Ergodic if they are

statistical cross correlation functions. i.e. 1. = ̅ , ̅ = ̅ 2. Rxx(τ) = RXX(τ), Rxy(τ) = RXY(τ)

individually Ergodic and their time cross correlation functions are equal to their respective

and Ryy(τ) = RYY(τ).

average of any sample function x(t) is equal to its statistical average, ̅ which
the probability of all other sample functions is equal to one. i.e. E[X(t)] = ̅ = A[x(t)] =
Mean Ergodic Random Process: A random process X(t) is said to be mean Ergodic if time
is constant and
with probability one for all x(t).
Autocorrelation Ergodic Process: A stationary random process X(t) is said to be
Autocorrelation Ergodic if and only if the time autocorrelation function of any sample
function x(t) is equal to the statistical autocorrelation function of X(t). i.e. A[x(t) x(t+τ)] =
E[X(t) X(t+τ)] or Rxx(τ) = RXX(τ).

Cross Correlation Ergodic Process: Two stationary random processes X(t) and Y(t) are
said to be cross correlation Ergodic if and only if its time cross correlation function of sample
functions x(t) and y(t) is equal to the statistical cross correlation function of X(t) and Y(t). i.e.
A[x(t) y(t+τ)] = E[X(t) Y(t+τ)] or Rxy(τ) = RXY(τ).

Properties of Autocorrelation function: Consider that a random process X(t) is at least

WSS and is a function of time difference τ = t2-t1. Then the following are the properties of the
autocorrelation function of X(t).
2
1. Mean square value of X(t) is E[X (t)] = RXX(0). It is equal to the power (average) of
the process, X(t).
Proof: We know that for X(t), RXX(τ) = E[X(t) X(t+ τ)] . If τ = 0, then RXX(0) = E[X(t)

2. Autocorrelation function is maximum at the origin i.e. | |

2
X(t)] = E[X (t)] hence proved.
RXX(0).
Proof: Consider two random variables X(t1) and X(t2) of X(t) defined at time intervals
2
t1 and t2 respectively. Consider a positive quantity [X(t1) X(t2)] 0
2
Taking Expectation on both sides, we get E[X(t1) X(t2)] 0
2 2
E[X (t1)+ X (t2) 2X(t1) X(t2)] 0
2 2
E[X (t1)]+ E[X (t2) 2E[X(t1) X(t2)] 0
2
RXX(0)+ RXX(0) 2 RXX(t1,t2) 0 [Since E[X (t)] = RXX(0)]
Given X(t) is WSS and τ = t2-t1.
Therefore 2 RXX(0 2 RXX(τ) 0

| |
RXX(0 RXX(τ) 0 or
RXX(0) hence proved.
3. RXX(τ) is an even function of τ i.e. RXX(-τ) = RXX(τ).
Proof: We know that RXX(τ) = E[X(t) X(t+ τ)]
Let τ = - τ then
RXX(-τ) = E[X(t) X(t- τ)]
Let u=t- τ or t= u+ τ
Therefore RXX(-τ) = E[X(u+ τ) X(u)] = E[X(u) X(u+ τ)]

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 7

Probability Theory and Stochastic Processes (13A04304) www.raveendraforstudentsinfo.i
RXX(-τ) = RXX(τ) hence proved. n
4. If a random process X(t) has a non zero mean value, E[X(t)] 0 and Ergodic with no
periodic components, then | |

= ̅ .

the mean value is E[X(t)] = ̅

Proof : Consider a random variable X(t)with random variables X(t1) and X(t2). Given
0 . We know that

components, as| |
RXX(τ) = E[X(t)X(t+τ)] = E[X(t1) X(t2)]. Since the process has no periodic
, the random variable becomes independent,
i.e.
| |
Since X(t) is Ergodic E[X(t1)] = E[ X(t2)] = ̅
= E[X(t1) X(t2)] = E[X(t1)] E[ X(t2)]

Therefore | | = ̅ hence
proved.
5. If X(t) is periodic then its autocorrelation function is also periodic.
Proof: Consider a Random process X(t) which is periodic with period T0
Then X(t) = X(t T0) or
X(t+ ) = X(t T0). Now we have RXX(τ) = E[X(t)X(t+τ)] then
RXX(τ T0) = E[X(t)X(t+τ T0)]
Given X(t) is WSS, RXX(τ T0) = E[X(t)X(t+τ)]
RXX(τ T0) = RXX(τ)
Therefore RXX(τ) is periodic hence proved.
6. If X(t) is Ergodic has zero mean, and no periodic components then
| |

= ̅ . Where ̅
= .
Proof: It is already proved that | | is the mean
value of
X(t) which is given as zero.
Therefore | | = hence
proved.
7. The autocorrelation function of random process RXX(τ) cannot have any arbitrary
shape.
Proof: The autocorrelation function RXX(τ) is an even function of and has maximum
value at the origin. Hence the autocorrelation function cannot have an arbitrary shape
hence proved.
8. If a random process X(t) with zero mean has the DC component A as Y(t) =A + X(t),
2
Then RYY(τ) = A + RXX(τ).
Proof: Given a random process Y(t) =A + X(t).
We know that RYY(τ) = E[Y(t)Y(t+τ)] =E[(A + X(t)) (A + X(t+ τ))]
2
= E[(A + AX(t) + AX(t+ τ)+ X(t) X(t+ τ)]
2
= E[(A ] + AE[X(t)] + E[AX(t+ τ)]+ E[X(t) X(t+ τ)]
2
=A +0+0+ RXX(τ).
2
Therefore RYY(τ) = A + RXX(τ) hence proved.
9. If a random process Z(t) is sum of two random processes X(t) and Y(t)
i.e, Z(t) = X(t) + Y(t). Then RZZ(τ) = RXX(τ)+ RXY(τ)+ RYX(τ)+ RYY(τ)
Proof: Given Z(t) = X(t) + Y(t).
We know that RZZ(τ) = E[Z(t)Z(t+τ)]
= E[(X(t)+Y(t)) (X(t+τ)Y(t+τ))]
= E[(X(t) X(t+τ)+ X(t) Y(t+τ) +Y(t) X(t+τ) +Y(t) Y(t+τ))]
= E[(X(t) X(t+τ)]+ E[X(t) Y(t+τ)] +E[Y(t) X(t+τ)] +E[Y(t) Y(t+τ))]
K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 8
Probability Theory R
Therefore Stochastic
and(τ) = RXX(τ)+Processes
RXY(τ)+(13A04304) n hence proved.
RYX(τ)+ RYY(τ)
ZZ
Properties of Cross Correlation Function: Consider two random processes X(t) and Y(t)
are at least jointly WSS. And the cross correlation function is a function of the time
difference τ = t2-t1. Then the following are the properties of cross correlation function.
1. RXY(τ) = RYX(-τ) is a Symmetrical property.
Proof: We know that RXY(τ) = E[X(t) Y(t+ τ)] also
RYX(τ) = E[Y(t) X(t+ τ)]
Let τ = - τ then

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page 9

Probability Theory and Stochastic Processes (13A04304) n
RYX(-τ) = E[Y(t) X(t- τ)]
Let u=t- τ or t= u+ τ. then
RYX(-τ) = E[Y(u+ τ) X(u)] = E[X(u) Y(u+ τ)]
Therefore RYX(-τ) = RXY(τ) hence proved.

then the cross correlation satisfies the inequality: | | √

2. If RXX(τ) and RYY(τ) are the autocorrelation functions of X(t) and Y(t) respectively

.
Proof: Consider two random processes X(t) and Y(t) with auto correlation functions
and . Also consider the inequality

√ √
2
E[ ] = 0

√ √ √
E[ ] 0

√ √ √
E[ ] 0

2 2
We know that E[X (t)] = RXX(0) and E[Y (t)] = RYY(0) and E[X(t) X(t+ τ)] = RXY(τ)

√
Therefore 0

√
2 0

√
1 0

√ . | | Or

| | √ hence proved.

Hence the absolute value of the cross correlation function is always less than or equal
to the geometrical mean of the autocorrelation functions.

then the cross correlation satisfies the inequality: | |

3. If RXX(τ) and RYY(τ) are the autocorrelation functions of X(t) and Y(t) respectively
[RXX(0)+ RYY(0)].
Proof: We know that the geometric mean of any two positive numbers cannot exceed
their arithmetic mean that is if RXX(τ) and RYY(τ) are two positive quantities then at

√ [RXX(0)+ RYY(0)].We know that | | √

τ=0,

Therefore | | [RXX(0)+ RYY(0)]. Hence proved.

WSS, then RXY(τ) = ̅ ̅ .

4. If two random processes X(t) and Y(t) are statistically independent and are at least

Proof: Let two random processes X(t) and Y(t) be jointly WSS, then we know that

RXY(τ) =E[X(t) Y(t+ τ)] Since X(t) and Y(t) are independent

RXY(τ) =E[X(t)]E[ Y(t+ τ)]

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page
10
 ̅ ̅
Probability Theory and Stochastic Processes (13A04304) www.raveendraforstudentsinfo.i
Therefore RXY(τ) = hence proved. n
5. If two random processes X(t) and Y(t) have zero mean and are jointly WSS, then
| | = .
Proof: We know that RXY(τ) =E[X(t) Y(t+ τ)]. Taking the limits on both sides
| | | |
As | |
=
, the random processes X(t) and Y(t) can be considered as
independent

= E[X(t)]E[ Y(t+ τ)] = ̅ ̅

processes therefore
| |
Given ̅ ̅ =0
Therefore | | = . Similarly | | = . Hence
proved.
Covariance functions for random processes:
Auto Covariance function: Consider two random processes X(t) and X(t+ τ) at two time
intervals t and t+ τ. The auto covariance function can be expressed as
CXX(t, t+τ) = E[(X(t)-E[X(t)]) ((X(t+τ) – E[X(t+τ)])] or

CXX(t, t+τ) = RXX(t, t+τ) - E[(X(t) E[X(t+τ)]

If X(t) is WSS, then CXX(τ) = RXX(τ) - ̅ . At τ = 0, CXX(0) = RXX(0) - ̅ =E[X ]- ̅ =

2

Therefore at τ = 0, the auto covariance function becomes the Variance of the random process.
The autocorrelation coefficient of the random process, X(t) is defined as

√
(t, t+τ) = if τ =0,

(0) = =1. Also | | 1.

Cross Covariance Function: If two random processes X(t) and Y(t) have random variables
X(t) and Y(t+ τ), then the cross covariance function can be defined as
CXY(t, t+τ) = E[(X(t)-E[X(t)]) ((Y(t+τ) – E[Y(t+τ)])] or

CXY(t, t+τ) = RXY(t, t+τ) - E[(X(t) E[Y(t+τ)]. If X(t) and Y(t) are jointly WSS, then

CXY(τ) = RXY(τ) - ̅ ̅ . If X(t) and Y(t) are Uncorrelated then

CXY(t, t+τ) =0.

The cross correlation coefficient of random processes X(t) and Y(t) is defined as

√
(t, t+τ) = if τ =0,

√
(0) = = .

Gaussian Random Process: Consider a continuous random process X(t). Let N random
variables X1=X(t1),X2=X(t2), . . . ,XN =X(tN) be defined at time intervals t1, t2, . . . tN
respectively. If random variables are jointly Gaussian for any N=1,2,…. And at any time
instants t1,t2,. . . tN. Then the random process X(t) is called Gaussian random process. The
Gaussian density function is given as

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page

11
fPXrobability
(x1, x2……Theory
xN ; t1,and Stochastic
tN) = Processes (13A04304) n – ̅̅̅
| |
t2,…..

̅̅̅̅̅̅̅̅
where CXX is a covariance matrix.

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, TPT. Page

12
Poisson’s random process: The Poisson process X(t) is a discrete random process which
represents the number of times that some event has occurred as a function of time. If the
number of occurrences of an event in any finite time interval is described by a Poisson
distribution with the average rate of occurrence is λ, then the probability of exactly
occurrences over a time interval (0,t) is

P[X(t)=K] = , K=0,1,2, . . .

And the probability density function is

(x) = ∑ (x-k).
 UNIT-4: RANDOM PROCESSES:SPECTRAL
CHARACTERISTICS

In this unit we will study the characteristics of random processes regarding

correlation and covariance functions which are defined in time domain. This unit explores
the important concept of characterizing random processes in the frequency domain. These
characteristics are called spectral characteristics. All the concepts in this unit can be easily
learnt from the theory of Fourier transforms.

Consider a random process X (t). The amplitude of the random process, when it
varies randomly with time, does not satisfy Dirichlet’s conditions. Therefore it is not
possible to apply the Fourier transform directly on the random process for a frequency
domain analysis. Thus the autocorrelation function of a WSS random process is used to
study spectral characteristics such as power density spectrum or power spectral density
(psd).

Power Density Spectrum: The power spectrum of a WSS random process X (t) is defined
as the Fourier transform of the autocorrelation function RXX (τ) of X (t). It can be expressed
as

SXX(ω) = We can obtain the autocorrelation function from the

power spectral density by taking the inverse Fourier transform i.e.

RXX (τ) =

Therefore, the power density spectrum S XX(ω) and the autocorrelation function R XX (τ) are
Fourier transform pairs.

The power spectral density can also be defined as S XX(ω) =

Where XT(ω) is a Fourier transform of X(t) in interval [-

T,T]

Average power of the random process: The average power PXX of a WSS random process
X(t) is defined as the time average of its second order moment or autocorrelation function
at τ =0.

Mathematically, PXX = A
2
{E[X (t)]}

PXX =

Or PXX = τ

We know that from the power density spectrum,

RXX (τ) =
K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 1
TPT.
At τ =0 PXX = RXX (0) =

Therefore average power of X(t) is

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 2

TPT.
PXX =

Properties of power density spectrum: The properties of the power density spectrum
SXX(ω) for a WSS random process X(t) are given as

(1) SXX(ω)

Proof: From the definition, the expected value of a non negative function E[ ]
is always non-negative.

Therefore SXX(ω) hence proved.

(2) The power spectral density at zero frequency is equal to the area under the curve
of the autocorrelation RXX (τ) i.e. SXX(0) =

Proof: From the definition we know that SXX(ω) = at ω=0,

SXX(0) = hence proved

(3) The power density spectrum of a real process X(t) is an even function

i.e. SXX(-ω)= SXX(ω)

Proof: Consider a WSS real process X(t). then

SXX(ω) = also SXX(-ω) =

Substitute τ = -τ then

SXX(-ω) =

Since X(t) is real, from the properties of autocorrelation we know that, RXX (-τ) = RXX (τ)

Therefore SXX(-ω) =

SXX(-ω)= SXX(ω) hence proved.

(4) SXX(ω) is always a real function

Proof: We know that SXX(ω) =

Since the function is a real function, SXX(ω) is always a real function hence

proved. (5) If SXX(ω) is a psd of the WSS random process X(t), then
2
= A {E[X (t)]} = RXX (0) or The time average of the mean square value of a
WSS random process equals the area under the curve of the power spectral

density. Proof: We know that RXX (τ) = A {E[X (t + τ) X(t)]}

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 3
TPT.
Probability Theory and Stochastic Processes www.raveendraforstudentsinfo.in
(13A04304)
= at τ =0,

2
RXX (0) = A {E[X (t)]} = = Area under the curve of the power spectral
density. Hence proved.

(6) If X(t) is a WSS random process with psd S XX(ω), then the psd of the derivative of
2 2
X(t) is equal to ω times the psd SXX(ω). That is S (ω) = ω SXX(ω).

Proof: We know that SXX(ω) = and XT(ω) =

= T(ω) = =

Therefore S (ω) =

S (ω) =

2
Therefore S (ω) = ω SXX(ω) hence proved.

Cross power density spectrum: Consider two real random processes X(t) and Y(t).
which are jointly WSS random processes, then the cross power density spectrum is defined
as the Fourier transform of the cross correlation function of X(t) and Y(t).and is
expressed as SXY(ω) = and SYX(ω) = by
inverse Fourier transformation, we can obtain the cross correlation functions as

RXY (τ) = and RYX (τ) =

Therefore the cross psd and cross correlation functions are forms a Fourier transform pair.

If XT(ω) and YT(ω) are Fourier transforms of X(t) and Y(t) respectively in interval [-
T,T], Then the cross power density spectrum is defined as

SXY(ω) = and SYX(ω) =

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 4

TPT.
Probability Theory and Stochastic Processes www.raveendraforstudentsinfo.in
(13A04304)
Av erage cross power: The average cross power PXY of the WSS random processes X(t) and
Y(t) is defined as the cross correlation function at τ =0. That is

PXY = or

PXY = τ = Also PXY = and PYX =

Properties of cross power density spectrum: The properties of the cross power for
real random processes X(t) and Y(t) are given by

(1) SXY(-ω)= SXY(ω) and SYX(-ω)= SYX(ω)

Proof: Consider the cross correlation function τ The cross power density spectrum is
SXY(ω) =

Let τ = - τ Then

SXY(ω) = Since RXY(-τ) = RXY(τ)

SXY(ω) =

Therefore SXY(-ω)= SXY(ω) Similarly SYX(-ω)= SYX(ω) hence proved.

(2) The real part of SXY(ω) and real part SYX(ω) are even functions of ω i.e.
Re [SXY(ω)] and Re [SYX(ω)] are even functions.

Proof: We know that SXY(ω) = and also we know that

=cosωt-jsinωt, Re [SXY(ω)] = ω

Since cos ωt is an even function i.e. cos ωt = cos (-ωt)

Re [SXY(ω)] = ω
= ω

Therefore SXY(ω)= SXY(-ω) Similarly SYX(ω)= SYX(-ω) hence proved.

(3) The imaginary part of SXY(ω) and imaginary part SYX(ω) are odd functions of ω i.e.
Im [SXY(ω)] and Im [SYX(ω)] are odd functions.

Proof: We know that SXY(ω) = and also we know that

=cosωt-jsinωt,

Im [SXY(ω)] = ω
=- ω
= - Im [SXY(ω)]

Therefore Im [SXY(ω)] = - Im [SXY(ω)] Similarly Im [SYX(ω)] = - Im [SYX(ω)] hence proved.

(4) SXY(ω)=0 and SYX(ω)=0 if X(t) and Y(t) are Orthogonal.

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 5

TPT.
Probability Theory and Stochastic Processes www.raveendraforstudentsinfo.in
(13A04304)
P roof: From the properties of cross correlation function, We know that the random processes
X(t) and Y(t) are said to be orthogonal if their cross correlation function is

zero. i.e. RXY(τ) = RYX(τ) =0.

We know that SXY(ω) =

Therefore SXY(ω)=0. Similarly SYX(ω)=0 hence proved.

(5) If X(t) and Y(t) are uncorrelated and have mean values and , then

SXY(ω)=2 .

Proof: We know that SXY(ω) =

= SXY(ω) =

Since X(t) and Y(t) are uncorrelated, we know that

Therefore SXY(ω) =

SXY(ω) =

SXY(ω) =

Therefore SXY(ω)=2 . hence proved.

K.RAVEENDRA, Associate Professor, In-charge Examinations Branch, SVEW, Page 6

TPT.