Section 9 Queueing Systems
Section 9 Queueing Systems
Server m
Message
Departures
Message queue
forms
Service channels
Service Time
S n denotes the service time requested by the nth message;
It expresses the time used by a service channel to serve / process (e.g.,
transmit or switch or perform other requested task) a message
We assume:
sec
sec
msg
1 Erlang = 1 sec service per sec = 1 minute service per minute.
Prof. Izhak Rubin
Service Discipline
The service discipline dictates the rule in accordance with which
arriving or queued messages are selected for service, once a service
channel becomes available.
Common service policies (scheduling schemes):
1. FIFO (FCFS): First-In First-Out (First-Come First-Served)
2. LIFO (LCFS): Last-In First-Out (Last-Come First-Served)
3. Priority class oriented (Preemptive vs. Non-preemptive)
4. Round-Robin
5. Shorter-Message-First (SMF)
Inter-arrival
distribution
time
Number of
sources
Service
distribution Number of
time
service
channels
Storage
capacity
= total Number of
messages that can be
held (incl. those in
service)
M = Exponential
D = Deterministic
G = General
GI = General independent
Geom = Geometric distribution
Prof. Izhak Rubin
Message Blocking
Assume the storage capacity of a QS is equal to N .
Call / Message blocking:
PB lim P Yn N
n
Time blocking:
PtB lim P X t N
t
o 1 PB
QS
o PB
D o 1 PB [mess/sec]
System throughput load:
f D f AD f o 1 PB o 1 PB D
Prof. Izhak Rubin
[Erlangs]
8
D2
Busy cycle
Yn X A , Y Yn , n 0
W2
S2
Busy period
S1
Z n X R , Z Z n , n 0
n
A1 A2 R1 R2
Idle period
Vt
Cn I n Gn
N n Number of messages served
S2
S1
W4
W2
W1
W5
W3
Prof. Izhak Rubin
C ~ Ti
i 1
N C
T1 T2
T3
T4
10
C ~ Ti AD
i 1
1 k AD
lim E Tn T AD
k k
n 1
N AD
E Tn
E C
1
n 1
AD
EN
E N
AD C N D C
N 1 PB C
N=2
T1AD
T2AD
T3AD
T4AD
11
I t P I t 1 e t u t , and E I 1.
From Wald's Lemma,
E G E N E S E N AD E C
Since E C E G E I ,
E C E I AD E C E C
E I
1
E C
, 1
1 1
E N E C
E G E N
1
, 1
1
, 1
Prof. Izhak Rubin
12
Littles Formula
C
Xt
D1
D2
D3
X
dt
t
n
0
n 1
Little's Formula:
E
X
dt
For a non-blocking system,
t
0
DE N
1 T
X lim X t dt
D D
X
T T 0
E C
E C
X D
For a blocking system,
N
E Dn
k
1
X 1 PB D
D lim Dn n 1
k k
EN
n 1
13
Qt dt Wn
1
Q lim
T T
n 1
Qt dt
Q dt
C
E C
E
W
n
1 k
W lim Wn n 1
k k
EN
n 1
DE N
D W
Q
E
C
X t Qt N s t
X Q Ns ,
N s X Q D D W D S =D f D
Note: The departure load rate f D for single server 1.
Prof. Izhak Rubin
14