18 A Discrete Markov Model of Vehicular Traffic
18 A Discrete Markov Model of Vehicular Traffic
JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted
digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about
JSTOR, please contact [email protected].
Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at
http://about.jstor.org/terms
INFORMS is collaborating with JSTOR to digitize, preserve and extend access to Transportation Science
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A Discrete Markov Model of Vehicular
Traffic*
MICHAEL C. DUNNEf and RICHARD W. ROTHERY
and
RENFREY B. POTTS*
For a number of years the Poisson process has been used as a model
to describe the time series of events of vehicles passing a point on
a roadway. In its simplest form the Poisson model does not take into
account the finite size of the vehicles nor does it properly describe
the characteristic bunching of traffic that commonly occurs, for
example, on a two-lane road when passing is hindered. To give a
more comprehensive description of traffic, various extensions of the
Poisson model and a variety of other models have been proposed,
with varying success. In this paper a discrete Markov model of
traffic is proposed. The model is an extension of the simple bi
nomial model and accounts for the bunching tendency of traffic by
assuming correlations between successive vehicles. A description
is given of the time-arrival experiments that were carried out to
test the model and the statistical analysis of the results of these
experiments is discussed. In addition, several theoretical aspects
of the model are examined.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
234 / DUNNE, ROTHERY, AND POTTS
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
a discrete markov model of vehicular traffic / 235
cisions to choose time slices of 60, 30, 15, 5, 1 or 3^ minute durations are
rather arbitrary and it is well known that different time slices lead to quite
different conclusions.17?91 Cox and Lewis m have suggested a procedure,
that is followed in this paper, for the thorough statistical analysis of a series
of events and used as an example some Swedish traffic data that have been
previously analyzed by Miller[10j and Bartlett.[4J The coefficient of
variation of the headway distribution for this data was 1.5 and tests
proved that the Poisson model was inadequate, but that a satisfactory
fit could be obtained with the branching Poisson and semi-Markov models
although there was insufficient data to discriminate between them. It is
the purpose of this paper to test the adequacy of the two-sta,te Markov
model by applying the methods proposed by Cox and Lewis to time-arrival
data collected for traffic on one lane of a two-way road.
(2)
with 0^p^l,0^^1 and p and q independent of fc. Hence, for
example,
P[Xk+1 = 11 Xk = 0] = p, (3)
P[Xk+l = 11 X* = 1] = 1 - g, (4)
and so on. When p = 1 ? q this Markov model reduces to the simple
binomial model.
There are two fundamental properties of the Markov model that are of
great importance and that will be referred to in later sections. First,
like the random arrivals model, it is a renewal model, i.e., the times be
tween events (arrivals) are independently and identically distributed.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
236 / dunne, rothery, and potts
Second, by its very definition, the model implies the existence of corre
lations between the counts of vehicles in successive time intervals and this
property is not possessed by the random arrivals model.
Counts
The counting distribution is characterized by
Yn = Zi + X2 + + Xn . (5)
The properties of Yn are well known 111'141?for instance Yn is asym
cally normal with mean np/(p + q) and variance npq(2 ? p ? q)/(p
Hence the traffic flow is Q = 3600p/{(p + q)r] veh/hr and the va
to mean ratio of counts, 7, tends to q(2 ? p ? q)/(p + q)2.
EXPERIMENTAL DATA
Data were taken on one lane of a two-lane rural road at a point 2.4 mi
downstream from the nearest stop sign or traffic signal. The passage of
each vehicle traveling in a single lane was recorded on magnetic tape to
gether with a 200 cycle/sec clock signal using standard digital recording
techniques. This information was then transcribed from magnetic tape to a
digital format suitable for computer analysis.
These experiments were conducted between 3:00 pm and 6:00 pm on
several days over a period of approximately two months. Flow levels from
about 300 to 650 vph were observed. The duration of each data set ranged
from one-half to one- and one-quarter hours depending on traffic conditions.
Two additional sets of data were collected at a second location (on a differ
ent road) to exclude the possibility that the results might have been biased
by features peculiar to the first location. These data have been included
in the analysis and possess the same characteristics as the others.
As the parameters (p> q, and r) in the Markov model are time independent,
no allowance is made for variations in flow level. For this reason a meaning
ful analysis of a data set can only be made when the flow remains reason
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OF VEHICULAR TRAFFIC / 237
ably constant over the period of observation. One of the simplest, yet most
revealing, methods of checking for systematic trends in the flow level is to
plot the cumulative number of arrivals, N(t), as a function of t. Such a plot
reveals how the average flow fluctuates with time and enables a trend-free
slab of data to be found graphically by use of a straightedge.
Fig. 1 illustrates how data set No. 1 has been divided into three sections
of approximately constant flow. Out of all the data collected, nine trend
free sections were obtained graphically and were subject to further analysis.
As indicated in Table I the lengths of the trend-free sections varied from
400 r
Msec.)
about 10 to 20 min and the flow levels ranged from 350 to 650 veh/hr.
In all cases the more sophisticated tests described by Cox and Lewis15'121
when applied to the original data sets, indicated the existence of systematic
trend and confirmed that the sections selected for further analysis were
trend free.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
to O
3.224**,
3.677**, 3.192**, 1.233, -0.589,
-1.747,
5.691**,
2.587**,
-0.835,0.098,0.2911.602
i (2).i - 1. 2.
-2.401 -1.016,
4.234**,
1.178 2.178*, -0.564
0.614, -0.076,0.804
-0.321,
2.358 -0.540
1.694,
0.168, 0.992, -0.237 0.123, 1.579,
-0.9131. 5 19, 0 . 4 71, 0 . 0 46 3.771**, -0.530
0.855, -0.035,
0.398, -0.241
-0.564, -1.132 -0.578,-1.156,0.841,
0.662, 0.1261.588, -0.583
0.052, 0.079, 0.110
Dn
TABLE I
1.742** = Dn 2.738** = Dn
2.197**
9.235** 5.030** 11.701** 2.257** 8.249**
0.993 0.594
Distribution-Free1.948
Statistics 1.406
(Transformed Data)
Statistics (Untransformed
= 1.224128.9**
L DrT In In 2>n+
In
Dn+DnWn2 Dn+ Wn2 Dn+Dn~Wn2 DrTWn2
Q = 585 veh/hr
1168 sec
C = 1.190 669 sec C = 1.126 1227 sec
130 veh C = 1.344 88 veh
890 sec
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
o< o O w to
CoCD
-0.324, -0.423,
-1.106,-0.282,
0.2740.741
0.841,
4.144**, 3.974**, -0.755, -1.354
2.236
3.682**, 1.441, 0.910 2.572**, 1.091, -0.558 3.694**, 2.432*, 2.948
0.621, 0.437, -2.689** 1.747, 2.115*, 2.101* 1.966*, 1.047, -0.067
0.804, 0.461, 1.788 1.682, 1.202, -1.177
-0.027,
-1.145, -0.245, -1.077,
-0.727 0.347
0.137, -1.116,-0.203,
-1.528 2.440*, -0.252 -0.685, 0.711, -0.035 1.007, -1.358, -0.373
= Dn
Dn+ = 2.096** =? Dn
Dn+ = 1.789** = Dn 2)n- = 2.092** = D? Dn+ = 1.425* ? Z>?
1.488*1.3445.219*
Wn2 = 8.660**
Dn" = 1.448
JF?2 = 6.630** Dn+ =1.287 TFn2 = 6.184** Dn" = 2.087 AT = 1.112JF?2 = 3.569**
Dn+Dn"Wn2
2>?
Dn~ =Wn2
0.444 = 0.586
In = 132.4 Zn - 134.9
AT = 0.479 Wn2 = 0.633 ln = 117.8 Z? = 183.8
Wn2 = 0.453 Dn" Wn2 Z? = 105.0
= 0.660= 0.554
2)n+ = 0.673
/)?- = 0.711
TFn2 = 0.634 Z>?+ = 0.326
C = 1.189 C = 1.154
Q = 524 veh/hr
C = 1.316 C = 1.122
887 sec
129 veh 826 sec 818 sec
1181 sec
900 sec C = 1.137
150 veh 120 veh 190 veh 97 veh
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
240 / DUNNE, ROTHERY, AND POTTS
4.0 r
3.0 h
2.0
1.0 -
; J_j_
"1' 111111
-1.0 -
-2.0
-3.01 J
-4.0 L
Fig. 2. Estimates of the first 50 standardized serial correlation coefficients for the
interarrival times for data set No. 1. The horizontal dashed lines are 5 per cent sig
nificance bands and the solid lines are 1 per cent significance bands for the estimates.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OF VEHICULAR TRAFFIC / 241
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
242 / DUNNE, ROTHERY, AND POTTS
fact, in all but one case, the level of significance is less than 1 per cent.
The correlations are strongest iorj = 1 or 2 indicating 'nearest neighbor'
or 'next-nearest neighbor' correlations?in other words a '1' is likely to be
followed by a '1' in the next interval or in the next but one.
Although the 0y(r) are dependent on r, the existence of correlations is a
physical property of the traffic stream and if correlations exist for some
particular value of r they will exist for all other sensible values of r, but
may be of different sign and magnitude. For example, Fig. 3 shows 0;(2) for
r= 2.0
-4.0 L
Fig. 3. Estimates of the first 50 standardized serial correlation coefficients for the
counts in 2-sec intervals for data set No. 1. The horizontal dashed lines are 5 per cent
significance bands and the solid lines are 1 per cent significance bands for the esti
mates.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OF VEHICULAR TRAFFIC / 243
T- 0.5
nil,II _LL
-4.0 L
Fig. 4. Estimates of the first 50 standardized serial correlation coefficients for the
counts in 0.5-sec intervals for data set No. 1. The horizontal dashed lines are 5 per
cent significance bands and the solid lines are 1 per cent significance bands for the
estimates.
Model Calibration
The parameters to be estimated are p, q, and r, p and q being dependent
on r. For a given set of arrival times there is associated with each value of
t a unique binary sequence from which p and q can be calculated in a
straightforward manner. Choosing a suitable value of r is, however, a more
difficult and far less well defined procedure. As this procedure is based on
the behavior of the serial correlation coefficients, hj(t), defined hitherto,
some of their properties will now be mentioned. In what follows the argu
ment, r, will be omitted for simplicity of notation.
It can be shown that jij = ju0(l ? p ? qY where /x0 is positive. Hence
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
244 / DUNNE, ROTHERY, AND POTTS
when p + q < 1, nj > 0 for all j and ah > /*2 > while for p + q > 1,
H2j > 0 and M2y+i < 0 for all j and | m \ > M2 > . As has been noted
before, when p + q = 1 the Markov model reduces to the simple binomial
model for which m = 0 for all j. The quantities 0/ have exactly the same
properties of sign and order.
The fact that it is assumed that no more than one vehicle should arrive
in each r-sec interval imposes an upper bound on the size of r. This con
8.o r
-6.0 -
-8.0 L
Fig. 5. Plot of the first 3 standardized serial correlation coefficients for the counts
in r-sec intervals against t for data set No. 1. The horizontal dashed lines are 5 per
cent significance bands and the solid lines are 1 per cent significance bands for the
estimates.
dition is, however, too restrictive to be practicable for, even under condi
tions of light flow, there will always be a few very small headways (say, of
the order of 3^ sec) that may lead to the inclusion of 2 veh within a r-sec
interval unless t is chosen smaller than the smallest headway. In addition,
choosing r to be of the order of ^ sec leads also to inconsistencies in the
properties of the serial correlation coefficients. So, rather than insisting
that no 2's should occur, it is suggested that r be chosen so as to keep the
number of 2's insignificant.
In Fig. 5 a plot is shown of 6j against r for j = 1, 2, 3. In the range
0,5 ^ t ^ 0.8, 0i is negative and 03 is positive, which is inconsistent with
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OF VEHICULAR TRAFFIC / 245
the properties of the Bj. For values of x ranging from 0.8 up to about
1.6, 02 is greater than 0i, which, again, is not acceptable. For values of r
larger than about 1.6, the Bj behave in accordance with the properties of
the Bj.
TABLE II
p q Number of 2's
Frequency
A?/A
/ / \
10 12
Number of Vehicles
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
246 / DUNNE, ROTHERY, AND POTTS
70i
Frequency
Platoon Length
creases, first 0i becomes negative, then 02, and so on. In the given example,
0i becomes negative at r = 0.8 or 0.9 and 02 appears certain to become
negative at about r = 0.4. No further information is to be gained by in
vestigating the behavior of the 0/ for values of j greater than 3 since, except
again for the very small values of r, these will quite quickly tend to zero.
Once a value of r is chosen the values of p and q are calculable merely
by counting the number of Ts following l's and so on.
In summary: the range of values of r is found for which the 0/ exhibit the
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OP VEHICULAR TRAFFIC / 247
Macroscopic Properties
The macroscopic traffic properties predicted by the model can be de
scribed by the frequency distributions for vehicle counts, and platoon and
Frequency
Gap Length
gap lengths. For data set No. 1, with r = 2, the transition matrix is
).75
p =. r?-7 0.25]
).58 0.42J
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
248 / dunne, rothery, and potts
DISCUSSION
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
a discrete markov model of vehicular traffic / 249
by Cox and Lewis have been used to establish the adequacy of the renewal
hypothesis, to reject the random arrivals model, and to prove the existence
of intervehicle correlations. However, it is not claimed that the two-state
Markov model is in any sense 'the' model of traffic. The more modest claim
is that the model can adequately describe the bunching of traffic that is an
important characteristic of medium traffic when passing is hindered. The
model is simple in form and directly describes the microscopic features of
traffic and infers the macroscopic properties, rather than obtaining them
from curve fitting techniques.
Possible extensions of the model that are being investigated include a
3-state model, an analysis of pulsed traffic and its diffusion, and a model of
correlated platoons and gaps.
APPENDIX
Two-State Markov Model: Some Mathematical Properties
The mathematical properties of this model have appeared elsewhere (see, for
example, reference 11) but for completeness some of the more important ones are
included here.
Transition Probabilities
The elements of the matrix Pn are the n-step transition probabilities. The simplest
method of evaluating Pn is that of spectral resolution for which purpose the eigen
values of P must be found. They are 1 and 1 ?p ? q respectively and the required
form of Pn is
p] + d - p - g)n T p -pi
v+qL
?
v+qL
Counting Distribution
To determine the probability generating function of the number, Yn, of suc
cesses in n trials it is necessary to evaluate [P(z)]n where
The eigenvalues Ai(z), \(z) of this matrix are solutions of the quadratic equation
The method of spectral resolution can be used to give [P(z)}w but the implicit form
is omitted.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
250 / dunne, rothery, and potts
ACKNOWLEDGMENT
The authors wish to thank Neil Fogo fo
experimental work and Susan Hanson for
and programming aspects of this proje
making available a computer program f
is also acknowledged. The authors have be
Robert Herman of the General Motors R
REFERENCES
1. D. J. Buckley, "Road Traffic Counting D
116 (1967).
2. F. A. Haight, Mathematical Theories of T
York, 1963.
3. G. F. Newell, "Mathematical Models of F
Opns. Res. 3, 176-186 (1955).
4. M. S. Bartlett, "The Spectral Analysis of
Soc, B. 25, 264-296 (1963).
5. D. R. Cox and P. A. W. Lewis, The Statist
Methuen, London, 1966.
6. R. R. Allan, "Extension of the Binomial
tinuous Case," Proc. Aust. Rd. Res. Board 3
7. D. L. Gerlough and A. Schuhl, Poisson
Saugatuck, Conn., 1955.
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms
A DISCRETE MARKOV MODEL OF VEHICULAR TRAFFIC / 251
This content downloaded from 14.139.185.114 on Thu, 08 Dec 2016 04:54:28 UTC
All use subject to http://about.jstor.org/terms