CH 1
CH 1
Introduction
Stochastic Modeling
The word "stochastic" means "random" or "chance" .
A stochastic model predicts a set of possible outcomes
weighted by their likelihoods, or probabilities.
1.1. Stochastic Processes
A stochastic process is a family of random variables where t is a
parameter running over a suitable index set T. Write instead of
.In a common situation, the index t corresponds to discrete units
of time, and the index set is In this case, might represent the
outcomes at successive tosses of a coin, repeated responses of a
subject in a learning experiment, or successive observations of
some characteristics of a certain population.
Stochastic processes are distinguished by their state
space, or the range of possible values for the random
variables by their index set , and by the dependence
relations among the random variables
Probability Review
2.
2.1. Events and Probabilities
Let and be events. The event that at least one of or occurs
is called the union of and and is written ; the event that both
occur is called the intersection of and and is written , or
simply . This notation extends to finite and countable sequences
of events. Given events
the event that at least one occurs is written
,
the event that all occur is written .
The probability of an event A is written The certain event,
denoted by , always occurs, and Pr. The impossible event,
denoted by , never occurs, and . It is always the case that Pr for
any event . Events are said to be disjoint if ; that is, if and
cannot both occur. For disjoint events
Pr
Conditional Probability
2.7.
For any events and , the conditional probability of given is written and
defined by
if (2.16)
and is left undefined if .
Multiplicative form
(2.17)
to compute other probabilities.
into
I 48
II 39
III 6 6
An urn is selected at random, all urns being equally likely, and then a
coin is selected at random from that urn. Using the notation I, II, III for
the events of selecting urns I, II, and III, respectively, and G for the
event of selecting a gold coin, then the problem description provides the
following probabilities and conditional probabilities as data:
for
and Var
Geometric and Negative Binomial Distributions
3.3.
Let be independent events having a common probability of
occurrence. Say that trial is a success (S) or failure (F) according as
occurs or not, and let count the number of failures prior to the first
success. Then has a geometric distribution with parameter p. The
probability mass function is
for
and the first two moments are
and Var
Sometimes the term "geometric distribution" is used in referring to the
probability mass function
for
The Poisson Distribution
3.4.
The Poisson Distribution with parameter has the probability mass
function
for
Using this series expansion