ST2187_Block 7 Decision-making under uncertainty using decision trees
ST2187_Block 7 Decision-making under uncertainty using decision trees
decision trees
There is an introduction video on the VLE, you can access it here:
https://emfssvideo.s3.amazonaws.com/MT%26ST/ST2187/ST2187_Block7_Intro.mp4
This block provides a formal framework for analysing decision problems which involve
uncertainty. Specifically, the following topics are included:
criteria for choosing among alternative decisions
how probabilities are used in the decision-making process
how early decisions affect decisions made at a later stage
how a decision-maker can quantify the value of information
how attitudes toward risk can affect the analysis.
A powerful graphical tool which guides that analysis is a decision tree. A decision tree
enables a decision-maker to view all important aspects of the problem at once - the decision
alternatives, the uncertain outcomes and their probabilities, the economic consequences, and
the chronological order of events.
After completing this block, you should be able to:
analyse decision-making under uncertainty using decision trees.
Readings
Albright, S and Winston, W.L, Business Analytics Data Analysis & Decision Making,
(Cengage Learning, 2017) 6th edition [ISBN 9781305947542] Chapter 6.
Decision trees
Decision trees are composed of nodes (circles, squares, and triangles) and branches (lines).
The nodes represent points in time. A decision node (a square) represents a time when the
decision-maker makes a decision. A probability node (a circle) represents a time when the
result of an uncertain outcome becomes known. An end node (a triangle) indicates that the
problem is completed - all decisions have been made, all uncertainty has been resolved, and
all payoffs and costs have been incurred.
Time proceeds from left to right. This means that any branches leading into a node (from the
left) have already occurred. Branches leading out of a decision node represent the possible
decisions; the decision-maker can choose the preferred branch.
Probabilities are listed on probability branches. These probabilities are conditional on the
events which have already been observed (those to the left).
Monetary values are shown to the right of the end nodes. EMVs are calculated through a
‘folding back’ process. Starting from the right of the decision tree and working back to the
left:
at each probability node, calculate an EMV - a sum of products of monetary values
and probabilities
at each decision node, take a maximum of EMVs to identify the optimal decision.
The risk profile for a decision is a ‘spike’ chart which represents the probability distribution
of monetary outcomes for this decision. By looking at the risk profile for a particular
decision, you can see the risks and rewards involved. By comparing risk profiles for different
decisions, you can gain more insight into their relative strengths and weaknesses.
Bayes’ rule
In a multistage decision tree, all probability branches at the right of the tree are conditional on
outcomes which have occurred earlier, to their left. Therefore, the probabilities on these
branches are of the form 𝑃(𝐴 | 𝐵), read as ‘A given B, where A is an event corresponding to a
current probability branch, and B is an event which occurs before event A in time.
When gathering data for the problem, it is sometimes more natural to assess conditional
probabilities in the opposite order, that is, 𝑃(𝐵 | 𝐴). Whenever this is the case, Bayes’
rule must be used to obtain the probabilities needed on the tree.
To develop Bayes’ rule, let 𝐴1 , … , 𝐴𝑛 An be any outcomes. Without any further information,
we believe the probabilities of the 𝐴𝑖 s, for 𝑖 = 1, … , 𝑛, are 𝑃(𝐴1 ), … , 𝑃(𝐴𝑛 ). These are
called prior probabilities. Because an information outcome might influence our thinking
about the probabilities of the 𝐴𝑖 s, we need to find the conditional probability 𝑃(𝐴𝑖 | 𝐵), for
each outcome 𝐴𝑖 . This is called the posterior probability of 𝐴𝑖 .
Bayes’ theorem is:
𝑃(𝐵 | 𝐴𝑖 ) 𝑃(𝐴𝑖 )
𝑃(𝐴𝑖 | 𝐵) = .
𝑃(𝐵 | 𝐴1 ) 𝑃(𝐴1 ) + ⋯ + 𝑃(𝐵 | 𝐴𝑛 ) 𝑃(𝐴𝑛 )
In words, Bayes’ rule says that the posterior is the likelihood times the prior, divided by a
sum of likelihoods times priors.
As a side benefit, the denominator in Bayes’ rule is also useful in multistage decision trees. It
is the probability 𝑃(𝐵) of the information outcome. This formula is important in its own
right. For B to occur, it must occur along with one of the 𝐴𝑖 s. The denominator of the formula
simply decomposes the probability of B into all of these possibilities. It is sometimes called
the law of probability.
Conclusion
The most important skill to gain from this block is the ability to approach decision problems
with uncertainty in a systematic manner.
This systematic approach requires you to:
list all possible decisions or strategies
list all possible uncertain outcomes
assess the probabilities of these outcomes (possibly with the aid of Bayes’ rule)
calculate all necessary monetary values
do the necessary calculations to obtain the best decision.
Baynes’ rule
The file Bayes’_rule.xlsx uses Bayes’ rule to revise the probability of being a drug user, given
the positive or negative results of the test.
Let D and ND denote that a randomly chosen athlete is or is not a drug user, and let 𝑇 + and
𝑇 − indicate a positive or negative test result. Using Bayes’ rule, you can calculate probability
of the events 𝑃(𝐷 | 𝑇 + ) and 𝑃(𝑁𝐷 | 𝑇 − ).
Exponential utility
The file Exponential_utility.xlsx looks at how a company’s risk averseness, determined by its
risk tolerance in an exponential utility function, affects its decision. Assume that Venture
Limited has an exponential utility function.
Block 7 learning activities
$40 0.20
$45 0.25
Cost if Tyson makes the new product itself
$50 0.35
$55 0.20
$40 0.15
$45 0.30
$50 0.40
$55 0.15
Do nothing $0 $0 $0
a. What is WTC’s payoff if they build a new plant and the market expands?
b. What is WTC’s payoff if they build a new plant and the market is stable?
c. What is WTC’s payoff if they build a new plant and the market contracts?
d. What is WTC’s payoff if they expand the plant and the market expands?
e. What is WTC’s payoff if they expand the plant and the market is stable?
f. What is WTC’s payoff if they expand the plant and the market contracts?
g. What is WTC’s payoff if they do nothing and the market expands?
h. What is WTC’s payoff if they do nothing and the market is stable?
i. What is WTC’s payoff if they do nothing and the market contracts?
j. Construct a decision tree to identify the course of action which maximises WTC’s
expected profit. Make sure to label all decision and chance nodes and include
appropriate costs, payoffs and probabilities.
k. What course of action is optimal for WTC? What is the expected profit in that case?
l. Generate a risk profile for each of WTC’s possible decisions in this problem.
Characterise the differences in risk for the different options.
Demand Probability
400 0.30
500 0.50
600 0.20
a. Derive the payoff table if the order quantity is 400, 500 and 600, respectively.
b. Construct a decision tree to identify the buyer’s course of action which maximises the
expected profit earned by the chain from the purchase and subsequent sale of footballs
in the coming year.
c. What is the optimal strategy for order quantity, and what is the expected profit in that
case?
d. Generate a risk profile for each possible decision in this problem. Would this have
any impact on your decision?
The station owner does not know which type of audience will dominate the community once
its growth has stabilised. Probabilities have been assigned to the potential dominant audience,
based on the community growth which has already occurred in the area. Since she wants to
begin building a brand image now, the decision as to which format to adopt must be made in
an environment of uncertainty. The station owner has been able to construct the following
payoff table, in which the entries are average monthly revenue in thousands of dollars.
Format A1 A2 A3
a. Construct a decision tree to help the station identify its optimal format. Make sure to
label all decision and chance nodes and include appropriate costs, payoffs and
probabilities.
b. What format is optimal? What is the expected profit in that case?
c. The station is most uncertain about the average monthly revenue associated with the
rock format and an A1 audience. Construct a strategy region chart for this input
variable with a possible range from $85,000 to $200,000. Does the optimal decision
to select the country format change at any point in this range?
d. As the average monthly revenue associated with the rock format and an A1 audience
varies between $85,000 to about $140,000, what happens to the maximum expected
revenue? Briefly explain why.
e. As the average monthly revenue associated with the rock format and an A1 audience
varies between about $140,000 and $200,000, what happens to the maximum
expected revenue? Briefly explain why.
Conditional
Type of accident Damage to car
probability
Draw a decision tree that reflects this sequence. There should be two ‘stages’ of decision
nodes. Then label the tree with some reasonable monetary values and probabilities, and
perform the folding back process to find the company’s best strategy. Note that if the
company wins the contract, its payoff is its bid amount minus its cost of completing the
project minus its cost of preparing the bid, where these costs are assumed to be known.