Chapter 4 Game Theory
Chapter 4 Game Theory
12/11/22 1
Components of a Game
Games have the following
characteristics:
Players
Rules
Payoffs
Based on Information
Outcomes
Strategies
12/11/22 2
Types of Games
We classify games into several types.
By the number of players:
By the Rules:
By the Payoff Structure:
By the Amount of Information Available to
the players
12/11/22 3
Games as Defined by the
Number of Players:
1-person (or game against nature,
game of chance)
2-person
n-person( 3-person & up)
12/11/22 4
Games as Defined by the
Rules:
These determine the number of
options/alternatives in the play of the
game.
The payoff matrix has a structure
(independent of value) that is a function
of the rules of the game.
Thus many games have a 2x2 structure
due to 2 alternatives for each player.
12/11/22 5
Games as Defined by the
Payoff Structure:
Zero-sum
Non-zero sum
(and occasionally Constant sum)
Examples:
Zero-sum
Classic games: Chess, checkers, tennis, poker.
Political Games: Elections, War
Non-zero sum
Classic games: Football (?), D&D, Video games
Political Games: Policy Process
12/11/22 6
Games defined by information
In games of perfect information, each player
moves sequentially, and knows all previous
moves by the opponent.
Chess & checkers are perfect information games
Poker is not
In a game of complete information, the rules are
known from the beginning, along with all possible
payoffs, but not necessarily chance moves
12/11/22 7
Strategies
We also classify the strategies that we
employ:
It is natural to suppose that one player
will attempt to anticipate what the other
player will do. Hence
Minimax - to minimize the maximum loss -
a defensive strategy
Maximin - to maximize the minimum gain -
an offensive strategy.
12/11/22 8
Iterated Play
Games can also have sequential play
which lends to more complex strategies.
(Tit-for-tat - always respond in kind.
Tat-for-tit - always respond conflictually to
cooperation and cooperatively towards
conflict.
12/11/22 9
Game or Nash Equilibria
Games also often have solutions or
equilibrium points.
These are outcomes which, owing to the
selection of particular reasonable
strategies will result in a determined
outcome.
An equilibrium is that point where it is not
to either players advantage to unilaterally
change
12/11/22
his or her mind. 10
Saddle points
The Nash equilibrium is also called a
saddle point because of the two curves
used to construct it:
an upward arching Maximin gain curve
and a downward arc for minimum loss.
Draw in 3-d, this has the general shape of a
western saddle (or the shape of the universe;
and if you prefer). .
12/11/22 11
Some Simple Examples
Battle of the Bismark Sea
Prisoner’s Dilemma
Chicken
12/11/22 12
The Battle of the Bismarck Sea
Simple 2x2 Game
US WWII Battle
Japanese Options
Sail Sail
North South
Recon 2 Days 2 Days
US North
Options Recon 1 Day 3 Days
12/11/22
South 13
The Battle of the Bismarck Sea
Japanese Options
Sail Sail Minima
North South of Rows
Recon 2 Days 2 Days 2
US North
Options Recon 1 Day 3 Days 1
South
Maxima of Columns 2 3
12/11/22 14
The Battle of the Bismarck Sea
- examined
This is an excellent example of a two-person
zero-sum game with a Nash equilibrium point.
Each side has reason to employ a particular
strategy
Maximin for US
Minimax for Japanese).
If both employ these strategies, then the
outcome will be Sail North/Watch North.
12/11/22 15
Decision Tree
Decision Tree Version of Battle of Bismark Sea
Search
North
2
Sail North
Search
South
1
Japanese
Search
North
2
Sail South
Search
South
3
12/11/22 16
The Prisoners Dilemma
The Prisoner’s dilemma is also 2-person
game but not a zero-sum game.
It also has an equilibrium point, and
that is what makes it interesting.
The Prisoner's dilemma is best
interpreted via a “story.”
12/11/22 17
A Simple Prisoner’s Dilemma
Prisoner A
~ Confess Confess
~ Confess -1 0
-1 -10
Prisoner B
Confess -10 -5
0 -5
12/11/22 18
Alternate Prisoner’s Dilemma
Language
Uses Cooperate instead of Confess to denote player cooperation with
each other instead of with prosecutor.
Prisoner A
Cooperate Defect
Cooperate -1 0
-1 -10
Prisoner B
Defect -10 -5
0 -5
12/11/22 19
What Characterizes a
Prisoner’s Dilemma
Uses Cooperate instead of Confess to denote player cooperation with
each other instead of with prosecutor.
Prisoner A
Cooperate Defect
12/11/22 20
What makes a Game a
Prisoner’s Dilemma?
We can characterize the set of choices in a
PD as:
Temptation (desire to double-cross other player)
Reward (cooperate with other player)
Punishment (play it safe)
Sucker (the player who is double-crossed)
A game is a Prisoner’s Dilemma whenever:
T>R>P>S
Or Temptation > Reward > Punishment > Sucker
12/11/22 21
What is the Outcome of a PD?
The saddle point is where both Confess
This is the result of using a Minimax
strategy.
Two aspects of the game can make a
difference.
The game assumes no communication
The strategies can be altered if there is
sufficient trust between the players.
12/11/22 22
Solutions to PD?
The Reward option is the joint optimal
payoff.
Can Prisoner’s reach this?
Minimax strategies make this impossible
Are there other strategies?
12/11/22 23
Iterated Play
The PD is a single decision game in
which the Nash equilibrium results from
a dominant strategy.
In iterated play (a series of PDs),
conditional strategies can be selected
12/11/22 24
The Theory of Metagames
Metagames step back from the game and look
at the other players strategy
Strategic choice is based upon opponents
choice.
For instance, we could adopt the following
strategies:
Tit-for-tat
Tat-for-tit
Choose Confess regardless
Choose ~Confess regardless
12/11/22 25
A Prisoner’s Dilemma
Metagame
Prisoner A
~ Confess Confess Tit-for-tat Tat-for-tit
Regardless Regardless
~ Confess -1 0 -1 0
-1 -10 -1 -10
Pris
B Confess -10 -5 -5 -10
0 -5 -5 0
12/11/22 26
The Full PD Metagame
See page 36 in Brahms
Using the Metagame tit-for-tat strategy,
we get three possible equilibria
One the original both confess
The other two, both ~confess (a
cooperative solution)
12/11/22 27
The Morality of tit-for-tat
Note that the conditional strategy of
cooperate regardless is a direct manifestation
of the Golden rule, perhaps the simplest and
most ubiquitous moral maxim we have.
Tit-for-tat invokes a rough system of justice
(or equality in any event)
Because tit-for-tat always results in equal
payoff to both players, it is a very equitable
strategy.
It also teaches its morality, by encouraging
mutual benefit through reciprocity.
12/11/22 28
Chicken
The game that we call chicken is widely
played in everyday life
bicycles
Cars
Interpersonal relations
And more…
12/11/22 29
The Game of Chicken
Driver A
~ Swerve Swerve
~ Swerve 1 2
1 4
Driver B
Swerve 4 3
2 3
12/11/22 30
Chicken is an Unstable game
There is no saddle point in the game.
No matter what the players choose, at
least one player can unilaterally change
for some advantage.
Chicken is therefore unstable.
We cannot predict the outcome
12/11/22 31
Chicken is Nuclear Deterrence
12/11/22 32
National Missile Defense
Let’s pick a current problem
National Missile Defense
Structure this as a game
12/11/22 33
The Game of National Missile
Defense
US
Build ~ Build
12/11/22 34
Calculating Expected Utility of
NMD
E(Build)=pA(B-C)+p~A(B-C)
E(~Build)=pA(B-C)+p~A(B-C)
E(Build)=pA(0-60)+p~A(0-60)
E(~Build)=pA(0-1000)+p~A(0-0)
12/11/22 36
Utility Curves
p1
12/11/22 37
Adding Complexity
More players
Information differences
If players do not know the payoffs then
they have very incomplete information
Nested Games
The
12/11/22 38
Tragedy of the Commons
First observed during the British
Enclosure movement
Describes the problem of the
unregulated use of a public good
Take a commons – e.g. a common
pasture for grazing of cattle in a village
12/11/22 39
An example
Take a village with 10 families
Each family has 10 cows which just
exactly provide the food they need.
The village commons has a carrying
capacity of 100 cows
12/11/22 40
Cow Carrying Capacity
Each cow produces 500 lbs of meat & dairy
per year up to or at carrying capacity of the
pasture.
10 families X 10 Cows X 500 lbs =
50,000 lbs of food at carrying capacity
12/11/22 41
One more cow
So Farmer Smythe decides he really needs
one more cow.
And there is no one to tell him no because
the commons is an unregulated public good
Like
Air
Water
Security ?
12/11/22 42
Reduced Capacity
With the overgrazing, each cow will now
produce only 490 lbs of food.
10 families X 10 Cows X 490 lbs =
49,000 lbs of food at carrying capacity
Each family gets 4900 lbs of meat & dairy,
instead of 5000.
Except Farmer Smythe, who gets 5390 lbs
Even with the reduced carrying capacity, it is
still to his advantage to add the extra cow
12/11/22 43
Look Familiar?
Look at the situation
N players
Equilibrium solution is to ~ cooperate
Joint optimal outcome is to cooperate,
This is an n-person Prisoner’s dilemma
12/11/22 44
Thinking Strategically
10 Tales of Strategy
Dixit and Nalebuff offer 10 simple
concepts that are strategic in nature.
They are worth reviewing, as they all
demonstrate some particular strategic
choice.
12/11/22 45
The Hot Hand
Are ‘hot hands’ just random sequences in a long
series of trials?
Probabilistic analysis suggests that what sports
observers claim as periods of exceptional
performance are not statistically excessive
But hot hands may be masked by team responses.
Take tennis:
If your backhand is weak, your opponent will play to it.
Improve your backhand, and you get to use your better
forehand more
12/11/22 46
To Lead or not to Lead
Front-runner strategy
The leading sailboat copies the strategy
of the trailing boat.
Doesn’t work in 3 boat races
Applicable to election?
When to go negative?
12/11/22 47
Go Directly to Jail
Just the Prisoner’s Dilemma
12/11/22 48
Here I stand
Taking an irrevocable stand may change
your opponent’s strategies.
A public statement makes a commitment
(and thereby changes payoffs) in ways
that may dictate an outcome.
Opponent has to “take it or leave it.
May be costly next time!
12/11/22 49
Belling the Cat
Is the individual willing to assume the risks of
the group
This is a “Hostages Dilemma”
Note the reference to plane full of passengers
powerless before a hijacker with a gun.
Is this likely to be the case after 9/11?
What does this say about this strategic decision?
12/11/22 50
The Thin End of the Wedge
Special interests get attention due to a
one-at-time strategy
We approve special provisions for a
single request, when if we looked at the
aggregate impact of many such
requests, we might not…
Line item veto is strategy for dealing
with it.
12/11/22 51
Look before you leap
Look at long term
consequences/commitments prior to
decision
E.g heroin
12/11/22 52
Mix your plays
Rely on your best strategy – strongest
asset
But not exclusively
If you run the football every play, the
defensive backfield will pull in and you
will be less effective.
The pass sets up the run.
12/11/22 53
Never give a sucker an even bet
When someone offers to bet you, they
often know the odds – don’t bet.
Such as appliance warranties
12/11/22 54
Game theory can be
dangerous to your health
Check your bargaining position before
you negotiate.
Do you negotiate first or afterwards?
Does your physical setting influence
strategy?
12/11/22 55
Other Games
Battle of the Sexes
12/11/22 56
Battle of the Sexes
M
Football Ballet
Football 2 0
1 0
F
Ballet 0 1
0 2
12/11/22 57
Battle of the sexes
12/11/22 58