Decisions under risk (DUR)
Decision rules when the probability of each outcome is known.
Requires an interval scale
When evaluating, we often need to quantify what outcomes are more valuable than others
- Expected Value (EV)
- Expected Monetary Value (EMV)
- Expected Utility (EU)
Typically, we use EU. Sometimes we use EMV under the assumption that it is equivalent to EU in a free market (utility is a positive linear transformation of monetary value)
Two arguments for why EU Max:
- In the long run, no strategy can be expected to do better than maximizing expected utility.
- There is no long run for humans
- Gambler’s Ruin: a gambler with finite wealth, playing a fair game, eventually goes broke with probability 1
- How is the long-run argument relevant to unique decisions that can’t be repeated?
- Axiomatic Approach. You should maximize expected utility, because you are also maximizing utility.
- This conclusion does not depend on the long run argument, so it applies even to the single case.
# Maximizing Expected Utility
Utility is a numerical representation of the agent’s preference ranking
Generally, we prefer using EU over EMV.
See also: utilitarianism
Utility theory allows for outcomes without monetary value, or whose value can’t be measured solely in terms of monetary payoff.
# Utility of Money
Note that generally, there is a diminishing marginal utility of money
For example, in a lottery where you win $1M for sure (A) or 50% chance to win $3M and 50% chance to get nothing (B), most people would choose A. The change in utility from $1M to $3M is not enough to offset the drop in probability from certainty to 50%.
# Paradoxes and Puzzles
# Allais Paradox
- Situation A: Choose between
- $1 million for sure
- A lottery:
- 10% for $5 million
- 89% for $1 million,
- 1% for nothing.
- Situation B: Choose between
- 10% for $5 million
- 11% for $1million
Paradox arrises if you choose a) over b) in situation A and d) over c) in situation B. But, we can show that these two situations are equivalent.
- Savage: fix irrational preferences of people!
- Revise the table: utilities of the same amount of money is not the same in the two situations (not very plausible)
- Priority heuristics (Gigerenzer): people have a hierarchy of goals and avoiding uncertainty is high on the list (hard to defend as a normative principle)
# Ellsberg Paradox
Same idea as Allais Paradox but shifts probabilities instead of values
Urn with 90 balls
- 30 red balls (R), 60 black (B) or yellow balls (Y)
- Let $p * 60$ be the number of black and $(1-p)*60$ is the number of yellow balls
- A ball will be draw and you make a bet on its colour
- Situation A: Bet R or B. Receive $100 if right, $0 if wrong
- Situation B: Bet (R or Y) or (B or Y). Receive $100 if right, $0 if wrong
Many people bet R in Situation A but bet (B or Y) kin situation B. People like to avoid uncertainty! However, this is inconsistent with EU Max
# St. Petersburg Paradox
A fair coin is tossed until it comes up Heads. If Heads appears for the first time on toss $n$, you are paid $$n$
What is the EMV of this game? Technically, the St. Petersburg game involves infinitely many states
$$EMV = (1/2)$2 + (1/2)^2$2 + \dots = 1 + 1 + \dots = \infty$$ You should be willing to pay any price to play!
- Bernoulli: diminishing marginal utility of money
- Refutation: change payout to $$2^n$
- Buffon: de minimis condition
- Ignore tiny probabilities
# Two-Envelope Paradox
A trustworthy informant tells you that one of the envelopes contains exactly twice as much as the other, but the informant does not tell you which is which. Since this is all you know, you decide to pick an envelope at random. Let us say you pick envelope A. Just before you open envelope A you are offered to swap and take envelope B instead.
Given what you know, both possibilities are equally likely. Hence, the expected monetary value of swapping to B is $\frac 1 2 2x + \frac 1 2 \frac x 2 = \frac 5 4 x$. Since $\frac 5 4 x > x$, it is rational to take B instead of A. But you can apply the same argument to arrive at a contradictory claim that you should take A instead of B.
- The present formulation of the paradox presupposes that there is no upper limit to how much money there is in the world
- Suppose that there indeed is some upper limit L to how much money there is in the world.
- It then follows that no envelope can contain more than (2/3)L
- The other envelope would be certain to contain (1/3)L