Risk and Uncertainty:

A Fallacy of Large Numbers (Reprint)

by Paul A. Samuelson

RISK AND UNCERTAINTY: A FALLACYOF LARGENUMBERS'

Erpcrienca shows that while R single cvcnt may have a probabilily alweed, D fawn This repetition of indepcndcnt single erente gives R greater approach toward certairrty. corresponds to the rn~rtbematically provable Law of I~swe Numbers of J~mcs Ilcrnonlli. Thus pcofrle This valid property of lnrge numbers is often given an invalid interpretation. my c.n insurance compaoy reduces its risk by increasing the number of ships it insures. Or they refuse to accept a msthemat.ically fnvoreble bet. but agree to R large enough ropetition of Such bets: e. 6.. believing it is almost a sure thing that them will be B million heads when two million a~urretric coins are tweed own thowh it is highly uaccrDlin there will The correct rclat.ionship (that an insurer reduces be one bend out of two coius taxxi. Mtnl risk by subdimifi~rp) is pointed out and B strong theorem is prored: that a person whose utility schedule prerente him from evw taking B specific favorable bet when offered nnly once can never mt.ionally take R large sequence of such fair bets, if expectad utility The ietrensitivity of sltcrnotive decision criteria-such as eelecting out of is maximized. eny two situations that one which will mwe probnbly leave you better off-is also demonstrated.

I. INTRODUCTIOS. - KThere is safety in numbers. Y So people tell one. But is there t And in what possible sense 1 The issue. is of some importance for economic behavior. Is it true that an insurance company reduces its risk by &&Zing the number of ships it insures ? isu one distinguish between risk and uncertainty by supposing that the former can count ou some remorseless caucelling out of actuarial risks ! To throrr light 0x1 a facet of this problem, I shall formnlate and prove a theorem that should dispel1 one fallacy of wide currency.

2. A TEST OF VALOR. _ S. Clam, already a distinguished mathematician rrhen xve were Junior Fellows together at Harvard a quarter century ago, ouce said: l I define a coward as someone who will not bet when you offer him two-to-one odds and let him choose Ais sidc.l With the centuries-old St. Petersburg Paradox in my mind, I pcdanticalls corrected him: * You mean will not make a suficimtty snlnU bet (so that the change in the marginal utility of money* will not contaminate his choice). m

3. A COIXILI PIG SPEAKS. - Recalling this conversation, a few years ago I offered some lunch ~~lleaguues to bet each $200 to $100 that the side of a coin tAey specitied rrould not appcx at the first tom. One distingui-

50

SCKENTLA

shard scholar -who lays no claim to advanced mathematical ekills - gave the following answer: Y I wont bet because 1 would foe1 the $100 loss more than the $200 gain. But I1 1 take you on if you promise to let me make 100 such bets*. What was behind this interesting answer f Ho, and many others, have given something liko tho following explanation. a One toss is not enough to make it reasonably pure that the law of avoragoa will turn out in my favor. But in a hundred tomes of a coin, the law of large numbere will make it a darn good bet. I am, 60 to speak, virtually sure to ceme out ahead in such a sequence, and that ie why I aocept the eequenoe while rejecting the single toss. a!

4. -hfAXlNtJN Loss AND PRORABLE LOSS, this answer? Here are a few observations.

- Wbat are we to think about

a) If it hurts much to lose $100, it must certainly hurt to lose 100 x $100 = $10,000. Yet there is a distinct ~ssi!GMy of so extreme a loas. Granted that the probability of 80 long a r:m of repetitions is, by moat numerical calculations, extremely low: leae than 1 in a million (or I/sroO), still, if a person is already at the very minimum of subaietenoe, with a marginal utility of income that beoomea praotioaily infinite for any Iose. he might act like a minimsxer and eschew options thst oould invoive any losses at all. [Note: increasing the sequence from n = 190 to n = 1,000 or n-03, will obviously not tempt such a minimaxer - even though the probability of any loss beoomea gigantically tiny]. b) Shifting your focus from the maximum possible lo.% (whieh grows in full proportion to the length of the sequenoe), you may ealoulate the probability of making no 10s~ at all. For the aingIe tom, it is of coume one-half. For 100 tosses, it ie the probability of getting34 or more correot heada (or, alternatively, tails) in 100 tossas. By the usual binomial oalculation and normal approximation ,* this probability of making a gain ie If this has not reduoed the probabifound to be very large, P,, = .99-l-. lity of a loss by enough, it ie evident &hat by inoreaaing n from 100 to some larger number will eucoeed in reducing the probability of a lose to aa low as you want to prescribe in advance. o) Indeed, James Bernoullis ao-oalled Law of Large Numbers yaranteev you this: I Suppose I offer you favorable odda at eaoh Texas that 80 your mathematical expectation of gain is k per cent in terms of the money you put at risk in eaoh toae, Then you oan choose a long-enough sequenoe of tosses to make the probability aa near as you like to one that your earninp will be inde&nitely near /c per cent return on the total money you put at risk S.

51

RISK AND UNCERTAINTY

5. IRIIATI~NALITY 0~ C~MP~UNDING A MISTAKE. - The rvirtual certaiuty * of making a largo gain must at first glance eeem a powerful argumout in favor of the decision to contract for a long sequence of favorable b&s. But should it be, when we recall that virtual oer;ainty cannot be complete certainty and realize that the improbable loss will be very great indeed if it doos occur? If a person is concerned with maximizing the expected or average value of the utility of all possible outcomes and my &league assurea me that he wante to stand with I)auiel Bernoulli, Bentham, Ramsey, v. Neumann, Marsohak, and Savage on this basio ieaue -it is simply not suffimust have oieut to look at the probability of a gain alone. Each outcome.

its utility reokontd al tlu appropria.te probability; and whn this is done it witi be joun4 that no sequenceis accepti& ij each oj ik si?tgb @aye ia mt
aoceptile. This is a basic theorem. Cne dramatic way of seeing this is to go Paradox itself. No matter how high a price my engage in this classic game, the probability will come out as much ahead as he carea to specify back to the St. Petersburg colleague agreed to pay to approach one that he will in advance.*

6. AN ALT.ER?(ATIVE AXIOM SYSTEM OF YAXIMIZINO PROBABILITXILS. No slave can serve hvo independent masters. If one is an expected.utilitymaximizer he cannot generally be a maximizer of the probability of some gain. However, economists ought to give serious attention to the merits of various alternative axiom systems. Here is one thet, at first glance, has superficial sttractivene.88. A&m: In choosing between two d&isions, A and B, select that one which will more probably leave you better off. I.e., select A over B if it is more probable that the gain given by A is larger than that on 23, or, in formulae:

Prob { As gain > Bs gain ) > [abbreviate Similarly with respect In terms of the above deciding not to &.s at all; Then clearly, A the above to A)B].

to any pair of (A, B. C. D, . ..). system, aall A agreeing to bet on one toss; B and C agreeing to a long sequence of eOeses. = B, C>B. C>A.

So my frieds decision to accept the long sequence tume out to agrea with this axiom system. However, if D is the &&ion to accept a sequence of two tosses. my friend said he would not undertake it; and yet, in this

52

SCIENTIA

syslom, D > B. Moreover, call E tbo decision to accept the following bet: ~-or1will a trillion dollars wit.11 probability .51 but loso a million with probability .i!). Pow could accept suob a bot; and of those who could, few would. Yd. in this axiom system E > B. lhore is a further fatal objection to this axiom system. It need not relation8 among 3 or more oboicee. Thus, it is quite satisfy transitivity possible to have X > Y, Y > Z and 2 > X. 0110 example is enough to show this pathologiaal possibility. Lot X be a sieuation that is a shade more likely to give you a small gain rather than a large loss. By this axiom system you will prefer it to the Situation Y, which gives you no lance of a gain or loss. And you will prefer Y to Situation 2, which makes it a shade more likely that you will restive a small loss rather than a large gain. But now let us comparo 2 and X. Instead of acting transitively, you will prefer Z to X for the simple mason that 2 will give you the better outcome in every situation exoept the one in wbicb simultaneously tbe respective outoomea would be the small gain and the small loss, a compound event whose probability is not much moro than about one-quarter (equal to the produot of two independent probabilities that are respectively just above one-half).

7. IBooF mm VHFAIRNE.S~ cdx 0wLY BREED UNFAIRNELIS. - Aftar the above digression, there remains the task ti prove the basic theorem already enunciated. Zheoren~. If at each income or wealth level within a range, the expetted utility of a certain investment or bet is worse than abshntion, theu no sequence of such independent ventures (that leavea one within the specified range of income) can have a favorable expected utility. Thus. if you would always refuse to take favorable odds on a single toss., you must rationally refuse to participate in any (finite) sequenoe of suoh to66e.s. The Iogic of the proof can be briefly indicated. If you will not mpt one toss, you cannot aocept two - sinoe the latter oould be thought of a8 consisting of the (unwise) decision to accept one plus the open decision to accept a second. Even if you were stuck with the first outoome, you WOtid cut your further (utility) losses and refuse the terminal throw. By &ending the reasoning from 2 to 3 = 2 + 1, . . . . and from n-l to n, we rule out my sequence at all.*

Ft(X.Y)--F(X.Y)*rr-.(X.Y)~... F (S. :hen Y) o-rilr G (11, Yl j--X -ce is the integral dFt (1. Y:

-F(X.Y)F(X.Y)...*F(X,Y). j-- F (X. -02 c Y and S) dG (S. Y) . . . . X dFk And. (X. Y) if J-XdF C Y.

WhW (X .Y)< Y

53

RISK

AND

UNCERTAINTY

8. CONCLUSIONS. - Now that 1 have demonstrated the fallacy that there is safety in numbers - that actuarial risks must allegedly cancel out in tl,e sense relcvnut for inocstmont decisions - a few general remarks may be in order. Firstly, when an insurance company doubles the number of ships it illsura, it does also double the range of its possible losses or gains. (This does not deny that it reduces the probability of its losses.) If at the same time that it doubles the pool of its risks, it doubles the number of its ow,,ers, it has indeed left the maximum possible loss per owner unchanged; but _ and this is the germ of truth in the expression Kthere is safety in numbers P - the insurance company has now succeeded in reducing the probability of mh loss; the gain to eaeh owner now becomes a more certain one. In short, it is not so much by adding new risks as by subdividing risks among more people that insurance companies reduce the risk of each. To see this, do not double or change at all the original number of ships insured bt the company: but let each owner sell half his shares to each new owner. Then the risk of loss to each owner per dollar now in the eompany will have indeed been reduced. Undoubtedly this is what my colleague really had in mind. In refnaing a bet. of $100 against $200, he should not then have specified a eeqnence of 100 such bets. That is adding risks. he should have asked to subdivide the risk and asked for a sequence of 100 bets, eaoh of which was 100th as bin (or $1 against 9). If the nuntey odds are favorable and if we ean subdi;ide the bets enough, any expected-utility-maximizer can be coaxed into a favorable-odds bet - for the obvious reason that the utility functions curvature becomes more and more negligible in a sufficiently limited range around any initial position. For suliiciently small bets we get more-thana-fair game in the utility space, and my basic theorem goes nicely into rerersf3.l Secondly, and finally, some economists have tried to distinguish betseen risk and uncertainty in the belief that aotuarial probabilities can reThe limit laws of probability grind fine duce risk to l virtual l certainty. but they do not grind that exceeding fine. I snzpeet there is often eonfudon betffeen tar0 similar-sounding situations. One ie the caw where the orvner of a lottery has Sold out ol.J the tickets: the buyers of the tieketa then face some kind of risky uncertainty, but the owner has completely eaneelled out his risks whatever the draw may show - which is not a ease of risk as againat uncertain, but really reflects a eaG of certainty without any risks at alL Another WI is that in which the management of Monte Carlo or of the I numbers game l do business with their euatomem. The management makes sure that the odds are in their favor: but they aan nere.r make sure that a rnn of luok will not go again& them and break the honse (even thongh +iey can reduce this probability of ruin to a posiliac fraction). ln every actuarial situatiou of mathematical probability, no matter

54

how large the numhors in the eamplo, wo are left witb a finite sample: in the appropriate limit law of probability there will necessarily be left an As Gertrude Stein epsilon of uncertainty even in so-called risk situations. never said: Epsilon aint zero. This virtual remark has great importance for the attempt to croate J difference of kind between risk and unto-tainty in the economics of investment and decision-making. P.A.
SAMUEL~~N

Cambridge, MassachusettsImti2ut.e of Technology.