Thanks for the feedback, Steve. I'd be interested in further comment on
your statement: "For unfavorable games, lower variance usually implies
greater risk." This isn't immediately clear to me. Let me paint my grasp
of the topic and I'd appreciate it if you would provide further feedback
(and you'll forgive me if I'm a little long-winded here in the interest of
clarity).
Part of the difficulty with talking about risk is that gambling authors
generally treat risk and variance as different expressions of the same
thing. It turns out that this is wrong, and I've argued "against the
current" on this previously with limited success, but now I believe I
can demonstrate this mathematically.
In the past I've argued that when playing a neg-EV game, variance
is the player's only friend, because reducing variance to zero would
force the player to simply pay the casino a fixed amount of EV each
time the game is played. Variance is what gives the player a chance
to come out ahead. Although this is true, this argument isn't perfect.
It isn't correct for a neg-EV player to seek variance just for the sake
of variance. But, in a game like Roulette, where all the plays have
the same EV, plays with high payoff (like 35:1 for a wager on a
single number) are lower risk than plays with lower payoff (like 1:1
for red/black/even/odd wagers).
I'll first own up to "risk" and "variance" as not being fully equivalent.
But from a practical standpoint variance isn't a bad starting point in
assessing the potential damage a game might do to your bankroll.
It isn't a bad starting point for pos-EV games. It is a terrible starting
point for neg-EV games, as the Roulette example illustrates.
Of course the return of a game is another key factor.
Seems that way, but one can actually ignore EV and variance completely
when studying risk. In addition, if your objective is risk based (example:
turn initial bankroll B units into goal G units, or go bust trying), then EV
and variance don't matter at all, only the risk matters. The probability
of success for this objective is given by p(success) = (1 - R^B) / (1 - R^G)
where R is the risk of ruin (or, for negative games, the inverse of the
casino's risk of ruin).
Roulette also illustrates this point -- the EVs of the plays are all the
same, but the risk varies from a high of R=1.11111 for even money
bets, to a low of R=1.00306536 for bets on a single number. If your goal
happens to be to turn $1 into $36, then betting it on a single number
on the roulette wheel gives you a 1/38 chance (double zero assumed).
If you try to turn $1 into $36 by betting on red/black/even/odd, your
probability of success drops to 1 in 390.5. Using the low variance
plays reduces your probability of reaching the goal by more than
a factor of 10 in this example.
I'll also admit that some of
the statements I might make here are approximations at best, but I think
they're sufficiently on target for purposes of getting a handle on this
subject.
Now, I'm interpreting variance as expressing, among other things, the
relative downside to actual return vs. expected. If two games have
identical returns, then the game with the higher variance has the larger
downside (and, in my book, "risk").
True for positive EV games, false for negative EV games.
However, if the returns aren't equal things become murkier.
Right. So, I would claim that if you really want to talk about risk, it
is better to just forget about EV and variance and compute risk
directly. This gets rid of the "murk" from using variance to approximate
risk, and it also gets rid of the "murkier" situations when returns aren't
equal.
If variances of the two games are identical but one game has an inferior
return, then while both games pose essentially similar probability of
falling short of EV by a given number of bets (or "downside" relative to
ER). However, clearly the game with the lesser return presents the greater
probability of a loss or, in other words, potential bankroll damage.
Although this may seem clear, it isn't necessarily true, due to the fact
that EV and variance cannot give a perfect indication of risk.
So,
if a game possesses a greater variance and a greater return the potential
impairment to bankroll relative to the other game becomes uncertain without
further analysis of the numbers. But it's still the case that this game
poses the greater risk of falling short of ER.
I think your reasoning on this falls well in line with conventional wisdom
on the subject. I also believe the conventional wisdom is flawed.
But, in the case of 2 or 3 Level MS play, variance is lower and return is
nominally higher than the equivalent single line game. I see both of these
serving to reduce MS risk of bankroll impairment vs. single line play -
whether the games have positive or negative returns.
Much of my point is that when it comes to risk, things that hold for positive
games do not hold, and often get turned around completely, for negative
games.
In positive games, minimizing risk means that you make the smallest bets
you can to maximize the number of units in your bankroll. The more units,
the higher your probability of reaching any pre-defined goal, before going
broke. Here you want to spread your wagers out as much as possible.
In negative games, minimizing risk means that you want to make as few
bets as possible, playing with "maximum boldness" to give you the best
shot at reaching your goal quickly and going home a winner.
When thinking about risk, it may be helpful to view the game from the
perspective of the casino. If the game is negative for you, then it is
positive for the casino. Any action you take that results in reducing
the risk for the casino will increase your own risk, and vice-versa.
If the casino has the edge, then they minimize risk if bets are small.
So, if you bet small, they will grind you down with minimum risk to
their bankroll. If variance increases the casino downside, then it
gives the player a better shot at coming out ahead. So, on a
Roulette table where the house has the edge, the high variance
bets are riskier for the casino and less risky for the player.
If your comments are correct, then there's obviously something missing from
this conceptual picture. In particular, I see these statements as holding
true irrespective of a positive or negative return. Care to steer me on a
stronger course, Steve?
I've been working on developing a new framework for thinking about
probability, based on a concept that I call "virtual payoffs." I'm going
to walk through this (too quickly, I'm afraid) and then try to show how
this allows us to view risk.
A while back I posted an article titled "Equivalent Games". That article
included the following table:
<---- Coin Flip Subgame ----> <------ Overall Outcome ----->
Return % Tries Sub-cycle % Hit Cycle
···
On Friday 23 January 2004 08:37 am, Harry D. Porter wrote:
--------------------------------------------------------------------------
1000 4.762161445 1735.498092607 0.002743974 36443.495514000
50 0.558915312 51.268241981 0.010901784 9172.810426000
25 5.962619841 25.307949781 0.235602642 424.443457000
8 9.224490842 8.028576209 1.148957250 87.035440178
5 5.522918550 5.010195394 1.102335960 90.716445466
4 4.523411750 4.006115160 1.129126740 88.564017180
3 22.284452726 3.003056542 7.420590460 13.476016570
2 25.809295114 2.001018502 12.898079200 7.753092414
1 21.351734420 1.000000000 21.351734420 4.683460277
--------------------------------------------------------------------------
This game is 8/5 JoB, played with a max-EV strategy. The column labeled
"Sub-cycle" can be interpreted in a lot of interesting ways. One way is to
treat these numbers as "virtual payoffs" that would make the game fair, so
that it paid back exactly 100.000000%. In other words, a breakeven game.
Given any set of final probabilities for a game+strategy, as shown in the
last two columns, there are an infinite number of ways to assign virtual
payoffs to give a breakeven game. This particular set of virtual payoffs
gives a "risk view" of the strategy. The virtual payoffs for this view are
related to the actual payoffs in such a way that each case has the same
risk. For a risk view, the actual payoff AP and virtual payoff VP are related
by the equation:
VP = (1 - R^AP) / (1 - R).
For this strategy, the risk parameter is very close to R=1.0010185.
So, for example, an actual payoff of 1000 gives:
VP = (1 - 1.0010185^1000) / (1 - 1.0010185) = (1 - 2.7676) / (1 - 1.0010185)
= 1735.49
This non-linear relationship between the actual and virtual payoffs
defines what "risk" truly means. Favorable games have R values
less than one, while unfavorable games have R values greater
than one.
Now for some magic. As I said above, these virtual payoffs would
give a return of 100% if they were applied to the actual game and
the (normal) max-EV strategy for 8/5 JoB was played. If we pretend
that this game has payoffs that match the virtual payoffs, and compute
a strategy that maximizes the "virtual EV", we will raise the virtual EV
above 100% and get a new playing strategy which has a lower risk!
In fact, this new strategy reduces the risk from 1.0010185 to 1.000962459.
This new "better risk" strategy has numbers that look like this:
pay % Try T Cycle prob Cycle
----------------------------------------------------------------------------
1000 5.15745432686 1679.98348585437 0.00306994347 32573.88974064100
50 0.54971783713 51.19737578622 0.01073722683 9313.39176725000
25 5.94586199097 25.29087965863 0.23509905829 425.35261829200
8 9.21072403444 8.02700079635 1.14746768664 87.14842358029
5 5.59918933828 5.00963386043 1.11768434466 89.47069937749
4 4.46467662610 4.00577846182 1.11455904730 89.72158114211
3 22.23687507540 3.00288830414 7.40516223823 13.50409306142
2 25.78246346011 2.00096245927 12.88503107126 7.76094364437
1 21.05303731071 1.00000000000 21.05303731071 4.74990845854
----------------------------------------------------------------------------
100.00000000000 0.40546996070 44.97184792739 2.22361331830
Notice that the royal cycle has shrunk from 36443 to 32574. This
is to be expected, since we were playing as if the royal had a
payoff of 1735 -- effectively trying for royals more often than we
did in the max-EV strategy. The column with virtual payoffs is
now labeled "T Cycle" because these numbers come from a
program that I wrote to compute risk and cost "views" from
probability numbers (or cycle numbers) for a VP game. These
represent new, improved "virtual payoffs" that represent the
risk view of this lower-risk strategy.
Now let's do the same thing again -- use the "T Cycle" column as
virtual payoffs, and find a new strategy which maximizes "virtual EV".
This gives the following table:
pay % Try T Cycle prob Cycle
----------------------------------------------------------------------------
1000 5.15280360155 1679.95880300094 0.00306722022 32602.81068143500
50 0.55010832794 51.19734366634 0.01074486074 9306.77487799900
25 5.94577440676 25.29087191802 0.23509566717 425.35875376100
8 9.21046326880 8.02700008174 1.14743530273 87.15088315836
5 5.60010808033 5.00963360570 1.11786779655 89.45601645259
4 4.47000911963 4.00577830908 1.11589029016 89.61454444205
3 22.23567891425 3.00288822781 7.40476408955 13.50481916650
2 25.78052093421 2.00096243385 12.88406043919 7.76152832191
1 21.05453334653 1.00000000000 21.05453334653 4.74957095245
----------------------------------------------------------------------------
100.00000000000 0.40546994776 44.97345901283 2.22353366174
The risk parameter for this strategy has a value of R=1.000962433846, which
is only a tiny improvement compared to the previous iteration. Now if you use
these virtual payoffs and try to iterate again, you get the same strategy
back! This means that we can't take any more "steps" to reduce risk. In
addition, the "virtual EV" for these payoffs is 100.00000% and this
is also maximum EV for these (virtual) payoffs. The strategy that produced
these numbers is the min-risk strategy for this game.
The royal cycle for this min-risk strategy is 32602.8, compared to a royal
cycle of 36443.5 for the max-EV strategy. The min-risk strategy is found
by pretending that the payoffs are all "stretched" according to the formula
which represents an equal risk parameter for all payoffs. If the actual
payoffs were set to the values of the virtual payoffs, we would get a
breakeven game. What this boils down to is that minimizing risk is just
like pretending that the payoffs were "risk adjusted" and the strategy
optimized for the virtual payoffs, resulting in a breakeven game. For
neg-EV games, this process results in virtual payoffs that are larger
than the real payoffs, causing the min-risk strategy to "try harder" to
get big payoffs. In contrast, pos-EV games result in virtual payoffs
that are smaller than the real payoffs, causing the min-risk strategy
to "avoid" big payoffs. So, to reduce risk in pos-EV games, we play
a less agressive strategy as if the royal was worth significantly less
than its true value. In neg-EV games, minimizing risk requires us to
do just the opposite -- pretend the royal payoff is larger than it really
is, and play more agressively.
The concept of virtual payoffs can be applied to a wide variety of playing
objectives. The min_cost_royal strategy keeps most payoffs "real" while
using a virtual payoff for the royal. If we play the max-EV strategy for
8/5 JoB, the virtual payoff for a royal would need to be 1798.6 units
to give a breakeven game. This is the cost of a royal for this strategy.
This min_cost_royal strategy reduces cost(royal) to 1733.142 units, and
this is the virtual payoff for the royal when using that strategy. This is
not very far removed from the 1679.95 virtual payoff given by the
min-risk strategy. In fact, the risk for min_cost_royal strategy is
1.00096246595, and the "risk view" of the min_cost_royal strategy
gives a virtual payoff of 1679.9899 for the royal flush, very close to
the value used to minimize overall risk.
I've gone through this rather quickly, so I've probably totally lost
anyone trying to read this. I'd appreciate any feedback in case
anyone is still with me. I need to learn how to describe this in
a way that is easy to understand, because I believe this is an
extremely powerful way to approach a broad spectrum of
problems involving optimal strategies.
Once one becomes used to thinking in terms of virtual payoffs, it
becomes obvious that minimizing risk means "play an overly
cautious strategy if you have the advantage, play agressively
if the house has the advantage."