The Statistician: What are the best powers to play?

by Josh Burton


Introduction

Diplomacy players are a shrewd bunch. We pride ourselves on being hard-nosed and hard-headed; we don't let our emotions get in the way of our actions; we consider our possibilities rationally and decide on the best course of action.

In particular, there are many Dippers who appreciate the strategic and tactical aspects of the game as much as the diplomatic aspect. We (I certainly include myself) enjoy playing the general as well as the diplomat. We love nothing more than to size up a position, analyze a power's strengths and weaknesses, identify objectives, and formulate a short-term and long-term plan for success. If terms like "stalemate line" and "tempo gain" bore you, you're probably more of a pure Diplomat. But if they pique your interest, you're one of us. A "general-diplomat".

A good general will study the wars of the past, so as to better understand the wars of the present. Similarly, a general-diplomat should study games already played, in order to play new games better. There have been thousands of games on the PBEM judges, yet very little effort has been put into performing thorough statistical analyses of those games. (The last time The Zine published a statistical analysis was in 1998.) Given the number of general-diplomats worldwide, I find this surprising.

No-press games

A no-press game is a game in which the players do not communicate at all, except through their orders. By constrast, in a press game, the players communicate normally. For the purposes of this article, I define "full press" to be any press settings in which the players can communicate directly to one another without any ambiguity as to who is talking (i.e., at least White, Partial, with no regard to Fake) and "incomplete press" to be any press settings that are neither no-press nor full-press. The term "no-press" is often conflated with the term "gunboat", which technically means that the players do not know each others' real-life identities. (Games without full press must be gunboat, of course, or the players would be able to communicate as if they were in a press game; but full press games may also be gunboat.)

Lately I have been playing exclusively no-press games, which require a smaller time commitment. Playing no-press also lets me play the role that I enjoy most: the general-diplomat. No-press games are fundamentally different from press games: You can't manipulate other players as easily, you can't make them tell you their plans, and you can't convince everyone to be your best friend. Make no mistake, there is still plenty of diplomacy going on -- there have been many articles about communication in no-press games -- but the negotiations are subordinated to the tactical and strategic needs of each power. Thus, tactics and strategy are paramount -- tactics for the short term, and strategy for the long term. To do well in no-press, you must truly understand the unique geography of the Diplomacy board. For these reasons, and because you have no a priori way to judge your opponents, statistical analysis of past games is very important to playing current ones.

FRIGATE

Although I have less time than I used to, I do have one skill I used to lack: I can program. I have recently learned how to write Perl. You may suppose that the task of extracting useful information from thousands of games would be hopelessly dull, but it's a feasible task for a crack Perl programmer. After many hours of work, I have written FRIGATE: a Perl-based program that produces useful game data.

Here's how FRIGATE works. First, I download all the game summary files (available online at http://doug.obscurestuff.com/dip/jdpr.html -- scroll to the bottom.) Then I read those files into FRIGATE, which parses them to determine each game's outcome, press settings, variant type, etc. All those games go into a big database. Then I simply ask FRIGATE to examine the database and print out the results I'm interested in. Thanks to the wonders of modern technology, all this happens in less than a minute.

As a side note, a small but significant portion of the games available are flagged as "irregular". This may be for any number of reasons -- abandoned games, unusual win conditions (e.g., tournament games with pre-set end years), player cheating, Payola rules, and so forth. I usually exclude irregular games from the database, which allows me to assume that every game ends in either a clear victory (18 centers) or an evenly shared draw.

The Best Power To Play

FRIGATE can answer all sorts of questions, but I think the first question everyone wants to ask is: "What are the best Diplomacy powers to play?" That's a surprisingly subtle question. How do you judge "best": is it the power that gets the most solo victories, or the power that participates in wins/draws the most often? Or is it the power with the most Calhamer Points? (Calhamer Points are awarded as follows: The winning/drawing powers receive 1 CP split evenly among them. This is the basis for Doug Massey's JDPR scores.) What kind of press settings are you playing with? And are you talking about Standard Diplomacy, or a variant?

All the results in this article will be devoted to answering that question. For now I will deal only with Standard games on the PBEM judges, and I will look at wins, draws, and Calhamer Points. I will examine separately the cases of full-press games, incomplete-press games (gray only, or broadcast only), and no-press games. For each case I will give the "FRIGATE ranking" of the seven powers (so called because the powers' first letters spell out "FRIGATE", though the rankings are hardly in this order.) Lastly, for each case I will give the "imbalance", which is a measure of the average inequality between any two powers' chances. (Mathematically, the imbalance is the standard deviation of the set, divided by the mean.)

Results

Full-press games (at least White, Partial) (4516 in database)
Power Wins Wins/Draws Calhamer Points
Austria 5.92% 27.28% 12.43%
England 6.46% 35.09% 15.18%
France 7.48% 39.30% 17.09%
Germany 6.39% 30.42% 13.59%
Italy 4.56% 28.35% 11.57%
Russia 8.17% 31.75% 15.27%
Turkey 6.32% 34.31% 14.88%
Total: 45.31% 226.50% 100%
Ranking: RFEGTAI FETRGIA FRETGAI
Imbalance: 17.44% 13.03% 13.22%

Incomplete-press games (Gray only, or broadcast only) (1320 in database)
Power Wins Wins/Draws Calhamer Points
Austria 6.52% 28.64% 12.61%
England 6.89% 33.33% 14.36%
France 9.39% 38.86% 17.79%
Germany 7.12% 32.05% 14.24%
Italy 5.30% 27.65% 11.28%
Russia 7.42% 29.02% 13.39%
Turkey 8.71% 35.61% 16.33%
Total: 51.36% 225.15% 100%
Ranking: FTRGEAI FTEGRAI FTEGRAI
Imbalance: 18.61% 12.75% 15.42%

No-press games (4262 in database)
Power Wins Wins/Draws Calhamer Points
Austria 6.41% 21.49% 11.12%
England 7.34% 27.66% 13.76%
France 13.21% 38.41% 21.11%
Germany 9.76% 29.73% 15.98%
Italy 5.49% 21.42% 10.37%
Russia 6.99% 18.68% 10.50%
Turkey 10.11% 32.31% 17.16%
Total: 59.31% 189.70% 100%
Ranking: FTGERAI FTGEAIR FTGEARI
Imbalance: 31.75% 25.96% 28.24%

Analysis

What knowledge can we glean from all these numbers? Several facts become readily apparent. First of all, the conventional wisdom regarding France and Italy is true: France really is the best power to play, under almost any circumstances, while poor Italy is usually the worst. Austria also has a consistently bad record, though not as bad as Italy's. All the other powers can be strong or weak, depending on what kind of game you're in and what your goal is.

Secondly, there are some noticeable differences between press and no-press games. The more that players can communicate, the more equal are their chances: the Frenchman is at less of an advantage, and the Italian less of a disadvantage, in full-press games. (By the numbers, France's relative advantage over Italy is more than twice as big in no-press as it is in full-press.) Full-press games are also drawish, while no-press games are more likely to lead to a solo victory: every power except Russia is more likely to solo in a no-press game than in a full-press game. (This is undoubtedly because it's easier to organize a Stop-the-Leader alliance in a press game.) If you want a fair and balanced game that's unlikely to end in a solo, play full press. If experiencing the thrill of victory is more important to you than giving everyone a fair share, play no-press. For a compromise, play incomplete press.

Interestingly, Russia fares much worse in games with less press. This makes sense: Russia is the only power that cannot guarantee for itself any neutral supply centers in 1901; the Russian player therefore needs to negotiate just to get a build. Russia also has a lot of nearby provinces that are usually declared DMZs in a press game, but cannot be agreed upon as such in no-press. Unable to use diplomacy to secure any neutrals or DMZs, Russia often gets pushed back on all fronts (attacked in Galicia and the Black Sea; bounced out of Sweden; forced out of Rumania) by the kind of aggressive defensiveness that is quite common in no-press. I suspect that many people like to attack Russia at the beginning of a no-press game, precisely because it is easy to find allies for such an attack. Hence the Russian player is often doomed quickly in a no-press game. And, apparently, Russia's loss is Germany's and Turkey's gain, since those powers are both stronger in games with less press.

Lastly, for all press types, the imbalance between powers is smaller for draws than for wins. Your power assignment strongly affects your odds to win, but doesn't change your odds of survival quite as much. So if you're stuck playing Italy and lamenting your lousy chances, just remember: if you aim for a draw instead of a win, you're not so far behind!

Further questions

The question explored in this article -- "What are the best Diplomacy powers to play?" -- is only one of many sensible questions that can be answered by good statistical analysis. And it doesn't even begin to solve the general-diplomat's problem of finding a strategy, after the powers have been assigned. Here are some other questions that might already have occurred to you:

I'm not going to discuss these issues just yet; I've blathered on enough for now. But I have already outfitted FRIGATE to answer some of these questions. And since FRIGATE is a work in progress, I might eventually get around to answering them all. If you're a general-diplomat and you'd like to hear some of these questions answered, or if you've got some ideas of your own, please don't hesitate to ask.

One final thought: The accuracy of any statistical analysis improves with more good data. The more PBEM Diplomacy games are played, the better my results will get with time. So do me a favor, and go play more Diplomacy!




Josh Burton
c/o The EDItor
(editor@diplom.org)

If you wish to e-mail feedback on this article to the author, and clicking on the envelope above does not work for you, feel free to use the "Dear DP..." mail interface.