Sunday, February 9, 2014

What Is the Most Underrated DotA 2 Team?

My previous posts about betting at the DotA 2 Lounge have been enormously popular.  There have been over 1000 games since my last post, and I decided to revisit the vastly expanded data set.  I have previously made the scripts available to anyone wishing to perform these analyses themselves.

First, a moment to talk about parimutuel betting.  The DotA 2 Lounge runs a parimutuel betting scheme.  Suppose that there are two teams playing and a better bets on the winning team.  That player's payout, assuming no house take, is simply given by the value of the total pool times the fraction of the pool in favor of the winning team that was bet by the player.


It's noteworthy that a successful gambler is not so much betting for the winning team as to bet for the team that maximizes their expected winnings.  Let's take a look at an example to demonstrate this.

TeamTeam ATeam B
% of Bets10%90%
True Chance of Winning25%75%

In this example, I have two teams playing, Team A and Team B.  90% of the bets are in favor of Team B.  This means that if Team A wins, then the payout will be 9-to-1.  The important piece of information here is the true chance of winning.  In the real world, this is certainly not known exactly so I have made it up for this example.

The expected return on investment for a bet on Team A is then 0.25 / 0.1 = 2.5.  The expected payout for a bet on Team B per unit bet is  0.75 / 0.9 = 0.83.  Therefore, a smart better will bet on the underdog in this case.  A bet on Team B is actually more likely to lose money than to gain it.

The two important variables here are the proportion of bets on each team, which is given to you at the DotA 2 Lounge.  You should bet as late as possible so that you can get the best possible information on who the other gamblers are betting on.  Next, you should estimate the chances of each team winning.  Bet on the team that you believe has a higher chance of winning than the proportion of bets shown.  If you believe that the chances of each team winning are identical to the proportion of bets, then which team you bet on is irrelevant.

Parimutuel betting with no house take is a zero-sum game.  If the gamblers are good at appraising each team's chances of winning, then it is irrelevant which team you bet on.  This is the second figure I have shown in each of my previous studies.  Previously, I found that the crowd was very good at this: random betting neither had a significant profit or loss.  This still appears to be the case.


Figure 1:  Random betting strategy at the DotA 2 lounge in the first 1637 (1414 of them were bettable) games.  Average 48 rares lost.   Standard deviation 39.6.   Zero (the break even point) is within 2 standard deviations of the mean, so I conclude that the random betting strategy is neither a winning nor a losing one, and that the crowd is still rational.

Now I'd like to know what the most overrated and underrated teams are.  In order to determine this, I will use the following method:  For each team that played at least 10 games at the DotA 2 Lounge, I will propose that I bet one rare on them per game and record the payout.  Then, I will simulate 10,000 trials of random betting only on the set of games that this team played.  I will use these simulated random bets to determine the mean and standard deviation of the payouts in games played by each team.  The standard score of each team will be equal to:


Standard scores over 2 or below -2 will be considered significant enough to call a team "underrated" or "overrated", respectively.  All other standard scores will be considered statistically insignificant, and will not be reported.

Most Underrated Teams
TeamScore
Alliance15.0561
Na'Vi8.79236
LGD.cn8.74577
DK8.02724
VG5.32555
TongFu5.19414
Kaipi4.9593
Speed4.7966
iG4.08545
Fnatic.eu3.77795
Liquid3.57337
Orange3.37028
Sigma.int3.25397
Mski3.15417
MiTH2.91098
Empire2.55101
mouz2.24567
FD2.20341

Most Overrated Teams
TeamScore
WPCA-3.60975
RS-3.36541
aL-2.24014
MUFC-2.12442
Remarkably, many popular teams scored so well over time that I was actually unable to simulate a scenario where random betting did better than just betting in their favor every time in 10,000 trials.  Alliance, Na'Vi, LGD.cn, and DK in particular seem to be very underrated.

The only significantly overrated teams at the DotA 2 Lounge were WPCA, RS, aL and MUFC.  Remarkably, WPCA never won a match, so random betting always did at least as well as betting on them!  These teams are all quite overrated, so next time you see them playing, you might consider betting for the opposition.

Note that all of this is based on historical data and does not guarantee future results.  If based on this data everyone starts betting for Alliance then Alliance may soon be one of the most overrated teams!  Or, if aL picks up some awesome new players, it may not be at all fair or accurate to base their future performance on their past failure to deliver.

Remember, like I said above: parimutuel betting is all about deciding whether the crowd has predicted the correct probabilities of winning, and betting against the crowd favorite is a good idea in any situation where you think that the crowd favorite's actual chance of winning is less than the proportion of bets in its favor.

Good luck with your bets!

7 comments:

  1. Do you ever actually take the time to take a break from all that thinking and play Dota 2? We have game nights every Wednesday at 8PM EST. I don't even know what timezone you're in lately. Hit me up either way. My profile name is [IK] Kanth Donos.

    I just sent you an invite on Google+

    -Nathan

    ReplyDelete
  2. And for the record...I don't know where you're getting your data from...but Na'vi is likely the most popular Dota 2 team of all time. When I watched the internationals last year...they were also likely the most picked team. Not sure how you're arriving at underrated.

    In other news...the Navy made a way better rail gun than you. http://www.businessinsider.com/us-navy-to-deploy-laser-weapon-system-2014-2?utm_content=bufferd3cd1&utm_medium=social&utm_source=facebook.com&utm_campaign=buffer

    ReplyDelete
    Replies
    1. Think of it this way: if a team won 90% of the time but got 80% of the bets, it would still be underrated. That's what's happening here. Even though Na'Vi gets a lot of bets due to its popularity, if you bet on Na'Vi every single time you'd do a lot better than random guessing. In fact, you'd do 8.7 standard deviations better! That indicates that even at its current level of popularity, Na'Vi is underrated.

      This data is pulled directly from the DotA 2 Lounge, and I simulated 10,000 random bets on every game that Na'Vi played (historically). While historical performance is not a guarantee of future resutls, I believe that this is a strong enough trend to say with confidence that Na'Vi is underrated.

      Delete
  3. Are you able to update this list from time to time?

    ReplyDelete
    Replies
    1. Yeah, I've been thinking about limiting how far back in time to decide which teams are hot now (player changes, strategy changes, etc.) I may do something with this again before the international. There is a lot of source code in my other DotA 2 posts you can use to do the analysis yourself, as well.

      Delete
    2. I am running the study.sh script using Cygwin it is taking forever for the scripts to run through every match. Am I running it wrong? from what I can see it is pulling data from matches 1 year ago and cannot finish running the script.

      Delete
  4. This is some great analysis. I would love to see more posts.

    ReplyDelete