OpenAI is doing well in Dota 2: semi-professional teams are defeated

The battle is in full swing.

Complex computer programs capture all the new outposts of humanity, if such can be considered the areas where a person traditionally surpasses a car. Earlier it was chess, then - after, after that - many other computer games, including very old ones .

Now the computer is still unable to defeat professional cybersportsmen - players in multiplayer games of a special genre - multiplayer online battle arena (MOBA). One of them is Dota 2, and here one still feels the superiority of man over the machine (provided that both are set to equal conditions). But the computer is already on the heels of a person - semi-professional players are already beginning to give way to artificial intelligence (its weak form, of course).

Professional teams still hold on - but how long will this balance of power be maintained? In August last year, the OpenAI team offered to fight with a computer to professional cybersportsman Dendi (Daniel Ishutin).


Then the computer won a man in two games out of three. But this cannot be called a full-fledged victory, since the computer was put in very limited conditions, which are usually not available during a normal game. How it all happened can be found on the developers blog .

Just a year later, AI OpenAI learned to play more professionally, in a normal environment. The scheme of the game is traditional - 5 * 5. And now the software platform wins almost all beginners (not really lamers, of course) and semi-professional players. True, some restrictions exist now. So, all five characters that make up a team should be the same for both opponents.


Each of the characters has their own unique abilities, skills, weapons, skills. All this makes the game Dota2 somewhat difficult for a computer - even in Dota 2 there are moves that are based on relatively simple logic. Chess here is not worth remembering - the computer has long been playing better than a man.

AI from OpenAI received the name OpenAI Five. He managed to beat the teams of semi-professional cybersportsmen. Victory got the computer relatively easily, as evidenced by a series of machine wins over a man over the past few months.

OpenAI Five won the amateur team with MMR 4200 in two out of three games. It so happened that the team of semi-professional cyber sportsmen with MMR 5500 computer won almost all the time - the ratio of winnings to the total number of games is 99%. It is fair to say that there were also certain restrictions in the match conditions - for example, players could not become invisible.

Bots from AI trained by playing with themselves, as well as in the framework of the program Proximal Policy Optimization. At the moment, the bots have accumulated about 180 years, that is, much longer than the duration of human life. Nevertheless, so far the game of bots leaves much to be desired, although it is gradually improving. Naturally, such work requires resources and they are - “hardware” for AI has 128 thousand processor cores and 256 Nvidia P100 256 GPUs. It is clear that the developers did not create such a monster themselves, but rented the power of the cloud service Google Cloud.

In August, OpenAI plans to still win over professional cybersportsmen, preparations for the match are already underway. If the computer succeeds in doing this, the AI ​​developers will be proud of the next achievement.

Open AI- a non-profit organization that is engaged in research in the field of artificial intelligence. Its main tasks are the development and promotion of AI. The organization was created through donations from well-known businessmen from Silicon Valley. Among others, this organization includes Ilon Musk, Peter Thiel, Sam Altman, Amazon, Microsoft and others.

Many scientists, including Stephen Hawking, expressed their support for OpenAI. The organization began working in 2016, when OpenAI released a platform for machine learning research with reinforcement. Most likely, the organization will still succeed in achieving its goal - to create an AI that will win a person in a purely human game. And with a high degree of probability this will happen already this year. By the way, the winning team, which turns out to be the strongest in Dota 2 at the world-class championship, receives several million US dollars as a prize. I would like to know if the prize will be given to the AI ​​if the computer takes part in one of these championships and wins all rivals.