{"id":759335,"date":"2020-05-22T10:30:00","date_gmt":"2020-05-22T14:30:00","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=759335"},"modified":"2020-05-22T10:30:00","modified_gmt":"2020-05-22T14:30:00","slug":"gaming-ais-nvidia-teaches-a-neural-network-to-recreate-pac-man","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=759335","title":{"rendered":"Gaming AIs: NVIDIA Teaches A Neural Network to Recreate Pac-Man"},"content":{"rendered":"

\"\"<\/a><\/p>\n

\n

Following last week\u2019s virtual GTC keynote and the announcement of their Ampere architecture, this week NVIDIA has been holding the back-half of their conference schedule. As with the real event, the company has been posting numerous sessions on everything NVIDIA, from Ampere to CUDA to remote desktop. But perhaps the most interesting talk \u2013 and certainly the most amusing \u2013 is coming from NVIDIA\u2019s research group.<\/p>\n


\n <\/p>\n

Tasked with developing future technologies and finding new uses for current technologies, today the group is announcing that they have taught a neural network Pac-Man.<\/p>\n


\n <\/p>\n

And no, I don\u2019t mean how to play<\/em> Pac-Man. I mean how to be<\/b> the game of Pac-Man.<\/p>\n


\n <\/p>\n

The reveal, timed to coincide with the 40th<\/sup> anniversary of the ghost-munching game, is coming out of NVIDIA\u2019s research into Generative Adversarial Networks (GANs). At a very high level, GANs are a type of neural network where two neural networks are trained against each other \u2013 typically one learning how to do a task and the other learning how to spot the first doing that task \u2013 with the end goal being that the competition between the networks can help make the two networks better by forcing them to improve to win. In terms of practical applications, GANs have most famously been used in research projects to create programs that can create realistic-looking images of real-world items, upscale existing images, and other image synthesis\/manipulation tasks.<\/p>\n


\n <\/p>\n

For Pac-Man, however, the researchers behind the fittingly named GameGAN project took things one step further, focusing on creating a GAN that can be taught how to emulate\/generate a video game. This includes not only recreating the look of a game, but perhaps most importantly, the rules of a game as well. In essence, GameGAN is intended to learn how a game works by watching it, not unlike a human would.<\/p>\n


\n <\/p>\n

For their first project, the GameGAN researchers settled on Pac-Man, which is as good a starting point as any. The 1980 game has relatively simple rules and graphics, and crucially for the training process, a complete game can be played in a short amount of time. As a result, over 50K \u201cepisodes\u201d of training, the researchers taught a GAN how to be Pac-Man solely by having the neural network watch the game being played.<\/p>\n


\n <\/p>\n

And most impressive of all, the crazy thing actually works.<\/p>\n


\n <\/p>\n


\n <\/p>\n

In a video released by NVIDIA, the company is briefly showing off the Pac-Man-trained GameGAN in action. While the resulting game isn\u2019t a pixel-perfect recreation of Pac-Man \u2013 notably, GameGAN\u2019s simulated resolution is lower \u2013 the game none the less looks and functions like the arcade version of Pac-Man. And it\u2019s not just for looks, either: the GameGAN version of Pac-Man accepts player input, just like the real game. In fact, while it\u2019s not ready for public consumption quite yet, NVIDIA has already said that they want to release a publicly playable version this summer, so that everyone can see it in action.<\/p>\n


\n <\/p>\n

Fittingly for a gaming-related research project, the training and development for the GameGAN was equally as silly at times. Because the network needed to consume thousands upon thousand of gameplay sessions \u2013 and NVIDIA presumably doesn\u2019t want to pay its staff to play Pac-Man all day \u2013 the researchers relied on a Pac-Man-playing bot to automatically play the game. As a result, the AI that is GameGAN has essentially been trained in Pac-Man by another AI. And this is not without repercussions \u2013 in their presentation, the researchers have noted that because the Pac-Man bot was so good at the game, GameGAN has developed a tendency to avoid killing Pac-Man, as if it were part of the rules. Which, if nothing else, is a lot more comforting than finding out that our soon-to-be AI overlords are playing favorites.<\/p>\n


\n <\/p>\n

All told, training the GameGAN for Pac-Man took a quad GV100 setup four days, over which time it monitored 50,000 gameplay sessions. Which, to put things in perspective of the amount of hardware used, 4 GV100 GPUs is 84.4 billion transistors, almost 10 million times as many transistors as are found in the original arcade game\u2019s Z80 CPU. So while teaching a GAN how to be a Pac-Man is incredibly impressive, it is, perhaps, not an especially efficient way to execute the game.<\/p>\n


\n <\/p>\n

Meanwhile, figuring out how to teach a neural network to be Pac-Man does have some practical goals to it as well. According to the research group, one big focus right now is in using this concept to more quickly train simulators, which traditionally have to be carefully constructed by humans in order to capture all of the possible interactions. If a neural network can instead learn how something behaves by watching what\u2019s happening and what inputs are being made, this could conceivably make creating simulators far faster and easier. Interestingly, the entire concept leads to something of a self-feedback loop, as the idea is to then use those simulators to then train other neural networks how to perform a task, such as NVIDIA\u2019s favorite goal of self-driving cars.<\/p>\n


\n <\/p>\n

Ultimately, whether it leads to real-world payoffs or not, there\u2019s something amusingly human about a neural network learning a game by observing \u2013 even (and especially) if it doesn\u2019t always learn the desired lesson.<\/p>\n

<\/p>\n

\"\"<\/a>\"\"<\/p>\n


\n
\nSource: AnandTech – Gaming AIs: NVIDIA Teaches A Neural Network to Recreate Pac-Man<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Following last week\u2019s virtual GTC keynote and the announcement of their Ampere architecture, this week NVIDIA has been holding the back-half of their conference schedule. As with the real event, the company has been posting numerous sessions on everything NVIDIA, … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":759336,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[93,110],"tags":[94],"class_list":["post-759335","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-anandtech","category-unfiltered-rss","tag-anandtech"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/759335","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=759335"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/759335\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/media\/759336"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=759335"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=759335"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=759335"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}