Artem Tashkinov shares a report from The Register: DeepMind has taught artificially intelligent programs to play classic Atari computer games by making them watch YouTube videos. Exploration games like 1984’s Montezuma’s Revenge are particularly difficult for AI to crack, because it’s not obvious where you should go, which items you need and in which order, and where you should use them. That makes defining rewards difficult without spelling out exactly how to play the thing, and thus defeating the point of the exercise. For example, Montezuma’s Revenge requires the agent to direct a cowboy-hat-wearing character, known as Panama Joe, through a series of rooms and scenarios to reach a treasure chamber in a temple, where all the goodies are hidden. Pocketing a golden key, your first crucial item, takes about 100 steps, and is equivalent to 100^18 possible action sequences.

To educate their code, the researchers chose three YouTube gameplay videos for each of the three titles: Montezuma’s Revenge, Pitfall, and Private Eye. Each game had its own agent, which had to map the actions and features of the title into a form it could understand. The team used two methods: temporal distance classification (TDC), and cross-modal temporal distance classification (CDC). The DeepMind code still relies on lots of small rewards, of a kind, although they are referred to as checkpoints. While playing the game, every sixteenth video frame of the agent’s session is taken as a snapshot and compared to a frame in a fourth video of a human playing the same game. If the agent’s game frame is close or matches the one in the human’s video, it is rewarded. Over time, it imitates the way the game is played in the videos by carrying out a similar sequence of moves to match the checkpoint frame. In the end, the agent was able to exceed average human players and other RL algorithms: Rainbow, ApeX, and DQfD. The researchers documented their method in a paper this week. You can view the agent in action here.

Read more of this story at Slashdot.

Source: Slashdot – DeepMind Used YouTube Videos To Train Game-Beating Atari Bot

MojoKid writes: Last week, Arm showed off its new Machine Learning Processor design, but today it has lifted the veil on its next-generation Cortex and Mali CPU, GPU, and VPU architectures, destined for 2019 smartphones and mobile devices. The Arm Cortex-A76 CPU, Mali-G76 GPU, and Mali-V76 VPU designs all step up performance and efficiency over previous generation designs, though there are architectural and layout changes and more advanced manufacturing processes. Arm believes its A76 core, which can be clocked at 3GHz+ when produced on a 7nm process, can perform within 10 percent of an Intel Skylake core within the same thermal constraints, but at approximately half the footprint. The Mali-G76 improves density and energy efficiency by 30 percent over the previous generation G72, while providing a 2.7x uplift in machine learning workloads. And the Mali-V76 VPU improves on the recently announced V52 by adding support for 8K UltraHD content, among many other improvements.

Read more of this story at Slashdot.

Source: Slashdot – Arm Unveils Next-Gen 76-Series Mobile CPU, GPU Cores