{"id":1218651,"date":"2025-02-20T17:39:12","date_gmt":"2025-02-20T22:39:12","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1218651"},"modified":"2025-02-20T17:39:12","modified_gmt":"2025-02-20T22:39:12","slug":"microsofts-new-ai-agent-can-control-software-and-robots","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1218651","title":{"rendered":"Microsoft\u2019s new AI agent can control software and robots"},"content":{"rendered":"<div>\n<p>On Wednesday, Microsoft Research introduced <a href=\"https:\/\/microsoft.github.io\/Magma\/\">Magma<\/a>, an integrated AI foundation model that combines visual and language processing to control software interfaces and robotic systems. If the results hold up outside of Microsoft&#8217;s internal testing, it could mark a meaningful step forward for an all-purpose multimodal AI that can operate interactively in both real and digital spaces.<\/p>\n<p>Microsoft claims that Magma is the first AI model that not only processes multimodal data (like text, images, and video) but can also natively act upon it\u2014whether that\u2019s navigating a user interface or manipulating physical objects. The project is a collaboration between researchers at Microsoft, <a href=\"https:\/\/www.kaist.ac.kr\/en\/\">KAIST<\/a>, the University of Maryland, the University of Wisconsin-Madison, and the University of Washington.<\/p>\n<p>We&#8217;ve seen other large language model-based robotics projects like Google&#8217;s <a href=\"https:\/\/arstechnica.com\/information-technology\/2023\/03\/embodied-ai-googles-palm-e-allows-robot-control-with-natural-commands\/\">PALM-E<\/a> and <a href=\"https:\/\/arstechnica.com\/information-technology\/2023\/07\/googles-rt-2-ai-model-brings-us-one-step-closer-to-wall-e\/\">RT-2<\/a> or Microsoft&#8217;s <a href=\"https:\/\/arstechnica.com\/information-technology\/2023\/02\/robots-let-chatgpt-touch-the-real-world-thanks-to-microsoft\/\">ChatGPT for Robotics<\/a> that utilize LLMs for an interface. However, unlike many prior multimodal AI systems that require separate models for perception and control, Magma integrates these abilities into a single foundation model.<\/p>\n<p><a href=\"https:\/\/arstechnica.com\/ai\/2025\/02\/microsofts-new-ai-agent-can-control-software-and-robots\/\">Read full article<\/a><\/p>\n<p><a href=\"https:\/\/arstechnica.com\/ai\/2025\/02\/microsofts-new-ai-agent-can-control-software-and-robots\/#comments\">Comments<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>On Wednesday, Microsoft Research introduced Magma, an integrated AI foundation model that combines visual and language processing to control software interfaces and robotic systems. If the results hold up outside of Microsoft&#8217;s internal testing, it could mark a meaningful step &hellip; <a href=\"https:\/\/www.prime-wow.com\/?p=1218651\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27,44,110],"tags":[],"class_list":["post-1218651","post","type-post","status-publish","format-standard","hentry","category-ars-technica","category-technology","category-unfiltered-rss"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1218651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1218651"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1218651\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1218651"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1218651"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1218651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}