{"id":1213887,"date":"2023-12-21T09:43:43","date_gmt":"2023-12-21T14:43:43","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1213887"},"modified":"2023-12-21T09:43:43","modified_gmt":"2023-12-21T14:43:43","slug":"apple-wants-ai-to-run-directly-on-its-hardware-instead-of-in-the-cloud","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1213887","title":{"rendered":"Apple wants AI to run directly on its hardware instead of in the cloud"},"content":{"rendered":"<div id=\"rss-wrap\">\n<figure class=\"intro-image intro-left\">\n  <img decoding=\"async\" src=\"https:\/\/www.prime-wow.com\/wp-content\/uploads\/2023\/12\/Screenshot-2023-09-12-at-1.59.20-PM-800x452-1.jpe\" alt=\"The iPhone 15 Pro.\" \/><\/p>\n<p class=\"caption\" style=\"font-size:0.8em\"><a href=\"https:\/\/cdn.arstechnica.net\/wp-content\/uploads\/2023\/09\/Screenshot-2023-09-12-at-1.59.20-PM.jpeg\" class=\"enlarge-link\" data-height=\"989\" data-width=\"1750\">Enlarge<\/a> <span class=\"sep\">\/<\/span> The iPhone 15 Pro. (credit: Apple)<\/p>\n<\/figure>\n<div><a name=\"page-1\" \/><\/div>\n<p>Apple\u2019s latest research about running large language models on smartphones offers the clearest signal yet that the iPhone maker plans to catch up with its Silicon Valley rivals in generative artificial intelligence.<\/p>\n<p>The paper, entitled \u201c<a href=\"https:\/\/arxiv.org\/pdf\/2312.11514.pdf\">LLM in a Flash<\/a>,\u201d offers a \u201csolution to a current computational bottleneck,\u201d its researchers write.<\/p>\n<p>Its approach \u201cpaves the way for effective inference of LLMs on devices with limited memory,\u201d they said. Inference refers to how large language models, the large data repositories that power apps like ChatGPT, respond to users\u2019 queries. Chatbots and LLMs normally run in vast data centers with much greater computing power than an iPhone.<\/p>\n<\/div>\n<p><a href=\"https:\/\/arstechnica.com\/?p=1992550#p3\">Read 15 remaining paragraphs<\/a> | <a href=\"https:\/\/arstechnica.com\/?p=1992550&amp;comments=1\">Comments<\/a><\/p>\n<p>&#013;<br \/>\n&#013;<br \/>\nSource: Ars Technica &#8211; <a href=\"https:\/\/arstechnica.com\/?p=1992550\" target=\"_blank\" rel=\"noopener\">Apple wants AI to run directly on its hardware instead of in the cloud<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Enlarge \/ The iPhone 15 Pro. (credit: Apple) Apple\u2019s latest research about running large language models on smartphones offers the clearest signal yet that the iPhone maker plans to catch up with its Silicon Valley rivals in generative artificial intelligence. &hellip; <a href=\"https:\/\/www.prime-wow.com\/?p=1213887\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":1213888,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[27,110],"tags":[73],"class_list":["post-1213887","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ars-technica","category-unfiltered-rss","tag-ars-technica"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1213887","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1213887"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1213887\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/media\/1213888"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1213887"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1213887"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1213887"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}