{"id":1236466,"date":"2025-03-03T09:36:56","date_gmt":"2025-03-03T14:36:56","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1236466"},"modified":"2025-03-03T09:36:56","modified_gmt":"2025-03-03T14:36:56","slug":"ai-firms-follow-deepseeks-lead-create-cheaper-models-with-distillation","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1236466","title":{"rendered":"AI firms follow DeepSeek\u2019s lead, create cheaper models with \u201cdistillation\u201d"},"content":{"rendered":"<div>\n<p>Leading artificial intelligence firms including OpenAI, Microsoft, and Meta are turning to a process called \u201cdistillation\u201d in the global race to create AI models that are cheaper for consumers and businesses to adopt.<\/p>\n<p>The technique caught widespread attention after China\u2019s DeepSeek used it to build powerful and efficient AI models based on open source systems released by competitors Meta and Alibaba. The breakthrough rocked confidence in Silicon Valley\u2019s AI leadership, leading Wall Street investors to wipe billions of dollars of value from US Big Tech stocks.<\/p>\n<p>Through distillation, companies take a large language model\u2014dubbed a \u201cteacher\u201d model\u2014which generates the next likely word in a sentence. The teacher model generates data which then trains a smaller \u201cstudent\u201d model, helping to quickly transfer knowledge and predictions of the bigger model to the smaller one.<\/p>\n<p><a href=\"https:\/\/arstechnica.com\/ai\/2025\/03\/ai-firms-follow-deepseeks-lead-create-cheaper-models-with-distillation\/\">Read full article<\/a><\/p>\n<p><a href=\"https:\/\/arstechnica.com\/ai\/2025\/03\/ai-firms-follow-deepseeks-lead-create-cheaper-models-with-distillation\/#comments\">Comments<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Leading artificial intelligence firms including OpenAI, Microsoft, and Meta are turning to a process called \u201cdistillation\u201d in the global race to create AI models that are cheaper for consumers and businesses to adopt. The technique caught widespread attention after China\u2019s &hellip; <a href=\"https:\/\/www.prime-wow.com\/?p=1236466\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[27,44,110],"tags":[],"class_list":["post-1236466","post","type-post","status-publish","format-standard","hentry","category-ars-technica","category-technology","category-unfiltered-rss"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1236466","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1236466"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1236466\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1236466"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1236466"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1236466"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}