{"id":1199597,"date":"2023-11-03T15:24:00","date_gmt":"2023-11-03T19:24:00","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1199597"},"modified":"2023-11-03T15:24:00","modified_gmt":"2023-11-03T19:24:00","slug":"metas-free-ai-isnt-cheap-to-use-companies-say","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1199597","title":{"rendered":"Meta&#039;s Free AI Isn&#039;t Cheap To Use, Companies Say"},"content":{"rendered":"<p>Some companies that pay for OpenAI&#8217;s artificial intelligence have been looking to cut costs with free, open-source alternatives. But these AI customers are realizing that oftentimes open-source tech can actually be more expensive than buying from OpenAI. The Information: Take Andreas Homer and Ebby Amir, co-founders of Cypher, an app that helps people create virtual versions of themselves in the form of a chatbot. Industry excitement this summer about the release of Llama 2, an open-source large language model from Meta Platforms, prompted the duo to test it for their app, leading to a $1,200 bill in August from Google Cloud, Cypher&#8217;s cloud provider. Then they tried using GPT-3.5 Turbo, an OpenAI model that underpins services such as ChatGPT, and were surprised to see that it cost around $5 per month to handle the same amount of work. <\/p>\n<p>Baseten, a startup that helps developers use open-source LLMs, says its customers report that using Llama 2 out of the box costs 50% to 100% more than for OpenAI&#8217;s GPT-3.5 Turbo. The open-source option is cheaper only for companies that want to customize an LLM by training it on their data; in that case, a customized Llama 2 model costs about one-fourth as much as a customized GPT-3.5 Turbo model, Baseten found. Baseten also found that OpenAI&#8217;s most advanced model, GPT-4, is about 15 times more expensive than Llama 2, but typically it&#8217;s only needed for the most advanced generative AI tasks like code generation rather than the ones most large enterprises want to incorporate.<\/p>\n<p \/>\n<div class=\"share_submission\" style=\"position:relative\">\n<a class=\"slashpop\" href=\"http:\/\/twitter.com\/home?status=Meta's+Free+AI+Isn't+Cheap+To+Use%2C+Companies+Say%3A+https%3A%2F%2Ftech.slashdot.org%2Fstory%2F23%2F11%2F03%2F1858250%2F%3Futm_source%3Dtwitter%26utm_medium%3Dtwitter\"><img decoding=\"async\" src=\"https:\/\/www.prime-wow.com\/wp-content\/uploads\/2023\/11\/twitter_icon_large-53.png\" \/><\/a><br \/>\n<a class=\"slashpop\" href=\"http:\/\/www.facebook.com\/sharer.php?u=https%3A%2F%2Ftech.slashdot.org%2Fstory%2F23%2F11%2F03%2F1858250%2Fmetas-free-ai-isnt-cheap-to-use-companies-say%3Futm_source%3Dslashdot%26utm_medium%3Dfacebook\"><img decoding=\"async\" src=\"https:\/\/www.prime-wow.com\/wp-content\/uploads\/2023\/11\/facebook_icon_large-27.png\" \/><\/a><\/p>\n<\/div>\n<p><a href=\"https:\/\/tech.slashdot.org\/story\/23\/11\/03\/1858250\/metas-free-ai-isnt-cheap-to-use-companies-say?utm_source=rss1.0moreanon&amp;utm_medium=feed\">Read more of this story<\/a> at Slashdot.<\/p>\n<p>&#013;<br \/>\n&#013;<br \/>\nSource: Slashdot &#8211; <a href=\"https:\/\/tech.slashdot.org\/story\/23\/11\/03\/1858250\/metas-free-ai-isnt-cheap-to-use-companies-say?utm_source=rss1.0mainlinkanon&amp;utm_medium=feed\" target=\"_blank\" rel=\"noopener\">Meta&#8217;s Free AI Isn&#8217;t Cheap To Use, Companies Say<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some companies that pay for OpenAI&#8217;s artificial intelligence have been looking to cut costs with free, open-source alternatives. But these AI customers are realizing that oftentimes open-source tech can actually be more expensive than buying from OpenAI. The Information: Take &hellip; <a href=\"https:\/\/www.prime-wow.com\/?p=1199597\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":1199598,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101,110],"tags":[100],"class_list":["post-1199597","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-slashdot","category-unfiltered-rss","tag-slashdot"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1199597","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1199597"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1199597\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/media\/1199598"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1199597"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1199597"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1199597"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}