Microsoft and Nvidia want to help developers run and configure AI models on their Windows PCs. During the Microsoft Ignite event on Wednesday, Microsoft announced Windows AI Studio: a new hub where developers can access AI models and tweak them to suit their needs. From a report: Windows AI Studio allows developers to access development tools and models from the existing Azure AI Studio and other services like Hugging Face. It also offers an end-to-end “guided workspace setup” with model configuration UI and walkthroughs to fine-tune various small language models (SLMs), such as Microsoft’s Phi, Meta’s Llama 2, and Mistral. <\/p>\n
Windows AI Studio lets developers test the performance of their models using Prompt Flow and Gradio templates as well. Microsoft says it’s going to roll out Windows AI Studio as a Visual Studio Code extension in the “coming weeks.” Nvidia, similarly, revealed updates to TensorRT-LLM, which the company initially launched for Windows as a way to run large language models (LLMs) more efficiently on H100 GPUs. However, this latest update brings TensorRT-LLM to PCs powered by GeForce RTX 30 and 40 Series GPUs with 8GB of RAM or more.<\/p>\n
\n![](\"https:\/\/www.prime-wow.com\/wp-content\/uploads\/2023\/11\/twitter_icon_large-495.png\"){kind=icon}
<\/a>![](\"https:\/\/www.prime-wow.com\/wp-content\/uploads\/2023\/11\/facebook_icon_large-248.png\"){kind=icon}
<\/a><\/p>\n<\/div>\nRead more of this story<\/a> at Slashdot.<\/p>\n
Microsoft and Nvidia want to help developers run and configure AI models on their Windows PCs. During the Microsoft Ignite event on Wednesday, Microsoft announced Windows AI Studio: a new hub where developers can access AI models and tweak them … Continue reading
\n
\nSource: Slashdot – Microsoft and Nvidia Are Making It Easier To Run AI Models on Windows<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"