Welcome to Episode 397 of the Microsoft Cloud IT Pro Podcast. In this episode, Scott and Ben dive into the world of local LLMs—large language models that run entirely on your device. We’re going to explore why more IT pros and developers are experimenting with them, the kinds of models you can run, and how you can integrate them directly into your workflow, including in Visual Studio Code for AI-assisted coding.

Your support makes this show possible! Please consider becoming a premium member for access to live shows and more. Check out our membership options.

Show Notes

Ollama

Running LLMs Locally: A Beginner's Guide to Using Ollama

open-webui/open-webui

LM Studio

LM. Studio Model Catalog

Why do people like Ollama more than LM Studio?

A Starter Guide for Playing with Your Own Local AI!

host ALL your AI locally

Run your own AI (but private)

About the sponsors

Would you like to become the irreplaceable Microsoft 365 resource for your organization? Let us know!