Microsoft Cloud IT Pro Podcast

Episode 397 – Local LLMs: Why Every Microsoft 365 & Azure Pro Should Explore Them

Listen Later

Welcome to Episode 397 of the Microsoft Cloud IT Pro Podcast. In this episode, Scott and Ben dive into the world of local LLMs—large language models that run entirely on your device. We’re going to explore why more IT pros and developers are experimenting with them, the kinds of models you can run, and how you can integrate them directly into your workflow, including in Visual Studio Code for AI-assisted coding.

Your support makes this show possible! Please consider becoming a premium member for access to live shows and more. Check out our membership options.

Show Notes
  • Ollama
  • Running LLMs Locally: A Beginner’s Guide to Using Ollama
  • open-webui/open-webui
  • LM Studio
  • LM. Studio Model Catalog
  • Why do people like Ollama more than LM Studio?
  • A Starter Guide for Playing with Your Own Local AI!
  • host ALL your AI locally
  • Run your own AI (but private)
    • About the sponsors
    Would you like to become the irreplaceable Microsoft 365 resource for your organization? Let us know!
    ...more
    View all episodesView all episodes
    Download on the App Store
    Microsoft Cloud IT Pro PodcastBy Ben Stegink, Scott Hoag
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    64 ratings

    More shows like Microsoft Cloud IT Pro Podcast

    View all
    The Joe Rogan Experience by Joe Rogan

    The Joe Rogan Experience

    229,837 Listeners

    SpaceTime with Stuart Gary by Stuart Gary

    SpaceTime with Stuart Gary

    321 Listeners

    Windows Weekly (Audio) by TWiT

    Windows Weekly (Audio)

    885 Listeners

    Risky Business by Patrick Gray

    Risky Business

    373 Listeners

    RunAs Radio by Richard Campbell

    RunAs Radio

    83 Listeners

    HBR IdeaCast by Harvard Business Review

    HBR IdeaCast

    182 Listeners

    CyberWire Daily by N2K Networks

    CyberWire Daily

    1,027 Listeners

    The Daily by The New York Times

    The Daily

    112,987 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    8,108 Listeners

    Ctrl+Alt+Azure by Tobias Zimmergren, Jussi Roine

    Ctrl+Alt+Azure

    12 Listeners

    SharePoint Maven Podcast by Greg Zelfond

    SharePoint Maven Podcast

    36 Listeners

    The Azure Security Podcast by Michael Howard, Sarah Young, Gladys Rodriguez and Mark Simos

    The Azure Security Podcast

    26 Listeners

    SmartLess by Jason Bateman, Sean Hayes, Will Arnett

    SmartLess

    58,483 Listeners

    Cybersecurity Headlines by CISO Series

    Cybersecurity Headlines

    139 Listeners

    Entra.Chat by Merill Fernando

    Entra.Chat

    5 Listeners