Microsoft Cloud IT Pro Podcast

Episode 397 – Local LLMs: Why Every Microsoft 365 & Azure Pro Should Explore Them

Listen Later

Welcome to Episode 397 of the Microsoft Cloud IT Pro Podcast. In this episode, Scott and Ben dive into the world of local LLMs—large language models that run entirely on your device. We’re going to explore why more IT pros and developers are experimenting with them, the kinds of models you can run, and how you can integrate them directly into your workflow, including in Visual Studio Code for AI-assisted coding.

Your support makes this show possible! Please consider becoming a premium member for access to live shows and more. Check out our membership options.

Show Notes
  • Ollama
  • Running LLMs Locally: A Beginner’s Guide to Using Ollama
  • open-webui/open-webui
  • LM Studio
  • LM. Studio Model Catalog
  • Why do people like Ollama more than LM Studio?
  • A Starter Guide for Playing with Your Own Local AI!
  • host ALL your AI locally
  • Run your own AI (but private)
    • About the sponsors
    Would you like to become the irreplaceable Microsoft 365 resource for your organization? Let us know!
    ...more
    View all episodesView all episodes
    Download on the App Store
    Microsoft Cloud IT Pro PodcastBy Ben Stegink, Scott Hoag
    • 4.8
    • 4.8
    • 4.8
    • 4.8
    • 4.8

    4.8

    62 ratings

    More shows like Microsoft Cloud IT Pro Podcast

    View all
    Security Now (Audio) by TWiT

    Security Now (Audio)

    1,961 Listeners

    Windows Weekly (Audio) by TWiT

    Windows Weekly (Audio)

    855 Listeners

    The Cloudcast by Massive Studios

    The Cloudcast

    154 Listeners

    Software Engineering Daily by Software Engineering Daily

    Software Engineering Daily

    630 Listeners

    CyberWire Daily by N2K Networks

    CyberWire Daily

    1,008 Listeners

    Microsoft Mechanics Podcast by Microsoft Mechanics

    Microsoft Mechanics Podcast

    19 Listeners

    Smashing Security by Graham Cluley & Carole Theriault

    Smashing Security

    312 Listeners

    Darknet Diaries by Jack Rhysider

    Darknet Diaries

    7,840 Listeners

    Techmeme Ride Home by Ride Home Media

    Techmeme Ride Home

    946 Listeners

    Cybersecurity Today by Jim Love

    Cybersecurity Today

    141 Listeners

    Defense in Depth by David Spark, Steve Zalewski, Geoff Belknap

    Defense in Depth

    71 Listeners

    365 Message Center Show by Daniel Glenn and Darrell Webster

    365 Message Center Show

    9 Listeners

    The Stack Overflow Podcast by The Stack Overflow Podcast

    The Stack Overflow Podcast

    63 Listeners

    The Practical 365 Podcast by Practical 365

    The Practical 365 Podcast

    9 Listeners