The Real Python Podcast

Running Local LLMs With Ollama and Connecting With Python


Listen Later

Would you like to learn how to work with LLMs locally on your own computer? How do you integrate your Python projects with a local model? Christopher Trudeau is back on the show this week with another batch of PyCoder’s Weekly articles and projects.

We cover a recent Real Python step-by-step tutorial on installing local LLMs with Ollama and connecting them to Python. It begins by outlining the advantages this strategy offers, including reducing costs, improving privacy, and enabling offline-capable AI-powered apps. We talk through the steps of setting things up, generating text and code, and calling tools.

We also share other articles and projects from the Python community, including the 2026 Python Developers Survey, creating callable instances with Python’s .__call__(), creating maps and projections with GeoPandas, ending 15 years of subprocess polling, discussing backseat software, a retry library that classifies errors, and a peer-to-peer encrypted CLI chat project.

This episode is sponsored by Honeybadger.

Course Spotlight: Tips for Using the AI Coding Editor Cursor

Learn Cursor fast: Use AI-powered coding with agents, project-aware chat, and inline edits to supercharge your VS Code workflow.

Topics:

  • 00:00:00 – Introduction
  • 00:02:37 – Take the Python Developers Survey 2026
  • 00:03:07 – How to Integrate Local LLMs With Ollama and Python
  • 00:08:15 – Sponsor: Honeybadger
  • 00:09:01 – Create Callable Instances With Python’s .__call__()
  • 00:12:13 – GeoPandas Basics: Maps, Projections, and Spatial Joins
  • 00:16:03 – Ending 15 Years of subprocess Polling
  • 00:18:57 – Video Course Spotlight
  • 00:20:23 – Backseat Software – Mike Swanson
  • 00:39:06 – cmd-chat: Peer-to-Peer Encrypted CLI Chat
  • 00:41:58 – redress: A Retry Library That Classifies Errors
  • 00:43:56 – Thanks and goodbye
  • News:

    • Take the Python Developers Survey 2026
    • The State of Python 2025: Trends and Survey Insights - The PyCharm Blog
    • Topics:

      • How to Integrate Local LLMs With Ollama and Python – Learn how to integrate your Python projects with local models (LLMs) using Ollama for enhanced privacy and cost efficiency.
      • Create Callable Instances With Python’s .__call__() – Learn about Python callables, including what “callable” means, how to use dunder call, and how to build callable objects with step-by-step examples.
      • GeoPandas Basics: Maps, Projections, and Spatial Joins – Dive into GeoPandas with this tutorial covering data loading, mapping, CRS concepts, projections, and spatial joins for intuitive analysis.
      • Ending 15 Years of subprocess Polling – Python’s standard library subprocess module relies on busy-loop polling to determine whether a process has completed yet. Modern operating systems have callback mechanisms to do this, and Python 3.15 will now take advantage of these.
      • Discussion:

        • Backseat Software – Mike Swanson’s Blog
        • Backseat Software – Hacker News
        • Projects:

          • cmd-chat: Peer-to-Peer Encrypted CLI Chat
          • redress: A Retry Library That Classifies Errors
          • Additional Links:

            • Ollama
            • Python’s .call() Method: Creating Callable Instances – Real Python
            • Quiz: GeoPandas Basics: Maps, Projections, and Spatial Joins
            • Level up your Python skills with our expert-led courses:

              • Customize VS Code Settings
              • Getting Started With Google Gemini CLI
              • Tips for Using the AI Coding Editor Cursor
              • Support the podcast & join our community of Pythonistas

                ...more
                View all episodesView all episodes
                Download on the App Store

                The Real Python PodcastBy Real Python

                • 4.7
                • 4.7
                • 4.7
                • 4.7
                • 4.7

                4.7

                139 ratings


                More shows like The Real Python Podcast

                View all
                The Changelog: Software Development, Open Source by Changelog Media

                The Changelog: Software Development, Open Source

                288 Listeners

                Software Engineering Daily by Software Engineering Daily

                Software Engineering Daily

                629 Listeners

                Talk Python To Me by Michael Kennedy

                Talk Python To Me

                583 Listeners

                Soft Skills Engineering by Jamison Dance and Dave Smith

                Soft Skills Engineering

                291 Listeners

                Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

                Super Data Science: ML & AI Podcast with Jon Krohn

                304 Listeners

                Python Bytes by Michael Kennedy and Brian Okken

                Python Bytes

                213 Listeners

                Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

                Syntax - Tasty Web Development Treats

                991 Listeners

                Darknet Diaries by Jack Rhysider

                Darknet Diaries

                8,098 Listeners

                Tech Brew Ride Home by Morning Brew

                Tech Brew Ride Home

                971 Listeners

                Practical AI by Practical AI LLC

                Practical AI

                216 Listeners

                AWS Podcast by Amazon Web Services

                AWS Podcast

                208 Listeners

                Django Chat by William Vincent and Carlton Gibson

                Django Chat

                75 Listeners

                Last Week in AI by Skynet Today

                Last Week in AI

                311 Listeners

                Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

                Machine Learning Street Talk (MLST)

                99 Listeners

                The Pragmatic Engineer by Gergely Orosz

                The Pragmatic Engineer

                74 Listeners