DevOps and Docker Talk: Cloud Native Interviews and Tooling

Local GenAI LLMs with Ollama and Docker


Listen Later

Bret and Nirmal are joined by friend of the show, Matt Williams, to learn how to run your own local ChatGPT clone and GitHub Copilot clone with Ollama and Docker's "GenAI Stack," to build apps on top of open source LLMs.

We've designed this conversation for tech people like myself, who are no strangers to using LLMs in web products like chat GPT, but are curious about running open source generative AI models locally and how they might set up their Docker environment to develop things on top of these open source LLMs.

šŸ™Œ My next course is coming soon! I've opened the waitlist for those wanting to go deep in GitHub Actions for DevOps and AI automation in 2025. I'm so thrilled to announce this course. The waitlist allows you to quickly sign up for some content updates, discounts, and more as I finish building the course. https://learn.bretfisher.com/waitlistšŸ¾

Matt Williams is walking us through all the parts of this solution, and with detailed explanations, shows us how Ollama can make it easier on Mac, Windows, and Linux to set up LLM stacks.

Be sure to check out the video version of this episode for any demos.

This episode is from our YouTube Live show on April 18, 2024 (Stream 262).

ā˜…Topicsā˜…

Creators & Guests

  • Cristi Cotovan - Editor
  • Beth Fisher - Producer
  • Bret Fisher - Host
  • Matt Williams - Host
  • Nirmal Mehta - Host
    • (00:00) - Intro
  • (01:32) - Understanding LLMs and Ollama
  • (03:16) - Ollama's Elevator Pitch
  • (08:40) - Installing and Extending Ollama
  • (17:17) - HuggingFace and Other Libraries
  • (19:24) - Which Model Should You Use?
  • (26:28) - Ollama and Its Applications
  • (28:57) - Retrieval Augmented Generation (RAG)
  • (36:44) - Deploying Models and API Endpoints
  • (40:38) - DockerCon Keynote and LLM Demo
  • (47:44) - Getting Started with Ollama

  • You can also support my free material by subscribing to my YouTube channel and my weekly newsletter at bret.news!

    Grab the best coupons for my Docker and Kubernetes courses.
    Join my cloud native DevOps community on Discord.
    Grab some merch at Bret's Loot Box
    Homepage bretfisher.com

    ...more
    View all episodesView all episodes
    Download on the App Store

    DevOps and Docker Talk: Cloud Native Interviews and ToolingBy Bret Fisher

    • 4.6
    • 4.6
    • 4.6
    • 4.6
    • 4.6

    4.6

    54 ratings


    More shows like DevOps and Docker Talk: Cloud Native Interviews and Tooling

    View all
    The Knowledge Project by Shane Parrish

    The Knowledge Project

    2,690 Listeners

    6 Minute English by BBC Radio

    6 Minute English

    1,756 Listeners

    Learning English Conversations by BBC Radio

    Learning English Conversations

    1,042 Listeners

    The Diary Of A CEO with Steven Bartlett by DOAC

    The Diary Of A CEO with Steven Bartlett

    8,549 Listeners

    Kubernetes Podcast from Google by Abdel Sghiouar, Kaslin Fields

    Kubernetes Podcast from Google

    182 Listeners

    Day Two DevOps by Packet Pushers

    Day Two DevOps

    15 Listeners

    DevOps Paradox by Darin Pope & Viktor Farcic

    DevOps Paradox

    25 Listeners

    Adventures in DevOps by Will Button, Warren Parad

    Adventures in DevOps

    18 Listeners

    Think Fast Talk Smart: Communication Techniques by Matt Abrahams, Think Fast Talk Smart

    Think Fast Talk Smart: Communication Techniques

    800 Listeners

    All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

    All-In with Chamath, Jason, Sacks & Friedberg

    9,927 Listeners

    Coaching Real Leaders by Harvard Business Review / Muriel Wilkins

    Coaching Real Leaders

    676 Listeners

    The Ezra Klein Show by New York Times Opinion

    The Ezra Klein Show

    15,931 Listeners

    The Foreign Affairs Interview by Foreign Affairs Magazine

    The Foreign Affairs Interview

    447 Listeners

    The Rest Is Politics: US by Goalhanger

    The Rest Is Politics: US

    2,171 Listeners

    Agentic DevOps by Bret Fisher

    Agentic DevOps

    2 Listeners