Fallthrough

Pull the (AI) Lever, Kronk!


Listen Later

Matt and Kris welcome back Bill Kennedy who's been working on Kronk, AI tooling in Go. They go through what Kronk (and it's dependent library Yzma) is, the power of running models locally, and how they see coding agents and LLMs shaping the future of the industry.

We've got supporter content, of course! This week that includes the message-caching trick that turns seconds into thirty milliseconds, why hybrid models quietly wreck the KV cache, Bill's "thirty billion knobs" explainer for dense versus mixture-of-experts models, why demo day is destroying engineering teams, and the stealth-startup math nobody says out loud. Not a supporter yet? Fix that today by heading over to https://fallthrough.fm/subscribe where you'll get not only extra content but also higher quality audio. Sign up today!

If you prefer to watch this episode, you can view it on YouTube.

No episode of the aftershow this week. We'll have more aftershow episodes soon! In the meantime, catch up on previous episodes at https://break.show.

Thanks for tuning in and happy listening!


Table of Contents:

  • Prologue (00:00:00)
  • Chapter 1: Why Go for AI, and the Origin of Kronk (00:02:14)
  • Chapter 2: What Kronk Is, an SDK to Kill the Model Server (00:08:56)
  • Chapter 3: Running It Yourself: Hugging Face, GGUF, and Hardware (00:14:58)
  • Chapter 8: Context, Attention, and the Honesty of Claude 4.8 (00:22:28)
  • Chapter 9: A Coding Agent Is a Skill, Not a Magic Wand (00:27:22)
  • Chapter 10: Semantics vs Mechanics (00:44:18)
  • Chapter 11: Rebuilding From Scratch: Specs and the Machine That Builds the Machine (00:47:29)
  • Chapter 14: Why AMP Wins: Pedigree and Economics (01:00:20)
  • Chapter 15: How to Actually Drive a Model: Plinko, Rocky Balboa, and Attention (01:14:59)
  • Epilogue (01:25:08)


Hosts

  • Matthew Sanabria - Host
  • Kris Brandow - Host
  • Bill Kennedy - Guest

  • Socials:
    • Website
    • Bluesky
    • Threads
    • X/Twitter
    • LinkedIn
    • Instagram
    • TikTok
    • Changelog Zulip
    • Gophers Slack
    • (00:00) - Prologue
  • (02:14) - Chapter 1: Why Go for AI, and the Origin of Kronk
  • (08:56) - Chapter 2: What Kronk Is, an SDK to Kill the Model Server
  • (14:58) - Chapter 3: Running It Yourself: Hugging Face, GGUF, and Hardware
  • (22:28) - Chapter 8: Context, Attention, and the Honesty of Claude 4.8
  • (27:22) - Chapter 9: A Coding Agent Is a Skill, Not a Magic Wand
  • (44:18) - Chapter 10: Semantics vs Mechanics
  • (47:29) - Chapter 11: Rebuilding From Scratch: Specs and the Machine That Builds the Machine
  • (01:00:20) - Chapter 14: Why AMP Wins: Pedigree and Economics
  • (01:14:59) - Chapter 15: How to Actually Drive a Model: Plinko, Rocky Balboa, and Attention
  • (01:25:08) - Epilogue
  • ...more
    View all episodesView all episodes
    Download on the App Store

    FallthroughBy Fallthrough Media

    • 4.2
    • 4.2
    • 4.2
    • 4.2
    • 4.2

    4.2

    13 ratings


    More shows like Fallthrough

    View all
    Software Engineering Radio - the podcast for professional software developers by team@se-radio.net (SE-Radio Team)

    Software Engineering Radio - the podcast for professional software developers

    274 Listeners

    Hanselminutes with Scott Hanselman by Scott Hanselman

    Hanselminutes with Scott Hanselman

    382 Listeners

    The Changelog: Software Development, Open Source by Changelog Media

    The Changelog: Software Development, Open Source

    287 Listeners

    Software Engineering Daily by Software Engineering Daily

    Software Engineering Daily

    623 Listeners

    Talk Python To Me by Michael Kennedy

    Talk Python To Me

    583 Listeners

    Soft Skills Engineering by Jamison Dance and Dave Smith

    Soft Skills Engineering

    289 Listeners

    Python Bytes by Michael Kennedy and Brian Okken

    Python Bytes

    213 Listeners

    Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

    Syntax - Tasty Web Development Treats

    987 Listeners

    CoRecursive: Coding Stories by Adam Gordon Bell - Software Developer

    CoRecursive: Coding Stories

    188 Listeners

    Practical AI by Practical AI LLC

    Practical AI

    214 Listeners

    The Stack Overflow Podcast by The Stack Overflow Podcast

    The Stack Overflow Podcast

    64 Listeners

    The Real Python Podcast by Real Python

    The Real Python Podcast

    139 Listeners

    Oxide and Friends by Oxide Computer Company

    Oxide and Friends

    65 Listeners

    Cup o' Go by Jonathan Hall & Shay Nehmad

    Cup o' Go

    16 Listeners

    go podcast() by Dominic St-Pierre

    go podcast()

    6 Listeners