Future Around & Find Out

Why This CTO Says AI Coding Agents Are “Insidious”, Overhyped, and Nowhere Near Replacing Human Engineers


Listen Later

AI coding assistants promise to write your code, speed up your sprint, and maybe even make engineers obsolete. But what if the people building with them every day see something very different?

In this special Halloween edition of CRAFTED. — which also marks the show’s third anniversary! — a masked CTO shares what he can’t say publicly: that these tools are powerful, but insidious. In his view, coding assistants are great for auto-complete, but they can’t do what a human engineer does. He says they’re terrible at starting from scratch and will often suggest code that “works in vacuum”, but not in context. And because AI can write so much code, so quickly, it’s hard to catch errors. In short, he sees an increase in short term velocity, at the expense of increased defects and an increasing dependency on systems that are untrustworthy. 

I want to emphasize that this episode features the experience of one very experienced person. There are obviously others who disagree, who say AI coding agents are incredible, so long as they’re managed well. 

However, there are also an increasing number of people questioning the sustainability of coding agents — they're incredibly expensive to run — and also how good they are in the first place.

For example Andrej Karpathy, the guy who literally coined the phrase "vibe coding" and was early at OpenAI and Tesla, just said publicly on Dwarkesh Podcast that the path to AI agents is going to be a lot slower than people in the industry think it will be. He said coding agents are "not that good at writing code that's never been written before" and that there is too much hype right now about where AI really is, with people in the industry, quote "trying to pretend like this is amazing, when it's not." 

And he said: "My Claude Code or Codex still feels like this elementary-grade student." 

Today's guest agrees with Karpathy on a lot of this. Our guest has worked at startups, scale-ups, and big tech companies you've definitely heard of and today he's at a very AI-forward company and using AI coding tools every day. 

Enjoy this special episode of CRAFTED.! 

---
And pretty please...!

  • Share with a friend! Word of mouth is how podcasts grow!
  • Subscribe to the newsletter at https://www.crafted.fm
  • Share your feedback! I’m experimenting with new episode formats and would love your feedback on this and other episodes. DM me on LinkedIn or contact me email, via https://www.crafted.fm
  • Sponsor the show? I’m actively speaking to potential sponsors for 2026 episodes. Let’s talk!
  • Get psyched!… There are some big updates to the show in 2026!

---
Key Quotes

  • 03:16 The myth of AI replacement: “The idea that AI can actually supplant a software engineer in their current role is basically nonsense.”
  • 06:29 Why AI struggles without human input: “If you remove the human engineer from the equation, there’s no place to start from. The AI does not do well when you’re starting from scratch because it doesn’t have the real-world context or the continuous learning required to make that system better.”
  • 12:21: The illusion of speed: “Coding assistants help you generate code very quickly. There’s an illusion that your velocity increases. What actually happens is you’re just shipping more bugs to production.”
  • 13:30 More code than humans can review: “AI generates so much code that no human can keep that context in their head and review it in a meaningful way. At some point you just have to trust — but who are you trusting? You’re trusting the AI, and the AI cannot be trusted.”
  • 14:02 AI & Junior Engineer Hiring: “The narrative that hiring trends have anything to do with AI is absurd. It’s not that AI is replacing junior engineers — it’s that companies are running lean and don’t have the bandwidth to train them.”
  • 15:42: Where the AI Bulls and Bears Differ: “Whereas we see flawed systems that aren't ready for primetime [...] they view this as ‘oh, that's, that's insignificant. They will get better almost immediately. It's not a big deal.’ But we've been repeating this cycle for years at this point.”
  • 19:50 Where AI Excels: “Where review and revise are part of the process already, that's a really good place for generative AI because you already have a human in the loop.”
  • 21:02: What builders need to unlearn “To the extent that people think these things are thinking or reasoning or on any path to AGI at all — they should discard that. These models don’t think. They’re very sophisticated pattern-matching machines, and that’s really it.”
...more
View all episodesView all episodes
Download on the App Store

Future Around & Find OutBy Dan Blumberg

  • 4.2
  • 4.2
  • 4.2
  • 4.2
  • 4.2

4.2

49 ratings


More shows like Future Around & Find Out

View all
This Week in Startups by Jason Calacanis

This Week in Startups

1,294 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

537 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,100 Listeners

Azeem Azhar's Exponential View by Azeem Azhar

Azeem Azhar's Exponential View

615 Listeners

Masters of Scale by WaitWhat

Masters of Scale

3,996 Listeners

Practical AI by Practical AI LLC

Practical AI

203 Listeners

My First Million by Hubspot Media

My First Million

2,660 Listeners

The Next Big Idea by Next Big Idea Club

The Next Big Idea

1,275 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,278 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

512 Listeners

The Artificial Intelligence Show by Paul Roetzer and Mike Kaput

The Artificial Intelligence Show

207 Listeners

Business Breakdowns by Colossus | Investing & Business Podcasts

Business Breakdowns

355 Listeners

The Startup Ideas Podcast by Greg Isenberg

The Startup Ideas Podcast

211 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

461 Listeners

TBPN by John Coogan & Jordi Hays

TBPN

141 Listeners