The Startup Ideas Podcast

How I code with AI agents, without being 'technical'


Listen Later

In this episode, I’m breaking down a guide from Ben Tossel on how you can actually build with AI agents without being technical. I walk through what he’s shipped as a “non-technical” builder, why he lives in the terminal/CLI, and the exact workflow he uses to go from idea → spec → build → iterate. We also talk about the meta-skill here: treating the model like your over-the-shoulder engineer/teacher, and using every bug as a learning checkpoint. The takeaway is simple: pick a tool, ship fast, fail forward, and build your own system as you go.

Ben’s Article: https://startup-ideas-pod.link/Ben-Tossell-Article

Timestamps

00:00 – Intro

01:04 – What Ben Has Shipped

03:21 – The Workflow: Feed Context → Spec Mode → Let The Agent Rip

07:52 – His Agent Setup

08:56 – Coding On The Go

10:07 – Things to Learn

13:33 – The New Abstraction Layer: Learning To Work With Agents

14:33 – Learning from Others

16:15 – Use The Model As Your Teacher (Ask Everything)

18:13 – Contributing to Real Products

19:13 – Why this is Different

21:31 – Asking Silly Questions

24:00 – Beyond “Vibe Coding”: A New Technical Class

24:43 – Vibe Coding is a game

27:12 – Fail Forward + Permission To Build And Throw Things Away

28:16 – Pick One Tool, Minimize Friction, Keep Shipping

Key Points

  • I don’t need to be a traditional engineer to ship—I can learn by watching agent output and iterating.

  • The terminal/CLI is the power move because it’s more capable and I can see what the agent is doing.

  • “Spec mode” works best when I interrogate the plan like a philosopher instead of pretending I understand everything.

  • agents.md becomes my portable instruction manual so every new repo starts clean and consistent.

  • The fastest learning path is building ahead of my capability and treating bugs as checkpoints—fail forward.

Numbered Section Summaries

  1. The Thesis: Non-Technical Doesn’t Mean Non-Builder I open with Ben’s core claim: you can ship real software by working through a terminal with agents, even if you can’t write the code yourself—because you can read the output and learn the system over time.

  2. Proof: What He’s Actually Shipped I run through examples Ben built—custom CLIs, a crypto tracker, “Droidmas” experiments, an AI-directed video demo system, and automations that keep projects moving even when he’s away from his desk.

  3. The Workflow: Context → Spec Mode → Autonomy High Ben’s process is straightforward: talk to the model to load context, switch into spec mode to pressure-test the plan, link docs/repos for exploration, then let the model run while he watches and steers when needed.

  4. http://agents.md/ The “Readme For Agents” That Follows You Everywhere I explain why agents . md matters—one predictable place to tell your agent how you want repos structured, how to commit, how to test, and what “good” looks like so each session gets smoother.

  5. Coding On The Go: PRs, Issues, Phone, Telegram, Slack We get into the real “agent native” behavior: install the GitHub app, work via pull requests and issues, tag the agent to self-fix, and even push changes from your phone—plus using Slack as a one-person “product” with an agent in the loop.

  6. Learning The Primitives: Bash, CLIs, VPS, Skills I cover the building blocks Ben’s learning: bash commands and repeatable terminal workflows, preferring CLIs over MCPs to save context, and using a VPS + syncing to keep projects always-on.

  7. The Mindset Shift: The Model Is The Teacher The real unlock is treating the model like your patient expert—ask everything you don’t understand, bake “explain simply” into your agent instructions, and close knowledge gaps as they appear.

  8. Fail Forward, Pick One, Keep Shipping I end on the playbook: build ahead of your capability, treat it like play, give yourself permission to throw things away, and stop tool-hopping—pick one system and go deep.

The #1 tool to find startup ideas/trends - https://www.ideabrowser.com

LCA helps Fortune 500s and fast-growing startups build their future - from Warner Music to Fortnite to Dropbox. We turn 'what if' into reality with AI, apps, and next-gen products https://latecheckout.agency/

The Vibe Marketer - Resources for people into vibe marketing/marketing with AI: https://www.thevibemarketer.com/

FIND ME ON SOCIAL

X/Twitter: https://twitter.com/gregisenberg

Instagram: https://instagram.com/gregisenberg/

LinkedIn: https://www.linkedin.com/in/gisenberg/

...more
View all episodesView all episodes
Download on the App Store

The Startup Ideas PodcastBy Greg Isenberg

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

204 ratings


More shows like The Startup Ideas Podcast

View all
The Smart Passive Income Online Business and Blogging Podcast by Pat Flynn

The Smart Passive Income Online Business and Blogging Podcast

3,451 Listeners

This Week in Startups by Jason Calacanis

This Week in Startups

1,296 Listeners

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch by Harry Stebbings

The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch

536 Listeners

The Side Hustle Show by Nick Loper of Side Hustle Nation | YAP Media

The Side Hustle Show

1,584 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,105 Listeners

Marketing School - Digital Marketing and Online Marketing Tips by Eric Siu and Neil Patel

Marketing School - Digital Marketing and Online Marketing Tips

1,268 Listeners

Founders by David Senra

Founders

2,221 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

233 Listeners

The Game with Alex Hormozi by Alex Hormozi

The Game with Alex Hormozi

4,471 Listeners

My First Million by Hubspot Media

My First Million

2,660 Listeners

Marketing Against The Grain by Hubspot Media

Marketing Against The Grain

359 Listeners

Moneywise by Hampton

Moneywise

651 Listeners

The Koerner Office - Business Ideas and Deep Dives with Chris Koerner by Chris Koerner

The Koerner Office - Business Ideas and Deep Dives with Chris Koerner

257 Listeners

The Next Wave - AI and The Future of Technology by Mindstream (Hubspot Media)

The Next Wave - AI and The Future of Technology

55 Listeners

AI + a16z by a16z

AI + a16z

34 Listeners