Today in Tech

How AI really remembers, and why agents will keep forgetting


Listen Later

Most people assume AI “remembers everything” — every chat, every command, every conversation. But that’s not how today’s systems actually work. On this episode of Today in Tech, Keith Shaw talks with Manifest AI CEO Jacob Buckman about how AI memory really works under the hood, why chatbots feel so different from humans, and what has to change for true long-running digital agents to become reality.

Jacob explains concepts like short-term vs. long-term AI memory, context windows, KV caches, and “scratchpad” summaries in plain language. He uses analogies from medicine and the movie Memento to show why current AI tools can ace a single conversation but struggle to stay on task over hours, days, or projects. They also dig into hallucinations, why simply “making models bigger” isn’t enough, and how new architectures like power retention aim to give AI a more human-like ability to remember what actually matters over time.


You’ll learn:

* Why AI remembers everything inside a chat window but almost nothing between sessions

* How today’s memory tricks (summaries, scratchpads, huge context windows) still fall short

* How memory limits hold back reliable AI agents for coding, research, and creative work

* Why better long-term memory could cut hallucinations and boost trust in business use cases

* What “power retention” is — and how it could reshape the next generation of AI systems



...more
View all episodesView all episodes
Download on the App Store

Today in TechBy Foundry

  • 3.4
  • 3.4
  • 3.4
  • 3.4
  • 3.4

3.4

10 ratings


More shows like Today in Tech

View all
Planet Money by NPR

Planet Money

30,825 Listeners

Marketplace by Marketplace

Marketplace

8,790 Listeners

WSJ What’s News by The Wall Street Journal

WSJ What’s News

4,419 Listeners

This Week in Tech (Audio) by TWiT

This Week in Tech (Audio)

3,063 Listeners

The Vergecast by The Verge

The Vergecast

3,721 Listeners

The Daily by The New York Times

The Daily

113,521 Listeners

Up First from NPR by NPR

Up First from NPR

57,047 Listeners

The Diary Of A CEO with Steven Bartlett by DOAC

The Diary Of A CEO with Steven Bartlett

8,936 Listeners

CIO Leadership Live by Foundry

CIO Leadership Live

15 Listeners

Salted Hash by IDG

Salted Hash

6 Listeners

Tech Brew Ride Home by Morning Brew

Tech Brew Ride Home

973 Listeners

Cyberthreat: Real Answers to Real Problems by Foundry

Cyberthreat: Real Answers to Real Problems

1 Listeners

The Intelligence from The Economist by The Economist

The Intelligence from The Economist

2,555 Listeners

A Hard Look at Software Security by Foundry

A Hard Look at Software Security

0 Listeners

Fiction - Comedy Fiction by The Sunset Explorers

Fiction - Comedy Fiction

6,447 Listeners

Big Technology Podcast by Alex Kantrowitz

Big Technology Podcast

510 Listeners

Hard Fork by The New York Times

Hard Fork

5,536 Listeners

The Economics of Everyday Things by Freakonomics Network & Zachary Crockett

The Economics of Everyday Things

1,662 Listeners

The Next Wave - AI and The Future of Technology by Mindstream (Hubspot Media)

The Next Wave - AI and The Future of Technology

58 Listeners