My Weird Prompts

AI Pipelines: In-Memory vs. Durable State


Listen Later

Everyone obsesses over frontier models and prompt engineering, but production AI fails at a more fundamental layer: the plumbing. This episode dives into the unglamorous but critical world of state management in multi-stage AI pipelines. We explore the trade-offs between volatile in-memory passing, high-speed caches like Redis, and durable databases, and introduce frameworks like LangGraph and Temporal that promise "immortal" execution. Learn why the "where" and "how" of data movement determines whether your system is a brittle prototype or a resilient enterprise tool.
...more
View all episodesView all episodes
Download on the App Store

My Weird PromptsBy Daniel Rosehill