As product lead at Anthropic, Jess has a first-hand look at how Anthropic teams are moving from prompting AI to building long-running agents that work overnight. In our episode, Jess showed me how to build a Claude analytics agent from scratch, then covered how Anthropic PMs use agents internally to understand the codebase, monitor customer feedback, and make better product decisions.

Jess and I talked about:

(00:00) AI agents that work while you sleep

(03:46) Claude Managed Agents help for long-running tasks

(05:22) Demo: Building a Claude analyst agent from scratch

(09:28) Traces: How to see where an agent got stuck

(15:08) Evals: How agents grade their own work

(20:16) 5 ways in which Anthropic PMs use agents internally

(28:06) Processing a 4,000-company waitlist with agents

(32:47) To build your first agent, focus on helping one person

(36:47) What changes when agents can work overnight

Thanks to our sponsors:

Linear: The AI agent platform for modern teams https://linear.app/behind-the-craft

Wispr Flow: 4x faster than typing with your voice https://ref.wisprflow.ai/peteryang

Riverside: All-in-one AI studio for podcasts and video https://creators.riverside.com/PeterYang

📌 Get the takeaways: https://creatoreconomy.so/p/inside-anthropics-bet-on-claude-agents-jess-yan

📌 Get my personal AI operating system with all my skills and prompts: https://www.behindthecraft.com/

Where to find Jess:

X: https://x.com/jess__yan

Website: https://platform.claude.com/docs/en/managed-agents/overviewSubscribe to this channel - more interviews coming soon!