Intellectually Curious

The $100 NanoChat: Karpathy’s Lean LLM Pipeline


Listen Later

We dive into Andrej Karpathy’s NanoChat project—a compact, hackable end-to-end LLM pipeline built on a tight budget. From 560M-parameter pretraining to supervised fine-tuning, tool use, and a sub-$100 cloud run, we unpack the philosophy of cognitive accessibility, the lean 8,300-line codebase, and what this teaches about readability, accessibility, and scalable AI on a budget.


Note: This podcast was AI-generated, and sometimes AI can make mistakes. Please double-check any critical information.

Sponsored by Embersilk LLC

...more
View all episodesView all episodes
Download on the App Store

Intellectually CuriousBy Mike Breault