The Quantum Drift

Inside the Mind of AI: How Large Language Models Work


Listen Later

Ever wondered how chatbots like ChatGPT predict the perfect response? Robert Loft and Haley Hanson unravel the magic behind large language models, inspired by a fascinating explainer for the Computer History Museum.

We break it down:

  • The basics: What LLMs are and how they predict words.
  • Training in action: From pre-training on massive data to fine-tuning with human feedback.
  • The transformer revolution: How attention mechanisms enable context-rich predictions.
  • The mind-blowing scale: Billions of parameters, GPUs, and computations spanning eons.

This episode is perfect for AI-curious minds seeking a fun, accessible intro to large language models. Plus, we’ll point you to resources and exhibits to explore further!


...more
View all episodesView all episodes
Download on the App Store

The Quantum DriftBy Robert Loft and Haley Hanson