Saturdata

How ChatGPT actually works: a dog explains | Saturdata with Joey Yudelson


Listen Later

What if you could explain ChatGPT using only a dog, some audiobooks, and a stick? Joey Yudelson joins Sam and Shifra to break down how large language models actually work, no PhD required. From next-word prediction to reinforcement learning, this one will make you feel like you actually get it.

We talk about:

- How LLMs learn to "speak human" by predicting the next word

- What reinforcement learning actually does (and why your model needs a stick sometimes)

- Why RLHF is basically dog training at a bazillion scale

- Spurious correlations and how models learn the wrong lessons

- What it really means when an AI "has a persona"

Follow Saturdata, your favorite weekend data podcast:

Spotify: https://open.spotify.com/show/5QolhKm1jDZzVuHO0S9ZBo?si=910efb23833f4fc1

LinkedIn: https://www.linkedin.com/company/saturdata

Instagram: @SaturdataPod

#Saturdata #MachineLearning #ChatGPT #LLM

...more
View all episodesView all episodes
Download on the App Store

SaturdataBy Saturdata Podcast