ToKCast

Ep 255: Does this research explain how LLMs work?


Listen Later

I take a look at these three papers: 1. https://www.arxiv.org/abs/2512.22471 2. https://arxiv.org/abs/2512.23752 3. https://arxiv.org/abs/2512.22473 Collectively titled "The Bayesian Attention Trilogy" along with some other material - in particular an interview with one of the authors "Vishal Misra" - https://www.engineering.columbia.edu/faculty-staff/directory/vishal-misra For those familiar with my output on this you can probably skip to about halfway through at 42:40. Prior to this is a lot of background on Induction, Bayesianism, Critical Rationalism and so on that people may have heard from me before in different contexts - although for what it's worth these are new ways of expressing those ideas. At the end I am reacting to a video found here: https://www.youtube.com/watch?v=uRuY0ozEm3Q

...more
View all episodesView all episodes
Download on the App Store

ToKCastBy Brett Hall

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

94 ratings


More shows like ToKCast

View all
The Knowledge Project by Shane Parrish

The Knowledge Project

2,695 Listeners

Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,248 Listeners

The a16z Show by Andreessen Horowitz

The a16z Show

1,095 Listeners

Into the Impossible With Brian Keating by Big Bang Productions Inc.

Into the Impossible With Brian Keating

1,070 Listeners

Hidden Forces by Demetri Kofinas

Hidden Forces

1,443 Listeners

The Michael Shermer Show by Michael Shermer

The Michael Shermer Show

934 Listeners

Naval by Naval

Naval

2,140 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

10,196 Listeners

The Saad Truth with Dr. Saad by thesaadtruthwithdrsaad

The Saad Truth with Dr. Saad

1,180 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

577 Listeners

Theories of Everything with Curt Jaimungal by Theories of Everything

Theories of Everything with Curt Jaimungal

21 Listeners

Patrick Boyle On Finance by Patrick Boyle

Patrick Boyle On Finance

196 Listeners

Joe Lonsdale: American Optimist by Joe Lonsdale

Joe Lonsdale: American Optimist

170 Listeners

The Poetry of Reality with Richard Dawkins by Richard Dawkins

The Poetry of Reality with Richard Dawkins

88 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

489 Listeners