Sign up to save your podcasts
Or
Share “38.2 - Jesse Hoogland on Singular Learning Theory” by DanielFilan
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“38.2 - Jesse Hoogland on Singular Learning Theory” by DanielFilan
YouTube link
You may have heard of singular learning theory, and its “local learning coefficient”, or LLC - but have you heard of the refined LLC? In this episode, I chat with Jesse Hoogland about his work on SLT, and using the refined LLC to find a new circuit in language models.
Topics we discuss:
Daniel Filan (00:09):
Hello, everyone. This is one of a series of short interviews that I’ve been conducting at the Bay Area Alignment Workshop, which is run by FAR.AI. Links to what we’re discussing, as usual, are in the description. A transcript is, as usual, available at axrp.net. And as usual, if you want to support the podcast, you can do so [...]
---
Outline:
(01:21) About Jesse
(02:51) The Aligment Workshop
(03:37) About Timaeus
(06:52) SLT that isn’t developmental interpretability
(12:20) The refined local learning coefficient
(16:25) Finding the multigram circuit
---
First published:
November 27th, 2024
Source:
https://www.lesswrong.com/posts/7399F7TjTMreDBcmN/38-2-jesse-hoogland-on-singular-learning-theory
---
Narrated by TYPE III AUDIO.
View all episodes
By LessWrongYouTube link
You may have heard of singular learning theory, and its “local learning coefficient”, or LLC - but have you heard of the refined LLC? In this episode, I chat with Jesse Hoogland about his work on SLT, and using the refined LLC to find a new circuit in language models.
Topics we discuss:
Daniel Filan (00:09):
Hello, everyone. This is one of a series of short interviews that I’ve been conducting at the Bay Area Alignment Workshop, which is run by FAR.AI. Links to what we’re discussing, as usual, are in the description. A transcript is, as usual, available at axrp.net. And as usual, if you want to support the podcast, you can do so [...]
---
Outline:
(01:21) About Jesse
(02:51) The Aligment Workshop
(03:37) About Timaeus
(06:52) SLT that isn’t developmental interpretability
(12:20) The refined local learning coefficient
(16:25) Finding the multigram circuit
---
First published:
November 27th, 2024
Source:
https://www.lesswrong.com/posts/7399F7TjTMreDBcmN/38-2-jesse-hoogland-on-singular-learning-theory
---
Narrated by TYPE III AUDIO.
More shows like LessWrong (30+ Karma)
View all
Making Sense with Sam Harris
26,362 Listeners
Conversations with Tyler
2,380 Listeners
The Peter Attia Drive
7,924 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,131 Listeners
ManifoldOne
87 Listeners
Your Undivided Attention
1,447 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
8,922 Listeners
Machine Learning Street Talk (MLST)
88 Listeners
Dwarkesh Podcast
379 Listeners
Hard Fork
5,425 Listeners
The Ezra Klein Show
15,206 Listeners
Moonshots with Peter Diamandis
475 Listeners
No Priors: Artificial Intelligence | Technology | Startups
121 Listeners
Latent Space: The AI Engineer Podcast
77 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
455 Listeners