Sign up to save your podcasts
Or
Share “Progress Update #1 from the GDM Mech Interp Team: Summary” by Neel Nanda, Arthur Conmy, lsgos, Senthooran Rajamanoharan, Tom Lieberum, János Kramár, Vikrant Varma
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
“Progress Update #1 from the GDM Mech Interp Team: Summary” by Neel Nanda, Arthur Conmy, lsgos, Senthooran Rajamanoharan, Tom Lieberum, János Kramár, Vikrant Varma
Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.Introduction.
This is a progress update from the Google DeepMind mechanistic interpretability team, inspired by the Anthropic team's excellent monthly updates! Our goal was to write-up a series of snippets, covering a range of things that we thought would be interesting to the broader community, but didn't yet meet our bar for a paper. This is a mix of promising initial steps on larger investigations, write-ups of small investigations, replications, and negative results.
Our team's two main current goals are to scale sparse autoencoders to larger models, and to do further basic science on SAEs. We expect these snippets to mostly be of interest to other mech interp practitioners, especially those working with SAEs. One exception is our infrastructure snippet, which we think could be useful to mechanistic interpretability researchers more broadly. We present preliminary results [...]
---
First published:
April 19th, 2024
Source:
https://www.lesswrong.com/posts/HpAr8k74mW4ivCvCu/progress-update-1-from-the-gdm-mech-interp-team-summary
---
Narrated by TYPE III AUDIO.
View all episodes
By LessWrongCrossposted from the AI Alignment Forum. May contain more technical jargon than usual.Introduction.
This is a progress update from the Google DeepMind mechanistic interpretability team, inspired by the Anthropic team's excellent monthly updates! Our goal was to write-up a series of snippets, covering a range of things that we thought would be interesting to the broader community, but didn't yet meet our bar for a paper. This is a mix of promising initial steps on larger investigations, write-ups of small investigations, replications, and negative results.
Our team's two main current goals are to scale sparse autoencoders to larger models, and to do further basic science on SAEs. We expect these snippets to mostly be of interest to other mech interp practitioners, especially those working with SAEs. One exception is our infrastructure snippet, which we think could be useful to mechanistic interpretability researchers more broadly. We present preliminary results [...]
---
First published:
April 19th, 2024
Source:
https://www.lesswrong.com/posts/HpAr8k74mW4ivCvCu/progress-update-1-from-the-gdm-mech-interp-team-summary
---
Narrated by TYPE III AUDIO.
More shows like LessWrong (30+ Karma)
View all
Making Sense with Sam Harris
26,446 Listeners
Conversations with Tyler
2,389 Listeners
The Peter Attia Drive
7,910 Listeners
Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas
4,136 Listeners
ManifoldOne
87 Listeners
Your Undivided Attention
1,462 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
9,095 Listeners
Machine Learning Street Talk (MLST)
87 Listeners
Dwarkesh Podcast
389 Listeners
Hard Fork
5,432 Listeners
The Ezra Klein Show
15,174 Listeners
Moonshots with Peter Diamandis
474 Listeners
No Priors: Artificial Intelligence | Technology | Startups
121 Listeners
Latent Space: The AI Engineer Podcast
75 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
459 Listeners