
Sign up to save your podcasts
Or
This is the first post in a sequence about how I think about and break down my research process. Post 2 is coming soon.
Thanks to Oli Clive-Griffin, Paul Bogdan, Shivam Raval and especially to Jemima Jones for feedback, and to my co-author Gemini 2.5 Pro - putting 200K tokens of past blog posts and a long voice memo in the context window is OP.
IntroductionResearch, especially in a young and rapidly evolving field like mechanistic interpretability (mech interp), can often feel messy, confusing, and intimidating. Where do you even start? How do you know if you're making progress? When do you double down, and when do you pivot?
These are far from settled questions, but I’ve supervised 20+ papers by now, and have developed my own mental model of the research process that I find helpful. This isn't the definitive way to do research (and I’d love [...]
---
Outline:
(00:36) Introduction
(03:28) The key stages
(03:35) Ideation (Stage 0): Choose a problem
(04:14) Exploration (Stage 1): Gain surface area
(06:55) Understanding (Stage 2): Test Hypotheses
(09:17) Distillation (Stage 3): Compress, Refine, Communicate
---
First published:
Source:
Narrated by TYPE III AUDIO.
This is the first post in a sequence about how I think about and break down my research process. Post 2 is coming soon.
Thanks to Oli Clive-Griffin, Paul Bogdan, Shivam Raval and especially to Jemima Jones for feedback, and to my co-author Gemini 2.5 Pro - putting 200K tokens of past blog posts and a long voice memo in the context window is OP.
IntroductionResearch, especially in a young and rapidly evolving field like mechanistic interpretability (mech interp), can often feel messy, confusing, and intimidating. Where do you even start? How do you know if you're making progress? When do you double down, and when do you pivot?
These are far from settled questions, but I’ve supervised 20+ papers by now, and have developed my own mental model of the research process that I find helpful. This isn't the definitive way to do research (and I’d love [...]
---
Outline:
(00:36) Introduction
(03:28) The key stages
(03:35) Ideation (Stage 0): Choose a problem
(04:14) Exploration (Stage 1): Gain surface area
(06:55) Understanding (Stage 2): Test Hypotheses
(09:17) Distillation (Stage 3): Compress, Refine, Communicate
---
First published:
Source:
Narrated by TYPE III AUDIO.
26,367 Listeners
2,397 Listeners
7,779 Listeners
4,103 Listeners
87 Listeners
1,442 Listeners
8,778 Listeners
89 Listeners
355 Listeners
5,370 Listeners
15,053 Listeners
460 Listeners
126 Listeners
64 Listeners
432 Listeners