
Sign up to save your podcasts
Or
This is the first post in a sequence about how I think about and break down my research process. Post 2 is coming soon.
Thanks to Oli Clive-Griffin, Paul Bogdan, Shivam Raval and especially to Jemima Jones for feedback, and to my co-author Gemini 2.5 Pro - putting 200K tokens of past blog posts and a long voice memo in the context window is OP.
IntroductionResearch, especially in a young and rapidly evolving field like mechanistic interpretability (mech interp), can often feel messy, confusing, and intimidating. Where do you even start? How do you know if you're making progress? When do you double down, and when do you pivot?
These are far from settled questions, but I’ve supervised 20+ papers by now, and have developed my own mental model of the research process that I find helpful. This isn't the definitive way to do research (and I’d love [...]
---
Outline:
(00:36) Introduction
(03:28) The key stages
(03:35) Ideation (Stage 0): Choose a problem
(04:14) Exploration (Stage 1): Gain surface area
(06:55) Understanding (Stage 2): Test Hypotheses
(09:17) Distillation (Stage 3): Compress, Refine, Communicate
---
First published:
Source:
---
Narrated by TYPE III AUDIO.
This is the first post in a sequence about how I think about and break down my research process. Post 2 is coming soon.
Thanks to Oli Clive-Griffin, Paul Bogdan, Shivam Raval and especially to Jemima Jones for feedback, and to my co-author Gemini 2.5 Pro - putting 200K tokens of past blog posts and a long voice memo in the context window is OP.
IntroductionResearch, especially in a young and rapidly evolving field like mechanistic interpretability (mech interp), can often feel messy, confusing, and intimidating. Where do you even start? How do you know if you're making progress? When do you double down, and when do you pivot?
These are far from settled questions, but I’ve supervised 20+ papers by now, and have developed my own mental model of the research process that I find helpful. This isn't the definitive way to do research (and I’d love [...]
---
Outline:
(00:36) Introduction
(03:28) The key stages
(03:35) Ideation (Stage 0): Choose a problem
(04:14) Exploration (Stage 1): Gain surface area
(06:55) Understanding (Stage 2): Test Hypotheses
(09:17) Distillation (Stage 3): Compress, Refine, Communicate
---
First published:
Source:
---
Narrated by TYPE III AUDIO.
26,327 Listeners
2,383 Listeners
8,010 Listeners
4,127 Listeners
90 Listeners
1,469 Listeners
9,200 Listeners
91 Listeners
425 Listeners
5,434 Listeners
15,371 Listeners
502 Listeners
128 Listeners
72 Listeners
464 Listeners