LessWrong (30+ Karma)

“Highly Opinionated Advice on How to Write ML Papers” by Neel Nanda


Listen Later

TL;DR

  • The essence of an ideal paper is the narrative: a short, rigorous and evidence-based technical story you tell, with a takeaway the readers care about
    • What? A narrative is fundamentally about a contribution to our body of knowledge: one to three specific novel claims that fit within a cohesive theme
    • How? You need rigorous empirical evidence that convincingly supports your claims
    • So what? Why should the reader care?
      • What is the motivation, the problem you’re trying to solve, the way it all fits in the bigger picture?
      • What is the impact? Why does your takeaway matter? The north star of a paper is ensuring the reader understands and remembers the narrative, and believes that the paper's evidence supports it
  • The first step is to compress your research into these claims.
  • The paper must clearly motivate these claims, explain them on an intuitive and technical level, and contextualise what's novel in [...]

---

Outline:

(00:10) TL;DR

(03:15) Introduction

(04:51) The Essence of a Paper

(05:40) Crafting a Narrative

(10:07) When to Start?

(11:41) Novelty

(17:26) Rigorous Supporting Evidence

(28:50) Paper Structure Summary

(32:30) Analysing My Grokking Work

(35:39) The Writing Process: Compress then Iteratively Expand

(37:09) Compress

(38:27) Iteratively Expand

(41:36) The Anatomy of a Paper

(41:48) Abstract

(45:03) Introduction

(47:49) Figures

(52:30) Main Body (Background, Methods and Results)

(54:51) Discussion

(56:00) Related Work

(57:24) Appendices

(58:35) Common Pitfalls and How to Avoid Them

(58:39) Obsessing Over Publishability

(01:00:29) Unnecessary Complexity and Verbosity

(01:01:41) Not Prioritizing the Writing Process

(01:02:28) Tacit Knowledge and Beyond

(01:03:53) Conclusion

The original text contained 13 footnotes which were omitted from this narration.

---

First published:

May 12th, 2025

Source:

https://www.lesswrong.com/posts/eJGptPbbFPZGLpjsp/highly-opinionated-advice-on-how-to-write-ml-papers

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

...more
View all episodesView all episodes
Download on the App Store

LessWrong (30+ Karma)By LessWrong


More shows like LessWrong (30+ Karma)

View all
Making Sense with Sam Harris by Sam Harris

Making Sense with Sam Harris

26,367 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,397 Listeners

The Peter Attia Drive by Peter Attia, MD

The Peter Attia Drive

7,779 Listeners

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas by Sean Carroll | Wondery

Sean Carroll's Mindscape: Science, Society, Philosophy, Culture, Arts, and Ideas

4,103 Listeners

ManifoldOne by Steve Hsu

ManifoldOne

87 Listeners

Your Undivided Attention by Tristan Harris and Aza Raskin, The Center for Humane Technology

Your Undivided Attention

1,442 Listeners

All-In with Chamath, Jason, Sacks & Friedberg by All-In Podcast, LLC

All-In with Chamath, Jason, Sacks & Friedberg

8,778 Listeners

Machine Learning Street Talk (MLST) by Machine Learning Street Talk (MLST)

Machine Learning Street Talk (MLST)

89 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

355 Listeners

Hard Fork by The New York Times

Hard Fork

5,370 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

15,053 Listeners

Moonshots with Peter Diamandis by PHD Ventures

Moonshots with Peter Diamandis

460 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

126 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

64 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

432 Listeners