The Test Set by Posit

Marco Gorelli: Narwhals, ecosystem glue, and the value of boring work


Listen Later

You’ve probably used Narwhals without realizing it. It’s the compatibility layer helping apps and libraries like Plotly play nice with Pandas, Polars, Arrow, and more — while keeping computation native instead of converting everything to Pandas. In this episode, Marco Gorelli explains how his weekend experiment turned into essential ecosystem infrastructure and why data types, not APIs, are where interoperability gets tricky. Plus what it takes to build trust and community around an open-source project.


Episode Notes
Marco shares the Narwhals origin story (including the meme-powered name), the hard edge cases that live in data types and null semantics, and why he’s cautious about using AI for code generation when correctness hinges on tiny details. We also jam on proactive “GitHub surfing,” conference talks as trust-building exercises, celebrating contributors, and how early commit messages capture the genuine excitement of building something new.


What’s Inside

  • Narwhals 101: You’ve probably used it (even if you didn’t know it)
  • The real interoperability traps: data types, null semantics, and “looks-the-same” operations
  • Why expression systems won, and how they shaped Marco’s approach — with nods to Ibis, Polars, and Pandas
  • Open source as social work: proactive outreach, trust-building, and a Discord-powered community
  • Extending Narwhals to new engines, starting with the Daft plugin
...more
View all episodesView all episodes
Download on the App Store

The Test Set by PositBy Posit, PBC

  • 5
  • 5
  • 5
  • 5
  • 5

5

25 ratings


More shows like The Test Set by Posit

View all
Planet Money by NPR

Planet Money

30,715 Listeners

More or Less by BBC Radio 4

More or Less

873 Listeners

In Our Time by BBC Radio 4

In Our Time

5,538 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,458 Listeners

Uncanny Valley | WIRED by WIRED

Uncanny Valley | WIRED

510 Listeners

The Daily by The New York Times

The Daily

113,075 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,268 Listeners

Throughline by NPR

Throughline

16,491 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

560 Listeners

R Weekly Highlights by Eric Nantz

R Weekly Highlights

6 Listeners

Hard Fork by The New York Times

Hard Fork

5,574 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,818 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,492 Listeners

If Books Could Kill by Michael Hobbes & Peter Shamshiri

If Books Could Kill

9,417 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,475 Listeners