The Test Set by Posit

Marco Gorelli: Narwhals, ecosystem glue, and the value of boring work


Listen Later

You’ve probably used Narwhals without realizing it. It’s the compatibility layer helping apps and libraries like Plotly play nice with Pandas, Polars, Arrow, and more — while keeping computation native instead of converting everything to Pandas. In this episode, Marco Gorelli explains how his weekend experiment turned into essential ecosystem infrastructure and why data types, not APIs, are where interoperability gets tricky. Plus what it takes to build trust and community around an open-source project.


Episode Notes
Marco shares the Narwhals origin story (including the meme-powered name), the hard edge cases that live in data types and null semantics, and why he’s cautious about using AI for code generation when correctness hinges on tiny details. We also jam on proactive “GitHub surfing,” conference talks as trust-building exercises, celebrating contributors, and how early commit messages capture the genuine excitement of building something new.


What’s Inside

  • Narwhals 101: You’ve probably used it (even if you didn’t know it)
  • The real interoperability traps: data types, null semantics, and “looks-the-same” operations
  • Why expression systems won, and how they shaped Marco’s approach — with nods to Ibis, Polars, and Pandas
  • Open source as social work: proactive outreach, trust-building, and a Discord-powered community
  • Extending Narwhals to new engines, starting with the Daft plugin
...more
View all episodesView all episodes
Download on the App Store

The Test Set by PositBy Posit, PBC

  • 5
  • 5
  • 5
  • 5
  • 5

5

25 ratings


More shows like The Test Set by Posit

View all
Planet Money by NPR

Planet Money

30,738 Listeners

More or Less by BBC Radio 4

More or Less

870 Listeners

In Our Time by BBC Radio 4

In Our Time

5,530 Listeners

Conversations with Tyler by Mercatus Center at George Mason University

Conversations with Tyler

2,457 Listeners

Uncanny Valley | WIRED by WIRED

Uncanny Valley | WIRED

510 Listeners

The Daily by The New York Times

The Daily

113,129 Listeners

Interesting Times with Ross Douthat by New York Times Opinion

Interesting Times with Ross Douthat

7,262 Listeners

Throughline by NPR

Throughline

16,486 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

561 Listeners

R Weekly Highlights by Eric Nantz

R Weekly Highlights

6 Listeners

Hard Fork by The New York Times

Hard Fork

5,587 Listeners

The Rest Is History by Goalhanger

The Rest Is History

15,801 Listeners

The Ezra Klein Show by New York Times Opinion

The Ezra Klein Show

16,487 Listeners

If Books Could Kill by Michael Hobbes & Peter Shamshiri

If Books Could Kill

9,420 Listeners

Prof G Markets by Vox Media Podcast Network

Prof G Markets

1,478 Listeners