Database School

Sharding Postgres without extensions with PgDog founder, Lev Kokotov


Listen Later

I chat with Lev Kokotov to talk about building PgDog, an open-source sharding solution for Postgres that sits outside the database. Lev shares the journey from creating PgCat to launching PgDog through YC, the technical challenges of sharding, and why he believes scaling Postgres shouldn’t require extensions or rewrites.


Follow Lev:

  • Twitter: https://twitter.com/levpgdog
  • PgDog: https://pgdog.dev


Follow Aaron:

  • Twitter: https://twitter.com/aarondfrancis
  • LinkedIn: https://www.linkedin.com/in/aarondfrancis
  • Website: https://aaronfrancis.com — find articles, podcasts, courses, and more.
  • Database School: https://databaseschool.com



Chapters

  • 00:00 - Intro
  • 01:27 - Lev’s self-taught to computer science degree journey
  • 04:50 - Transition to Postgres discussion
  • 05:24 - History of PgCat
  • 07:06 - What PG Cat does and key features
  • 08:59 - Why Lev built PgCat instead of extending PG Bouncer
  • 10:06 - PG Cat’s current status and usage
  • 12:20 - Moving from PgCat to PgDog
  • 13:09 - Applying to YC as a solo founder
  • 16:24 - YC pitch: the market gap for Postgres sharding
  • 18:52 - High-level overview of PgDog
  • 23:32 - Why PgDog is not an extension
  • 25:57 - When to build Postgres extensions vs standalone tools
  • 27:49 - PgDog architecture and query parsing
  • 30:39 - Handling cross-shard queries and current capabilities
  • 33:47 - How PgDog shards an existing large Postgres database
  • 36:37 - Parallel replication streams for faster sharding
  • 39:07 - Alternate resharding approaches
  • 42:52 - Where PgDog draws the orchestration line
  • 44:00 - Vision for PgDog Cloud vs bring-your-own-database
  • 46:47 - Company status: first hire, design partners, and production use
  • 50:45 - How deploys work for customers
  • 52:20 - Importance of building closely with design partners
  • 54:05 - Paid design partnerships and initial deployments
  • 56:23 - Benefit of sitting outside Postgres for compatibility
  • 58:32 - Near-term roadmap and long-term vision
  • 1:01:03 - Where to find Lev online
...more
View all episodesView all episodes
Download on the App Store

Database SchoolBy Try Hard Studios

  • 5
  • 5
  • 5
  • 5
  • 5

5

3 ratings


More shows like Database School

View all
Software Engineering Radio by se-radio@computer.org

Software Engineering Radio

271 Listeners

Hanselminutes with Scott Hanselman by Scott Hanselman

Hanselminutes with Scott Hanselman

383 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

289 Listeners

Startups For the Rest of Us by Rob Walling

Startups For the Rest of Us

703 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

626 Listeners

Python Bytes by Michael Kennedy and Brian Okken

Python Bytes

214 Listeners

Y Combinator Startup Podcast by Y Combinator

Y Combinator Startup Podcast

226 Listeners

Syntax - Tasty Web Development Treats by Wes Bos & Scott Tolinski - Full Stack JavaScript Web Developers

Syntax - Tasty Web Development Treats

988 Listeners

REWORK by 37signals

REWORK

210 Listeners

CoRecursive: Coding Stories by Adam Gordon Bell - Software Developer

CoRecursive: Coding Stories

190 Listeners

Practical AI by Practical AI LLC

Practical AI

211 Listeners

Oxide and Friends by Oxide Computer Company

Oxide and Friends

62 Listeners

BG2Pod with Brad Gerstner and Bill Gurley by BG2Pod

BG2Pod with Brad Gerstner and Bill Gurley

467 Listeners

Mostly Technical by Ian Landsman and Aaron Francis

Mostly Technical

26 Listeners

Cheeky Pint by Stripe

Cheeky Pint

48 Listeners