The GeekNarrator

WarpStream: A drop-in replacement for Kafka


Listen Later

In this episode of The GeekNarrator podcast, host Kaivalya Apte interviews Ryan and Richie, the founders of WarpStream. They discuss the architecture, benefits, and core functionalities of WarpStream, a drop-in replacement for Apache Kafka. The conversation covers their experience with Kafka, the design decisions behind WarpStream, and the operational challenges it addresses. They also delve into the seamless migration process, the scalability, and cost benefits, the integration with the Kafka ecosystem, and potential future features. This episode is a must-watch for developers and tech enthusiasts interested in modern, distributed data streaming solutions.

Chapters:
00:00 Introduction
02:27 Introducing Warpstream: A Kafka Replacement
11:07 Deep Dive into Warpstream's Architecture
35:42 Exploring Kafka's Ordering Guarantees
36:52 Handling Buffering and Compaction
38:44 Efficient Data Reading and File Caching
44:06 WarpStream's Flexibility and Cost Efficiency
01:06:59 Future Features
Links:
WarpStream : https://www.warpstream.com/
Blog: https://www.warpstream.com/blog
X:
Ryan: https://x.com/ryanworl
Richard Artoul: https://x.com/richardartoul
Kaivalya Apte: https://x.com/thegeeknarrator
If you like this episode, please hit the like button and share it with your network.
Also please subscribe if you haven't yet.
Database internals series: https://youtu.be/yV_Zp0Mi3xs
Popular playlists:
Realtime streaming systems: https://www.youtube.com/playlist?list=PLL7QpTxsA4se-mAKKoVOs3VcaP71X_LA-
Software Engineering: https://www.youtube.com/playlist?list=PLL7QpTxsA4sf6By03bot5BhKoMgxDUU17
Distributed systems and databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4sfLDUnjBJXJGFhhz94jDd_d
Modern databases: https://www.youtube.com/playlist?list=PLL7QpTxsA4scSeZAsCUXijtnfW5ARlrsN
Stay Curios! Keep Learning!
#distributedsystems #kafka #s3 #streaming

...more
View all episodesView all episodes
Download on the App Store

The GeekNarratorBy Kaivalya Apte

  • 5
  • 5
  • 5
  • 5
  • 5

5

3 ratings


More shows like The GeekNarrator

View all
Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

622 Listeners

TED Tech by TED Tech

TED Tech

396 Listeners

Up First from NPR by NPR

Up First from NPR

56,524 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

517 Listeners

The Daily Brief by Zerodha

The Daily Brief

14 Listeners

The Pragmatic Engineer by Gergely Orosz

The Pragmatic Engineer

64 Listeners