TopicPartition

tansu - pluggable stateless kafka (written in rust)


Listen Later


Tansu is an open-source (Apache-license), stateless Kafka broker that supports pluggable storage engines (PostgreSQL, SQLite, S3 and in-memory). Similar to WarpStream, it is a modern diskless Kafka implementation which does not explicitly store data on disk but rather outsources the durability and replication to another storage backend. Tansu is the only implementation (that I'm aware of) which supports pluggable storage backends, including SQL databases like Postgres and SQLite. Critically, unlike the other alternatives, it does not depend on a coordinator service. The combination of these two unlock a truly stateless Kafka which allows for some interesting use cases, like:

  • instant auto-scalability
  • incredibly flexible deployment models (per VPC, AZ, region, etc.)
  • embedded Kafka
  • dead-easy CI/CD integration

and more.It is also the only truly open source diskless Kafka implementation.

Tansu is made for developers. It is fully Kafka API compatible, but makes certain ergonomic decisions that help it boast better UX than regular Kafka.

...more
View all episodesView all episodes
Download on the App Store

TopicPartitionBy 2minutestreaming