Welcome to our 3nd episode. This is the second part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. In this part we’ll talk about Apache Zookeeper the best kept secret in a lot of open source distributed systems. We’ll also touch upon clients, atomic broadcasts and things that can hurt availability. Hope you enjoy the ride as we walk the route taken by messages through Apache Kafka. Remember to subscribe for more interesting, deep tech conversations.

Follow us on Twitter

@dosco

@strlen

Links

ZooKeeper: Wait-free coordination for Internet-scale systems

ZooKeeper’s atomic broadcast protocol: Theory and practice

PacificA: Replication in Log-Based Distributed Storage Systems

Bigtable: A Distributed Storage System for Structured Data

The Chubby lock service for loosely-coupled distributed systems