Apache Kafka is an interesting software, every design decision the team makes perfect sense. I decided to dive deep into the discussion of the consumer group concept which is underrated and talk more about it.

0:00 Intro

1:24 Messaging Systems Explained

3:30 Partitioning

4:30 Pub/Sub vs Queue

6:55 Consumer Group

10:00 Parallelism in Consumer Group

10:30 Partition awareness in Consumer Group

11:30 Achieving Pub/Sub with Consumer Group

14:00 Head of Line blocking in Kafka