Streaming Audio: Apache Kafka® & Real-Time Data

Kafka Screams: The Scariest JIRAs and How To Survive Them ft. Anna McDonald


Listen Later

In today's spooktacular episode of Streaming Audio, Anna McDonald (Technical Account Manager, Confluent) discusses six of the scariest Apache Kafka® JIRAs. Starting with KAFKA-6431: Lock Contention in Purgatory, Anna breaks down what purgatory is and how it’s not something to fear or avoid. 

Next, she dives into KAFKA-8522: Tombstones Can Survive Forever, where she explains tombstones, compacted topics, null values, and log compaction. Not to mention there’s KAFKA-6880: Zombie Replicas Must Be Fenced, which sounds like the spookiest of them all. 

KAFKA-8233, which focuses on the new TestTopology mummy (wrapper) class, provides one option for setting the topology through your Kafka Screams Streams application. As Anna puts it, "This opens doors for people to build better, more resilient, and more interesting topologies." 

To close out the episode, Anna talks about two more JIRAs: KAFKA-6738, which focuses on the Kafka Connect dead letter queue as a means of handling bad data, and the terrifying KAFKA-5925 on the addition of an executioner API. 

EPISODE LINKS

  • KAFKA-6431: Lock Contention in Purgatory
  • KAFKA-8522: Tombstones Can Survive Forever
  • KAFKA-6880: Zombie Replicas Must Be Fenced
  • KAFKA-8233: Helper Classes to Make it Simpler to Write Test Logic with TopologyTestDriver 
  • KAFKA-6738: Kafka Connect Handling of Bad Data
  • KAFKA-5925: Adding Records Deletion Operation to the New Admin Client API
  • Streaming Apps and Poison Pills: Handle the Unexpected with Kafka Streams
  • Data Modeling for Apache Kafka – Streams, Topics & More with Dani Traphagen
  • Distributed Systems Engineering with Apache Kafka ft. Jason Gustafson
  • Kafka Streams Topology Visualizer
  • Follow Anna McDonald on Twitter
  • Follow Mitch Henderson on Twitter
  • Join the Confluent Community Slack
  • Fully managed Apache Kafka as a service! Try free.
...more
View all episodesView all episodes
Download on the App Store

Streaming Audio: Apache Kafka® & Real-Time DataBy Confluent, founded by the original creators of Apache Kafka®

  • 4.8
  • 4.8
  • 4.8
  • 4.8
  • 4.8

4.8

44 ratings


More shows like Streaming Audio: Apache Kafka® & Real-Time Data

View all
Planet Money by NPR

Planet Money

30,913 Listeners

The Changelog: Software Development, Open Source by Changelog Media

The Changelog: Software Development, Open Source

285 Listeners

Talk Python To Me by Michael Kennedy

Talk Python To Me

586 Listeners

Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

631 Listeners

AWS Podcast by Amazon Web Services

AWS Podcast

201 Listeners

DataFramed by DataCamp

DataFramed

268 Listeners

Tech Lead Journal by Henry Suryawirawan

Tech Lead Journal

12 Listeners

System Design by Wes and Kevin

System Design

93 Listeners

Postgres FM by Nikolay Samokhvalov and Michael Christofides

Postgres FM

20 Listeners

Kubernetes for Humans by Komodor

Kubernetes for Humans

2 Listeners

Learn System Design by Ben Kitchell

Learn System Design

32 Listeners