The GeekNarrator

Distributed Stream processing with Maximilian Michels


Listen Later

Hey šŸ‘‹ , Ā 

In this podcast we are talking about Distributed Stream Processing at High scale with Maximilian Michels (https://www.linkedin.com/in/maximilianmichels/) , who is an expert in Data intensive applications and an open source maintainer for Apache Flink, Beam and other cool technologies. Ā 

Ā We have covered an introduction on Stream Processing at high scale:

Ā - What is stream processing?Ā 

- How does it compare with Batch Processing and also event processing?Ā 

- What tools are available to perform stream processing?Ā 

- Use cases where we need Stream processing.Ā 

- Flink vs Kafka and some factors to decide between the two. Ā https://docs.confluent.io/platform/current/streams/index.html and https://flink.apache.org/

- Why Exactly once processing is a Hard problem and how Kafka and Flink approach that problem? Is it similar to exactly once delivery?

Ā - Do we really need exactly once?

Ā - Why data locality matters?

Ā - Should we make network calls from the stream processor OR have a join instead? How do decide? Ā And so many other important considerations based on real production experience in operating stream processing pipelines at a very high scale.Ā 

Ā I hope you like the podcast. Please like, share and subscribe šŸ™ Ā Ā The GeekNarrator channel needs your love and support 😃 Ā 


Regards, The GeekNarrator

...more
View all episodesView all episodes
Download on the App Store

The GeekNarratorBy Kaivalya Apte

  • 5
  • 5
  • 5
  • 5
  • 5

5

3 ratings


More shows like The GeekNarrator

View all
Practical AI by Practical AI LLC

Practical AI

213 Listeners

Software Unscripted by Richard Feldman

Software Unscripted

27 Listeners

Training Data by Sequoia Capital

Training Data

39 Listeners