
Sign up to save your podcasts
Or


Hey š , Ā
In this podcast we are talking about Distributed Stream Processing at High scale with Maximilian Michels (https://www.linkedin.com/in/maximilianmichels/) , who is an expert in Data intensive applications and an open source maintainer for Apache Flink, Beam and other cool technologies. Ā
Ā We have covered an introduction on Stream Processing at high scale:
Ā - What is stream processing?Ā
- How does it compare with Batch Processing and also event processing?Ā
- What tools are available to perform stream processing?Ā
- Use cases where we need Stream processing.Ā
- Flink vs Kafka and some factors to decide between the two. Ā https://docs.confluent.io/platform/current/streams/index.html and https://flink.apache.org/
- Why Exactly once processing is a Hard problem and how Kafka and Flink approach that problem? Is it similar to exactly once delivery?
Ā - Do we really need exactly once?
Ā - Why data locality matters?
Ā - Should we make network calls from the stream processor OR have a join instead? How do decide? Ā And so many other important considerations based on real production experience in operating stream processing pipelines at a very high scale.Ā
Ā I hope you like the podcast. Please like, share and subscribe š Ā Ā The GeekNarrator channel needs your love and support š Ā
Regards, The GeekNarrator
By Kaivalya Apte5
33 ratings
Hey š , Ā
In this podcast we are talking about Distributed Stream Processing at High scale with Maximilian Michels (https://www.linkedin.com/in/maximilianmichels/) , who is an expert in Data intensive applications and an open source maintainer for Apache Flink, Beam and other cool technologies. Ā
Ā We have covered an introduction on Stream Processing at high scale:
Ā - What is stream processing?Ā
- How does it compare with Batch Processing and also event processing?Ā
- What tools are available to perform stream processing?Ā
- Use cases where we need Stream processing.Ā
- Flink vs Kafka and some factors to decide between the two. Ā https://docs.confluent.io/platform/current/streams/index.html and https://flink.apache.org/
- Why Exactly once processing is a Hard problem and how Kafka and Flink approach that problem? Is it similar to exactly once delivery?
Ā - Do we really need exactly once?
Ā - Why data locality matters?
Ā - Should we make network calls from the stream processor OR have a join instead? How do decide? Ā And so many other important considerations based on real production experience in operating stream processing pipelines at a very high scale.Ā
Ā I hope you like the podcast. Please like, share and subscribe š Ā Ā The GeekNarrator channel needs your love and support š Ā
Regards, The GeekNarrator

213 Listeners

27 Listeners

39 Listeners