Sign up to save your podcasts
Or
Share Apache Beam with Frances Perry
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Apache Beam with Frances Perry
Unbounded data streams create difficult challenges for our application architectures. The data never stops coming, and we are forced to assume that we will never know if or when we have seen all of our data. Some streaming systems give us the tools to deal partially with unbounded data streams, but we have to complement those streaming systems with batch processing, in a technique known as the Lambda Architecture.
Apache Beam is a unified model for defining and executing data processing workflows, and Frances Perry joins the show to explain how Beam provides a way for us to model our data processing, agnostic of whether we choose to run those workflows on Spark, Flink, or Google’s Dataflow.
Links
The post Apache Beam with Frances Perry appeared first on Software Engineering Daily.
View all episodes
By Cloud Engineering Archives - Software Engineering Daily
3.8
3131 ratings
Unbounded data streams create difficult challenges for our application architectures. The data never stops coming, and we are forced to assume that we will never know if or when we have seen all of our data. Some streaming systems give us the tools to deal partially with unbounded data streams, but we have to complement those streaming systems with batch processing, in a technique known as the Lambda Architecture.
Apache Beam is a unified model for defining and executing data processing workflows, and Frances Perry joins the show to explain how Beam provides a way for us to model our data processing, agnostic of whether we choose to run those workflows on Spark, Flink, or Google’s Dataflow.
Links
The post Apache Beam with Frances Perry appeared first on Software Engineering Daily.