Data on Kubernetes Community

The Challenges of Data Processing On Kubernetes - A look at Spark, Flink, Dask, and Ray // Holden Karau (DoK Day North America 2022)


Listen Later

From the DoK Day North America 2022 (https://youtu.be/YWTa-DiVljY)


ABSTRACT

This talk will go through both the improvements that have been made in Kubernetes for batch analytic workloads as well as some of the current pain experienced by users and developers moving their workloads to Kube. In this talk you will learn about how we “cheated” back in the YARN and Mesos days to make things go fast, why Kubernetes doesn’t like those cheats, and what some alternatives are.

...more
View all episodesView all episodes
Download on the App Store

Data on Kubernetes CommunityBy Data on Kubernetes Community


More shows like Data on Kubernetes Community

View all
Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners