Data on Kubernetes Community

One Click to Run Apache Spark as a Service on Kubernetes (DoK Day EU 2022) // Bo Yang


Listen Later

https://go.dok.community/slack

https://dok.community/ 

From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE)

It is still challenging to run Apache Spark and other big data processing workload on Kubernetes, especially in large scale. People need to address various issues like resource isolation, queuing, and cost efficiency. This session will share details about those challenges and how to address them. We will also present a convenient (one-click) way to deploy Apache Spark on Kubernetes, and dramatically lower the barrier to use Spark.

Bo has been working in big data area for 10 years, and gained intensive experience of running Apache Spark in large scale while he worked in in Uber. In the Kubernetes era, he focuses on building world class Apache Spark Service, and making the tooling available to the Spark and Kubernetes communities.

...more
View all episodesView all episodes
Download on the App Store

Data on Kubernetes CommunityBy Data on Kubernetes Community


More shows like Data on Kubernetes Community

View all
Software Engineering Daily by Software Engineering Daily

Software Engineering Daily

621 Listeners