One Click to Run Apache Spark as a Service on Kubernetes (DoK Day EU 2022) // Bo Yang - podcast episode cover

One Click to Run Apache Spark as a Service on Kubernetes (DoK Day EU 2022) // Bo Yang

May 27, 202210 min
--:--
--:--
Download Metacast podcast app
Listen to this episode in Metacast mobile app
Don't just listen to podcasts. Learn from them with transcripts, summaries, and chapters for every episode. Skim, search, and bookmark insights. Learn more

Episode description

https://go.dok.community/slack

https://dok.community/ 

From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE)

It is still challenging to run Apache Spark and other big data processing workload on Kubernetes, especially in large scale. People need to address various issues like resource isolation, queuing, and cost efficiency. This session will share details about those challenges and how to address them. We will also present a convenient (one-click) way to deploy Apache Spark on Kubernetes, and dramatically lower the barrier to use Spark.

Bo has been working in big data area for 10 years, and gained intensive experience of running Apache Spark in large scale while he worked in in Uber. In the Kubernetes era, he focuses on building world class Apache Spark Service, and making the tooling available to the Spark and Kubernetes communities.

For the best experience, listen in Metacast app for iOS or Android