Spark on Kubernetes

Chouaieb Nemri
7 min readJun 25, 2021

Introduction

Take your Spark Big Data workloads to the next level by leveraging the power and flexibility of Kubernetes.

In this article, we are going to learn why it may be relevant to use Spark on Kubernetes and how to do it.

For the sake of our demo we will be using a Minikube Cluster to run a basic Spark-Pi job.

Why use Spark on…

--

--