Introduction

In this article, we are going to learn why it may be relevant to use Spark on Kubernetes and how to do it.

For the sake of our demo we will be using a Minikube Cluster to run a basic Spark-Pi job.

Why use Spark on…