Push Spark DataFrames to ElasticSearch index

Chouaieb Nemri
4 min readSep 7, 2021

Introduction

The aim of this short blog article is to show you how to migrate data from a Data source that you can connect to via Spark (HDFS for instance) to an ElasticSearch index by leveraging the Elastic-hadoop driver. We will start by a short presentation of ElasticSearch and Spark frameworks and the possible use cases of these two famous Data Engineering tools and then…

--

--