# Using Apache Spark for elasticsearch indexing

**URL:** <https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [August 12, 2016, 10:56am UTC](https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913 "2016-08-12T10:56:46Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![siddharth\_gupta](https://avatars.discourse-cdn.com/v4/letter/s/dec6dc/32.png) [@siddharth\_gupta](https://discuss.elastic.co/u/siddharth_gupta)\
**Post date:** [August 12, 2016, 10:56am UTC](https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913/1 "2016-08-12T10:56:46Z")

</div>

Hello,

I want to use apache spark for indexing in elasticsearch because it takes me 5-6 hours to index my 1400000 records.

Can anybody suggest a proper tutorial ?

Thanks,  
Siddharth

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [August 12, 2016, 10:59am UTC](https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913/2 "2016-08-12T10:59:21Z")

</div>

What exactly do you mean.

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 12, 2016, 11:28am UTC](https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913/3 "2016-08-12T11:28:52Z")

</div>

That sounds like very poor indexing performance. How large are your documents? Are you using bulk requests? If so, what is your bulk size? What is the specification of your cluster?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/using-apache-spark-for-elasticsearch-indexing/57913/4 "2017-07-06T13:23:42Z")

</div>