# Is it possible to perform bulk insert from Spark to ElasticSearch?

**URL:** https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [July 8, 2015, 5:52pm UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174 "2015-07-08T17:52:51Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![diplomaticguru](https://avatars.discourse-cdn.com/v4/letter/d/e56c9b/32.png) [@diplomaticguru](https://discuss.elastic.co/u/diplomaticguru)
#### Post date: [July 8, 2015, 5:52pm UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174/1 "2015-07-08T17:52:51Z")

</div>

Is it possible perform bulk insert from Spark to ElasticSearch?

At the moment, I'm using the 'saveToEsWithMeta' method for upserting the data(JavaPairRDD). Is there a way to bulk insert using the \_bulk API? Are there any example that I could take a look?

---

<div class="post-metadata">

### Author: ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)
#### Post date: [July 9, 2015, 9:27am UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174/2 "2015-07-09T09:27:04Z")

</div>

All the writes in Elasticsearch-Hadoop (including Spark) are done using the  
bulk API underneath (through the REST protocol and thus use the `_bulk`  
endpoint). Whether you saving 1, 100 or 10K, the procedure is the same.  
Btw, I recommend spending some time reading the whole reference  
documentation as it covers the architecture pretty well and provides plenty  
of examples.

---

<div class="post-metadata">

### Author: ![diplomaticguru](https://avatars.discourse-cdn.com/v4/letter/d/e56c9b/32.png) [@diplomaticguru](https://discuss.elastic.co/u/diplomaticguru)
#### Post date: [July 9, 2015, 10:53am UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174/3 "2015-07-09T10:53:48Z")

</div>

Thank you @costin for your reply. I'll check out the document but were you referring to this; [https://github.com/elastic/elasticsearch-hadoop/blob/master/docs/src/reference/asciidoc/core/spark.adoc](https://github.com/elastic/elasticsearch-hadoop/blob/master/docs/src/reference/asciidoc/core/spark.adoc)

---

<div class="post-metadata">

### Author: ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)
#### Post date: [July 14, 2015, 6:33am UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174/4 "2015-07-14T06:33:05Z")

</div>

@diplomaticguru Why are you looking at the source and not the official, rendered doc which is available [here](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/spark.html)? The docs are mentioned in the Github readme and on the project homepage.

How did you come across es-hadoop ? It's an honest question since it looks like the reference documentation was not advertised enough and I'd like to address that.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:28pm UTC](https://discuss.elastic.co/t/is-it-possible-to-perform-bulk-insert-from-spark-to-elasticsearch/25174/5 "2017-07-06T13:28:04Z")

</div>


