# Bulk documents into Elasticsearch with pyspark

**URL:** https://discuss.elastic.co/t/bulk-documents-into-elasticsearch-with-pyspark/105443
**Category:** Elasticsearch
**Created:** [October 26, 2017, 2:56pm UTC](https://discuss.elastic.co/t/bulk-documents-into-elasticsearch-with-pyspark/105443 "2017-10-26T14:56:10Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![xavi23](https://avatars.discourse-cdn.com/v4/letter/x/db5fbb/32.png) [@xavi23](https://discuss.elastic.co/u/xavi23)
#### Post date: [October 26, 2017, 2:56pm UTC](https://discuss.elastic.co/t/bulk-documents-into-elasticsearch-with-pyspark/105443/1 "2017-10-26T14:56:10Z")

</div>

Hello,

I want to load a big document that contain many jsons into an existing index in elasticsearch with pyspark.

I have a dataframe and I try to load many jsons with this command:

dataframe.write.format("org.elasticsearch.spark.sql").option("es.nodes" ,ESnode).option("es.port" ,ESport).option("es.resource" ,ESresource)

ESnode= "endpoint-private"  
ESport="privateport"  
ESresource= "glue/glue"

The process not failed but not load any document.

How I can load a big document that contain many jsons into ES with pyspark?

Thanks.

King regards.

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [November 23, 2017, 2:56pm UTC](https://discuss.elastic.co/t/bulk-documents-into-elasticsearch-with-pyspark/105443/2 "2017-11-23T14:56:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.