# Writing to Elasticsearch from Spark failing

**URL:** <https://discuss.elastic.co/t/writing-to-elasticsearch-from-spark-failing/238344>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [June 23, 2020, 9:33pm UTC](https://discuss.elastic.co/t/writing-to-elasticsearch-from-spark-failing/238344 "2020-06-23T21:33:35Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Biswajit.kundu](https://avatars.discourse-cdn.com/v4/letter/b/91b2a8/32.png) [@Biswajit.kundu](https://discuss.elastic.co/u/Biswajit.kundu)\
**Post date:** [June 23, 2020, 9:33pm UTC](https://discuss.elastic.co/t/writing-to-elasticsearch-from-spark-failing/238344/1 "2020-06-23T21:33:36Z")

</div>

Hi,  
Am trying to write to elastic search from Spark running on my local. I have a data frame df and am doing this

```auto
df.write.format("org.elasticsearch.spark.sql").option("es.nodes","abc-es.xyz.com").option("es.port","9200").option("es.mapping.id","id-field").mode("append").save("my_index_alias/doc")`

```

when I'm doing this specifying "es.nodes" to "localhost", its working fine and I can see documents on my local Elasticsearch. But I need to write to our actual Elasticsearch cluster.  
I am able to access the elastic search cluster when accessing it on browser "[https://abc-es.xyz.com](https://abc-es.xyz.com)",  
am seeing a json on browser with name, cluster-name,cluster-uuid, version, tagline.

But from Spark am getting

```auto
".. INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when processing request: Connection refused..
....
...
ERROR NetworkClient: Node [<IP of abc-es.xyz.com>:9200] failed (Connection refused...."

```

Any idea what could be the issue here??

Thanks

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 21, 2020, 9:33pm UTC](https://discuss.elastic.co/t/writing-to-elasticsearch-from-spark-failing/238344/2 "2020-07-21T21:33:39Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.