# Hortonworks distribution and ES 5.2

**URL:** https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [February 11, 2017, 12:38am UTC](https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729 "2017-02-11T00:38:20Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![eman](https://avatars.discourse-cdn.com/v4/letter/e/94ad74/32.png) [@eman](https://discuss.elastic.co/u/eman)
#### Post date: [February 11, 2017, 12:38am UTC](https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729/1 "2017-02-11T00:38:21Z")

</div>

We currently load data to ES using a Spark script running on a Hortonworks cluster HDP 2.4 (Spark 1.6). We have a new dev ES cluster 5.2. I got this error when running the same script to load the data to ES 5.2 cluster:

org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Unsupported/Unknown Elasticsearch version 5.2.0

I checked the latest Hortonworks distro, and it is also using Spark 1.6.

Any way to use Hortonworks with ES 5.2?

---

<div class="post-metadata">

### Author: ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [February 14, 2017, 8:45pm UTC](https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729/2 "2017-02-14T20:45:45Z")

</div>

@eman you will need to upgrade your version of ES-Hadoop to version 5.2.0. ES-Hadoop 5.2.0 is backwards compatible with earlier versions of Elasticsearch, so it should be fairly straightforward. Please also double check that there are no [breaking changes](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/breaking-changes.html) that may cause you issues during the upgrade.

---

<div class="post-metadata">

### Author: ![eman](https://avatars.discourse-cdn.com/v4/letter/e/94ad74/32.png) [@eman](https://discuss.elastic.co/u/eman)
#### Post date: [February 15, 2017, 7:53pm UTC](https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729/3 "2017-02-15T19:53:48Z")

</div>

Thanks for the tip @james.baiera . I ended up using ES Spark connector for Spark 1.3 to 1.6  
"org.elasticsearch" % "elasticsearch-spark-13\_2.10" % "5.2.0"

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [March 15, 2017, 7:53pm UTC](https://discuss.elastic.co/t/hortonworks-distribution-and-es-5-2/74729/4 "2017-03-15T19:53:51Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.