# Performance degradation when writing to AWS elasticsearch using elasticsearch-hadoop library

**URL:** <https://discuss.elastic.co/t/performance-degradation-when-writing-to-aws-elasticsearch-using-elasticsearch-hadoop-library/50298>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [May 18, 2016, 5:45am UTC](https://discuss.elastic.co/t/performance-degradation-when-writing-to-aws-elasticsearch-using-elasticsearch-hadoop-library/50298 "2016-05-18T05:45:05Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [July 28, 2016, 6:55pm UTC](https://discuss.elastic.co/t/performance-degradation-when-writing-to-aws-elasticsearch-using-elasticsearch-hadoop-library/50298/6 "2016-07-28T18:55:06Z")

</div>

@larghir The situation with keys being shuffled to one reducer is primarily a MapReduce case. A Spark RDD will write out to Elasticsearch in parallel using which ever number of partitions are configured. Writing parallelism does also depend on your RDD layout, your configuration, and the available resources in your environment.

---

_[View the full topic](https://discuss.elastic.co/t/performance-degradation-when-writing-to-aws-elasticsearch-using-elasticsearch-hadoop-library/50298)._
