# Enable compression while indexing data using Hive/Elastic connector

**URL:** <https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [December 3, 2019, 1:49am UTC](https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265 "2019-12-03T01:49:28Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![sachinjose](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sachinjose/32/58679_2.png) [@sachinjose](https://discuss.elastic.co/u/sachinjose)\
**Post date:** [December 3, 2019, 1:49am UTC](https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265/1 "2019-12-03T01:49:29Z")

</div>

Hi Team,

We are using Hive/Elasticsearch(connector) for batch indexing data to ES, Can some one pls share the configs in the indexer side to enable compression(gzip/deflate) for the data in transit(bulk write) in order to reduce the network consumption during indexing time.

I am able to test enabling decompress data in the ES side.

Thanks,  
Sachin

---

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [December 4, 2019, 3:01pm UTC](https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265/2 "2019-12-04T15:01:37Z")

</div>

Unfortunately we do not support compressing data in ES-Hadoop at the moment due to restrictions with the client libraries that are used: [https://github.com/elastic/elasticsearch-hadoop/issues/804](https://github.com/elastic/elasticsearch-hadoop/issues/804).

Hopefully in the future though!

---

<div class="post-metadata">

**Author:** ![sachinjose](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sachinjose/32/58679_2.png) [@sachinjose](https://discuss.elastic.co/u/sachinjose)\
**Post date:** [December 4, 2019, 6:43pm UTC](https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265/3 "2019-12-04T18:43:37Z")

</div>

Thank you for the reply [james.baiera](https://discuss.elastic.co/u/james.baiera), Could you please suggest any alternate options like tweaking Spark ES indexing code or any other alternate approach ?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [January 1, 2020, 6:43pm UTC](https://discuss.elastic.co/t/enable-compression-while-indexing-data-using-hive-elastic-connector/210265/4 "2020-01-01T18:43:38Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.