# Hadoop-Elasticsearch - Avro Support

**URL:** https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [July 7, 2015, 2:36pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050 "2015-07-07T14:36:09Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![ajaybhatnagar](https://avatars.discourse-cdn.com/v4/letter/a/aca169/32.png) [@ajaybhatnagar](https://discuss.elastic.co/u/ajaybhatnagar)
#### Post date: [July 7, 2015, 2:36pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050/1 "2015-07-07T14:36:09Z")

</div>

Hi,

I am looking into possible integration of Elasticsearch and Hadoop using es-hadoop. Would like to know if it can support Avro format from/to Hadoop and Elasticsearch ?

If yes, are there any requirements / plugins needed to support or some special configuration requirements.  
If it is not supported currently, are there any plans for this to be available ?

Thanks  
Ajay

---

<div class="post-metadata">

### Author: ![vijaym123](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/vijaym123/32/3590_2.png) [@vijaym123](https://discuss.elastic.co/u/vijaym123)
#### Post date: [July 8, 2015, 7:31am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050/2 "2015-07-08T07:31:33Z")

</div>

REGISTER piggybank.jar and read your Avro data and then Store it on your ES cluster with EsStorage!

Eg:

REGISTER piggybank.jar;  
records = LOAD '/input/data' USING org.apache.pig.piggybank.storage.avro.AvroStorage('no\_schema\_check',  
'schema\_file', 'examples/schema/test.avsc');  
STORE records INTO 'library/book' USING org.elasticsearch.hadoop.pig.EsStorage('es.http.timeout=5m','es.index.auto.create=false' );  
Cheers,  
Vijay

---

<div class="post-metadata">

### Author: ![ajaybhatnagar](https://avatars.discourse-cdn.com/v4/letter/a/aca169/32.png) [@ajaybhatnagar](https://discuss.elastic.co/u/ajaybhatnagar)
#### Post date: [July 8, 2015, 1:59pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050/3 "2015-07-08T13:59:37Z")

</div>

Thanks Vijay  
We will give it a try.  
Ajay

---

<div class="post-metadata">

### Author: ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)
#### Post date: [July 9, 2015, 9:27am UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050/4 "2015-07-09T09:27:04Z")

</div>

Thanks for the example @vijaym123. es-hadoop supports _any_ data format  
supported/available in Hadoop. As in the example below, simply use the  
appropriate `Storage`/`Input/OuputFormat`/`Loader` and you're set.  
This is consistent across all the libraries supported by the connector -  
Map/Reduce, Hive, Pig, Spark, Storm, etc...

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:28pm UTC](https://discuss.elastic.co/t/hadoop-elasticsearch-avro-support/25050/5 "2017-07-06T13:28:08Z")

</div>