# Elasticsearch-hadoop and Apache Storm integration

**URL:** <https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [June 14, 2016, 2:55pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751 "2016-06-14T14:55:58Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![adisajohnson](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@adisajohnson](https://discuss.elastic.co/u/adisajohnson)\
**Post date:** [June 14, 2016, 2:55pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751/1 "2016-06-14T14:55:58Z")

</div>

Hello there,

I am following [https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html) .

I am trying to write to elastic search using the ESBolt. The flow's topology consists of only 1 spout and 1 bolt  
builder.setSpout("spout", new RandomSentenceSpout(), 10);  
builder.setBolt("es-bolt", new EsBolt("storm/docs"), 5) .shuffleGrouping("spout");

with conf.put("es.index.auto.create", "true");

However, when i run the flow, no errors, no issues. I can see that it successfully created the storm/docs in es. However, it does not index anything.

Tried debugging through the code. Inside the TemplatedBulk.class, on one of the indexing request, i see that the write method is returning:

{"index":{}}  
{"word":"snow white and the seven dwarfs"}

Should the "index" entry be empty? Any suggestions on how to figure out what I am doing wrong?

Env info:  
hadoop: 2.4  
storm: .10  
ES: 2.3.3

thanks  
Adisa

---

<div class="post-metadata">

**Author:** ![adisajohnson](https://avatars.discourse-cdn.com/v4/letter/a/dfb087/32.png) [@adisajohnson](https://discuss.elastic.co/u/adisajohnson)\
**Post date:** [June 15, 2016, 1:32pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751/2 "2016-06-15T13:32:53Z")

</div>

hello there. anybody? @costin , @james.baiera any suggestions?

---

<div class="post-metadata">

**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Post date:** [June 15, 2016, 5:01pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751/3 "2016-06-15T17:01:00Z")

</div>

Hey there!

To give some wisdom on the bulk output - bulk data doesn't really need the index/type specified on it in this case because [that data is being provided as part of the resource path on the REST call](https://www.elastic.co/guide/en/elasticsearch/guide/current/bulk.html#_don_8217_t_repeat_yourself) that the connector makes.

As for why documents are not being indexed, I don't think there's enough information to go off of in the post. I would suggest double checking your mappings and index settings as a reasonable starting point.

Hope that helps!

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 16, 2016, 6:28am UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751/4 "2016-06-16T06:28:41Z")

</div>

FYI even the devs that answer on here do so on their own time, so please be patient 🙂

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-hadoop-and-apache-storm-integration/52751/5 "2017-07-06T13:24:19Z")

</div>