# Missing in bulk response

**URL:** https://discuss.elastic.co/t/missing-in-bulk-response/9282
**Category:** Elasticsearch
**Created:** [October 9, 2012, 1:35am UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282 "2012-10-09T01:35:15Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![arta](https://avatars.discourse-cdn.com/v4/letter/a/aca169/32.png) [@arta](https://discuss.elastic.co/u/arta)
#### Post date: [October 9, 2012, 1:35am UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/1 "2012-10-09T01:35:15Z")

</div>

Hi,  
Often times I observe that Java BulkItemResponse does not contain some of documents I put in the corresponding BulkRequest.  
I don't see any error log in ES's log file.  
(I have action: DEBUG in logging.yml)

Please guide me where to look at.  
Thank you for your help.

---

<div class="post-metadata">

### Author: ![arta](https://avatars.discourse-cdn.com/v4/letter/a/aca169/32.png) [@arta](https://discuss.elastic.co/u/arta)
#### Post date: [October 10, 2012, 9:46pm UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/2 "2012-10-10T21:46:54Z")

</div>

I found on the client side, I have following error:  
ERROR; ... bulk request:org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for task.

This must be the reason why I don't see any document ids in the BulkResponse.

I don't see any corresponding errors/infos in any of elasticsearch data nodes.  
(my client is not a data node. it is a Java client node).

It is happening now and this time the error is only from one of my indices.  
(I issue bulk requests by index. I have 70+ indices.)

The other day, I saw the problem from some (but not all) indices.

Please help me where I should look at to investigate further.  
Thank you.

---

<div class="post-metadata">

### Author: ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)
#### Post date: [October 11, 2012, 7:46am UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/3 "2012-10-11T07:46:08Z")

</div>

Hiya

On Wed, 2012-10-10 at 14:46 -0700, arta wrote:

> I found on the client side, I have following error:  
> ERROR;[search.analyzer.ElasticSearchIndexer:303][BatchingQueue-timer] bulk  
> request:org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for  
> task.

How many documents (and of what size) are you bulk indexing in a single  
request?

> It is happening now and this time the error is only from one of my indices.  
> (I bulk requests by index. I have 70+ indices.)

70 indices running on how many nodes?

My guess would be:

1. passing too much data at once to bulk
2. running too many indices on too few nodes with not enough resources

clint

--

---

<div class="post-metadata">

### Author: ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)
#### Post date: [October 11, 2012, 2:58pm UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/4 "2012-10-11T14:58:07Z")

</div>

Also, it seems like the timeout is not coming from elasticsearch itself, but from the client library you are using? If its the Java client, do you execute the bulk with a timeout?

On Oct 11, 2012, at 12:46 AM, Clinton Gormley [clint@traveljury.com](mailto:clint@traveljury.com) wrote:

> Hiya
> 
> On Wed, 2012-10-10 at 14:46 -0700, arta wrote:
> 
> > I found on the client side, I have following error:  
> > ERROR;[search.analyzer.ElasticSearchIndexer:303][BatchingQueue-timer] bulk  
> > request:org.elasticsearch.ElasticSearchTimeoutException: Timeout waiting for  
> > task.
> 
> How many documents (and of what size) are you bulk indexing in a single  
> request?
> 
> > It is happening now and this time the error is only from one of my indices.  
> > (I bulk requests by index. I have 70+ indices.)
> 
> 70 indices running on how many nodes?
> 
> My guess would be:
> 
> 1. passing too much data at once to bulk
> 2. running too many indices on too few nodes with not enough resources
> 
> clint
> 
> --

--

---

<div class="post-metadata">

### Author: ![arta](https://avatars.discourse-cdn.com/v4/letter/a/aca169/32.png) [@arta](https://discuss.elastic.co/u/arta)
#### Post date: [October 11, 2012, 5:24pm UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/5 "2012-10-11T17:24:15Z")

</div>

Thank you for the replies, Clinton, Kimchy.

Here are answers to your questions:

> How many documents (and of what size) are you bulk indexing in a single request?

I limit up to 100 indexings or deletions in a bulk.

> 70 indices running on how many nodes?

I have 13 nodes.

> Also, it seems like the timeout is not coming from elasticsearch itself, but from the client library you are using? If its the Java client, do you execute the bulk with a timeout?

The exception is caught by my code. It is thrown by the following code:  
BulkRequestBuilder req = client.prepareBulk();  
req.add(...); // up to 100 times  
req.execute().actionGet(60000, TimeUnit.MILLISECONDS);

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 3:09am UTC](https://discuss.elastic.co/t/missing-in-bulk-response/9282/6 "2017-07-06T03:09:16Z")

</div>


