# Document missing when processing bulk operation **URL:** https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852 **Category:** Elasticsearch **Created:** [April 20, 2018, 10:22am UTC](https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852 "2018-04-20T10:22:22Z") **Posts on this page:** 4 **Page:** 1
### Author: ![Ganesh\_Ravikumar](https://avatars.discourse-cdn.com/v4/letter/g/dfb087/32.png) [@Ganesh\_Ravikumar](https://discuss.elastic.co/u/Ganesh_Ravikumar) #### Post date: [April 20, 2018, 10:22am UTC](https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852/1 "2018-04-20T10:22:23Z")
Documents are missing when processing bulk operation. Pushing 12000 records but in the response it shows only 6500. When looked in to elastic search logs, found the following information. Also verified all 12000 are unique interactions. So those missing are not update operation. ![54%20PM](https://us1.discourse-cdn.com/elastic/original/3X/d/8/d8e4fb18b00a7ebd88a571375529b49b55128201.png) ---
### Author: ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet) #### Post date: [April 20, 2018, 12:34pm UTC](https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852/2 "2018-04-20T12:34:49Z")
Please don't post images of text as they are hardly readable and not searchable. Instead paste the text and format it with `` icon. Check the preview window. ---
### Author: ![Ganesh\_Ravikumar](https://avatars.discourse-cdn.com/v4/letter/g/dfb087/32.png) [@Ganesh\_Ravikumar](https://discuss.elastic.co/u/Ganesh_Ravikumar) #### Post date: [April 20, 2018, 1:21pm UTC](https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852/3 "2018-04-20T13:21:24Z")
``` [2018-04-20T08:35:25,971][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][23]]: segment writing can't keep up [2018-04-20T08:35:25,971][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][12]]: segment writing can't keep up [2018-04-20T08:35:25,971][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][13]]: segment writing can't keep up [2018-04-20T08:35:25,971][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][30]]: segment writing can't keep up [2018-04-20T08:35:25,971][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][64]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][40]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][24]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][46]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][28]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][19]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][25]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][18]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][68]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][61]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][54]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][59]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][16]]: segment writing can't keep up [2018-04-20T08:35:25,978][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][29]]: segment writing can't keep up [2018-04-20T08:35:25,979][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][35]]: segment writing can't keep up [2018-04-20T08:35:25,979][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][11]]: segment writing can't keep up [2018-04-20T08:35:25,979][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][34]]: segment writing can't keep up [2018-04-20T08:35:25,979][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][49]]: segment writing can't keep up [2018-04-20T08:35:25,979][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][56]]: segment writing can't keep up [2018-04-20T08:35:30,980][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][14]]: segment writing can't keep up [2018-04-20T08:35:35,981][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][14]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][16]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][29]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][68]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][61]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][11]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][40]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][23]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][25]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][64]] [2018-04-20T08:35:35,982][INFO][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][46]] ``` ---
### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system) #### Post date: [May 18, 2018, 1:21pm UTC](https://discuss.elastic.co/t/document-missing-when-processing-bulk-operation/128852/4 "2018-05-18T13:21:33Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.