Documents are missing when processing bulk operation. Pushing 12000 records but in the response it shows only 6500. When looked in to elastic search logs, found the following information. Also verified all 12000 are unique interactions. So those missing are not update operation.
Please don't post images of text as they are hardly readable and not searchable.
Instead paste the text and format it with </> icon. Check the preview window.
[2018-04-20T08:35:25,971][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][23]]: segment writing can't keep up
[2018-04-20T08:35:25,971][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][12]]: segment writing can't keep up
[2018-04-20T08:35:25,971][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][13]]: segment writing can't keep up
[2018-04-20T08:35:25,971][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][30]]: segment writing can't keep up
[2018-04-20T08:35:25,971][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][64]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][40]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][24]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][46]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][28]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][19]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][25]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][18]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][68]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][61]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][54]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][59]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][16]]: segment writing can't keep up
[2018-04-20T08:35:25,978][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][29]]: segment writing can't keep up
[2018-04-20T08:35:25,979][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][35]]: segment writing can't keep up
[2018-04-20T08:35:25,979][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][11]]: segment writing can't keep up
[2018-04-20T08:35:25,979][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][34]]: segment writing can't keep up
[2018-04-20T08:35:25,979][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][49]]: segment writing can't keep up
[2018-04-20T08:35:25,979][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][56]]: segment writing can't keep up
[2018-04-20T08:35:30,980][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] now throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][14]]: segment writing can't keep up
[2018-04-20T08:35:35,981][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][14]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][16]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][29]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][68]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][61]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][11]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][40]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][23]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][25]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][64]]
[2018-04-20T08:35:35,982][INFO ][o.e.i.IndexingMemoryController] [Hun0Ov2] stop throttling indexing for shard [[fullhistory-bae39d21-6b9d-4456-9e5c-ce33c5dd7e08-2][46]]This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.