Avoid partial success of bulk Ingests under load

Elastic Stack Elasticsearch
1

Under heavy loads we observed that few bulk ingests are returning status code of 200. But If we look at their response content, we see "errors=true". And out of 100 requests, few failed with 429 errors. So this is a partial success.

Is there any way to make sure that all requests pass or fail rather few pass few fail. So that I can retry the bulk again rather parsing the response and trying to resubmit for those failed alone?

2

No, different part are executed on different nodes so it is always possible to have partial failures. There is no atomicity for bulk requests.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.