Lossing the rest documents when BulkIndexError occured

Elastic Stack Elasticsearch
1

I wanna know process of the rest documents when BulkIndexError occured.

official document says bulk process is indexing documents by each so there is no problem with rest docs, even if there is some indexerror on some documents.

But I think they are gone away because,
in my experience,
1. i got list[1000dicts] and each dict had unique ID.
2. I tried to bulk that list like below.

           try:
               helpers.bulk(es_client, documents)
           except elasticsearch.helpers.BulkIndexError as e:
               for error in e.errors:
                   with open(
                       error_file_path, "a",
                       encoding="utf-8",
                   ) as error_file:
                       json.dump(error, error_file, indent=4)

.
3. Finished bulking and there is 1 error log in json file.
4. But only 599 documents on my index.
5. I tried to bulk 999 documents except the one what is written on json
6. finally 999 documents on my index

My experience represent that bulking is not asynchronous right?
i suspect that bulking is indexing documents one by one synchronously and rest docs are gone if a bulkindexerror occured.

Am i wrong? or anyone knows about this issue

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.