Bulk index if not exists

Elastic Stack Elasticsearch
1

I have the following document structure
{ "id": "977373", "name": "Air Odisha" }

I want to create documents in bulk only if id and name are not present already.

2

Welcome to our community! :smiley:

The closest thing would be an upsert.

3

You can specify the action in the bulk request to be create instead of index. This will create a new document and fail if the document already exists. There is an example in the docs.

1 Like
4

That upsert is based on _id of the document but I need to check the matching document based on two keys(id, name) of the document. So it's like I have to create thousands of documents in the ES and the condition is to create the documents only when there is no matching(id & name) in the ES for all the document to be inserted.

5

The you need to create the document id based on the two fields you mentioned.

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.