Update old data from csv python

Elastic Stack Elasticsearch
1

I have a bunch of indices A,B,C,D containing large amounts of data per each let's say 50 million records per index and the record contains data as follows:

 user: amine, age: 22, state: Michigan

and I want to create a new index E and bulk new data into it from a csv file. What I hope for is that if a user from E already exists in one of the other indices but with different information for example:

  user: amine, age: 25, state: California

I want the user amine to be updated in all other indices with the new data.

2

Create index alias for all indices with writing index targetting E. Update by query , with query identifying the document of the user and doc as upsert parameter, will update the document if exists and create a new document to E if not exists.

You may consider using data stream if you have such situations some times.

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.