I have case where I am trying to do following.
job#:123, status:running, user:elastic → goes to job_index
in index _id = job#
case1:
check if _id:123 exist and status=running in job_index and if is then don’t do anything else create new record.
Case2: source = job#123, status:success, user:elastic
check if _id=123 and status=running , if yes, update record ( after this case, job:123 will never get it back from database)
I am going to use python to insert this to elastic index.
reason I am trying do this as I know create will first delete record and then insert it which is load on elastic cluster. but then query for hundreds of job from elastic is also load on cluster.
which one is better, update or search and do selective insert.?