Could not index event to Elasticsearch action=update


(Elastic-for-me) #1

2019-01-14T12:42:10,098][WARN ][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {:status=>404, :action=>["update", {:_id=>"417050708", :_index=>"houston_jobs", :_type=>"doc", :routing=>nil, :_retry_on_conflict=>1}, #LogStash::Event:0x1e89489b], :response=>{"update"=>{"_index"=>"houston_jobs", "_type"=>"doc", "_id"=>"417050708", "status"=>404, "error"=>{"type"=>"document_missing_exception", "reason"=>"[doc][417050708]: document missing", "index_uuid"=>"JsdfNppxQVqs9Tb-mhv_Uw", "shard"=>"0", "index"=>"houston_jobs"}}}}

I have suddenly started getting this ? what is happening here.
I don't have action=>update in config file


(Elastic-for-me) #2

Fixed.

I had a one config file running every five min pulling data from database and inserting in to Elasticsearch
I had a another config file which was running once a hour and pulling different data and updating same index that I had created before. with same document_id. and both config was on same pipeline

I created two separate pipeline and error has gone away.