Hello Team
I am using Elasticsearch version 7.8.0 and Logstash 7.8.0.
I am trying to extract data from Elasticsearch index to csv file.
I am using a script to perform the activity for various different indexes created based on date format.
Whenever my script hits an Index name : myindex-2021-06-15
, and suppose this index does not exist in my elasticsearch cluster, logstash hangs on
Error: [404] {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [jcappdetails-2020-10-17]","resource.type":"index_or_alias","resource.id":"myindex-2021-06-15","index_uuid":"_na_","index":"myindex-2021-06-15"}],"type":"index_not_found_exception","reason":"no such index [myindex-2021-06-15]","resource.type":"index_or_alias","resource.id":"myindex-2021-06-15","index_uuid":"_na_","index":"myindex-2021-06-15"},"status":404}
Exception: Elasticsearch::Transport::Transport::Errors::NotFound
Stack: /mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:202:in `__raise_transport_error'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:319:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/http/manticore.rb:67:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/client.rb:131:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-api-5.0.5/lib/elasticsearch/api/actions/search.rb:183:in `search'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:321:in `search_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:269:in `do_run_slice'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:250:in `do_run'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:238:in `run'
/mnt/logstash-7.8.0/logstash-core/lib/logstash/java_pipeline.rb:345:in `inputworker'
/mnt/logstash-7.8.0/logstash-core/lib/logstash/java_pipeline.rb:336:in `block in start_input'
I expect logstash to move on after getting above error and not wait for my input of "CONTROL+C" to break it and perform below itself.
^C[2021-06-28T06:36:04,305][WARN ][logstash.runner ] SIGINT received. Shutting down.
[2021-06-28T06:36:05,158][INFO ][logstash.javapipeline ] Pipeline terminated {"pipeline.id"=>"main"}
[2021-06-28T06:36:05,206][INFO ][logstash.runner ] Logstash shut down.
Could you please help me to achieve logstash movement ahead after getting index is not available and not stuck and wait in there ...