Logstash stucks if Index is not available

Hello Team

I am using Elasticsearch version 7.8.0 and Logstash 7.8.0.

I am trying to extract data from Elasticsearch index to csv file.

I am using a script to perform the activity for various different indexes created based on date format.

Whenever my script hits an Index name : myindex-2021-06-15 , and suppose this index does not exist in my elasticsearch cluster, logstash hangs on

  Error: [404] {"error":{"root_cause":[{"type":"index_not_found_exception","reason":"no such index [jcappdetails-2020-10-17]","resource.type":"index_or_alias","resource.id":"myindex-2021-06-15","index_uuid":"_na_","index":"myindex-2021-06-15"}],"type":"index_not_found_exception","reason":"no such index [myindex-2021-06-15]","resource.type":"index_or_alias","resource.id":"myindex-2021-06-15","index_uuid":"_na_","index":"myindex-2021-06-15"},"status":404}
  Exception: Elasticsearch::Transport::Transport::Errors::NotFound
  Stack: /mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:202:in `__raise_transport_error'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/base.rb:319:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/transport/http/manticore.rb:67:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-transport-5.0.5/lib/elasticsearch/transport/client.rb:131:in `perform_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/elasticsearch-api-5.0.5/lib/elasticsearch/api/actions/search.rb:183:in `search'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:321:in `search_request'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:269:in `do_run_slice'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:250:in `do_run'
/mnt/logstash-7.8.0/vendor/bundle/jruby/2.5.0/gems/logstash-input-elasticsearch-4.6.0/lib/logstash/inputs/elasticsearch.rb:238:in `run'
/mnt/logstash-7.8.0/logstash-core/lib/logstash/java_pipeline.rb:345:in `inputworker'
/mnt/logstash-7.8.0/logstash-core/lib/logstash/java_pipeline.rb:336:in `block in start_input'

I expect logstash to move on after getting above error and not wait for my input of "CONTROL+C" to break it and perform below itself.

^C[2021-06-28T06:36:04,305][WARN ][logstash.runner          ] SIGINT received. Shutting down.
[2021-06-28T06:36:05,158][INFO ][logstash.javapipeline    ] Pipeline terminated {"pipeline.id"=>"main"}
[2021-06-28T06:36:05,206][INFO ][logstash.runner          ] Logstash shut down.

Could you please help me to achieve logstash movement ahead after getting index is not available and not stuck and wait in there ...

Is my above description incomplete , due to which I am not getting any replies ...

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.