Logstash Output to ES hosted on AWS, authentication not working


(Nathan Smith) #1

I've been trying to send my Logstash output to an Elasticsearch instance being hosted on AWS. Following the instructions here I've set up my conf file's output as the following:

output {
    elasticsearch {
        hosts => ["host_url"]
        index => "logstash-dev-device-data"
        document_type => "logstash-device-data"
        manage_template => true
        template => "./logstash_idx_mapping.json"
        template_name => "logstash_idx_mapping_template"
        user => "username"
        password => "${LOGSTASH_PASSWORD}"
    }
}

In kibana, I have a user set up with the username and password I'm passing in the config output above.
I'm still getting the following error

Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:main, :exception=>"LogStash::ConfigurationError", :message=>"Something is wrong with your configuration.", :backtrace=>["/usr/share/logstash/logstash-core/lib/logstash/config/mixin.rb:86:in 'config_init'"

Does anyone know what else I can try for this? Thanks!


(Christian Dahlqvist) #2

I believe AWS ES requires a separate, custom output plugin named amazon_es.


(Nathan Smith) #3

Thanks for the response Christian. This wasn't using AWS's specific ES service, but it turned out the issue was stemming from a change in my template path.


(system) closed #4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.