Need help on logstash scalability


(Anitha Raja) #1

With single logstash, all successfully running. But when I try to add another logstash, it throws error as below. Logstash pipeline started successfully but error on reaching elasticsearch. I have a elasticsearch cluster consists of one coordinating only node and 2 master eligible nodes. I am trying to reach coordinating only node(running on another machine) in my logstash output config.

[2018-10-01T10:09:17,924][INFO ][logstash.inputs.beats ] Beats inputs: Starting input listener {:address=>"0.0.0.0:5443"}

[2018-10-01T10:09:17,996][INFO ][logstash.pipeline ] Pipeline started successfully {:pipeline_id=>"main", :thread=>"#<Thread:0x70bb428a@/usr/share/logstash/logstash-core/lib/logstash/pipeline.rb:247 run>"}

[2018-10-01T10:09:18,025][INFO ][logstash.agent ] Pipelines running {:count=>1, :pipelines=>["main"]}

[2018-10-01T10:09:18,036][INFO ][org.logstash.beats.Server] Starting server on port: 5443

[2018-10-01T10:09:22,112][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://elastic:elastic@:9200/, :path=>"/"}

[2018-10-01T10:09:22,124][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://elastic:elastic@:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://elastic:elastic@:9200/][Manticore::ClientProtocolException] URI does not specify a valid host name: http:/"}

And my logstash config
output {
elasticsearch {
hosts => ["http://x.x.x.x:9200"]
user => elastic
password => elastic
sniffing => true
manage_template => false
index => "%{[@metadata][beat]}-%{[@metadata][version]}-%{+YYYY.MM.dd}"
}
}

If I execute locally it works --
curl -XGET "http://x.x.x.x:9200"
{
"name" : "adtoox-master",
"cluster_name" : "adtoox-cluster",
"cluster_uuid" : "XCuJPpPcQvyGw0WH1D_GNg",
"version" : {
"number" : "6.2.4",
"build_hash" : "ccec39f",
"build_date" : "2018-04-12T20:37:28.497551Z",
"build_snapshot" : false,
"lucene_version" : "7.2.1",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.