Connection refuse issue in Elasticsearch cluster

nuwan · November 18, 2018, 4:40pm

Hi All

I have setup 3 mode ELK cluster and it worked well. But recently I upgrade it to latest version now Elasticsearch service and kibana service working well but when I execute curl command to verify elasticsearch I got connection refuse and when i try to access kibana dashboard I got Following error on Browser
"Kibana server is not ready yet"
<Nov 18 11:24:54 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:54Z","tags":["warning","elasticsearch","data"],"pid":12759,"message":"No living connecti
Nov 18 11:24:54 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:54Z","tags":["license","warning","xpack"],"pid":12759,"message":"License information fro
Nov 18 11:24:56 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:56Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"Unable to revive
Nov 18 11:24:56 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:56Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"No living connect
Nov 18 11:24:58 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:58Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"Unable to revive
Nov 18 11:24:58 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:58Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"No living connect
Nov 18 11:24:58 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:58Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"Unable to revive
Nov 18 11:24:58 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:58Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"No living connect
Nov 18 11:24:59 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:59Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"Unable to revive
Nov 18 11:24:59 915423-Elastic1Prod.newfrontierdata.com kibana[12759]: {"type":"log","@timestamp":"2018-11-18T16:24:59Z","tags":["warning","elasticsearch","admin"],"pid":12759,"message":"No living connect /b>

warkolm · November 18, 2018, 7:38pm

Please show the command and the output.

Please check your Elasticsearch logs.

nuwan · November 19, 2018, 5:20am

Command is

curl http://172.24.32.209:9200

Output:
Last login: ඉ නෙවැ 18 11:33:43 EST 2018 on pts/8
[root@915423-Elastic1Prod ~]# curl http://172.24.32.209:9200
curl: (7) Failed connect to 172.24.32.209:9200; Connection refused
[root@915423-Elastic1Prod ~]#

2018-11-17T10:31:30,706][ERROR][o.e.b.Bootstrap ] [915423-Elastic1Prod.newfrontierdata.com] Exception java.lang.IllegalStateException: index and alias names need to be unique, but the following duplicates were found [.kibana (alias of [.kibana_2/PPiBvCj3QM2c9wyH-GPvgQ])] at org.elasticsearch.cluster.metadata.MetaData$Builder.build(MetaData.java:1111) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:72) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.gateway.GatewayMetaState.(GatewayMetaState.java:86) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.node.Node.(Node.java:499) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:212) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:212) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) [elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) [elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:127) [elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) [elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) [elasticsearch-cli-6.5.0.jar:6.5.0] at org.elasticsearch.cli.Command.main(Command.java:90) [elasticsearch-cli-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) [elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:86) [elasticsearch-6.5.0.jar:6.5.0] [2018-11-17T10:31:30,708][WARN ][o.e.b.ElasticsearchUncaughtExceptionHandler] [915423-Elastic1Prod.newfrontierdata.com] uncaught exception in thread [main] org.elasticsearch.bootstrap.StartupException: java.lang.IllegalStateException: index and alias names need to be unique, but the following duplicates were found [.kibana (alias of [.kibana_2/PPiBvCj3QM2c9wyH-GPvgQ])] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:140) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:127) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124) ~[elasticsearch-cli-6.5.0.jar:6.5.0] at org.elasticsearch.cli.Command.main(Command.java:90) ~[elasticsearch-cli-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:93) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:86) ~[elasticsearch-6.5.0.jar:6.5.0] Caused by: java.lang.IllegalStateException: index and alias names need to be unique, but the following duplicates were found [.kibana (alias of [.kibana_2/PPiBvCj3QM2c9wyH-GPvgQ])] at org.elasticsearch.cluster.metadata.MetaData$Builder.build(MetaData.java:1111) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.gateway.MetaStateService.loadFullState(MetaStateService.java:72) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.gateway.GatewayMetaState.(GatewayMetaState.java:86) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.node.Node.(Node.java:499) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.node.Node.(Node.java:265) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap$5.(Bootstrap.java:212) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:212) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:333) ~[elasticsearch-6.5.0.jar:6.5.0] at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:136) ~[elasticsearch-6.5.0.jar:6.5.0] ... 6 more

system · December 17, 2018, 5:30am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.