Hello Team,
I am trying to install Elasticsearch on Kubernetes (1.24) version using the Elasticsearch(8.5.1) helm charts.
I was able to install the charts and pods are in running status but when i tried to access the elastic endpoint it gave me 504 error.
logs are as below
{"@timestamp":"2023-03-21T17:01:17.377Z", "log.level": "WARN", "message":"failed to connect to {elasticsearch-master-2}{Dvhvi77JRk2ZaCUPbOiIsA}{GyRzc6MZRQKvJh5BWfzJbA}{elasticsearch-master-2}{172.30.3.170}{172.30.3.170:9300}{cdhilmrstw}{ml.allocated_processors_double=2.0, ml.machine_memory=6442450944, xpack.installed=true, ml.max_jvm_size=2147483648, ml.allocated_processors=2} (tried [1] times)", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][generic][T#2]","log.logger":"org.elasticsearch.cluster.NodeConnectionsService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch","error.type":"org.elasticsearch.transport.ConnectTransportException","error.message":"[elasticsearch-master-2][172.30.3.170:9300] connect_exception","error.stack_trace":"org.elasticsearch.transport.ConnectTransportException: [elasticsearch-master-2][172.30.3.170:9300] connect_exception\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.transport.TcpTransport$ChannelsConnectedListener.onFailure(TcpTransport.java:1119)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.action.ActionListener.lambda$toBiConsumer$0(ActionListener.java:305)\n\tat org.elasticsearch.base@8.5.1/org.elasticsearch.core.CompletableContext.lambda$addListener$0(CompletableContext.java:33)\n\tat java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)\n\tat java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)\n\tat java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)\n\tat java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2194)\n\tat org.elasticsearch.base@8.5.1/org.elasticsearch.core.CompletableContext.completeExceptionally(CompletableContext.java:48)\n\tat org.elasticsearch.transport.netty4@8.5.1/org.elasticsearch.transport.netty4.Netty4TcpChannel.lambda$addListener$0(Netty4TcpChannel.java:63)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:710)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:623)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:586)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:995)\n\tat io.netty.common@4.1.77.Final/io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: 172.30.3.170/172.30.3.170:9300\nCaused by: java.net.ConnectException: Connection refused\n\tat java.base/sun.nio.ch.Net.pollConnect(Native Method)\n\tat java.base/sun.nio.ch.Net.pollConnectNow(Net.java:672)\n\tat java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:973)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:710)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:623)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:586)\n\tat io.netty.transport@4.1.77.Final/io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)\n\tat io.netty.common@4.1.77.Final/io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:995)\n\tat io.netty.common@4.1.77.Final/io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\n"}
{"@timestamp":"2023-03-21T17:01:17.576Z", "log.level": "INFO", "message":"elected-as-master ([2] nodes joined)[_FINISH_ELECTION_, {elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw} completing election, {elasticsearch-master-0}{qjD-5ozhSFeEk7jLJ7VzMQ}{7Ezgb53TRKmOfwJNsscamA}{elasticsearch-master-0}{172.30.49.161}{172.30.49.161:9300}{cdhilmrstw} completing election], term: 6, version: 73, delta: master node changed {previous [], current [{elasticsearch-master-0}{qjD-5ozhSFeEk7jLJ7VzMQ}{7Ezgb53TRKmOfwJNsscamA}{elasticsearch-master-0}{172.30.49.161}{172.30.49.161:9300}{cdhilmrstw}]}", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.service.MasterService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}
{"@timestamp":"2023-03-21T17:01:17.648Z", "log.level": "WARN", "message":"failing [elected-as-master ([2] nodes joined)[_FINISH_ELECTION_, {elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw} completing election, {elasticsearch-master-0}{qjD-5ozhSFeEk7jLJ7VzMQ}{7Ezgb53TRKmOfwJNsscamA}{elasticsearch-master-0}{172.30.49.161}{172.30.49.161:9300}{cdhilmrstw} completing election]]: failed to commit cluster state version [73]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][masterService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.service.MasterService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch","error.type":"org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException","error.message":"node is no longer master for term 6 while handling publication","error.stack_trace":"org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 6 while handling publication\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1426)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:476)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.MasterService.publishClusterStateUpdate(MasterService.java:367)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:304)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:170)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:110)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:148)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:825)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:257)\n\tat org.elasticsearch.server@8.5.1/org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:223)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\n"}
{"@timestamp":"2023-03-21T17:01:17.649Z", "log.level": "INFO", "message":"master node changed {previous [], current [{elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw}]}, term: 7, version: 73, reason: ApplyCommitRequest{term=7, version=73, sourceNode={elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw}{ml.allocated_processors_double=2.0, ml.machine_memory=6442450944, ml.max_jvm_size=2147483648, xpack.installed=true, ml.allocated_processors=2}}", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.service.ClusterApplierService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}
{"@timestamp":"2023-03-21T17:01:17.870Z", "log.level": "INFO", "message":"removed {{elasticsearch-master-2}{Dvhvi77JRk2ZaCUPbOiIsA}{GyRzc6MZRQKvJh5BWfzJbA}{elasticsearch-master-2}{172.30.3.170}{172.30.3.170:9300}{cdhilmrstw}}, term: 7, version: 74, reason: ApplyCommitRequest{term=7, version=74, sourceNode={elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw}{ml.allocated_processors_double=2.0, ml.machine_memory=6442450944, ml.max_jvm_size=2147483648, xpack.installed=true, ml.allocated_processors=2}}", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.service.ClusterApplierService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}
{"@timestamp":"2023-03-21T17:01:17.924Z", "log.level": "INFO", "message":"primary-replica resync completed with 0 operations", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][generic][T#3]","log.logger":"org.elasticsearch.index.shard.IndexShard","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch","tags":[" [.geoip_databases][0]"]}
{"@timestamp":"2023-03-21T17:01:18.020Z", "log.level": "INFO", "message":"Node [{elasticsearch-master-0}{qjD-5ozhSFeEk7jLJ7VzMQ}] is selected as the current health node.", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][management][T#2]","log.logger":"org.elasticsearch.health.node.selection.HealthNodeTaskExecutor","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}
{"@timestamp":"2023-03-21T17:01:22.373Z", "log.level": "WARN", "message":"timed out after [5s/5002ms] ([discovery.seed_resolver.timeout]=[5s]) resolving host [elasticsearch-master-headless]", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][generic][T#1]","log.logger":"org.elasticsearch.discovery.SeedHostsResolver","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}
{"@timestamp":"2023-03-21T17:04:07.968Z", "log.level": "INFO", "message":"added {{elasticsearch-master-2}{Dvhvi77JRk2ZaCUPbOiIsA}{R-aTlxgJSUGrWTgJsAdnjQ}{elasticsearch-master-2}{172.30.3.189}{172.30.3.189:9300}{cdhilmrstw}}, term: 7, version: 80, reason: ApplyCommitRequest{term=7, version=80, sourceNode={elasticsearch-master-1}{yQTZ61QYRfixYvLOX08CBQ}{RxBvUB4ESvazJeCAyvm34Q}{elasticsearch-master-1}{172.30.121.59}{172.30.121.59:9300}{cdhilmrstw}{ml.allocated_processors_double=2.0, ml.machine_memory=6442450944, ml.max_jvm_size=2147483648, xpack.installed=true, ml.allocated_processors=2}}", "ecs.version": "1.2.0","service.name":"ES_ECS","event.dataset":"elasticsearch.server","process.thread.name":"elasticsearch[elasticsearch-master-0][clusterApplierService#updateTask][T#1]","log.logger":"org.elasticsearch.cluster.service.ClusterApplierService","elasticsearch.cluster.uuid":"xoLQBtjQT_WpHwZTPqi6hA","elasticsearch.node.id":"qjD-5ozhSFeEk7jLJ7VzMQ","elasticsearch.node.name":"elasticsearch-master-0","elasticsearch.cluster.name":"elasticsearch"}[quote="Raman_Sawhney, post:1, topic:328276, full:true"]
Hello Team,
I am trying to install Elasticsearch on Kubernetes (1.24) version using the Elasticsearch(8.5.1) helm charts.
I was able to install the charts and pods are in running status but when i tried to access the elastic endpoint it gave me 504 error.
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
© 2020. All Rights Reserved - Elasticsearch
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.