Cannot access kibana from browser

Trying to connect kibana (7.15.2) with Elasticsearch version 7.15.2

i have setup a cluster with 3 master nodes 2 data nodes(ebs attached)

elasticsearch config for 1 of the master node (elasticsearch.yml)

cluster.name: elkProd

node.name: master-1

#node.attr.rack: r1

path.data: /var/lib/elasticsearch

path.logs: /var/log/elasticsearch
node.roles: [ master ]
#bootstrap.memory_lock: true

network.host: [ "private ip" ]

http.port: 9200

discovery.seed_hosts: ["private-ip-master1","private-ip-master2","private-ip-master3"]
#discovery.zen.ping.unicast.hosts: ["private-ip-master1","private-ip-master2","private-ip-master3"]
discovery.zen.minimum_master_nodes: 2

cluster.initial_master_nodes: ["master-1", "master-2","master-3"]

#action.destructive_requires_name: true

elasticsearch config for 1 of the data node (elasticsearch.yml)

cluster.name: elkProd

node.name: data-1

#node.attr.rack: r1

path.data: /var/lib/elasticsearch

path.logs: /var/log/elasticsearch

node.roles: [ data ]
#bootstrap.memory_lock: true

network.host: [ "10.5.5.13" ]

http.port: 9200

#discovery.seed_hosts: ["host1", "host2"]
discovery.zen.ping.unicast.hosts: ["private-ip-master1","private-ip-master2","private-ip-master3"]
discovery.zen.minimum_master_nodes: 2

cluster.initial_master_nodes: ["master-1", "master-2","master-3"]

#action.destructive_requires_name: true

curl on es:- curl -X GET "http://private-ip-master1:9200/_cluster/health?pretty"
{
"cluster_name" : "elkProd",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 5,
"number_of_data_nodes" : 2,
"active_primary_shards" : 8,
"active_shards" : 16,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0,
"task_max_waiting_in_queue_millis" : 0,
"active_shards_percent_as_number" : 100.0
}

Kibana configurations:- Running kibana server on master node 1 (Kibana.yml)

server.port: 5601
server.host: "0.0.0.0"

server.basePath: ""

server.rewriteBasePath: false

server.publicBaseUrl: ""

server.maxPayload: 1048576

server.name: "elkKibana"

elasticsearch.hosts: ["http:private-ip-master1//:9200", "http://private-ip-master2:9200", "http://private-ip-master3:9200"]

kibana.index: ".kibana"

kibana.defaultAppId: "home"

elasticsearch.username: "kibana_system"
elasticsearch.password: "pass"

elasticsearch.serviceAccountToken: "my_token"

server.ssl.enabled: false
server.ssl.certificate: /path/to/your/server.crt
server.ssl.key: /path/to/your/server.key

xpack.security.http.ssl.client_authentication in Elasticsearch is set to required.

elasticsearch.ssl.certificate: /path/to/your/client.crt
elasticsearch.ssl.key: /path/to/your/client.key

elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]

elasticsearch.ssl.verificationMode: full

elasticsearch.pingTimeout: 1500

elasticsearch.requestTimeout: 30000

elasticsearch.requestHeadersWhitelist: [ authorization ]

elasticsearch.customHeaders: {}

elasticsearch.shardTimeout: 30000

elasticsearch.logQueries: false

#pid.file: /run/kibana/kibana.pid

#logging.dest: stdout

#logging.silent: false

#logging.quiet: false

#logging.verbose: false

#ops.interval: 5000

#i18n.locale: "en"

Curl to kibana internal :-
curl -XGET http://private-ip-master1:5601/status -I

HTTP/1.1 200 OK
content-security-policy: script-src 'unsafe-eval' 'self'; worker-src blob: 'self'; style-src 'unsafe-inline' 'self'
x-content-type-options: nosniff
referrer-policy: no-referrer-when-downgrade
kbn-name: elkKibana
kbn-license-sig: ***********
content-type: text/html; charset=utf-8
cache-control: private, no-cache, no-store, must-revalidate
content-length: 144351
vary: accept-encoding
accept-ranges: bytes
Date: Wed, 27 Mar 2024 08:08:26 GMT
Connection: keep-alive
Keep-Alive: timeout=120

But when trying to open it on browser http://publicip-master-node-1:5601

Page is not opening....

Hi @Paras_Madaan,

You are using an old version of Elasticsearch and Kibana that is past EOL as per this guide. We would recommend upgrading to a supported version if you can.

Are you seeing any errors in the Kibana logs or browser developer console when accessing Kibana via the browser? What do you mean by the page isn't opening? Does the connection timeout?

message":"ResponseError: illegal_argument_exception: [illegal_argument_exception] Reason: node [master-3] does not have the [remote_cluster_client] role

Got the log saying server running at 0.0.0.0:5601

Getting Connection timeout.

Do you have Cross Cluster Replication (CCR) enabled? It looks like one of your nodes doesn't have the remote_cluster_client role. Can you try adding that role as per this related thread.

hi, i cant see any steps to add remote cluster client

added node.role[master,remote_cluster_client]

now hitting http://public-elastic-ip:5601 connection timeout no error on kibana
hitting http://0.0.0.0:5601 gives {"statusCode":503,"error":"Service Unavailable","message":"License is not available."}

CCR is a licensed feature, so that's why you're getting the license is not available error. Have you tried disabling CCR?