KIBANA UI is not coming up even all services are UP Without any error in Logs

Dear Team

We are newly installing KIBANA Setup on new server,
After configuration of services all services are up From Backend also no any error observed in Elasticsearch/kibana logs ,but UI URL is not coming up we are getting error as below:

This site can’t be reached10.119.200.93 refused to connect.
Try:
Checking the connection
Checking the proxy and the firewall
ERR_CONNECTION_REFUSED

--> Please find our elasticsearch.yml & kibana.yml file as below:

elasticsearc.yml:

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
cluster.name: NIA_PP_ELK
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
node.name: ELKMONPP
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
path.data: /var/lib/elasticsearch
#
# Path to log files:
#
path.logs: /var/log/elasticsearch
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#
network.host: 10.119.200.93
#
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#
http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
discovery.seed_hosts: []
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ELKMONPP
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true
#
# ---------------------------------- Security ----------------------------------
#
#                                 *** WARNING ***
#
# Elasticsearch security features are not enabled by default.
# These features are free, but require configuration changes to enable them.
# This means that users don’t have to provide credentials and can get full access
# to the cluster. Network connections are also not encrypted.
#
# To protect your data, we strongly encourage you to enable the Elasticsearch security features.
# Refer to the following documentation for instructions.
#
# https://www.elastic.co/guide/en/elasticsearch/reference/7.16/configuring-stack-security.html
ingest.geoip.downloader.enabled: False

kibana.yml

# Kibana is served by a back end server. This setting specifies the port to use.
server.port: 8888

# Specifies the address to which the Kibana server will bind. IP addresses and host names are both valid values.
# The default is 'localhost', which usually means remote machines will not be able to connect.
# To allow connections from remote users, set this parameter to a non-loopback address.
server.host: "10.119.200.93"

# Enables you to specify a path to mount Kibana at if you are running behind a proxy.
# Use the `server.rewriteBasePath` setting to tell Kibana if it should remove the basePath
# from requests it receives, and to prevent a deprecation warning at startup.
# This setting cannot end in a slash.
#server.basePath: ""

# Specifies whether Kibana should rewrite requests that are prefixed with
# `server.basePath` or require that they are rewritten by your reverse proxy.
# This setting was effectively always `false` before Kibana 6.3 and will
# default to `true` starting in Kibana 7.0.
#server.rewriteBasePath: false

# Specifies the public URL at which Kibana is available for end users. If
# `server.basePath` is configured this URL should end with the same basePath.
#server.publicBaseUrl: ""

# The maximum payload size in bytes for incoming server requests.
#server.maxPayload: 1048576

# The Kibana server's name.  This is used for display purposes.
server.name: "ELKMONPP"

# The URLs of the Elasticsearch instances to use for all your queries.
elasticsearch.hosts:  ["http://10.119.200.93:9200"]

# Kibana uses an index in Elasticsearch to store saved searches, visualizations and
# dashboards. Kibana creates a new index if the index doesn't already exist.
#kibana.index: ".kibana"

# The default application to load.
#kibana.defaultAppId: "home"

# If your Elasticsearch is protected with basic authentication, these settings provide
# the username and password that the Kibana server uses to perform maintenance on the Kibana
# index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
# is proxied through the Kibana server.
#elasticsearch.username: "kibana_system"
#elasticsearch.password: "pass"

# Kibana can also authenticate to Elasticsearch via "service account tokens".
# If may use this token instead of a username/password.
# elasticsearch.serviceAccountToken: "my_token"

# Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
# These settings enable SSL for outgoing requests from the Kibana server to the browser.
#server.ssl.enabled: false
#server.ssl.certificate: /path/to/your/server.crt
#server.ssl.key: /path/to/your/server.key

# Optional settings that provide the paths to the PEM-format SSL certificate and key files.
# These files are used to verify the identity of Kibana to Elasticsearch and are required when
# xpack.security.http.ssl.client_authentication in Elasticsearch is set to required.
#elasticsearch.ssl.certificate: /path/to/your/client.crt
#elasticsearch.ssl.key: /path/to/your/client.key

# Optional setting that enables you to specify a path to the PEM file for the certificate
# authority for your Elasticsearch instance.
#elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]

# To disregard the validity of SSL certificates, change this setting's value to 'none'.
#elasticsearch.ssl.verificationMode: full

# Time in milliseconds to wait for Elasticsearch to respond to pings. Defaults to the value of
# the elasticsearch.requestTimeout setting.
#elasticsearch.pingTimeout: 1500

# Time in milliseconds to wait for responses from the back end or Elasticsearch. This value
# must be a positive integer.
#elasticsearch.requestTimeout: 30000

# List of Kibana client-side headers to send to Elasticsearch. To send *no* client-side
# headers, set this value to [] (an empty list).
#elasticsearch.requestHeadersWhitelist: [ authorization ]

# Header names and values that are sent to Elasticsearch. Any custom headers cannot be overwritten
# by client-side headers, regardless of the elasticsearch.requestHeadersWhitelist configuration.
#elasticsearch.customHeaders: {}

# Time in milliseconds for Elasticsearch to wait for responses from shards. Set to 0 to disable.
#elasticsearch.shardTimeout: 30000

# Logs queries sent to Elasticsearch. Requires logging.verbose set to true.
#elasticsearch.logQueries: false

# Specifies the path where Kibana creates the process ID file.
#pid.file: /run/kibana/kibana.pid

# Enables you to specify a file where Kibana stores log output.
#logging.dest: stdout

# Set the value of this setting to true to suppress all logging output.
#logging.silent: false

# Set the value of this setting to true to suppress all logging output other than error messages.
#logging.quiet: false

# Set the value of this setting to true to log all events, including system usage information
# and all requests.
#logging.verbose: false

# Set the interval in milliseconds to sample system and process performance
# metrics. Minimum is 100ms. Defaults to 5000.
#ops.interval: 5000

# Specifies locale to be used for all localizable strings, dates and number formats.
# Supported languages are the following: English - en , by default , Chinese - zh-CN .
#i18n.locale: "en"

Sorry if this sounds stupid but are you trying to connect at port 8888, right?

Do you really have no error messages from ES or Kibana logs?

yes we are trying to connect port 8888,& we are not getting any error in KIBANA/ELASTICSEARCH Logs

Have you tried to connect to Elasticsearch directly via curl or any other HTTP client from the same serer where Kibana is running to discard any connectivity issues?

It is weird that you don't get any errors from Kibana logs. Maybe you can try increasing the log level to get more details on what's happening.

Yeah, please try checking curl elasticsearch and kibana both, also enable verbose logging in kibana.yml to get detailed logs. Hope this helps!

After enabling verbose logging below logs are generated:

{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "spaces" at "/usr/share/kibana/x-pack/plugins/spaces""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "stackAlerts" at "/usr/share/kibana/x-pack/plugins/stack_alerts""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "taskManager" at "/usr/share/kibana/x-pack/plugins/task_manager""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "telemetryCollectionXpack" at "/usr/share/kibana/x-pack/plugins/telemetry_collection_xpack""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "timelines" at "/usr/share/kibana/x-pack/plugins/timelines""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "transform" at "/usr/share/kibana/x-pack/plugins/transform""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "translations" at "/usr/share/kibana/x-pack/plugins/translations""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "triggersActionsUi" at "/usr/share/kibana/x-pack/plugins/triggers_actions_ui""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "uiActionsEnhanced" at "/usr/share/kibana/x-pack/plugins/ui_actions_enhanced""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "upgradeAssistant" at "/usr/share/kibana/x-pack/plugins/upgrade_assistant""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "uptime" at "/usr/share/kibana/x-pack/plugins/uptime""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "watcher" at "/usr/share/kibana/x-pack/plugins/watcher""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins-discovery"],"pid":156742,"message":"Successfully discovered plugin "xpackLegacy" at "/usr/share/kibana/x-pack/plugins/xpack_legacy""}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins","advancedSettings"],"pid":156742,"message":""/usr/share/kibana/src/plugins/advanced_settings/server" does not export "config"."}
{"type":"log","@timestamp":"2024-02-23T15:21:13+05:30","tags":["debug","plugins","bfetch"],"pid":156742,"message":""/usr/share/kibana/src/plugins/bfetch/server" does not export "config"."}

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.