Kibana already restart

Ilya_21bA · June 7, 2021, 1:30pm

Kibana restarts for an unknown reason,
LOG:

 C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack"}
{"type":"log","@timestamp":"2021-06-07T13:22:29Z","tags":["debug","legacy-proxy"],"pid":16240,"message":"\"getConnections\" has been called."}
{"type":"log","@timestamp":"2021-06-07T13:22:29Z","tags":["plugin","debug"],"pid":16240,"path":"C:\\ELK\\kibana-7.1.1-windows-x86_64\\src\\legacy\\core_plugins\\apm_oss","message":"Found plugin at C:\\ELK\\kibana-7.1.1-windows-x86_64\\src\\legacy\\core_plugins\\apm_oss"}
{"type":"log","@timestamp":"2021-06-07T13:22:38Z","tags":["debug","config"],"pid":13756,"message":"Marking config path as handled: server"}
{"type":"log","@timestamp":"2021-06-07T13:22:38Z","tags":["debug","http"],"pid":13756,"message":"registering route handler for [/core]"}
{"type":"log","@timestamp":"2021-06-07T13:22:38Z","tags":["debug","root"],"pid":13756,"message":"starting root"}
{"type":"log","@timestamp":"2021-06-07T13:22:38Z","tags":["debug","config"],"pid":13756,"message":"Marking config path as handled: logging"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","server"],"pid":13756,"message":"starting server"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","http","server"],"pid":13756,"message":"starting http server"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","http","server"],"pid":13756,"message":"http server running at http://192.168.34.73:5601"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-service"],"pid":13756,"message":"Starting plugins service"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","config"],"pid":13756,"message":"Marking config path as handled: plugins"}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-discovery"],"pid":13756,"message":"Discovering plugins..."}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-discovery"],"pid":13756,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\bin\\src\\plugins\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-discovery"],"pid":13756,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\bin\\plugins\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-discovery"],"pid":13756,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\kibana-extra\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","plugins-service"],"pid":13756,"message":"Discovered 0 plugins."}
{"type":"log","@timestamp":"2021-06-07T13:22:39Z","tags":["debug","legacy-service"],"pid":13756,"message":"starting legacy service"}
{"type":"log","@timestamp":"2021-06-07T13:22:44Z","tags":["debug","config"],"pid":13756,"message":"Marking config path as handled: server"}
{"type":"log","@timestamp":"2021-06-07T13:23:21Z","tags":["plugin","debug"],"pid":13756,"path":"C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack","message":"Found plugin at C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack"}

And this pattern is repeated in the logs, Help Please/

rashmi · June 8, 2021, 4:26am

Hi,
Can you check both ES and Kibana logs as well? What version of the stack is running ? Is there a proxy running behind ?

Thanks
Rashmi

Ilya_21bA · June 8, 2021, 4:36am

Hi, this started after the system indexes were removed from the index management tab in the Kibana, v7.1.1

Ilya_21bA · June 8, 2021, 4:40am

no proxy

rashmi · June 8, 2021, 4:42am

Can you paste the elasticsearch.yml and kibana.yml with the ES n Kibana logs ?

Thanks

Ilya_21bA · June 8, 2021, 4:44am

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#
#cluster.name: my-application
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#
#node.name: node-1
#
# Add custom attributes to the node:
#
#node.attr.rack: r1
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
#path.data: /path/to/data
#
# Path to log files:
#
#path.logs: /path/to/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# Set the bind address to a specific IP (IPv4 or IPv6):
#
#network.host: 192.168.0.1
#
# Set a custom port for HTTP:
#
#http.port: 9200
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#
#discovery.seed_hosts: ["host1", "host2"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
#cluster.initial_master_nodes: ["node-1", "node-2"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Gateway -----------------------------------
#
# Block initial recovery after a full cluster restart until N nodes are started:
#
#gateway.recover_after_nodes: 3
#
# For more information, consult the gateway module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true

xpack.security.enabled: false   
xpack.security.transport.ssl.enabled: false

This Elastic yml

Ilya_21bA · June 8, 2021, 4:44am

# Kibana is served by a back end server. This setting specifies the port to use.
server.port: 5601

# Specifies the address to which the Kibana server will bind. IP addresses and host names are both valid values.
# The default is 'localhost', which usually means remote machines will not be able to connect.
# To allow connections from remote users, set this parameter to a non-loopback address.
server.host: 192.168.34.73

# Enables you to specify a path to mount Kibana at if you are running behind a proxy.
# Use the `server.rewriteBasePath` setting to tell Kibana if it should remove the basePath
# from requests it receives, and to prevent a deprecation warning at startup.
# This setting cannot end in a slash.
#server.basePath: ""

# Specifies whether Kibana should rewrite requests that are prefixed with
# `server.basePath` or require that they are rewritten by your reverse proxy.
# This setting was effectively always `false` before Kibana 6.3 and will
# default to `true` starting in Kibana 7.0.
#server.rewriteBasePath: false

# The maximum payload size in bytes for incoming server requests.
#server.maxPayloadBytes: 1048576

# The Kibana server's name.  This is used for display purposes.
#server.name: "your-hostname"


# The URLs of the Elasticsearch instances to use for all your queries.
#elasticsearch.hosts: ["http://localhost:9200"]

# When this setting's value is true Kibana uses the hostname specified in the server.host
# setting. When the value of this setting is false, Kibana uses the hostname of the host
# that connects to this Kibana instance.
#elasticsearch.preserveHost: true

# Kibana uses an index in Elasticsearch to store saved searches, visualizations and
# dashboards. Kibana creates a new index if the index doesn't already exist.
kibana.index: ".kibana"

# The default application to load.
#kibana.defaultAppId: "home"

# If your Elasticsearch is protected with basic authentication, these settings provide
# the username and password that the Kibana server uses to perform maintenance on the Kibana
# index at startup. Your Kibana users still need to authenticate with Elasticsearch, which
# is proxied through the Kibana server.
#elasticsearch.username: "kibana"
#elasticsearch.password: "12341234"

# Enables SSL and paths to the PEM-format SSL certificate and SSL key files, respectively.
# These settings enable SSL for outgoing requests from the Kibana server to the browser.
#server.ssl.enabled: false
#server.ssl.certificate: /path/to/your/server.crt
#server.ssl.key: /path/to/your/server.key

# Optional settings that provide the paths to the PEM-format SSL certificate and key files.
# These files validate that your Elasticsearch backend uses the same key files.
#elasticsearch.ssl.certificate: /path/to/your/client.crt
#elasticsearch.ssl.key: /path/to/your/client.key

# Optional setting that enables you to specify a path to the PEM file for the certificate
# authority for your Elasticsearch instance.
#elasticsearch.ssl.certificateAuthorities: [ "/path/to/your/CA.pem" ]

# To disregard the validity of SSL certificates, change this setting's value to 'none'.
#elasticsearch.ssl.verificationMode: full

# Time in milliseconds to wait for Elasticsearch to respond to pings. Defaults to the value of
# the elasticsearch.requestTimeout setting.
#elasticsearch.pingTimeout: 1500

# Time in milliseconds to wait for responses from the back end or Elasticsearch. This value
# must be a positive integer.
#elasticsearch.requestTimeout: 30000

# List of Kibana client-side headers to send to Elasticsearch. To send *no* client-side
# headers, set this value to [] (an empty list).
#elasticsearch.requestHeadersWhitelist: [ authorization ]

# Header names and values that are sent to Elasticsearch. Any custom headers cannot be overwritten
# by client-side headers, regardless of the elasticsearch.requestHeadersWhitelist configuration.
#elasticsearch.customHeaders: {}

# Time in milliseconds for Elasticsearch to wait for responses from shards. Set to 0 to disable.
#elasticsearch.shardTimeout: 30000

# Time in milliseconds to wait for Elasticsearch at Kibana startup before retrying.
#elasticsearch.startupTimeout: 5000

# Logs queries sent to Elasticsearch. Requires logging.verbose set to true.
elasticsearch.logQueries: true

# Specifies the path where Kibana creates the process ID file.
#pid.file: /var/run/kibana.pid

# Enables you specify a file where Kibana stores log output.
logging.dest: C:\ELK\kibana-7.1.1-windows-x86_64\bin\logs\kibana.log

# Set the value of this setting to true to suppress all logging output.
logging.silent: false

# Set the value of this setting to true to suppress all logging output other than error messages.
logging.quiet: false

# Set the value of this setting to true to log all events, including system usage information
# and all requests.
logging.verbose: true

# Set the interval in milliseconds to sample system and process performance
# metrics. Minimum is 100ms. Defaults to 5000.
#ops.interval: 5000

# Specifies locale to be used for all localizable strings, dates and number formats.
#i18n.locale: "en"


xpack.security.enable: false
#xpack.security.encryptionKey: "something_at_least_32_characters"
#elasticsearch.username: "kibana"
#elasticsearch.password: "12341234"

This Kibana

Ilya_21bA · June 8, 2021, 4:46am

Kibana Logs

C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack"}
{"type":"log","@timestamp":"2021-06-07T12:39:45Z","tags":["debug","legacy-proxy"],"pid":11888,"message":"\"getConnections\" has been called."}
{"type":"log","@timestamp":"2021-06-07T12:39:45Z","tags":["plugin","debug"],"pid":11888,"path":"C:\\ELK\\kibana-7.1.1-windows-x86_64\\src\\legacy\\core_plugins\\console","message":"Found plugin at C:\\ELK\\kibana-7.1.1-windows-x86_64\\src\\legacy\\core_plugins\\console"}
{"type":"log","@timestamp":"2021-06-07T12:39:48Z","tags":["debug","root"],"pid":11888,"message":"shutting root down"}
{"type":"log","@timestamp":"2021-06-07T12:39:55Z","tags":["debug","config"],"pid":16924,"message":"Marking config path as handled: server"}
{"type":"log","@timestamp":"2021-06-07T12:39:55Z","tags":["debug","http"],"pid":16924,"message":"registering route handler for [/core]"}
{"type":"log","@timestamp":"2021-06-07T12:39:55Z","tags":["debug","root"],"pid":16924,"message":"starting root"}
{"type":"log","@timestamp":"2021-06-07T12:39:55Z","tags":["debug","config"],"pid":16924,"message":"Marking config path as handled: logging"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","server"],"pid":16924,"message":"starting server"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","http","server"],"pid":16924,"message":"starting http server"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","http","server"],"pid":16924,"message":"http server running at http://192.168.34.73:5601"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-service"],"pid":16924,"message":"Starting plugins service"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","config"],"pid":16924,"message":"Marking config path as handled: plugins"}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-discovery"],"pid":16924,"message":"Discovering plugins..."}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-discovery"],"pid":16924,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\bin\\src\\plugins\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-discovery"],"pid":16924,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\bin\\plugins\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-discovery"],"pid":16924,"message":"Scanning \"C:\\ELK\\kibana-7.1.1-windows-x86_64\\kibana-extra\" for plugin sub-directories..."}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","plugins-service"],"pid":16924,"message":"Discovered 0 plugins."}
{"type":"log","@timestamp":"2021-06-07T12:39:56Z","tags":["debug","legacy-service"],"pid":16924,"message":"starting legacy service"}
{"type":"log","@timestamp":"2021-06-07T12:40:02Z","tags":["debug","config"],"pid":16924,"message":"Marking config path as handled: server"}
{"type":"log","@timestamp":"2021-06-07T12:40:30Z","tags":["plugin","debug"],"pid":16924,"path":"C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack","message":"Found plugin at 
C:\\ELK\\kibana-7.1.1-windows-x86_64\\node_modules\\x-pack"}

Ilya_21bA · June 8, 2021, 4:47am

This pattern already Continues

Ilya_21bA · June 8, 2021, 4:48am

This Elastic Logs

cluster.initial_master_nodes] must be configured
[2021-06-07T15:34:57,242][INFO ][o.e.c.c.Coordinator      ] [AGILEVLG-SRV-23] cluster UUID [lHj7X6mNQ7y3mI99N0MlYQ]
[2021-06-07T15:34:57,259][INFO ][o.e.c.c.ClusterBootstrapService] [AGILEVLG-SRV-23] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing master is discovered
[2021-06-07T15:34:57,492][INFO ][o.e.c.s.MasterService    ] [AGILEVLG-SRV-23] elected-as-master ([1] nodes joined)[{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{99G_WA8jQP61SfSykMkRiA}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 68746, version: 2658, reason: master node changed {previous [], current [{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{99G_WA8jQP61SfSykMkRiA}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20}]}
[2021-06-07T15:34:57,867][INFO ][o.e.c.s.ClusterApplierService] [AGILEVLG-SRV-23] master node changed {previous [], current [{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{99G_WA8jQP61SfSykMkRiA}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20}]}, term: 68746, version: 2658, reason: Publication{term=68746, version=2658}
[2021-06-07T15:34:58,166][INFO ][o.e.h.AbstractHttpServerTransport] [AGILEVLG-SRV-23] publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200}, {[::1]:9200}
[2021-06-07T15:34:58,166][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] started
[2021-06-07T15:34:58,805][INFO ][o.e.l.LicenseService     ] [AGILEVLG-SRV-23] license [d4e0e9c1-e77b-4f41-be86-79afa8cae0d4] mode [basic] - valid
[2021-06-07T15:34:58,821][INFO ][o.e.g.GatewayService     ] [AGILEVLG-SRV-23] recovered [8] indices into cluster_state
[2021-06-07T15:35:00,638][INFO ][o.e.c.r.a.AllocationService] [AGILEVLG-SRV-23] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[logstash-pikautotesttc12and5][0]] ...]).
[2021-06-07T15:48:22,815][INFO ][o.e.m.j.JvmGcMonitorService] [AGILEVLG-SRV-23] [gc][797] overhead, spent [371ms] collecting in the last [1s]
[2021-06-07T16:31:12,516][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] stopping ...
[2021-06-07T16:31:12,516][INFO ][o.e.x.w.WatcherService   ] [AGILEVLG-SRV-23] stopping watch service, reason [shutdown initiated]
[2021-06-07T16:31:12,907][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [AGILEVLG-SRV-23] [controller/9748] [Main.cc@148] Ml controller exiting
[2021-06-07T16:31:12,907][INFO ][o.e.x.m.p.NativeController] [AGILEVLG-SRV-23] Native controller process has stopped - no new native processes can be started
[2021-06-07T16:31:13,001][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] stopped
[2021-06-07T16:31:13,001][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closing ...
[2021-06-07T16:31:13,047][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closed
[2021-06-07T16:31:22,204][INFO ][o.e.e.NodeEnvironment    ] [AGILEVLG-SRV-23] using [1] data paths, mounts [[(c:)]], net usable_space [21.6gb], net total_space [126.6gb], types [NTFS]
[2021-06-07T16:31:22,239][INFO ][o.e.e.NodeEnvironment    ] [AGILEVLG-SRV-23] heap size [989.8mb], compressed ordinary object pointers [true]
[2021-06-07T16:31:22,454][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] node name [AGILEVLG-SRV-23], node ID [nZb0BalCR1SI3AtEeN8AXg], cluster name [elasticsearch]
[2021-06-07T16:31:22,454][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] version[7.1.1], pid[12692], build[default/zip/7a013de/2019-05-23T14:04:00.380842Z], OS[Windows Server 2012 R2/6.3/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_231/25.231-b11]
[2021-06-07T16:31:22,454][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] JVM home [C:\Program Files\Java\jre1.8.0_231]
[2021-06-07T16:31:22,454][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=C:\Users\BEZZBT~1\AppData\Local\Temp\elasticsearch, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Dio.netty.allocator.type=unpooled, -Delasticsearch, -Des.path.home=c:\ELK\elasticsearch-7.1.1, -Des.path.conf=c:\ELK\elasticsearch-7.1.1\config, -Des.distribution.flavor=default, -Des.distribution.type=zip, -Des.bundled_jdk=true, exit, abort, -Xms1024m, -Xmx1024m, -Xss1024k]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [aggs-matrix-stats]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [analysis-common]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [ingest-common]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [ingest-geoip]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [ingest-user-agent]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [lang-expression]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [lang-mustache]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [lang-painless]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [mapper-extras]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [parent-join]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [percolator]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [rank-eval]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [reindex]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [repository-url]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [transport-netty4]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-ccr]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-core]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-deprecation]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-graph]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-ilm]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-logstash]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-ml]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-monitoring]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-rollup]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-security]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-sql]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] loaded module [x-pack-watcher]
[2021-06-07T16:31:28,438][INFO ][o.e.p.PluginsService     ] [AGILEVLG-SRV-23] no plugins loaded
[2021-06-07T16:31:40,815][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [AGILEVLG-SRV-23] [controller/14944] [Main.cc@109] controller (64 bit): Version 7.1.1 (Build fd619a36eb77df) Copyright (c) 2019 Elasticsearch BV
[2021-06-07T16:31:44,095][INFO ][o.e.d.DiscoveryModule    ] [AGILEVLG-SRV-23] using discovery type [zen] and seed hosts providers [settings]
[2021-06-07T16:31:46,110][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] initialized
[2021-06-07T16:31:46,110][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] starting ...
[2021-06-07T16:31:46,672][INFO ][o.e.t.TransportService   ] [AGILEVLG-SRV-23] publish_address {127.0.0.1:9300}, bound_addresses {127.0.0.1:9300}, {[::1]:9300}
[2021-06-07T16:31:46,688][WARN ][o.e.b.BootstrapChecks    ] [AGILEVLG-SRV-23] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured
[2021-06-07T16:31:46,688][INFO ][o.e.c.c.Coordinator      ] [AGILEVLG-SRV-23] cluster UUID [lHj7X6mNQ7y3mI99N0MlYQ]
[2021-06-07T16:31:46,737][INFO ][o.e.c.c.ClusterBootstrapService] [AGILEVLG-SRV-23] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing master is discovered
[2021-06-07T16:31:46,969][INFO ][o.e.c.s.MasterService    ] [AGILEVLG-SRV-23] elected-as-master ([1] nodes joined)[{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{kfo3nmKmSW2-kLtsXfelVQ}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 68747, version: 2665, reason: master node changed {previous [], current [{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{kfo3nmKmSW2-kLtsXfelVQ}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20}]}
[2021-06-07T16:31:47,626][INFO ][o.e.c.s.ClusterApplierService] [AGILEVLG-SRV-23] master node changed {previous [], current [{AGILEVLG-SRV-23}{nZb0BalCR1SI3AtEeN8AXg}{kfo3nmKmSW2-kLtsXfelVQ}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=8589463552, xpack.installed=true, ml.max_open_jobs=20}]}, term: 68747, version: 2665, reason: Publication{term=68747, version=2665}
[2021-06-07T16:31:47,891][INFO ][o.e.h.AbstractHttpServerTransport] [AGILEVLG-SRV-23] publish_address {127.0.0.1:9200}, bound_addresses {127.0.0.1:9200}, {[::1]:9200}
[2021-06-07T16:31:47,891][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] started
[2021-06-07T16:31:48,516][INFO ][o.e.l.LicenseService     ] [AGILEVLG-SRV-23] license [d4e0e9c1-e77b-4f41-be86-79afa8cae0d4] mode [basic] - valid
[2021-06-07T16:31:48,563][INFO ][o.e.g.GatewayService     ] [AGILEVLG-SRV-23] recovered [8] indices into cluster_state
[2021-06-07T16:31:50,380][INFO ][o.e.c.r.a.AllocationService] [AGILEVLG-SRV-23] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[logstash-runstatus12][0], [logstash-pikautotesttc][0], [logstash-pikautotesttc12and5][0]] ...]).
[2021-06-07T16:52:29,431][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] stopping ...
[2021-06-07T16:52:29,463][INFO ][o.e.x.w.WatcherService   ] [AGILEVLG-SRV-23] stopping watch service, reason [shutdown initiated]
[2021-06-07T16:52:29,963][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [AGILEVLG-SRV-23] [controller/14944] [Main.cc@148] Ml controller exiting
[2021-06-07T16:52:29,963][INFO ][o.e.x.m.p.NativeController] [AGILEVLG-SRV-23] Native controller process has stopped - no new native processes can be started
[2021-06-07T16:52:30,994][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] stopped
[2021-06-07T16:52:30,994][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closing ...
[2021-06-07T16:52:31,041][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closed

warkolm · June 8, 2021, 4:53am

Based on the logs it looks like something is telling Elasticsearch to shut down, and then start back up;

Ilya_21bA:

[2021-06-07T16:31:13,001][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] stopped
[2021-06-07T16:31:13,001][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closing ...
[2021-06-07T16:31:13,047][INFO ][o.e.n.Node               ] [AGILEVLG-SRV-23] closed

Elasticsearch cannot just restart itself like that. Neither can Kibana.

FYI that reached EOL quite some time ago, please upgrade ASAP.

Ilya_21bA · June 8, 2021, 5:17am

Thanks you for your answer, And as for the update, you know that it is very scary to climb there, it works and works, there is quite little information on Russian portals, since I am from Russia, the loss of the ELK stack is unacceptable)))...

Ilya_21bA · June 8, 2021, 5:18am

We will be completely reinstalling everything...

system · July 6, 2021, 5:19am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Kibana Keeps Restarting for no apparent reason Kibana	2	715	November 25, 2019
Kibana keep restarting Kibana	3	1541	October 26, 2018
Kibana is not starting anymore Kibana	15	8976	November 29, 2017
Kibana stops running when tried to access with curl or browser Kibana	2	435	August 31, 2020
Kibana need to restart after a period of inactivity Kibana	3	214	July 16, 2021

Kibana already restart

Related Topics