Please help

(Pankaj) #1

[elastic@elasticsearch elasticsearch] sudo systemctl status elasticsearch -l ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Mon 2018-12-10 03:55:01 EST; 2min 35s ago Docs: http://www.elastic.co Process: 81969 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -p {PID_DIR}/elasticsearch.pid --quiet (code=exited, status=1/FAILURE)
Main PID: 81969 (code=exited, status=1/FAILURE)

Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:219)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/java.nio.file.Files.newByteChannel(Files.java:373)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/java.nio.file.Files.newByteChannel(Files.java:424)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:420)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at java.base/java.nio.file.Files.newInputStream(Files.java:158)
Dec 10 03:55:01 elasticsearch.local elasticsearch[81969]: at org.elasticsearch.tools.launchers.JvmOptionsParser.main(JvmOptionsParser.java:60)
Dec 10 03:55:01 elasticsearch.local systemd[1]: elasticsearch.service: main process exited, code=exited, status=1/FAILURE
Dec 10 03:55:01 elasticsearch.local systemd[1]: Unit elasticsearch.service entered failed state.
Dec 10 03:55:01 elasticsearch.local systemd[1]: elasticsearch.service failed.

and kibana status

[elastic@elasticsearch elasticsearch]$ systemctl status kibana -l
● kibana.service - Kibana
Loaded: loaded (/etc/systemd/system/kibana.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Mon 2018-12-10 03:49:51 EST; 10min ago
Process: 81604 ExecStart=/usr/share/kibana/bin/kibana -c /etc/kibana/kibana.yml (code=exited, status=217/USER)
Main PID: 81604 (code=exited, status=217/USER)

Dec 10 03:49:51 elasticsearch.local systemd[1]: kibana.service: main process exited, code=exited, status=217/USER
Dec 10 03:49:51 elasticsearch.local systemd[1]: Unit kibana.service entered failed state.
Dec 10 03:49:51 elasticsearch.local systemd[1]: kibana.service failed.
Dec 10 03:49:51 elasticsearch.local systemd[1]: kibana.service holdoff time over, scheduling restart.
Dec 10 03:49:51 elasticsearch.local systemd[1]: Stopped Kibana.
Dec 10 03:49:51 elasticsearch.local systemd[1]: start request repeated too quickly for kibana.service
Dec 10 03:49:51 elasticsearch.local systemd[1]: Failed to start Kibana.
Dec 10 03:49:51 elasticsearch.local systemd[1]: Unit kibana.service entered failed state.
Dec 10 03:49:51 elasticsearch.local systemd[1]: kibana.service failed.

I'm not able to start both the services and currenlty version is 7

(Mark Walkom) #2

What do your actual Elasticsearch logs show?

(Pankaj) #3

Elasticsearch logs

[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-ml]
[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-monitoring]
[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-rollup]
[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-security]
[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-sql]
[2018-12-10T03:10:24,240][INFO ][o.e.p.PluginsService ] [elasticsearch.local] loaded module [x-pack-watcher]
[2018-12-10T03:10:24,241][INFO ][o.e.p.PluginsService ] [elasticsearch.local] no plugins loaded
[2018-12-10T03:10:33,308][INFO ][o.e.x.s.a.s.FileRolesStore] [elasticsearch.local] parsed [0] roles from file [/etc/elasticsearch/roles.yml]
[2018-12-10T03:10:36,743][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [elasticsearch.local] [controller/75660] [Main.cc@109] controller (64 bit): Version 7.0.1 (Build 6a88928693d862) Copyright (c) 2019 Elasticsearch BV
[2018-12-10T03:10:38,961][DEBUG][o.e.a.ActionModule ] [elasticsearch.local] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
[2018-12-10T03:10:40,326][INFO ][o.e.d.DiscoveryModule ] [elasticsearch.local] using discovery type [zen] and seed hosts providers [settings]
[2018-12-10T03:10:44,121][INFO ][o.e.n.Node ] [elasticsearch.local] initialized
[2018-12-10T03:10:44,122][INFO ][o.e.n.Node ] [elasticsearch.local] starting ...
[2018-12-10T03:10:44,858][INFO ][o.e.t.TransportService ] [elasticsearch.local] publish_address {127.0.0.1:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}
[2018-12-10T03:10:44,910][WARN ][o.e.b.BootstrapChecks ] [elasticsearch.local] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_master_nodes] must be configured
[2018-12-10T03:10:44,971][INFO ][o.e.c.c.ClusterBootstrapService] [elasticsearch.local] no discovery configuration found, will perform best-effort cluster bootstrapping after [3s] unless existing master is discovered
[2018-12-10T03:10:47,974][INFO ][o.e.c.c.Coordinator ] [elasticsearch.local] setting initial configuration to VotingConfiguration{BXhH-TIoS8qrKlhULvRG-Q}
[2018-12-10T03:10:48,312][INFO ][o.e.c.s.MasterService ] [elasticsearch.local] elected-as-master ([1] nodes joined)[{elasticsearch.local}{BXhH-TIoS8qrKlhULvRG-Q}{vvnMuNAWQhuDvD_1ROnKFA}{127.0.0.1}{127.0.0.1:9300}{ml.machine_memory=2906284032, xpack.installed=tru[2018-12-10T03:10:49,171][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elasticsearch.local] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-7-]
[2018-12-10T03:10:49,260][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elasticsearch.local] adding template [.monitoring-es] for index patterns [.monitoring-es-7-
]
[2018-12-10T03:10:49,326][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elasticsearch.local] adding template [.monitoring-beats] for index patterns [.monitoring-beats-7-]
[2018-12-10T03:10:49,406][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elasticsearch.local] adding template [.monitoring-alerts-7] for index patterns [.monitoring-alerts-7]
[2018-12-10T03:10:49,473][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elasticsearch.local] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-7-
]
[2018-12-10T03:10:49,541][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elasticsearch.local] adding index lifecycle policy [watch-history-ilm-policy]
[2018-12-10T03:10:49,732][INFO ][o.e.l.LicenseService ] [elasticsearch.local] license [ebb566ef-0441-4e9f-8176-13b7079fc1b1] mode [basic] - valid
[2018-12-10T03:19:02,492][INFO ][o.e.n.Node ] [elasticsearch.local] stopping ...
[2018-12-10T03:19:02,531][INFO ][o.e.x.w.WatcherService ] [elasticsearch.local] stopping watch service, reason [shutdown initiated]
[2018-12-10T03:19:02,604][INFO ][o.e.x.m.p.l.CppLogMessageHandler] [elasticsearch.local] [controller/75660] [Main.cc@148] Ml controller exiting
[2018-12-10T03:19:02,619][INFO ][o.e.x.m.p.NativeController] [elasticsearch.local] Native controller process has stopped - no new native processes can be started
[2018-12-10T03:19:02,628][INFO ][o.e.n.Node ] [elasticsearch.local] stopped
[2018-12-10T03:19:02,629][INFO ][o.e.n.Node ] [elasticsearch.local] closing ...
[2018-12-10T03:19:02,699][INFO ][o.e.n.Node ] [elasticsearch.local] closed

Kibana logs

[root@elasticsearch ~]# systemctl status kibana -l
● kibana.service - Kibana
Loaded: loaded (/etc/systemd/system/kibana.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Thu 2019-05-16 19:57:46 EDT; 2h 35min ago
Main PID: 4326 (code=exited, status=1/FAILURE)

May 16 19:57:46 elasticsearch.local systemd[1]: kibana.service holdoff time over, scheduling restart.
May 16 19:57:46 elasticsearch.local systemd[1]: Stopped Kibana.
May 16 19:57:46 elasticsearch.local systemd[1]: start request repeated too quickly for kibana.service
May 16 19:57:46 elasticsearch.local systemd[1]: Failed to start Kibana.
May 16 19:57:46 elasticsearch.local systemd[1]: Unit kibana.service entered failed state.
May 16 19:57:46 elasticsearch.local systemd[1]: kibana.service failed.
May 16 20:21:26 elasticsearch.local systemd[1]: [/etc/systemd/system/kibana.service:3] Unknown lvalue 'StartLimitIntervalSec' in section 'Unit'
May 16 20:21:26 elasticsearch.local systemd[1]: [/etc/systemd/system/kibana.service:4] Unknown lvalue 'StartLimitBurst' in section 'Unit'
May 16 21:25:49 elasticsearch.local systemd[1]: [/etc/systemd/system/kibana.service:3] Unknown lvalue 'StartLimitIntervalSec' in section 'Unit'
May 16 21:25:49 elasticsearch.local systemd[1]: [/etc/systemd/system/kibana.service:4] Unknown lvalue 'StartLimitBurst' in section 'Unit'

(Mark Walkom) #4

Please format your code/logs/config using the </> button, or markdown style back ticks. It helps to make things easy to read which helps us help you :slight_smile:

Basically that says the process started ok, but something then asked it to shutdown. Which it did.

(Pankaj) #5

Thanks for replying.
i read it somewhere but I'm not able to understand how to write that code within <> . Could you please show me how to use that with the code?

#6

I select the log and then click on </> to format the logs.

(Pankaj) #7

@elk11 I'm still not getting as i'm new in elk. and where do i have to change in configuration file.

(Pankaj) #8

Version 7

[root@elasticsearch elasticsearch]# systemctl status elasticsearch -l
● elasticsearch.service - Elasticsearch
Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Wed 2019-05-22 19:52:17 EDT; 6min ago
Docs: http://www.elastic.co
Process: 7125 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -p ${PID_DIR}/elasticsearch.pid --quiet (code=exited, status=1/FAILURE)
Main PID: 7125 (code=exited, status=1/FAILURE)

May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.cli.Command.main(Command.java:90)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
May 22 19:52:17 elasticsearch.local elasticsearch[7125]: Refer to the log for complete error details.
May 22 19:52:17 elasticsearch.local systemd[1]: elasticsearch.service: main process exited, code=exited, status=1/FAILURE
May 22 19:52:17 elasticsearch.local systemd[1]: Unit elasticsearch.service entered failed state.
May 22 19:52:17 elasticsearch.local systemd[1]: elasticsearch.service failed.

#9

I'm still not getting as i'm new in elk. and where do i have to change in configuration file.

If you are asking about code formatting, The code formatting on this forum has nothing to do with elasticsearch config file.

It's just that when you are copy pasting log/code/config files, Select the content and press </>

(Pankaj) #10
 ● elasticsearch.service - Elasticsearch

Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Wed 2019-05-22 19:59:41 EDT; 7s ago
Docs: http://www.elastic.co
Process: 7226 ExecStart=/usr/share/elasticsearch/bin/elasticsearch -p ${PID_DIR}/elasticsearch.pid --quiet (code=exited, status=1/FAILURE)
Main PID: 7226 (code=exited, status=1/FAILURE)

May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:150)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:86)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:124)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.cli.Command.main(Command.java:90)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:115)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:92)
May 22 19:59:41 elasticsearch.local elasticsearch[7226]: Refer to the log for complete error details.
May 22 19:59:41 elasticsearch.local systemd[1]: elasticsearch.service: main process exited, code=exited, status=1/FAILURE
May 22 19:59:41 elasticsearch.local systemd[1]: Unit elasticsearch.service entered failed state.
May 22 19:59:41 elasticsearch.local systemd[1]: elasticsearch.service failed.

(Pankaj) #11

(post withdrawn by author, will be automatically deleted in 24 hours unless flagged)