Kibana starting with fatal error no such file

steves · November 28, 2022, 9:45pm

I just installed Kibana after getting Elasticsearch running (secure), both installed with apt, on an Ubuntu 22.04 Server.

I start Kibana with
systemctl start kibana.service or for debugging ./bin/kibana

which results in
<FATAL CLI ERROR Error: ENOENT: no such file or directory, open '/usr/share/kibana/config/kibana.yml'>

Which is a correct error, but per Elastic docs, as an apt install, it is supposed to look for /etc/kibana. I have also uninstalled, wiped the dirs and installed to ensure it was clean.

There is no 'config' dir anywhere. I tested using a symbolic link back to /etc/kibana to help it find kibana.yml but it comes down to not having the proper permissions due to either wrong runtime user or permissions assigned.

In other words the default install is not running. And I did configure the
server.host: "<-my-LAN-IP->" setting, which is the same as Elasticsearch is using.

stephenb · November 28, 2022, 10:18pm

Don't start Kibana like that it will not work, and certainly won't help debugging.

Start with

systemctl start kibana

Then per the docs look at the logs using to debug.

journalctl -u kibana.service

Post the logs perhaps we can hrlp

steves · November 28, 2022, 10:48pm

journalctl shows:
journalctl -u kibana.service Nov 27 11:27:43 we-regenerate systemd[1]: Started Kibana. Nov 27 11:27:45 we-regenerate kibana[25894]: FATAL CLI ERROR YAMLException: duplicated mapping key at line 199, column 1: Nov 27 11:27:45 we-regenerate kibana[25894]: elasticsearch.hosts: ['https://1 ...

Hmm, line 199. There are only 174 lines in kibana.yml.

After ['https://1 is a digit 1, not l as in localhost. The IP does start with a one...

stephenb · November 28, 2022, 11:45pm

Kibana uses

/etc/kibana/kibana.yml

perhaps post it...and more of the logs...and we might be able to figure it out.

steves · November 29, 2022, 7:30pm

Sure, the lines not commented out:

server.host: "10.125.65.210"
server.name: "your-hostname"

logging:
  appenders:
    file:
      type: file
      fileName: /var/log/kibana/kibana.log
      layout:
        type: json
  root:
    appenders:
      - default
      - file

pid.file: /run/kibana/kibana.pid

journalctl -u kibana.service
Started Kibana.
FATAL CLI ERROR YAMLException: duplicated mapping key at line 199, column 1:
elasticsearch.hosts: ['https://1 ...
^
at generateError (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:167:10)
at throwError (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:173:9)
at storeMappingPair (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:335:7)
at readBlockMapping (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1098:9)
at composeNode (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1359:12)
at readDocument (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1525:3)
at loadDocuments (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1588:5)
at load (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1614:19)
at safeLoad (/usr/share/kibana/node_modules/js-yaml/lib/js-yaml/loader.js:1637:10)
at readYaml (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.j>
at getConfigFromFiles (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/rea>
at RawConfigService.loadConfig (/usr/share/kibana/node_modules/@kbn/config/target_node/sr>
at bootstrap (/usr/share/kibana/src/core/server/bootstrap.js:57:20)
at Command. (/usr/share/kibana/src/cli/serve/serve.js:216:11)
at Command. (/usr/share/kibana/src/cli/command.js:102:20)
at Command.listener (/usr/share/kibana/node_modules/commander/index.js:370:29)
at Command.emit (node:events:513:28)
at Command.parseArgs (/usr/share/kibana/node_modules/commander/index.js:892:12)
at Command.parse (/usr/share/kibana/node_modules/commander/index.js:642:21)
at Object. (/usr/share/kibana/src/cli/cli.js:49:9)
at Module._compile (node:internal/modules/cjs/loader:1155:14)
at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
at Module.load (node:internal/modules/cjs/loader:1033:32)
at Function.Module._load (node:internal/modules/cjs/loader:868:12)
at Module.require (node:internal/modules/cjs/loader:1057:19)
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-mid>
at require (node:internal/modules/cjs/helpers:103:18)
at Object. (/usr/share/kibana/src/cli/dist.js:16:1)
at Module._compile (node:internal/modules/cjs/loader:1155:14)
at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
at Module.load (node:internal/modules/cjs/loader:1033:32)
at Function.Module._load (node:internal/modules/cjs/loader:868:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
at node:internal/main/run_main_module:22:47
kibana.service: Main process exited, code=exited, status=1/FAILURE
kibana.service: Failed with result 'exit-code'.
kibana.service: Consumed 1.563s CPU time.
kibana.service: Scheduled restart job, restart counter is at 1.
Stopped Kibana.
kibana.service: Consumed 1.563s CPU time.
Started Kibana.

stephenb · November 29, 2022, 8:04pm

Hmm ...

Understood but it thinks there's more line so obviously there's more commented lines.

I've never seen that exact error. It's still pointing to a corrupt Kibana.yml

Perhaps there's some non-printable characters at the end? Perhaps make a copy of the file and and then a brand new kibana.yml from scratch and only put in those lines...

Or even as simple as

server.host: "10.125.65.210"
server.name: "your-hostname"

Leave out the other stuff.

Remove the file all together so you can still get the same error.

Did you install with any extra flags? How did you install?

Uninstall reinstall.

steves · November 30, 2022, 3:40pm

OK, renamed kibana.yml (which was created by the install) and created a new one with vim and copied and pasted the two lines you used and got the exact same message down to the execution time of 1.563s CPU time.

I had used apt to install both elasticsearch and kibana, no flag of any kind (see below).

I uninstalled, removed /etc/kibana/ and /usr/share/kibana/. Rebooted and then reinstalled using
apt install kibana

It installed kibana 8.5.2 (same ver as elasticsearch). That resulted in the exact same message down to the execution time according to diff.

That should not be as the date and time has changed from Jan 27 (above in prev msg) and journalctl -u kibana.service should show a different message with current date and time!

Date shows current time so that's working.

Elasticsearch query with curl -u elastic:<my-passwd> -k 'https://<my-lan-ip>:9200' returned the normal results.

/var/log/kibana remains empty.

apt's last entry:

Start-Date: 2022-11-30 09:42:01
Commandline: apt install kibana
Install: kibana:amd64 (8.5.2)
End-Date: 2022-11-30 09:42:12

dpkg.log:

2022-11-30 09:42:01 startup archives unpack
2022-11-30 09:42:02 install kibana:amd64 8.5.2 8.5.2
2022-11-30 09:42:02 status half-installed kibana:amd64 8.5.2
2022-11-30 09:42:12 status unpacked kibana:amd64 8.5.2
2022-11-30 09:42:12 startup packages configure
2022-11-30 09:42:12 configure kibana:amd64 8.5.2
2022-11-30 09:42:12 status unpacked kibana:amd64 8.5.2
2022-11-30 09:42:12 status half-configured kibana:amd64 8.5.2
2022-11-30 09:42:12 status installed kibana:amd64 8.5.2

syslog:

Nov 30 09:42:12 we-regenerate systemd[1]: Reloading.
Nov 30 09:42:12 we-regenerate systemd[1]: open-vm-tools.service: Service has no ExecStart=, ExecStop=, or SuccessAction=. Refusing.
Nov 30 09:42:12 we-regenerate systemd[1]: Started Kibana.
Nov 30 09:42:13 we-regenerate dbus-daemon[701]: [system] Activating via systemd: service name='org.freedesktop.PackageKit' unit='packagekit.service' requested by ':1.20' (uid=0 pid=1438 comm="/usr/bin/gdbus call --system --dest org.freedeskto" label="unconfined")
Nov 30 09:42:13 we-regenerate systemd[1]: Starting PackageKit Daemon...
Nov 30 09:42:13 we-regenerate PackageKit: daemon start
Nov 30 09:42:13 we-regenerate dbus-daemon[701]: [system] Successfully activated service 'org.freedesktop.PackageKit'
Nov 30 09:42:13 we-regenerate systemd[1]: Started PackageKit Daemon.
Nov 30 09:42:13 we-regenerate kibana[1411]: FATALÂ CLI ERROR Error: ENOENT: no such file or directory, open '/etc/kibana/kibana.yml'
Nov 30 09:42:13 we-regenerate kibana[1411]: at Object.openSync (node:fs:590:3)
Nov 30 09:42:13 we-regenerate kibana[1411]: at readFileSync (node:fs:458:35)
Nov 30 09:42:13 we-regenerate kibana[1411]: at readYaml (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:25:69)
Nov 30 09:42:13 we-regenerate kibana[1411]: at getConfigFromFiles (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:57:18)
Nov 30 09:42:13 we-regenerate kibana[1411]: at RawConfigService.loadConfig (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/raw_config_service.js:56:70)
Nov 30 09:42:13 we-regenerate kibana[1411]: at bootstrap (/usr/share/kibana/src/core/server/bootstrap.js:57:20)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command. (/usr/share/kibana/src/cli/serve/serve.js:216:11)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command. (/usr/share/kibana/src/cli/command.js:102:20)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command.listener (/usr/share/kibana/node_modules/commander/index.js:370:29)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command.emit (node:events:513:28)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command.parseArgs (/usr/share/kibana/node_modules/commander/index.js:892:12)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Command.parse (/usr/share/kibana/node_modules/commander/index.js:642:21)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Object. (/usr/share/kibana/src/cli/cli.js:49:9)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module.require (node:internal/modules/cjs/loader:1057:19)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)
Nov 30 09:42:13 we-regenerate kibana[1411]: message repeated 5 times: [ at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)]
Nov 30 09:42:13 we-regenerate kibana[1411]: at require (node:internal/modules/cjs/helpers:103:18)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Object. (/usr/share/kibana/src/cli/dist.js:16:1)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:13 we-regenerate kibana[1411]: at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
Nov 30 09:42:13 we-regenerate kibana[1411]: at node:internal/main/run_main_module:22:47
Nov 30 09:42:13 we-regenerate systemd[1]: kibana.service: Main process exited, code=exited, status=1/FAILURE
Nov 30 09:42:13 we-regenerate systemd[1]: kibana.service: Failed with result 'exit-code'.
Nov 30 09:42:13 we-regenerate systemd[1]: kibana.service: Consumed 1.658s CPU time.
Nov 30 09:42:16 we-regenerate systemd[1]: kibana.service: Scheduled restart job, restart counter is at 1.
Nov 30 09:42:16 we-regenerate systemd[1]: Stopped Kibana.
Nov 30 09:42:16 we-regenerate systemd[1]: kibana.service: Consumed 1.658s CPU time.
Nov 30 09:42:16 we-regenerate systemd[1]: Started Kibana.
Nov 30 09:42:18 we-regenerate kibana[1514]: FATALÂ CLI ERROR Error: ENOENT: no such file or directory, open '/etc/kibana/kibana.yml'
Nov 30 09:42:18 we-regenerate kibana[1514]: at Object.openSync (node:fs:590:3)
Nov 30 09:42:18 we-regenerate kibana[1514]: at readFileSync (node:fs:458:35)
Nov 30 09:42:18 we-regenerate kibana[1514]: at readYaml (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:25:69)
Nov 30 09:42:18 we-regenerate kibana[1514]: at getConfigFromFiles (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:57:18)
Nov 30 09:42:18 we-regenerate kibana[1514]: at RawConfigService.loadConfig (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/raw_config_service.js:56:70)
Nov 30 09:42:18 we-regenerate kibana[1514]: at bootstrap (/usr/share/kibana/src/core/server/bootstrap.js:57:20)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command. (/usr/share/kibana/src/cli/serve/serve.js:216:11)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command. (/usr/share/kibana/src/cli/command.js:102:20)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command.listener (/usr/share/kibana/node_modules/commander/index.js:370:29)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command.emit (node:events:513:28)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command.parseArgs (/usr/share/kibana/node_modules/commander/index.js:892:12)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Command.parse (/usr/share/kibana/node_modules/commander/index.js:642:21)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Object. (/usr/share/kibana/src/cli/cli.js:49:9)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module.require (node:internal/modules/cjs/loader:1057:19)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)
Nov 30 09:42:18 we-regenerate kibana[1514]: message repeated 5 times: [ at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)]
Nov 30 09:42:18 we-regenerate kibana[1514]: at require (node:internal/modules/cjs/helpers:103:18)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Object. (/usr/share/kibana/src/cli/dist.js:16:1)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:18 we-regenerate kibana[1514]: at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
Nov 30 09:42:18 we-regenerate kibana[1514]: at node:internal/main/run_main_module:22:47
Nov 30 09:42:18 we-regenerate systemd[1]: kibana.service: Main process exited, code=exited, status=1/FAILURE
Nov 30 09:42:18 we-regenerate systemd[1]: kibana.service: Failed with result 'exit-code'.
Nov 30 09:42:18 we-regenerate systemd[1]: kibana.service: Consumed 1.558s CPU time.
Nov 30 09:42:21 we-regenerate systemd[1]: kibana.service: Scheduled restart job, restart counter is at 2.
Nov 30 09:42:21 we-regenerate systemd[1]: Stopped Kibana.
Nov 30 09:42:21 we-regenerate systemd[1]: kibana.service: Consumed 1.558s CPU time.
Nov 30 09:42:21 we-regenerate systemd[1]: Started Kibana.
Nov 30 09:42:22 we-regenerate kibana[1524]: FATALÂ CLI ERROR Error: ENOENT: no such file or directory, open '/etc/kibana/kibana.yml'
Nov 30 09:42:22 we-regenerate kibana[1524]: at Object.openSync (node:fs:590:3)
Nov 30 09:42:22 we-regenerate kibana[1524]: at readFileSync (node:fs:458:35)
Nov 30 09:42:22 we-regenerate kibana[1524]: at readYaml (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:25:69)
Nov 30 09:42:22 we-regenerate kibana[1524]: at getConfigFromFiles (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/read_config.js:57:18)
Nov 30 09:42:22 we-regenerate kibana[1524]: at RawConfigService.loadConfig (/usr/share/kibana/node_modules/@kbn/config/target_node/src/raw/raw_config_service.js:56:70)
Nov 30 09:42:22 we-regenerate kibana[1524]: at bootstrap (/usr/share/kibana/src/core/server/bootstrap.js:57:20)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command. (/usr/share/kibana/src/cli/serve/serve.js:216:11)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command. (/usr/share/kibana/src/cli/command.js:102:20)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command.listener (/usr/share/kibana/node_modules/commander/index.js:370:29)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command.emit (node:events:513:28)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command.parseArgs (/usr/share/kibana/node_modules/commander/index.js:892:12)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Command.parse (/usr/share/kibana/node_modules/commander/index.js:642:21)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Object. (/usr/share/kibana/src/cli/cli.js:49:9)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module.require (node:internal/modules/cjs/loader:1057:19)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)
Nov 30 09:42:22 we-regenerate kibana[1524]: message repeated 5 times: [ at Module.Hook._require.Module.require (/usr/share/kibana/node_modules/require-in-the-middle/index.js:101:39)]
Nov 30 09:42:22 we-regenerate kibana[1524]: at require (node:internal/modules/cjs/helpers:103:18)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Object. (/usr/share/kibana/src/cli/dist.js:16:1)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module._compile (node:internal/modules/cjs/loader:1155:14)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Object.Module._extensions..js (node:internal/modules/cjs/loader:1209:10)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Module.load (node:internal/modules/cjs/loader:1033:32)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Function.Module._load (node:internal/modules/cjs/loader:868:12)
Nov 30 09:42:22 we-regenerate kibana[1524]: at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
Nov 30 09:42:22 we-regenerate kibana[1524]: at node:internal/main/run_main_module:22:47
Nov 30 09:42:22 we-regenerate systemd[1]: kibana.service: Main process exited, code=exited, status=1/FAILURE
Nov 30 09:42:22 we-regenerate systemd[1]: kibana.service: Failed with result 'exit-code'.
Nov 30 09:42:22 we-regenerate systemd[1]: kibana.service: Consumed 1.552s CPU time.
Nov 30 09:42:25 we-regenerate systemd[1]: kibana.service: Scheduled restart job, restart counter is at 3.
Nov 30 09:42:25 we-regenerate systemd[1]: Stopped Kibana.
Nov 30 09:42:25 we-regenerate systemd[1]: kibana.service: Consumed 1.552s CPU time.
Nov 30 09:42:25 we-regenerate systemd[1]: kibana.service: Start request repeated too quickly.
Nov 30 09:42:25 we-regenerate systemd[1]: kibana.service: Failed with result 'exit-code'.
Nov 30 09:42:25 we-regenerate systemd[1]: Failed to start Kibana.
Nov 30 09:42:55 we-regenerate systemd[1]: kibana.service: Start request repeated too quickly.
Nov 30 09:42:55 we-regenerate systemd[1]: kibana.service: Failed with result 'exit-code'.
Nov 30 09:42:55 we-regenerate systemd[1]: Failed to start Kibana.

journalctl -u kibana.service still shows the log from Nov 27 so something must be wrong there.

Max disk use is 5% on 200G which could have been why journalctl did not update. I had rebooted the server before reinstalling. Restarted it with systemctl daemon-reload.

Haha, OK!

Nothing wrong with journalctl, it outputs to a function similar to less but hitting the End key does not result in jumping to the end, as it does in less. I had to use arrow down to reach the end which is totally up-to-date. The keys does however work the same as vim, which I had not considered up to this point.

Does not solve the kibana issue. Same after a pretty complete uninstall and reinstall.
Apt does report half-configured kibana, but maybe that's just a progress report.

stephenb · November 30, 2022, 4:46pm

That looks like a permission error... It can not find / open the file.
Can you do a ls -la on the /etc/kibana directory?

also per the docs apt install kibana should be
sudo apt-get update && sudo apt-get install kibana
which ensures the correct permissions get set.

I don't know what that means

journalctl -u kibana.service -f will follow I believe.

Not sure what your issue is,,

steves · November 30, 2022, 9:45pm

Kibana not starting.

(I'll redo the install but using apt-get, surprised they even have apt if it's not the same as apt-get.)

I do run update before any install, which I know I did not share with you.
sudo apt-get update && sudo apt-get install kibana.

This went better as it now does look for /etc/kibana/kibana.yml, though it could not find it. It did create the dir and put the two keystore files into it. I'll read the instructions to see what I'm supposed to do next.

ls -la /etc/kibana

-rw-rw---- 1 root kibana 130 Nov 30 16:16 kibana.keystore
-rw-r--r-- 1 root kibana 62 Nov 30 16:16 .kibana.keystore.initial_md5sum

The docs says it creates kibina.yml automatically. I created a new one with:

server.host: "10.125.65.210"
server.name: "your-hostname"

And added node.options:

--unhandled-rejections=warn

Kibana interface fired up and I'm logged in.

Last time I got here I added some integration and then it crashed after adding some integration module, don't recall which. This is when I did a completely new O/S install to ensure a clean start which resulted in me reaching out. Not knowing there's a diff between apt and apt-get is something I did not know so glad to learn that.

My next intention is to search Mariadb which I understand I need Logstash. Should I add any integrations first or just installLogstash?

stephenb · December 1, 2022, 1:41am

It depends on what you want to do .... if you to pull data from MariaDB and push into Elasticsearch that is logstash with the JDBC Connector.

Open a new thread on that ...

the difference between apt and apt-get not an expert but I say always follow the docs closely

A default comes with the packages and IF you do default install with security it will be appended to ... but it you are not using security it should leave it alone.

steves · December 1, 2022, 10:33am

@stephenb Thanks for your help!

system · December 29, 2022, 10:34am

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Kibana not running as a service Kibana	13	3198	April 27, 2023
Kibana service fails to start Kibana	7	30743	May 18, 2020
Kibana.crt, no such file or directory Kibana	2	1513	March 18, 2020
Kibana Service Failed to start Kibana	13	20033	August 20, 2019
Kibana is not starting anymore Kibana	15	8977	November 29, 2017

Kibana starting with fatal error no such file

Related Topics