Metricbeat VM Can't Connect To Elasticsearch On Different Device

Elastic Stack Beats
41

i tried to do .\metricbeat -e and it shows like this :

PS C:\Program Files\Metricbeat> .\metricbeat -e
{"log.level":"info","@timestamp":"2023-03-07T13:22:23.025+0700","log.origin":{"file.name":"instance/beat.go","file.line":724},"message":"Home path: [C:\\Program Files\\Metricbeat] Config path: [C:\\Program Files\\Metricbeat] Data path: [C:\\Program Files\\Metricbeat\\data] Logs path: [C:\\Program Files\\Metricbeat\\logs]","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:23.030+0700","log.origin":{"file.name":"instance/beat.go","file.line":732},"message":"Beat ID: 917c84f0-577a-4642-b3d8-390649267784","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-03-07T13:22:26.072+0700","log.logger":"add_cloud_metadata","log.origin":{"file.name":"add_cloud_metadata/provider_aws_ec2.go","file.line":81},"message":"read token request for getting IMDSv2 token returns empty: Put \"http://169.254.169.254/latest/api/token\": context deadline exceeded (Client.Timeout exceeded while awaiting headers). No token in the metadata request will be used.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.074+0700","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1096},"message":"Beat info","service.name":"metricbeat","system_info":{"beat":{"path":{"config":"C:\\Program Files\\Metricbeat","data":"C:\\Program Files\\Metricbeat\\data","home":"C:\\Program Files\\Metricbeat","logs":"C:\\Program Files\\Metricbeat\\logs"},"type":"metricbeat","uuid":"917c84f0-577a-4642-b3d8-390649267784"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.074+0700","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1105},"message":"Build info","service.name":"metricbeat","system_info":{"build":{"commit":"9b77c2c135c228c2eedc310f6e975bb1a76169b1","libbeat":"8.6.2","time":"2023-02-12T04:40:35.000Z","version":"8.6.2"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.075+0700","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1108},"message":"Go runtime info","service.name":"metricbeat","system_info":{"go":{"os":"windows","arch":"amd64","max_procs":12,"version":"go1.18.10"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.097+0700","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1112},"message":"Host info","service.name":"metricbeat","system_info":{"host":{"architecture":"x86_64","boot_time":"2023-03-02T09:22:16+07:00","name":"Tw1cUser","ip":["fe80::9cb9:7063:f5be:1242/64","169.254.209.76/16","fe80::502f:773a:cb38:56fa/64","169.254.4.1/16","fe80::a51d:cb94:22d9:397c/64","192.168.20.13/24","fe80::9227:6f29:8f94:3619/64","169.254.147.137/16","fe80::854:99b4:e4b3:cbbe/64","169.254.6.26/16","::1/128","127.0.0.1/8"],"kernel_version":"10.0.22621.1265 (WinBuild.160101.0800)","mac":["5c:87:9c:bb:ae:b4","5e:87:9c:bb:ae:b3","f8:b4:6a:b4:9d:0e","5c:87:9c:bb:ae:b3","5c:87:9c:bb:ae:b7"],"os":{"type":"windows","family":"windows","platform":"windows","name":"Windows 11 Pro","version":"10.0","major":10,"minor":0,"patch":0,"build":"22621.1265"},"timezone":"+07","timezone_offset_sec":25200,"id":"6f9b31dc-538e-453f-9065-6df72f51ccaa"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.097+0700","log.logger":"beat","log.origin":{"file.name":"instance/beat.go","file.line":1141},"message":"Process info","service.name":"metricbeat","system_info":{"process":{"cwd":"C:\\Program Files\\Metricbeat","exe":"C:\\Program Files\\Metricbeat\\metricbeat.exe","name":"metricbeat.exe","pid":14884,"ppid":3712,"start_time":"2023-03-07T13:22:22.129+0700"},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:26.097+0700","log.origin":{"file.name":"instance/beat.go","file.line":296},"message":"Setup Beat: metricbeat; Version: 8.6.2","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"warn","@timestamp":"2023-03-07T13:22:28.448+0700","log.logger":"cfgwarn","log.origin":{"file.name":"tlscommon/config.go","file.line":102},"message":"DEPRECATED: Treating the CommonName field on X.509 certificates as a host name when no Subject Alternative Names are present is going to be removed. Please update your certificates if needed. Will be removed in version: 8.0.0","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.448+0700","log.logger":"esclientleg","log.origin":{"file.name":"eslegclient/connection.go","file.line":108},"message":"elasticsearch url: https://192.168.140.188:9200/","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.448+0700","log.logger":"publisher","log.origin":{"file.name":"pipeline/module.go","file.line":113},"message":"Beat name: Tw1cUser","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.673+0700","log.origin":{"file.name":"instance/beat.go","file.line":486},"message":"metricbeat start running.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.673+0700","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":145},"message":"Starting metrics logging every 30s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.678+0700","log.origin":{"file.name":"helper/privileges_windows.go","file.line":79},"message":"Metricbeat process and system info: {\"OSVersion\":{\"Major\":6,\"Minor\":2,\"Build\":9200},\"Arch\":\"amd64\",\"NumCPU\":12,\"User\":{\"SID\":\"S-1-5-21-274620106-4154477554-2475833221-1001\",\"Account\":\"weann\",\"Domain\":\"TW1CUSER\",\"Type\":1},\"ProcessPrivs\":{\"SeBackupPrivilege\":{\"enabled\":false},\"SeChangeNotifyPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreateGlobalPrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeCreatePagefilePrivilege\":{\"enabled\":false},\"SeCreateSymbolicLinkPrivilege\":{\"enabled\":false},\"SeDebugPrivilege\":{\"enabled\":true},\"SeDelegateSessionUserImpersonatePrivilege\":{\"enabled\":false},\"SeImpersonatePrivilege\":{\"enabled_by_default\":true,\"enabled\":true},\"SeIncreaseBasePriorityPrivilege\":{\"enabled\":false},\"SeIncreaseQuotaPrivilege\":{\"enabled\":false},\"SeIncreaseWorkingSetPrivilege\":{\"enabled\":false},\"SeLoadDriverPrivilege\":{\"enabled\":false},\"SeManageVolumePrivilege\":{\"enabled\":false},\"SeProfileSingleProcessPrivilege\":{\"enabled\":false},\"SeRemoteShutdownPrivilege\":{\"enabled\":false},\"SeRestorePrivilege\":{\"enabled\":false},\"SeSecurityPrivilege\":{\"enabled\":false},\"SeShutdownPrivilege\":{\"enabled\":false},\"SeSystemEnvironmentPrivilege\":{\"enabled\":false},\"SeSystemProfilePrivilege\":{\"enabled\":false},\"SeSystemtimePrivilege\":{\"enabled\":false},\"SeTakeOwnershipPrivilege\":{\"enabled\":false},\"SeTimeZonePrivilege\":{\"enabled\":false},\"SeUndockPrivilege\":{\"enabled\":false}}}","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.678+0700","log.origin":{"file.name":"helper/privileges_windows.go","file.line":87},"message":"SeDebugPrivilege is enabled. SeDebugPrivilege=(Enabled)","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.699+0700","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":195},"message":"Total metrics","service.name":"metricbeat","monitoring":{"metrics":{"beat":{"cpu":{"system":{"ticks":0,"time":{"ms":0}},"total":{"ticks":31,"time":{"ms":31},"value":31},"user":{"ticks":31,"time":{"ms":31}}},"info":{"ephemeral_id":"2483d9ef-533a-4bcf-b275-bb7bee980579","name":"metricbeat","uptime":{"ms":6530},"version":"8.6.2"},"memstats":{"gc_next":21932248,"memory_alloc":12226728,"memory_sys":38448552,"memory_total":37381352,"rss":64491520},"runtime":{"goroutines":37}},"libbeat":{"config":{"module":{"running":0,"starts":0,"stops":0},"reloads":0,"scans":0},"output":{"events":{"acked":0,"active":0,"batches":0,"dropped":0,"duplicates":0,"failed":0,"toomany":0,"total":0},"read":{"bytes":0,"errors":0},"type":"elasticsearch","write":{"bytes":0,"errors":0}},"pipeline":{"clients":0,"events":{"active":0,"dropped":0,"failed":0,"filtered":0,"published":0,"retry":0,"total":0},"queue":{"acked":0,"max_events":4096}}},"system":{"cpu":{"cores":12},"handles":{"open":253}}},"ecs.version":"1.6.0"}}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.700+0700","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":196},"message":"Uptime: 6.5323603s","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.700+0700","log.logger":"monitoring","log.origin":{"file.name":"log/log.go","file.line":163},"message":"Stopping metrics logging.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"info","@timestamp":"2023-03-07T13:22:28.700+0700","log.origin":{"file.name":"instance/beat.go","file.line":491},"message":"metricbeat stopped.","service.name":"metricbeat","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2023-03-07T13:22:28.700+0700","log.origin":{"file.name":"instance/beat.go","file.line":1071},"message":"Exiting: 1 error: metricset 'system/load' not found","service.name":"metricbeat","ecs.version":"1.6.0"}
Exiting: 1 error: metricset 'system/load' not found

for this, i don't use port 5601, i have changed kibana port to 5605

42

Apologies..

I have no clue what all is wrong...

metricbeat should take like 5 mins setup I can't explain all the issues...

Perhaps someone else will be able to help.

Good Luck!!

I would suggest you start over and follow the Quick Start Guide

43

Hi @stephenb
good news, I tried again to do .\metricbeat setup suddenly I could connect to Kibana Windows Server 2019, but the system data from my laptop didn't appear on the Kibana Windows Server 2019 dashboard.

PS C:\Program Files\Metricbeat> .\metricbeat test output
elasticsearch: https://192.168.140.188:9200/...
  parse url... OK
  connection...
    parse host... OK
    dns lookup... OK
    addresses: 192.168.140.188
    dial up... OK
  TLS...
    security: server's certificate chain verification is enabled
    handshake... OK
    TLS version: TLSv1.3
    dial up... OK
  talk to server... OK
  version: 8.6.2
PS C:\Program Files\Metricbeat> .\metricbeat setup
Index setup finished.
Loading dashboards (Kibana must be running and reachable)
Loaded dashboards

and i want ask about something.
i don't know why my metricbeat on windows server 2019 still send this on windows powershell:

[2023-03-07T15:17:42.396+07:00][INFO ][plugins.fleet] Fleet Usage: {"agents_enabled":true,"agents":{"total_enrolled":0,"healthy":0,"unhealthy":0,"offline":0,"total_all_statuses":0,"updating":0},"fleet_server":{"total_all_statuses":0,"total_enrolled":0,"healthy":0,"unhealthy":0,"offline":0,"updating":0,"num_host_urls":0}}
[2023-03-07T15:20:35.433+07:00][INFO ][status] Kibana is now degraded (was available)
[2023-03-07T15:20:41.089+07:00][INFO ][status] Kibana is now available (was degraded)
[2023-03-07T15:22:48.494+07:00][INFO ][status] Kibana is now degraded (was available)
[2023-03-07T15:22:53.271+07:00][INFO ][status] Kibana is now available (was degraded)
[2023-03-07T15:23:19.110+07:00][INFO ][status] Kibana is now degraded (was available)
[2023-03-07T15:23:23.576+07:00][INFO ][status] Kibana is now available (was degraded)
[2023-03-07T15:24:02.350+07:00][INFO ][status] Kibana is now degraded (was available)
[2023-03-07T15:24:07.834+07:00][INFO ][status] Kibana is now available (was degraded)
[2023-03-07T15:24:31.282+07:00][INFO ][plugins.ml] Task ML:saved-objects-sync-task: No ML saved objects in need of synchronization
44

I don't know what those logs are from again, when you only give me partial information I can't help.

What command is that from?
What component is is that from? I don't know. Those look like Kibana logs..

45

Hi @stephenb
that's command after i run kibana on windows server 2019.
if i run kibana from my laptop, not showing like that.

and why my system data from my laptop i can't see on kibana windows server 2019?
yesterday already loaded but when i check on kibana windows server 2019, showing my laptop hostname but no data system loaded

PS C:\Program Files\Metricbeat> .\metricbeat setup
Index setup finished.
Loading dashboards (Kibana must be running and reachable)
Loaded dashboards

and i following your instruction from this still not showing data system from my laptop to kibana windows server 2019

This is from Kibana Windows Server 2019 showing my laptop hostname but not data system show up.

image
image1920×1020 186 KB

46

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.