# Linux client data not visible on ELK server after

**URL:** https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521
**Category:** Beats
**Tags:** filebeat
**Created:** [May 16, 2023, 5:01am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521 "2023-05-16T05:01:05Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![jg23](https://avatars.discourse-cdn.com/v4/letter/j/ecae2f/32.png) [@jg23](https://discuss.elastic.co/u/jg23)
#### Post date: [May 16, 2023, 5:01am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/1 "2023-05-16T05:01:05Z")

</div>

Hi,

I recently installed the ELK stack on a Linux server running Ubuntu 22.04 using the following as a guide:

> **[How To Install Elasticsearch, Logstash, and Kibana (Elastic Stack) on Ubuntu...](https://www.digitalocean.com/community/tutorials/how-to-install-elasticsearch-logstash-and-kibana-elastic-stack-on-ubuntu-22-04)**
>
> In this tutorial, we will go over the installation of the Elastic Stack on an Ubuntu 22.04 server. You will learn how to install all of the components of the…

After the initial installation and setup, I've also been able to successfully send logs from 4 other linux clients to the server using the filebeats service with the system module enabled.

However one of my linux clients is no longer being detected on the ELK server. The issue occurred after applying a number of regular linux patches and rebooting the system.

I've at least checked the following:

- TCP port 5044 is accessible from the linux client
- The configuration files haven't changed as a result of the patching
- The filebeat service is running on the linux client
- There were no changes on the ELK server, i.e. all other linux clients are able to communicate with the server

Not sure where to go from here or which log files to examine (server and client end) to troubleshoot the issue.

Thanks,

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 18, 2023, 12:02am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/2 "2023-05-18T00:02:59Z")

</div>

What do the Filebeat logs show?

---

<div class="post-metadata">

### Author: ![jg23](https://avatars.discourse-cdn.com/v4/letter/j/ecae2f/32.png) [@jg23](https://discuss.elastic.co/u/jg23)
#### Post date: [May 18, 2023, 4:55am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/3 "2023-05-18T04:55:51Z")

</div>

Hi Mark,

I'm pasting a snippet of the filebeat logfile on the affected Linux client

```auto
.. snip ..
May 18 14:45:46 gitlab filebeat[154013]: 2023-05-18T14:45:46.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:46:15 gitlab filebeat[154013]: 2023-05-18T14:46:15.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:46:36 gitlab filebeat[154013]: 2023-05-18T14:46:36.492+1000 INFO [input.harvester] log/harvester.go:341 File is inactive. Closing be>
May 18 14:46:46 gitlab filebeat[154013]: 2023-05-18T14:46:46.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:47:16 gitlab filebeat[154013]: 2023-05-18T14:47:16.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:47:45 gitlab filebeat[154013]: 2023-05-18T14:47:45.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:48:15 gitlab filebeat[154013]: 2023-05-18T14:48:15.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:48:46 gitlab filebeat[154013]: 2023-05-18T14:48:46.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 14:49:15 gitlab filebeat[154013]: 2023-05-18T14:49:15.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s  

```

One noteable entry is the one shown below

```auto
May 18 14:46:36 gitlab filebeat[154013]: 2023-05-18T14:46:36.492+1000 INFO [input.harvester] log/harvester.go:341 File is inactive. Closing because close_inactive of 5m0s reached. {"input_id": "cd7c325a-e4c9-49d5-97c4-42044db652a6", "source": "/var/log/auth.log", "state_id": "native::132006-64768", "finished": false, "os_id": "132006-64768", "old_source": "/var/log/auth.log", "old_finished": true, "old_os_id": "132006-64768", "harvester_id": "e48b4ced-d160-43af-ad5a-12cad66a5e78"}

```

Other checks include:

- Checking the filebeat service is running

```auto
root@gitlab:~# systemctl status filebeat
● filebeat.service - Filebeat sends log files to Logstash or directly to Elasticsearch.
     Loaded: loaded (/lib/systemd/system/filebeat.service; enabled; vendor preset: enabled)
     Active: active (running) since Thu 2023-05-11 17:03:12 AEST; 6 days ago
       Docs: https://www.elastic.co/beats/filebeat
   Main PID: 154013 (filebeat)
      Tasks: 10 (limit: 9402)
     Memory: 43.0M
        CPU: 3min 16.698s
     CGroup: /system.slice/filebeat.service
             └─154013 /usr/share/filebeat/bin/filebeat --environment systemd -c /etc/filebeat/filebeat.yml --path.home /usr/share/filebeat --path.config /etc/filebeat --p>

May 18 14:49:15 gitlab filebeat[154013]: 2023-05-18T14:49:15.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s

```

- Checking that the elk server is accessible from the client on TCP port 5044

```auto
root@gitlab:~# telnet sys-elk 5044
.. snip ..
Connected to sys-elk.....
Escape character is '^]'.
^]

```

---

<div class="post-metadata">

### Author: ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)
#### Post date: [May 18, 2023, 5:23am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/4 "2023-05-18T05:23:49Z")

</div>

> [@jg23](#):
>
> One noteable entry is the one shown below

OK thanks, is there anything written to that log after that timestamp?

Can you share your Filebeat config?

---

<div class="post-metadata">

### Author: ![jg23](https://avatars.discourse-cdn.com/v4/letter/j/ecae2f/32.png) [@jg23](https://discuss.elastic.co/u/jg23)
#### Post date: [May 18, 2023, 6:07am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/5 "2023-05-18T06:07:13Z")

</div>

Hi Mark,

Yes it looks like the log file is still reporting activity after restarting the filebeat service:

```auto
May 18 15:38:46 gitlab filebeat[154013]: 2023-05-18T15:38:46.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 15:39:14 gitlab filebeat[154013]: 2023-05-18T15:39:14.767+1000 INFO [input.harvester] log/harvester.go:310 Harvester started for paths:>
May 18 15:39:16 gitlab filebeat[154013]: 2023-05-18T15:39:15.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 15:39:45 gitlab filebeat[154013]: 2023-05-18T15:39:45.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s      
.. snip ..
May 18 16:01:46 gitlab filebeat[154013]: 2023-05-18T16:01:45.999+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 16:02:16 gitlab filebeat[154013]: 2023-05-18T16:02:16.000+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s >
May 18 16:02:46 gitlab filebeat[154013]: 2023-05-18T16:02:46.001+1000 INFO [monitoring] log/log.go:184 Non-zero metrics in the last 30s

```

I'm pasting the filebeat config file (filtering out all the empty lines and comments):

```auto
filebeat.inputs:
- type: filestream
  id: my-filestream-id
  enabled: false
  paths:
    - /var/log/*.log
filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: false
setup.template.settings:
  index.number_of_shards: 1
setup.kibana:
output.logstash:
  hosts: ["sys-elk:5044"]
processors:
  - add_host_metadata:
      when.not.contains.tags: forwarded
  - add_cloud_metadata: ~
  - add_docker_metadata: ~
  - add_kubernetes_metadata: ~

```

Much appreciated,

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 15, 2023, 8:07am UTC](https://discuss.elastic.co/t/linux-client-data-not-visible-on-elk-server-after/333521/6 "2023-06-15T08:07:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
