# Filebeat system module

**URL:** https://discuss.elastic.co/t/filebeat-system-module/150283
**Category:** Beats
**Tags:** filebeat
**Created:** [September 28, 2018, 3:56am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283 "2018-09-28T03:56:19Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![Tek\_Chand](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tek_chand/32/34318_2.png) [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)
#### Post date: [September 28, 2018, 3:56am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/1 "2018-09-28T03:56:19Z")

</div>

Hello Team,

I am using ELK 6.4.0 and Beats (Filebeat, Metricbeat) 6.4.0. Currently my architecture is Beat-\>Logstash-\>Elasticsearch-\>Kibana.

I am using Filebeat System module and ouput in filebeat.yml is logstash. In this case, logs are coming on kibana dashboard via system module. But logs are not showing in **Filebeat syslog and SSH dashboard.**

But when i am **replacing output logstash with elasticsearch** in filebeat.yml file then logs are coming on kibana dashboard as well as showing on Syslog and SSH filebeat dashboard.

is logstash unable to add those required fileds or something else?

I want to use logstash and Filebeat Syslog and SSH dashboard so that we can easily visualize the SSH loging attempt like success and failed with geolocation.

Please help me to troubleshoot the issue.

I am getting one more error when running the below command on filebeat server:

```auto
filebeat -e -modules=nginx -setup -E "output.elasticsearch.hosts=["http://localhost:9200"]"

```

**Error:**

```auto
ERROR	registrar/registrar.go:363	Writing of registry returned error: rename /var/lib/filebeat/registry.new /var/lib/filebeat/registry: no such file or directory. Continuing...

```

I have checked /var/lib/filebeat/registry file is present on the server.

Sorry, if it is not totally clear. In learning phase of ELK.

Thanks in advance.

---

<div class="post-metadata">

### Author: ![pierhugues](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pierhugues/32/48383_2.png) [@pierhugues](https://discuss.elastic.co/u/pierhugues)
#### Post date: [September 28, 2018, 12:59pm UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/2 "2018-09-28T12:59:30Z")

</div>

@Tek_Chand all of the modules inside Filebeat relies on the [ingest node](https://www.elastic.co/guide/en/elasticsearch/reference/6.4/ingest.html) which is an Elasticsearch feature to do the transformation on the original data. When you start Filebeat with a module we automatically configure the remote ingest pipeline for the transformation.

When you add Logstash between Filebeat and Elasticsearch you are losing capabilities that you have to either do one of the following:

- If you don't need Logstash just keep Filebeat -\> Elasticsearch
- Convert the [ingest pipeline](https://github.com/elastic/beats/tree/master/filebeat/module/system) found in the ingest directory into a Logstash pipeline manually or using the [migration tool](https://www.elastic.co/guide/en/logstash/current/ingest-converter.html).
- Configure the elasticsearch output with condition on your data to send the data to to the [ingest pipeline](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-pipeline).

It's still a bit more involved to add Logstash in the middle and we aim to provide a better path in the future.

---

<div class="post-metadata">

### Author: ![pierhugues](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pierhugues/32/48383_2.png) [@pierhugues](https://discuss.elastic.co/u/pierhugues)
#### Post date: [September 28, 2018, 1:00pm UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/3 "2018-09-28T13:00:38Z")

</div>

For the other error, what distribution are you running?  
Can you add the output of which filebeat to this thread?

---

<div class="post-metadata">

### Author: ![Tek\_Chand](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tek_chand/32/34318_2.png) [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)
#### Post date: [September 29, 2018, 6:31am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/4 "2018-09-29T06:31:55Z")

</div>

@Pier, Thanks for your response.

> [@pierhugues](#):
>
> For the other error, what distribution are you running?

I am running Ubuntu 16.04 and Filebeat version is 6.4.0.

> [@pierhugues](#):
>
> Can you add the output of which filebeat to this thread?

```auto
admin@xyz:~$ which filebeat
/usr/bin/filebeat

```

[https://www.elastic.co/guide/en/logstash/5.6/filebeat-modules.html](https://www.elastic.co/guide/en/logstash/5.6/filebeat-modules.html)

I am following above link so i can use logstash with filebeat module. And i am getting above error when running the command in first step.

But logs are reaching on Kibana dashboard from filebeat only getting single error when running the command in first step.

Thanks.

---

<div class="post-metadata">

### Author: ![Tek\_Chand](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tek_chand/32/34318_2.png) [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)
#### Post date: [October 1, 2018, 6:58am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/5 "2018-10-01T06:58:21Z")

</div>

@Pier, Can you please let me know the reason for above mentioned error? i,e

> [@Tek\_Chand](#):
>
> ERROR registrar/registrar.go:363 Writing of registry returned error: rename /var/lib/filebeat/registry.new /var/lib/filebeat/registry: no such file or directory. Continuing...

I have tested it on my testing environment but issue is not replicate there. But facing issue in my production environment.  
Thanks.

---

<div class="post-metadata">

### Author: ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)
#### Post date: [October 1, 2018, 7:04am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/6 "2018-10-01T07:04:20Z")

</div>

I would assume it's either an error related to access rights or the directory indeed does not exist.

---

<div class="post-metadata">

### Author: ![Tek\_Chand](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/tek_chand/32/34318_2.png) [@Tek\_Chand](https://discuss.elastic.co/u/Tek_Chand)
#### Post date: [October 1, 2018, 7:07am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/7 "2018-10-01T07:07:55Z")

</div>

@Rufflin, Thank you for your response.

Please find the current directory and permission:

```auto
root@xyz:/var/lib# ls -lah | grep file
drwxr-x--- 2 root root 4.0K Oct 1 07:05 filebeat
root@xyz:/var/lib/filebeat# ls -lah
total 16K
drwxr-x--- 2 root root 4.0K Oct 1 07:05 .
drwxr-xr-x 51 root root 4.0K Sep 5 06:11 ..
-rw------- 1 root root 48 Aug 6 10:30 meta.json
-rw------- 1 root root 717 Oct 1 07:05 registry

```

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 29, 2018, 7:07am UTC](https://discuss.elastic.co/t/filebeat-system-module/150283/8 "2018-10-29T07:07:56Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
