# How to debug filebeat module, it doesn't seem to be getting syslog data

**URL:** <https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [June 15, 2022, 4:15pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307 "2022-06-15T16:15:48Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 15, 2022, 4:15pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/1 "2022-06-15T16:15:48Z")

</div>

I'm trying to use the panw module receiving data via a syslog port. I've enabled the module and can see that filebeat is listening on the proper udp port. I can see traffic arrive in tcpdump and the events look valid.

I enabled debug logging in filebeat and I don't see anything that looks like an event arriving, so I don't know what else to check. Shouldn't a debug log show something when the input is received?

Thanks

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [June 15, 2022, 4:52pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/2 "2022-06-15T16:52:07Z")

</div>

Hi @rugenl  
Please Share Config and Logs  
Do you see filebeat reporting that is is listening on UDP port?  
You can also set the output to console to just eliminate variables.

```auto
output.console:
  pretty: true

```

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 16, 2022, 1:51pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/3 "2022-06-16T13:51:15Z")

</div>

The filebeat log shows it starts the udp listen:

> "Starting Syslog input","service.name":"filebeat","protocol":"udp"

It would be nice if it included a port number but netstat shows that the correct port is in use by filebeat.

This filebeat is using other modules, so I can't redirect the output to console, but I switched to a simple -type: syslog, without the panw module and it will index the "raw" syslog events.

The debug log doesn't show anything about the event until it publishes it. Is there a way to turn on debugging in the module? The doc shows how to enable logging in the publisher section, but doesn't seem to list any other sections. I'm just setting logging.level: debug in filebeat.yml.

Thanks

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [June 16, 2022, 2:09pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/4 "2022-06-16T14:09:43Z")

</div>

> [@rugenl](#):
>
> This filebeat is using other modules, so I can't redirect the output to console, but I switched to a simple -type: syslog, without the panw module and it will index the "raw" syslog events.

Interesting... Thoughts..

But I don't know a way to test just a module you could try `logging.level: trace`

If this is a unix system you could down load another filebeat.tar.gz to a temp directory and set it up and run to console / isolate.

Also you can run manually filebeat with the -d "\*" to look at the output messages or `-d "publisher"`

so you are not seeing and failed to index event messages? (pehaps failing at the ingest pipeline) did you change anything about the pipelines?

Did you run setup after you enabled the panw modules?

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 16, 2022, 2:25pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/5 "2022-06-16T14:25:42Z")

</div>

> [@stephenb](#):
>
> Did you run setup after you enabled the panw modules?

Yes, I did the setup and verified the ingest pipelines are loaded. I think that is all setup does, the datastreams are setup as verified by the -type: syslog test. I'm about 90% sure filebeat isn't trying to send the events to Elastic.

They are supposedly on PANOS 10.1, I can't find any comments in the module about version support.

I'll get to more testing when I get time. Thanks

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [June 16, 2022, 4:17pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/6 "2022-06-16T16:17:50Z")

</div>

From the [panw modules doc](https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-module-panw.html)

> ### 
> 
> Compatibility
> 
> This module has been tested with logs generated by devices running PAN-OS versions 7.1 to 9.0 but limited compatibility is expected for earlier versions.
> 
> The [ingest-geoip](https://www.elastic.co/guide/en/elasticsearch/plugins/8.2/ingest-geoip.html) Elasticsearch plugin is required to run this module.

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 16, 2022, 5:17pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/7 "2022-06-16T17:17:05Z")

</div>

I'm hoping that is just an outdated doc reference 🙂 PAN-OS 9.0 went out of support March 1, 2022. I'm willing to work on "fixing" the module for the new data format if that is needed, I just can't get to a point where I can see what is failing.

I'm just the syslog catcher on this, I don't know anything about PAN-OS that I haven't Googled today 🙂

Our prior ingest was done in logstash and was setup before modules and ingest pipelines were available. It was doing a csv split on the data, sending it to Elasticsearch, but was failing because some field that was mapped as an IP address was now text. The index failure was a clear message in the logstash log.

Thanks. stay tuned, I'm hoping to get back to this after chumming the daily sharks....

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [June 16, 2022, 5:21pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/8 "2022-06-16T17:21:44Z")

</div>

> [@rugenl](#):
>
> after chumming the daily sharks....

Swim Safe!

Yeah we just need the error... Yes if the ingest pipeline or actuall write is failing / typically you should be able to see that in the filebeat logs.

Once we get that we should be able to figure out.

I enabled the module and set -d "\*" and then just netcatted a message to the port and saw it send through to elastic I just sent "Hello World" and the pipeline did not fail etc...

Some reason thinking filebeat is not reading from the UDP or there is some other disconnect.

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 16, 2022, 6:48pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/9 "2022-06-16T18:48:04Z")

</div>

Well, this is embarrassing.... I'm amazed that I can read this:

> **`var.syslog_host`**  
> The interface to listen to UDP based syslog traffic. Defaults to `localhost`. Set to `0.0.0.0` to bind to all available interfaces.

As "Defaults to '0.0.0.0"... I was only listening on localhost, it's working now. It looks like some "types" are still failing, I know I'm not seeing "Threat" events, probably the same mapping error.

---

<div class="post-metadata">

**Author:** ![stephenb](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/stephenb/32/40856_2.png) [@stephenb](https://discuss.elastic.co/u/stephenb)\
**Post date:** [June 16, 2022, 7:24pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/10 "2022-06-16T19:24:42Z")

</div>

> [@rugenl](#):
>
> As "Defaults to '0.0.0.0"... I was only listening on localhost, it's working now. It looks like some "types" are still failing, I know I'm not seeing "Threat" events, probably the same mapping error.

Cool! and Doh! right 🙂

Let us know if you need help fixing the ingest pipeline but yeah probably a parsing / mapping error

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 14, 2022, 9:25pm UTC](https://discuss.elastic.co/t/how-to-debug-filebeat-module-it-doesnt-seem-to-be-getting-syslog-data/307307/11 "2022-07-14T21:25:28Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
