# My custom module ignores pipeline

**URL:** https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946
**Category:** Beats
**Tags:** filebeat
**Created:** [November 30, 2018, 5:09pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946 "2018-11-30T17:09:19Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![gaetanoziri](https://avatars.discourse-cdn.com/v4/letter/g/8dc957/32.png) [@gaetanoziri](https://discuss.elastic.co/u/gaetanoziri)
#### Post date: [November 30, 2018, 5:09pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/1 "2018-11-30T17:09:19Z")

</div>

Hi,

I builded a custom module for my application following this [guide](https://www.elastic.co/guide/en/beats/devguide/current/filebeat-modules-devguide.html).

After the setup of this module i can see the messages form my module in kabana, but they are not parsed with my pipeline.

Below the steps that i did:

1. setup filebeat `.\filebeat.exe setup -e`

2. enable the module `.\filebeat.exe modules enable <mymodule>`

3. setup the module `.\filebeat.exe setup --modules <mymodule> -e`

Note, I tested my pipeline using API.

There are others steps to do?

Thanks,  
Gaetano

UPDATE:  
If I run the below commands it seems work correctly:

1. stop the filebeat service `Stop-Service filebeat`

2. disable the module `.\filebeat.exe modules disable <mymodule>`

3. run this command: `.\filebeat.exe -modules=<mymodule> -setup -e`

This behavior is really strange because the service is stopped, the module is disabled but in kibana i can see the messages correctly parsed.

---

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [December 3, 2018, 11:16pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/2 "2018-12-03T23:16:05Z")

</div>

When running `filebeat setup`, you should also pass `--pipelines` in order to install the ingest pipelines.

The later command not only setups, but also runs filebeat. This might have setup the module once the first event has been seen.

---

<div class="post-metadata">

### Author: ![gaetanoziri](https://avatars.discourse-cdn.com/v4/letter/g/8dc957/32.png) [@gaetanoziri](https://discuss.elastic.co/u/gaetanoziri)
#### Post date: [December 4, 2018, 9:57am UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/3 "2018-12-04T09:57:48Z")

</div>

> [@steffens](#):
>
> When running `filebeat setup` , you should also pass `--pipelines` in order to install the ingest pipelines.

The pipelines are installed, i can see the ingest pipelines if i run this http request `GET _ingest/pipeline/`.

However, i tryed to run `.\filebeat.exe setup --modules <mymodule> -e --pipelines` but the parsing still doesn't work.

---

<div class="post-metadata">

### Author: ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)
#### Post date: [December 5, 2018, 1:54pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/4 "2018-12-05T13:54:57Z")

</div>

Now you got me confused. So you say the module is enabled, ingest node pipeline is correctly installed, but filebeat is not using the pipeline you did create?

Can you share your module definition, configuration and filebeat logs?

---

<div class="post-metadata">

### Author: ![gaetanoziri](https://avatars.discourse-cdn.com/v4/letter/g/8dc957/32.png) [@gaetanoziri](https://discuss.elastic.co/u/gaetanoziri)
#### Post date: [December 6, 2018, 4:36pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/5 "2018-12-06T16:36:33Z")

</div>

> [@steffens](#):
>
> Now you got me confused. So you say the module is enabled, ingest node pipeline is correctly installed, but filebeat is not using the pipeline you did create?

Yes.

> [@steffens](#):
>
> Can you share your module definition, configuration and filebeat logs?

You can see this [commit](https://github.com/gaetanoziri/beats/commit/18958ff356a5b2aa35adbcc65ade26584edb3eac).

In the logs i see only this two lines:

| 2018-12-06T17:20:21.172+0100 | INFO | instance/beat.go:608 | Home path: [C:\temp\filebeat-6.4.3-windows-x86\_64] Config path: [C:\temp\filebeat-6.4.3-windows-x86\_64] Data path: [C:\temp\filebeat-6.4.3-windows-x86\_64\data] Logs path: [C:\temp\filebeat-6.4.3-windows-x86\_64\logs] |
| --- | --- | --- | --- |
| 2018-12-06T17:20:21.212+0100 | INFO | instance/beat.go:615 | Beat UUID: 0b0c66ab-f277-4a53-bac4-feb8806d976c |

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 3, 2019, 4:37pm UTC](https://discuss.elastic.co/t/my-custom-module-ignores-pipeline/158946/6 "2019-01-03T16:37:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.