# Filebeat custom module pipeline failed

**URL:** <https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [September 21, 2020, 4:09am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297 "2020-09-21T04:09:15Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![icaruswu](https://avatars.discourse-cdn.com/v4/letter/i/ebca7d/32.png) [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Post date:** [September 21, 2020, 4:09am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/1 "2020-09-21T04:09:15Z")

</div>

I build my own filebeat and I created a 'pipeline.yml' in the ingest directory. And I'm surely changed the ingest\_pipeline PATH in the mainfest.yml. But when I executed the filebeat but the pipeline processors not worked. Then I checked the pipeline in the dev tool but found my own filebeat pipeline processor not changed. It's still null. So, how could I solve this problem?  
 ![2020-09-21 12-03-22 的屏幕截图](https://us1.discourse-cdn.com/elastic/original/3X/4/8/48fe2484fec8fbb07e270ea6fe2cf93ee41b500b.png)  
 ![2020-09-21 12-08-01 的屏幕截图](https://us1.discourse-cdn.com/elastic/original/3X/4/8/4828fd329eb9ac77c5c08399167229e01ddd2805.png)  
 ![2020-09-21 12-08-27 的屏幕截图](https://us1.discourse-cdn.com/elastic/original/3X/0/3/03c2f6c187bbb1e1934610d283cf732ca66ceed5.png)

---

<div class="post-metadata">

**Author:** ![icaruswu](https://avatars.discourse-cdn.com/v4/letter/i/ebca7d/32.png) [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Post date:** [September 21, 2020, 4:14am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/2 "2020-09-21T04:14:35Z")

</div>

I build this filebeat module to collect log. This fileset can collect the log data, but I wanna use the pipeline processors to filter or rename some fields.

---

<div class="post-metadata">

**Author:** ![borna\_talebi](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/borna_talebi/32/76317_2.png) [@borna\_talebi](https://discuss.elastic.co/u/borna_talebi)\
**Post date:** [September 21, 2020, 5:42am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/3 "2020-09-21T05:42:31Z")

</div>

Hi,  
I never created a filebeat myself but by reading this [doc](https://www.elastic.co/guide/en/beats/devguide/current/filebeat-modules-devguide.html) I think you should configure your manifest like this:

```auto
ingest_pipeline: ingest/pipeline.json
input: config/testfileset.yml

```

so I think you should change `- ingest/pipeline.yml` to` - ingest/pipeline.json`

also you could create an ingest pipeline inside elasticsearch and tell you index(or inside your index template settings) to use that pipeline.

---

<div class="post-metadata">

**Author:** ![icaruswu](https://avatars.discourse-cdn.com/v4/letter/i/ebca7d/32.png) [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Post date:** [September 21, 2020, 5:58am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/4 "2020-09-21T05:58:39Z")

</div>

yeah, I tried to use `pipeline.yml` and `pipeline.json` both. But all failed to work.  
It's not appropriate to create ingest pipeline inside Elasticsearch cause I will try to buid another more custom filebeats or filesets in my codes.  
Maybe I use some wrong configuration?

---

<div class="post-metadata">

**Author:** ![icaruswu](https://avatars.discourse-cdn.com/v4/letter/i/ebca7d/32.png) [@icaruswu](https://discuss.elastic.co/u/icaruswu)\
**Post date:** [September 22, 2020, 6:51am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/5 "2020-09-22T06:51:07Z")

</div>

I create another filebeat module and It works good.  
Maybe some configs wrong. It's really funny. 😅

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 20, 2020, 8:51am UTC](https://discuss.elastic.co/t/filebeat-custom-module-pipeline-failed/249297/6 "2020-10-20T08:51:21Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
