# Filebeat is not using custom pipeline mentioned in the output.elasticsearch

**URL:** <https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465>\
**Category:** Beats\
**Tags:** filebeat, ingest-pipeline\
**Created:** [June 30, 2021, 1:11pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465 "2021-06-30T13:11:47Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mahesh\_Gadagi](https://avatars.discourse-cdn.com/v4/letter/m/d9b06d/32.png) [@Mahesh\_Gadagi](https://discuss.elastic.co/u/Mahesh_Gadagi)\
**Post date:** [June 30, 2021, 1:11pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/1 "2021-06-30T13:11:47Z")

</div>

Hello all,

Currently, I am using filebeat, elastic search 7.9.1 version and I have added the custom Ingest pipeline to push the logs but still, filebeat creates a new Ingest pipeline as filebeat-7.9.1-haproxy-log-pipeline. But whenever filebeat pushes the logs I want it to push the pipeline I have mentioned in the configuration, can someone help, please?

filebeat.yml

```auto
output.elasticsearch:

  hosts: ['localhost:9200']

  username: 'abc'

  password: 'abc'

  index: "mytestindex-%{[agent.version]}-%{+yyyy.MM.dd}"

  pipeline: "my_test_pipeline"

```

Here I am expecting it should use my\_test\_pipeline to push the logs instead of filebeat-7.9.1-haproxy-log-pipeline

Regards,  
Mahesh

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 30, 2021, 1:54pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/2 "2021-06-30T13:54:58Z")

</div>

Get node stats

```auto
GET _nodes/your-ingest-node/stats/ingest

```

Check the count fields in "my\_test\_pipeline"

---

<div class="post-metadata">

**Author:** ![Mahesh\_Gadagi](https://avatars.discourse-cdn.com/v4/letter/m/d9b06d/32.png) [@Mahesh\_Gadagi](https://discuss.elastic.co/u/Mahesh_Gadagi)\
**Post date:** [June 30, 2021, 3:00pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/3 "2021-06-30T15:00:28Z")

</div>

How this will help me to solve the problem, please ?

---

<div class="post-metadata">

**Author:** ![rugenl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/rugenl/32/12887_2.png) [@rugenl](https://discuss.elastic.co/u/rugenl)\
**Post date:** [June 30, 2021, 3:10pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/4 "2021-06-30T15:10:24Z")

</div>

If the count is \> 0 entering the pipeline, the data is getting there. Each process in the pipeline has a count, so you can see some of what is happening inside the pipeline.

---

<div class="post-metadata">

**Author:** ![Mahesh\_Gadagi](https://avatars.discourse-cdn.com/v4/letter/m/d9b06d/32.png) [@Mahesh\_Gadagi](https://discuss.elastic.co/u/Mahesh_Gadagi)\
**Post date:** [June 30, 2021, 3:24pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/5 "2021-06-30T15:24:42Z")

</div>

But I already know that none of the logs are processing through my pipeline.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 28, 2021, 5:24pm UTC](https://discuss.elastic.co/t/filebeat-is-not-using-custom-pipeline-mentioned-in-the-output-elasticsearch/277465/6 "2021-07-28T17:24:55Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.