# Filebeat to elasticsearch using ingest pipeline

**URL:** <https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341>\
**Category:** Elasticsearch\
**Tags:** ingest-pipeline\
**Created:** [April 27, 2022, 5:45am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341 "2022-04-27T05:45:34Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![shrikantgulia](https://avatars.discourse-cdn.com/v4/letter/s/c68b51/32.png) [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Post date:** [April 27, 2022, 5:45am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/1 "2022-04-27T05:45:34Z")

</div>

Dear Team,

need a advise we are ingesting data from filebeat to ES using the ingest pipeline in ES  
I have created an ingest pipeline and also created an index template in that defined the ingest pipeline

"PUT \_ingest/pipeline/beat\_test  
{  
"description": "THN Test",  
"processors": [{  
"json": {  
"field": "message",  
"add\_to\_root": false,  
"target\_field": "fields",  
"ignore\_failure" : true  
}  
}  
]  
}

PUT \_component\_template/logs-my\_app-settings  
{  
"template": {  
"settings": {  
"index.default\_pipeline": "beat\_test"  
}  
}  
}

PUT \_index\_template/logs-my\_app-template  
{  
"index\_patterns": ["logs\_json"],  
"composed\_of": ["logs-my\_app-settings"]  
}"

and the output of my filebeat is

'  
output.Elasticsearch:  
hosts: ["[https://ESIP](https://ESIP):PORT"]  
username: "test\_data"  
password: "\*\*\*\*\*"  
pipeline: "beat\_test"  
'

Still not getting data in the ES defined index

a help would be highly appreicated

Regards

---

<div class="post-metadata">

**Author:** ![shrikantgulia](https://avatars.discourse-cdn.com/v4/letter/s/c68b51/32.png) [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Post date:** [April 27, 2022, 9:47am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/2 "2022-04-27T09:47:16Z")

</div>

@Badger any idea for this

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [April 29, 2022, 1:05am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/3 "2022-04-29T01:05:21Z")

</div>

Please don't ping people that aren't already taking part in your topic.

Please also format your code/logs/config using the `</>` button, or markdown style back ticks. It helps to make things easy to read which helps us help you

> [@shrikantgulia](#):
>
> Still not getting data in the ES defined index

What does this mean? Where does the data go?

---

<div class="post-metadata">

**Author:** ![shrikantgulia](https://avatars.discourse-cdn.com/v4/letter/s/c68b51/32.png) [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Post date:** [April 29, 2022, 9:37am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/4 "2022-04-29T09:37:40Z")

</div>

Hi,

thankyou for the response  
my data is going in the default filebeat index this is the main concern

even after definig the index.

though figured out a different way  
i have set the \_index field to the index name.

Warm Regards

---

<div class="post-metadata">

**Author:** ![ibra\_013](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ibra_013/32/104827_2.png) [@ibra\_013](https://discuss.elastic.co/u/ibra_013)\
**Post date:** [May 1, 2022, 6:12pm UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/5 "2022-05-01T18:12:00Z")

</div>

Hi,

did you solve it ?

---

<div class="post-metadata">

**Author:** ![shrikantgulia](https://avatars.discourse-cdn.com/v4/letter/s/c68b51/32.png) [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Post date:** [May 5, 2022, 7:45am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/6 "2022-05-05T07:45:04Z")

</div>

Yes, I solved it.  
I created an ingestpipeline config

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [June 2, 2022, 7:45am UTC](https://discuss.elastic.co/t/filebeat-to-elasticsearch-using-ingest-pipeline/303341/7 "2022-06-02T07:45:33Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.