# Map Files to specific Ingest Pipelines

**URL:** https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063
**Category:** Beats
**Tags:** filebeat
**Created:** [July 8, 2016, 3:18pm UTC](https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063 "2016-07-08T15:18:07Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![sirsteve](https://avatars.discourse-cdn.com/v4/letter/s/f04885/32.png) [@sirsteve](https://discuss.elastic.co/u/sirsteve)
#### Post date: [July 8, 2016, 3:18pm UTC](https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063/1 "2016-07-08T15:18:07Z")

</div>

Hi,

I'm playing around with the new Elastic5 products and am interested in using the ingest node feature with Filebeat as the agent. I have a server that runs several applications with different log files/formats and it seems that per Filebeat agent you can only define a single Elasticsearch output that references a single pipeline.

It would be nice if it was possible to define a mapping of log files to output pipelines instead of having to maintain one big pipeline containing all of the grok patterns. I feel it could get messy trying to keep track of all of the patterns and which application's logs they are matching.

Something obvious I am missing or will I have to maintain a large list of grok patterns in one pipeline?

Thanks

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [July 8, 2016, 3:27pm UTC](https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063/2 "2016-07-08T15:27:12Z")

</div>

You're not missing anything, it's hard to use when there are a lot of patterns at the moment. We plan to do something about this problem before we release 5.0.

I realized we don't have an issue for this in our repo yet. Could you please [open one](https://github.com/elastic/beats/issues/new)? Thanks

---

<div class="post-metadata">

### Author: ![sirsteve](https://avatars.discourse-cdn.com/v4/letter/s/f04885/32.png) [@sirsteve](https://discuss.elastic.co/u/sirsteve)
#### Post date: [July 8, 2016, 3:32pm UTC](https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063/3 "2016-07-08T15:32:17Z")

</div>

Thanks

> <https://github.com/elastic/beats/issues/1998>

---

<div class="post-metadata">

### Author: ![andrewkroh](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/andrewkroh/32/3784_2.png) [@andrewkroh](https://discuss.elastic.co/u/andrewkroh)
#### Post date: [July 8, 2016, 3:40pm UTC](https://discuss.elastic.co/t/map-files-to-specific-ingest-pipelines/55063/4 "2016-07-08T15:40:51Z")

</div>


