# Filebeat: allow prospectors includes from different files

**URL:** <https://discuss.elastic.co/t/filebeat-allow-prospectors-includes-from-different-files/52833>\
**Category:** Beats\
**Created:** [June 15, 2016, 8:12am UTC](https://discuss.elastic.co/t/filebeat-allow-prospectors-includes-from-different-files/52833 "2016-06-15T08:12:14Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![dmajere](https://avatars.discourse-cdn.com/v4/letter/d/c67d28/32.png) [@dmajere](https://discuss.elastic.co/u/dmajere)\
**Post date:** [June 15, 2016, 8:12am UTC](https://discuss.elastic.co/t/filebeat-allow-prospectors-includes-from-different-files/52833/1 "2016-06-15T08:12:14Z")

</div>

Filebeat version: 1.2.3 (amd64)  
The situation is:  
I've got a node on which I start containers with applications on demand. Containers can appear and disappear frequently, and so the log files i need to ship.  
What I was trying to do, is to create a path section for appearing application log files dynamically.  
Currently config file with prospectors looks like:

```auto
filebeat:
  prospectors:
    -
      paths:
        - /mnt/docker/logs/app1/*.log
    - paths:
        - /mnt/docker/logs/app2/*.log

```

To generate such a file, I need to fetch the list of all the path (all the containers in my situation) every time. I't a bit inconvenient.

It would be cool if filebeat would allow to do path includes.  
For example:

/etc/filebeat/filebeat.yml

```auto
filebeat: 
config_dir: /etc/filebeat/conf.d

```

/etc/filebeat/conf.d/app1.yml

```auto
  prospectors:
    -
      paths:
        - /mnt/docker/logs/app1/*.log

```

and /etc/filebeat/conf.d/app2.yml

```auto
  prospectors:
    -
      paths:
        - /mnt/docker/logs/app1/*.log

```

If I do this now, filebeat will use prospectors only from the last config file it read.

UP:  
It seems that I was wrong, and mergeConfigs does it properly

---

<div class="post-metadata">

**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\
**Post date:** [June 16, 2016, 8:28am UTC](https://discuss.elastic.co/t/filebeat-allow-prospectors-includes-from-different-files/52833/2 "2016-06-16T08:28:34Z")

</div>

If I understand you right, config\_dir is working as expected. Here are also the docs for it: [https://www.elastic.co/guide/en/beats/filebeat/1.2/configuration-filebeat-options.html#\_config\_dir](https://www.elastic.co/guide/en/beats/filebeat/1.2/configuration-filebeat-options.html#_config_dir)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2016, 8:12am UTC](https://discuss.elastic.co/t/filebeat-allow-prospectors-includes-from-different-files/52833/3 "2016-07-06T08:12:42Z")

</div>

This topic was automatically closed after 21 days. New replies are no longer allowed.