# Filebeat Harvester

**URL:** <https://discuss.elastic.co/t/filebeat-harvester/118599>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [February 6, 2018, 9:59am UTC](https://discuss.elastic.co/t/filebeat-harvester/118599 "2018-02-06T09:59:39Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![charan.gandra](https://avatars.discourse-cdn.com/v4/letter/c/a87d85/32.png) [@charan.gandra](https://discuss.elastic.co/u/charan.gandra)\
**Post date:** [February 6, 2018, 9:59am UTC](https://discuss.elastic.co/t/filebeat-harvester/118599/1 "2018-02-06T09:59:39Z")

</div>

Filebeat is not harvesting all the log file details in prospectors.

Here is my prospectors:

filebeat.prospectors:

- type: log

However Filebeat is only harvesting secure and messages file not the other \*.log files. Any help is greatly appreciated

2018-02-06T09:42:37Z INFO Loading and starting Prospectors completed. Enabled prospectors: 1  
2018-02-06T09:42:37Z INFO Config reloader started  
2018-02-06T09:42:37Z INFO Loading of config files completed.  
2018-02-06T09:42:37Z INFO Harvester started for file: /var/log/secure  
2018-02-06T09:42:37Z INFO Harvester started for file: /var/log/messages  
2018-02-06T09:43:07Z INFO Non-zero metrics in the last 30s: beat.info.uptime.ms=30003 beat.memstats.gc\_next=5655728 beat.memstats.memory\_alloc=2842168 beat.memstats.memory\_total=6360272 filebeat.events.added=18 filebeat.events.done=18 filebeat.harvester.open\_files=2 filebeat.harvester.running=2 filebeat.harvester.started=2 libbeat.config.module.running=0 libbeat.config.reloads=1 libbeat.output.events.acked=11 libbeat.output.events.batches=2 libbeat.output.events.total=11 libbeat.output.read.bytes=12 libbeat.output.type=logstash libbeat.output.write.bytes=974 libbeat.pipeline.clients=1 libbeat.pipeline.events.active=0 libbeat.pipeline.events.filtered=7 libbeat.pipeline.events.published=11 libbeat.pipeline.events.retry=5 libbeat.pipeline.events.total=18 libbeat.pipeline.queue.acked=11 registrar.states.current=5 registrar.states.update=18 registrar.writes=9

---

<div class="post-metadata">

**Author:** ![exekias](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/exekias/32/28718_2.png) [@exekias](https://discuss.elastic.co/u/exekias)\
**Post date:** [February 6, 2018, 11:08am UTC](https://discuss.elastic.co/t/filebeat-harvester/118599/2 "2018-02-06T11:08:02Z")

</div>

Hi @charan.gandra,

Does Filebeat have access to those files? Permissions are respected when harvesting files

Br,

---

<div class="post-metadata">

**Author:** ![charan.gandra](https://avatars.discourse-cdn.com/v4/letter/c/a87d85/32.png) [@charan.gandra](https://discuss.elastic.co/u/charan.gandra)\
**Post date:** [February 6, 2018, 1:40pm UTC](https://discuss.elastic.co/t/filebeat-harvester/118599/3 "2018-02-06T13:40:26Z")

</div>

Thanks. Actually it is working. I didn't notice that it has already harvested those files.

Thanks,

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 6, 2018, 1:40pm UTC](https://discuss.elastic.co/t/filebeat-harvester/118599/4 "2018-03-06T13:40:31Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.