# Filebeats not picking .log files from directories

**URL:** <https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [June 9, 2022, 11:23am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790 "2022-06-09T11:23:16Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Dhilipkumar](https://avatars.discourse-cdn.com/v4/letter/d/a698b9/32.png) [@Dhilipkumar](https://discuss.elastic.co/u/Dhilipkumar)\
**Post date:** [June 9, 2022, 11:23am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790/1 "2022-06-09T11:23:16Z")

</div>

Hello All,

Im using 8.1.3 version of Elasticsearch and 8.1.0 version of filebeat for log Analysis puropse in Linux environment as a group user.  
We have log files of various types (e.g .txt, .log, .html, .sql, .csv) in a directory with various sub directories say to maxdepth of 8. While running filebeat with \*\* in the path it picks the .html, .sql, .txt files but not .log files. The Parent directory may look like the one in the picture that i've shared.  
Can someone help resolve this issue.

 ![Filbeat_Example](https://us1.discourse-cdn.com/elastic/original/3X/5/c/5cedd6dccb1bb0e49d27cb41eebffb781f6f9bed.png)

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [June 14, 2022, 4:30am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790/2 "2022-06-14T04:30:40Z")

</div>

Welcome to our community! 😃

It'd be useful if you could share your config.

---

<div class="post-metadata">

**Author:** ![Dhilipkumar](https://avatars.discourse-cdn.com/v4/letter/d/a698b9/32.png) [@Dhilipkumar](https://discuss.elastic.co/u/Dhilipkumar)\
**Post date:** [June 15, 2022, 9:50am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790/3 "2022-06-15T09:50:40Z")

</div>

```auto

filebeat.inputs:

- type: log
  enabled: true
  paths:
    - /home/oracle/catt-logs-week23/**

# ============================== Filebeat modules ==============================

filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: true

# ======================= Elasticsearch template setting =======================

setup.template.settings:
  index.number_of_shards: 1

setup.ilm.enabled: false

# =================================== Kibana ===================================

setup.kibana:
  host: "<hostip>:5601"

# ---------------------------- Elasticsearch Output ----------------------------
output.elasticsearch:
 
  hosts: ["<hostip>:9200"]
  index: "week23-sec-last-dir-log"

setup.template:
  name: 'week23-sec-last-dir-log'
  pattern: 'week23-sec-last-dir-log'

  username: "username"
  password: "password"

# ================================= Processors =================================
processors:
  - add_host_metadata:
      when.not.contains.tags: forwarded
     

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 13, 2022, 11:50am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790/4 "2022-07-13T11:50:42Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
