# Filebeat with container discovery stucks once a day

**URL:** <https://discuss.elastic.co/t/filebeat-with-container-discovery-stucks-once-a-day/230031>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [April 27, 2020, 9:03pm UTC](https://discuss.elastic.co/t/filebeat-with-container-discovery-stucks-once-a-day/230031 "2020-04-27T21:03:15Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![r2r2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/r2r2/32/46439_2.png) [@r2r2](https://discuss.elastic.co/u/r2r2)\
**Post date:** [April 27, 2020, 9:03pm UTC](https://discuss.elastic.co/t/filebeat-with-container-discovery-stucks-once-a-day/230031/1 "2020-04-27T21:03:16Z")

</div>

Hello!

I have 3 containers of [docker.elastic.co/beats/filebeat:7.6.1](http://docker.elastic.co/beats/filebeat:7.6.1) in Nomad. They stop to send logs once a day in random time and begin to waste cpu iowait. Restart of container helps approximatelly for a day.

Configuration of filebeat is listed below:

> **Summary**
>
> ```
> filebeat.autodiscover:
> providers:
> - type: docker
> hints.enabled: false
> labels.dedot: true
> templates:
> - condition:
> not.contains:
> docker.container.name: filebeat
> config:
> - type: container
> paths:
> - '/var/lib/docker/containers/${data.docker.container.id}/*.log'
> enabled: true
> exclude_lines: ['.*customline*']
> combine_partial: true
> json:
> keys_under_root: false
> message_key: log
> processors:
> - add_docker_metadata: ~
> tail_files: true
> setup:
> template:
> name: "filebeat-index"
> pattern: "filebeat-index-*"
> overwrite: false
> settings.index.number_of_shards: 3
> ilm.enabled: false
> kibana:
> host: "kibana-host"
> 
> output.elasticsearch:
> hosts: ["elastic-host:9200"]
> index: "filebeat-index-%{+yyyy.MM.dd}"
> bulk_max_size: 1000
> workers: 2
> 
> ```

I have the same configuration on 2 other Nomad clusters with less log data and it works fine there.  
But this problem cluster probably has too much containers. And I think the issue is in discovery.  
Could you suggest me anything, please?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 25, 2020, 9:03pm UTC](https://discuss.elastic.co/t/filebeat-with-container-discovery-stucks-once-a-day/230031/2 "2020-05-25T21:03:18Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.