# Logstash and Filebeat config for Logs count more 10,000

**URL:** <https://discuss.elastic.co/t/logstash-and-filebeat-config-for-logs-count-more-10-000/49902>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [May 12, 2016, 12:55pm UTC](https://discuss.elastic.co/t/logstash-and-filebeat-config-for-logs-count-more-10-000/49902 "2016-05-12T12:55:39Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![shubham\_deodia](https://avatars.discourse-cdn.com/v4/letter/s/a8b319/32.png) [@shubham\_deodia](https://discuss.elastic.co/u/shubham_deodia)\
**Post date:** [May 12, 2016, 12:55pm UTC](https://discuss.elastic.co/t/logstash-and-filebeat-config-for-logs-count-more-10-000/49902/1 "2016-05-12T12:55:39Z")

</div>

I am trying to configure my BELK server for large log count( more than 20,000).

Currently my config is

Logstash:

> ```
> input{
> beats{
> port => 27080
> congestion_threshold => 1500
> }
> 
> ```

Filebeat

> ```
> filebeat:
> prospectors:
> - paths:
> - /
> input_type: /var/log/*.log
> document_type: log
> registry: /etc/filebeat
> spool_size: 9000
> idle_timeout: 500s
> 
> ```

Its working fine for log count less than 1000.

But, If it is above that its giving me error.

> beats\_input\_codec\_plain\_applied, \_grokparsefailure

Does anyone know any resolution to this issue. What parameters do i need to change.

---

<div class="post-metadata">

**Author:** ![ruflin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/ruflin/32/3116_2.png) [@ruflin](https://discuss.elastic.co/u/ruflin)\
**Post date:** [May 13, 2016, 1:25pm UTC](https://discuss.elastic.co/t/logstash-and-filebeat-config-for-logs-count-more-10-000/49902/2 "2016-05-13T13:25:22Z")

</div>

This looks more like a potential issue on the Logstash side, but not sure if it is related to the number of log files as it seems to be a grok failure. Can you post some more of the error message you get? I assume you get this error from Logstash?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 5, 2017, 9:52pm UTC](https://discuss.elastic.co/t/logstash-and-filebeat-config-for-logs-count-more-10-000/49902/3 "2017-07-05T21:52:02Z")

</div>