# Logstash 429 errors when pushing data to Elastic Search

**URL:** <https://discuss.elastic.co/t/logstash-429-errors-when-pushing-data-to-elastic-search/98140>\
**Category:** Logstash\
**Created:** [August 24, 2017, 12:08am UTC](https://discuss.elastic.co/t/logstash-429-errors-when-pushing-data-to-elastic-search/98140 "2017-08-24T00:08:17Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![sgunnala](https://avatars.discourse-cdn.com/v4/letter/s/f0a364/32.png) [@sgunnala](https://discuss.elastic.co/u/sgunnala)\
**Post date:** [August 24, 2017, 12:08am UTC](https://discuss.elastic.co/t/logstash-429-errors-when-pushing-data-to-elastic-search/98140/1 "2017-08-24T00:08:17Z")

</div>

Filebeats -\> Kafka 0.9 -\>Logstash 5.0.2 -\> ElasticSearch 5.2

We push more then 30k/sec events from Logstash to ES using multiple indexers consuming from Kafka. some peak numbers we see upto 70 mil per 30 mins. ES is 18 data node/2 master node cluster with 9:1 primary:replica for indices . Its all works perfect for 4 days and all of a sudden Kafka lag tops to 15 mil with no processing but ES node is all green and healthy.

Restarted one indexer and now I see 429 errors and no more processing in indexer logs. stopped file beats as lag is growing. Any inputs are appreciated.

---

<div class="post-metadata">

**Author:** ![thiago](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/thiago/32/32096_2.png) [@thiago](https://discuss.elastic.co/u/thiago)\
**Post date:** [August 24, 2017, 12:18am UTC](https://discuss.elastic.co/t/logstash-429-errors-when-pushing-data-to-elastic-search/98140/2 "2017-08-24T00:18:11Z")

</div>

The `429` http code is Elasticsearch telling Logstash to slowdown because it is not being able to keep up with indexing.

If it was working at 30k/s and now the indexing drops drastically and it is not recovering, you need to check Elasticsearch logs to see what's going there.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 21, 2017, 12:18am UTC](https://discuss.elastic.co/t/logstash-429-errors-when-pushing-data-to-elastic-search/98140/3 "2017-09-21T00:18:15Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.