# Monitor incoming data rates **URL:** \ **Category:** Elasticsearch\ **Created:** [April 9, 2015, 3:49am UTC](https://discuss.elastic.co/t/monitor-incoming-data-rates/23164 "2015-04-09T03:49:43Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![gromit](https://avatars.discourse-cdn.com/v4/letter/g/ac8455/32.png) [@gromit](https://discuss.elastic.co/u/gromit)\ **Post date:** [April 9, 2015, 3:49am UTC](https://discuss.elastic.co/t/monitor-incoming-data-rates/23164/1 "2015-04-09T03:49:43Z")
I have alerts configured on my Logstash - Elasticsearch setup which perform regular queries to see what state the cluster is in etc. Recently I had a situation where Logstash was running OK and ES cluster was in Green state, but there was no data going into ES. Is there a way to monitor this, e.g if the incoming data rate to ES drops below 100 events a minute. I can't do it by Logstash metrics because that side of it was running normally, i.e. no change in data rates. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [April 9, 2015, 4:38am UTC](https://discuss.elastic.co/t/monitor-incoming-data-rates/23164/2 "2015-04-09T04:38:31Z")
Marvel monitors these sorts of things out of the box. But maybe \_cluster/stats and keep an eye on docs.count? What is monitoring things now? On 9 April 2015 at 13:49, Bernie Carolan [bernie.carolan@gmail.com](mailto:bernie.carolan@gmail.com) wrote: > I have alerts configured on my Logstash - Elasticsearch setup which > perform regular queries to see what state the cluster is in etc. > > Recently I had a situation where Logstash was running OK and ES cluster > was in Green state, but there was no data going into ES. > Is there a way to monitor this, e.g if the incoming data rate to ES drops > below 100 events a minute. > > I can't do it by Logstash metrics because that side of it was running > normally, i.e. no change in data rates. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/2458951a-5c82-4003-841a-d634aa1c1dfd%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8xhf2bKbH73eY-EMkoUXbShbBe%3Db%2Bg9n%2BaCyzoBqOvXw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X8xhf2bKbH73eY-EMkoUXbShbBe%3Db%2Bg9n%2BaCyzoBqOvXw%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\ **Post date:** [April 9, 2015, 6:12am UTC](https://discuss.elastic.co/t/monitor-incoming-data-rates/23164/3 "2015-04-09T06:12:49Z")
On Thursday, April 09, 2015 at 05:49 CEST, Bernie Carolan [bernie.carolan@gmail.com](mailto:bernie.carolan@gmail.com) wrote: > I have alerts configured on my Logstash - Elasticsearch setup which > perform regular queries to see what state the cluster is in etc. > Recently I had a situation where Logstash was running OK and ES > cluster was in Green state, but there was no data going into ES. > Is there a way to monitor this, e.g if the incoming data rate to ES > drops below 100 events a minute. > I can't do it by Logstash metrics because that side of it was running > normally, i.e. no change in data rates. How can Logstash be running normally when it halts the pipeline when one output isn't able to accept messages? Are you saying that Elasticsearch accepts messages but just drops them on the floor? -- Magnus Bäck | Software Engineer, Development Tools [magnus.back@sonymobile.com](mailto:magnus.back@sonymobile.com) | Sony Mobile Communications -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/20150409061248.GA13186%40seldlx20533.corpusers.net](https://groups.google.com/d/msgid/elasticsearch/20150409061248.GA13186%40seldlx20533.corpusers.net). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:20am UTC](https://discuss.elastic.co/t/monitor-incoming-data-rates/23164/4 "2017-07-06T00:20:40Z")