# Seeing Indexing Rejections **URL:** \ **Category:** Elasticsearch\ **Tags:** elastic-stack-monitoring\ **Created:** [June 22, 2016, 12:49pm UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657 "2016-06-22T12:49:14Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![nandanrao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nandanrao/32/8966_2.png) [@nandanrao](https://discuss.elastic.co/u/nandanrao)\ **Post date:** [June 22, 2016, 12:49pm UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657/1 "2016-06-22T12:49:14Z")
In multiple places in the documentation, it is recommended that we monitor index rejections through marvel. "In such a scenario, monitor Elasticsearch (through Marvel or other plugins) and keep an eye on bulk processing. Look at the percentage of documents being rejected" -- [https://www.elastic.co/guide/en/elasticsearch/hadoop/master/performance.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/master/performance.html) "If you are using Marvel, you can see the rejection counts under the THREAD POOLS - BULK section of the Node Statistics Dashboard. " -- [https://www.elastic.co/blog/performance-considerations-elasticsearch-indexing](https://www.elastic.co/blog/performance-considerations-elasticsearch-indexing) But it seems like this feature was removed from Marvel? Or moved somewhere? There does not seem to be any documentation as to what I can see in Marvel, so I assume I'm just supposed to click around and everything is there, but I don't seem to find a good way to see rejection percentage or number of rejections in bulk indexing. Help! ---
**Author:** ![bohyun](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/bohyun/32/10087_2.png) [@bohyun](https://discuss.elastic.co/u/bohyun)\ **Post date:** [June 23, 2016, 3:03am UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657/2 "2016-06-23T03:03:49Z")
Hi Nandanrao - Are you currently using ES 1.x or 2.x? The reference you have above on seeing the rejection counts under Thread pools-bulk section is _still_ valid for ES 1.x and Marvel 1.x. If you're on 2.x, you will quickly find out that our Marvel has changed significantly, due to many changes in ES 2.0 and corresponding changes in Kibana 4. Because of these changes, Marvel 2.0 had to be completely re-written from ground up ([release note](https://www.elastic.co/guide/en/marvel/2.3/release-notes.html#_2_0_0)) and we decided to make Marvel lighter and simpler for quicker understanding of your Elasticsearch clusters. Please visit [https://www.elastic.co/guide/en/marvel/current/index.html](https://www.elastic.co/guide/en/marvel/current/index.html) for the latest Marvel documentation. Hope this helps, Bohyun ---
**Author:** ![nandanrao](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nandanrao/32/8966_2.png) [@nandanrao](https://discuss.elastic.co/u/nandanrao)\ **Post date:** [June 23, 2016, 5:17am UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657/3 "2016-06-23T05:17:17Z")
Yes, I'm using 2.x. Simpler and lighter sounds wonderful! However, now that Marvel has changed, is there a new recommended way to see those statistics and therefore tune bulk indexing? ---
**Author:** ![pickypg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pickypg/32/62409_2.png) [@pickypg](https://discuss.elastic.co/u/pickypg)\ **Post date:** [June 23, 2016, 2:39pm UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657/4 "2016-06-23T14:39:42Z")
Hi nandanrao, Marvel 2.x does not currently display anything about the threadpools beyond the CPU usage, which is correlated of course, but it does limit you to the data that it chooses to _display_. Now, while we do not like forcing users to do more work, we do _collect_ the number of bulk rejections in the `.marvel-es-1-*` index under the `node_stats` type (the field is `node_stats.thread_pool.bulk.rejected`). Given that, you can graph that using Kibana against that index. The problem that you will likely run into is that the value is simply a counter of the number of rejectons _per node_ since the node started. So if it's `1` the last time you read it, then it will be at least `1` the next time that you read it (unless it was restarted). With Elasticsearch, you can use a pipeline derivative aggregation to get the _change_, but Kibana does not yet support pipeline aggregations, so you'll just have to visualize the raw count. Note: every document contains the `source_node` information, so you can filter by the node's name. So, the next question is: How does this work in Kibana until it gets visualized in Marvel? 1. You can create a visualization (probably want points, not bars or a pie chart). 2. For the top level value (the Y value), then you would want to do max of `node_stats.thread_pool.bulk.rejected` (this gives the max rejections for any given bucket, thereby getting the most important value within any bucket). 3. For the bottom value (the X value), aggregate by a date histogram. Bucket however you want (you probably want **auto** , but you can use minute, hour, whatever). You would then want to _also_ filter on the node's name to limit the graph to the individual node. Otherwise it's operating against all nodes (so you'd not necessarily want max unless you sub-aggregated the X value by node). This will give the same effect as you got in Marvel 1.x. Hope that helps, Chris ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:43pm UTC](https://discuss.elastic.co/t/seeing-indexing-rejections/53657/5 "2017-07-06T13:43:01Z")
Closed on July 6, 2017, 1:43pm UTC