# Marvel high index rate
**URL:** https://discuss.elastic.co/t/marvel-high-index-rate/38935
**Category:** Elasticsearch
**Tags:** elastic-stack-monitoring
**Created:** [January 12, 2016, 5:01am UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935 "2016-01-12T05:01:47Z")
**Posts on this page:** 8
**Page:** 1
### Author:  [@voipoclay](https://discuss.elastic.co/u/voipoclay)
#### Post date: [January 12, 2016, 5:01am UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/1 "2016-01-12T05:01:47Z")
I notice in marvel the highest insert activity belongs to the marvel index and shows around 680/s to 960/s.
I was curious why this is so high?
---
### Author:  [@tanguy](https://discuss.elastic.co/u/tanguy)
#### Post date: [January 12, 2016, 8:25am UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/2 "2016-01-12T08:25:08Z")
Hi voipoclay,
That seems to be high indeed. Which exact versions are you using? How many nodes / indices / shards do you cluster have?
---
### Author:  [@voipoclay](https://discuss.elastic.co/u/voipoclay)
#### Post date: [January 12, 2016, 4:48pm UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/3 "2016-01-12T16:48:40Z")
ES 2.1.1
Kibana 4.3.0
Marvel (not sure how to tell)
Nodes: 11
Indices: 438
Memory: 11GB / 57GB
Total Shards: 4348
Unassigned Shards: 0
Documents: 45,107,944
Data: 35GB
---
### Author:  [@tanguy](https://discuss.elastic.co/u/tanguy)
#### Post date: [January 12, 2016, 7:57pm UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/4 "2016-01-12T19:57:27Z")
Marvel is indexing a set of documents for every nodes, indices and shards of your cluster. These documents are used to build the various charts.
In your case, you have many nodes / indices /shards compared to the volume of data (35 GB). That's around 100K / 80MB per index and this is not a lot.
Every 10 sec you have 11 (nodes) + 438 (indices) + 4348 (shards) = ~4800 documents indexed in 2 shards (marvel indices), so a total of 9600 docs every 10 secs which explains 960 docs /sec.
Hope this helps
---
### Author:  [@voipoclay](https://discuss.elastic.co/u/voipoclay)
#### Post date: [January 12, 2016, 10:50pm UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/5 "2016-01-12T22:50:27Z")
Ok thanks for the detailed reply and I can see how this makes sense now.
I wish that I could monitor the cluster without such a load. It seem like 1000/s when the rest of my cluster is fairly idle seems like a lot of load to monitor and kind of gives me "false" readouts in a sense because 90% of the load is just from marvel and not actual production activity.
I guess I can live with it since it does have useful information. Would be kind of nice if there was a way to store the metrics for marvel locally to the kibana machine rather then on the target cluster.
Regardless thank you for explaining this to me!
---
### Author:  [@tanguy](https://discuss.elastic.co/u/tanguy)
#### Post date: [January 13, 2016, 9:19am UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/6 "2016-01-13T09:19:06Z")
> [@voipoclay](#):
>
> Would be kind of nice if there was a way to store the metrics for marvel locally to the kibana machine rather then on the target cluster.
The marvel agent plugin can be configured to export data to another monitoring cluster (using a HTTP Exporter) so that marvel data are not stored locally in the same cluster as your business data. This is the recommended configuration for production clusters.
In your case, I'd also investigate how to reduce the number of indices & shards.
---
### Author:  [@whybangbang](https://discuss.elastic.co/u/whybangbang)
#### Post date: [January 13, 2016, 9:23am UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/7 "2016-01-13T09:23:26Z")
[enter link description here](https://discuss.elastic.co/t/marvel-index-rate-maybe-high/39051,)
if you can help me solve the problem,thank you, as this case ,i also find index rate is high
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:45pm UTC](https://discuss.elastic.co/t/marvel-high-index-rate/38935/8 "2017-07-06T13:45:45Z")