# Too many marvel indices with default per-day idx generation
**URL:** https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705
**Category:** Elasticsearch
**Tags:** elastic-stack-monitoring
**Created:** [December 9, 2015, 8:15am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705 "2015-12-09T08:15:17Z")
**Posts on this page:** 10
**Page:** 1
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [December 9, 2015, 8:15am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/1 "2015-12-09T08:15:17Z")
Greetings. There used to be a option for marvel in 1.x version that control the format Marvel uses to create its data index: marvel.agent.exporter.es.index.timeformat. I can therefore set that to [YYYY.MM](http://YYYY.MM) so that Marvel just create one index for the whole month data.
After I upgraded ELK to 2.x this option seems to be not effective any longer, as the new marvel begins to create index every day like YYYY.MM.DD. Is there any way to get back to my original index format setting?
---
### Author:  [@tanguy](https://discuss.elastic.co/u/tanguy)
#### Post date: [December 9, 2015, 8:47am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/2 "2015-12-09T08:47:57Z")
Hi zkun,
The setting `index.name.time_format` can be configure at exporter level and it accepts a time format like `YYYY`, `YYYY.MM`, `YYYY-MM-dd`... default value is `YYYY.MM.dd`:
```auto
marvel.agent.exporters:
id2:
type: http
host: ["http://domain:port",...]
index.name.time_format: "YYYY.MM.dd"
```
We'll update the documentation to make this more clear.
---
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [December 9, 2015, 10:23am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/3 "2015-12-09T10:23:18Z")
Thank you for the kind tip.
Then how should I config marvel app in kibana to get data from new indices instead of the old .marvel-es-YYYY.MM.dd? Now it's totally blank in marvel dashboard.
---
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [December 11, 2015, 2:20am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/4 "2015-12-11T02:20:38Z")
Update with my discovery yesterday:
There are several marvel index related init js script in kibana marvel plugin folder installedPlugins/marvel/. And I noticed that they still look for a pattern like YYYY.MM.dd although the format has been changed under marvel.agent.exporters in ELS config. But the dashboard keeps blank even after changing those in js to [YYYY.MM](http://YYYY.MM)
In the 1.x marvel the pattern could be set at a folded place in marvel dashboard. Hope the new marvel will inherit this by adding a brief config panel.
---
### Author:  [@tsullivan](https://discuss.elastic.co/u/tsullivan)
#### Post date: [December 16, 2015, 11:56pm UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/5 "2015-12-16T23:56:39Z")
Hi zkun, we have an issue in Marvel 2.x where the UI doesn't follow the config setting for `index.name.time_format`, but we have identified a fix for it, and will have this fixed in a future version.
---
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [December 17, 2015, 3:09am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/6 "2015-12-17T03:09:21Z")
Thank you for the kind reply. Is this issue tracked on github so that I can check the progress of resolution?
---
### Author:  [@tsullivan](https://discuss.elastic.co/u/tsullivan)
#### Post date: [December 17, 2015, 7:54pm UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/7 "2015-12-17T19:54:58Z")
We're planning to release a fix for this in the next Marvel version early next year.
I'm also curious, how much history do you have that the number of one-per-day indices are a problem?
---
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [December 18, 2015, 6:40am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/8 "2015-12-18T06:40:17Z")
We did use default index pattern settings at first. But as it turned out to be 100+ indices after 2 month running we switched to month-based idx pattern, given that there're only 2 data nodes to hold all indices.
---
### Author:  [@zkun](https://discuss.elastic.co/u/zkun)
#### Post date: [February 5, 2016, 1:56am UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/9 "2016-02-05T01:56:38Z")
I saw the fix has already been included in the latest release. Thanks!
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 6, 2017, 1:45pm UTC](https://discuss.elastic.co/t/too-many-marvel-indices-with-default-per-day-idx-generation/36705/10 "2017-07-06T13:45:23Z")