Marvel houskeeping


(Thomas Andres) #1

I upgraded elasticsearch to 0.90.11 and installed marvel. Congratulations
on a really nice tool!

Now I have a small issue: since marvel is generating quite a lot of data
(for our develop system), I would like to configure an automatic delete of
old data. Is there such an option? I didn't find anything in the
documentation. It would be great to specify a rolling window of n days of
data to keep.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/90ac3f1f-23c4-461f-95d5-f054f1fc5706%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Tony Su) #2

I haven't thought of automating, but it seems to me that it should be easy
to address manually.
Haven't looked to see I this can be done in Marvel, but in
elasticsearch-head and elasticsearch-hq both display the indices.
Since data is indexed by data, you can select the indexes you wish and
perform an operation on them.

Of course the underlying curl command should be an option, too.

You may be able to do the same in Marvel. Indices are displayed but I
haven't investigated Marvel's ability to perform operations, I've only been
looking at what can be configured to display.

Tony

On Friday, February 14, 2014 7:41:36 AM UTC-8, Thomas Andres wrote:

I upgraded elasticsearch to 0.90.11 and installed marvel. Congratulations
on a really nice tool!

Now I have a small issue: since marvel is generating quite a lot of data
(for our develop system), I would like to configure an automatic delete of
old data. Is there such an option? I didn't find anything in the
documentation. It would be great to specify a rolling window of n days of
data to keep.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0bb77086-abc7-4234-a247-d1a5ce50ae8f%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Boaz Leskes) #3

Hi Thomas,

Marvel itself doesn't have a setting for this, but you can have a look at
this tool, built by the logstash team to help management indices with time
based data: https://github.com/elasticsearch/curator

Cheers,
Boaz

On Friday, February 14, 2014 4:41:36 PM UTC+1, Thomas Andres wrote:

I upgraded elasticsearch to 0.90.11 and installed marvel. Congratulations
on a really nice tool!

Now I have a small issue: since marvel is generating quite a lot of data
(for our develop system), I would like to configure an automatic delete of
old data. Is there such an option? I didn't find anything in the
documentation. It would be great to specify a rolling window of n days of
data to keep.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/98be7697-3788-42b3-9477-b55971bb3d2f%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Thomas Andres) #4

I know deleting them isn't hard, and it's good to know there is a tool to
automate that. However, I do think that Marvel should do that itself.
Shouldn't be too hard to e.g. extend the code that creates a new daily
index to also cleanup old ones.

As it is now, you install a plugin and suddenly run out of space, which I
don't consider a good default behaviour (I know you guys take care of
setting smart default values, which is one reason elasticsearch is so
good!). I think this would be a small extension, that probably prevents
many users from a rather bad surprise.

Cheers
Thomas

Am Freitag, 14. Februar 2014 20:40:26 UTC+1 schrieb Boaz Leskes:

Marvel itself doesn't have a setting for this, but you can have a look at
this tool, built by the logstash team to help management indices with time
based data: https://github.com/elasticsearch/curator

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d77c267c-1f88-4d58-9029-f69ae52ac409%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(David Pilato) #5

It will be possible in the future when this issue will be fixed: https://github.com/elasticsearch/elasticsearch/issues/2114

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr

Le 24 février 2014 à 13:47:07, Thomas Andres (thomas.andres@ergon.ch) a écrit:

I know deleting them isn't hard, and it's good to know there is a tool to automate that. However, I do think that Marvel should do that itself. Shouldn't be too hard to e.g. extend the code that creates a new daily index to also cleanup old ones.

As it is now, you install a plugin and suddenly run out of space, which I don't consider a good default behaviour (I know you guys take care of setting smart default values, which is one reason elasticsearch is so good!). I think this would be a small extension, that probably prevents many users from a rather bad surprise.

Cheers
Thomas

Am Freitag, 14. Februar 2014 20:40:26 UTC+1 schrieb Boaz Leskes:

Marvel itself doesn't have a setting for this, but you can have a look at this tool, built by the logstash team to help management indices with time based data: https://github.com/elasticsearch/curator

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d77c267c-1f88-4d58-9029-f69ae52ac409%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/etPan.530b4c6b.515f007c.5e46%40MacBook-Air-de-David.local.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #6