ElasticSearch log management


(IronMike) #1

Does ElasticSearch roll logs? Does it create new log with different name
everyday?
I would like to know how to manage logs, I would like to keep last 10 days
worth of logs, but not more that that, as they can be very big.
Any ideas What Elasticsearch already does and what I need to do in order to
manage logs?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/61f7ff1c-021e-4aa9-bffd-ba72a6837c37%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Ivan Brusic) #2

Elasticsearch uses log4j for logging, so all logging configuration can be
done via the log4j config file logging.xml

https://github.com/elasticsearch/elasticsearch/blob/master/config/logging.yml

The default type is dailyRollingFile, which as the name states, rotates the
log file daily.

--
Ivan

On Mon, Jun 30, 2014 at 8:02 AM, IronMan2014 sabdalla80@gmail.com wrote:

Does ElasticSearch roll logs? Does it create new log with different name
everyday?
I would like to know how to manage logs, I would like to keep last 10 days
worth of logs, but not more that that, as they can be very big.
Any ideas What Elasticsearch already does and what I need to do in order
to manage logs?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/61f7ff1c-021e-4aa9-bffd-ba72a6837c37%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/61f7ff1c-021e-4aa9-bffd-ba72a6837c37%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQD2AV3Kk3iZbG8%3DCSGJ4PR074c2X_Bin_PvKppnJHh7GA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Nik Everett) #3

On Mon, Jun 30, 2014 at 1:51 PM, Ivan Brusic ivan@brusic.com wrote:

Elasticsearch uses log4j for logging, so all logging configuration can be
done via the log4j config file logging.xml

https://github.com/elasticsearch/elasticsearch/blob/master/config/logging.yml

The default type is dailyRollingFile, which as the name states, rotates
the log file daily.

We need them deleted after the right amount of time so its easier for us to
just let logrotate do everything:
http://git.wikimedia.org/blob/operations%2Fpuppet.git/production/modules%2Felasticsearch%2Ffiles%2Flogrotate
http://git.wikimedia.org/blob/operations%2Fpuppet.git/production/modules%2Felasticsearch%2Ftemplates%2Flogging.yml.erb

That last one is an erb file so don't use it verbatim - just use it for
inspiration if you need it.

Nik

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd3LXqpE41xwL6fLgfqnGU%2BBKvn94kY-ktO13WRAdOeVBQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(IronMike) #4

Thanks, So do you keep all the logs? How do you delete old ones?

On Monday, June 30, 2014 1:51:13 PM UTC-4, Ivan Brusic wrote:

Elasticsearch uses log4j for logging, so all logging configuration can be
done via the log4j config file logging.xml

https://github.com/elasticsearch/elasticsearch/blob/master/config/logging.yml

The default type is dailyRollingFile, which as the name states, rotates
the log file daily.

--
Ivan

On Mon, Jun 30, 2014 at 8:02 AM, IronMan2014 <sabda...@gmail.com
<javascript:>> wrote:

Does ElasticSearch roll logs? Does it create new log with different name
everyday?
I would like to know how to manage logs, I would like to keep last 10
days worth of logs, but not more that that, as they can be very big.
Any ideas What Elasticsearch already does and what I need to do in order
to manage logs?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/61f7ff1c-021e-4aa9-bffd-ba72a6837c37%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/61f7ff1c-021e-4aa9-bffd-ba72a6837c37%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c5ce353f-7275-40cc-b2bc-6a8376dbb091%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #5