I am trying to tune how indexing slowlogs are collected. I know that I can set
a threshold
https://github.com/elasticsearch/elasticsearch/blob/fdf1998f390bf1bb7741c133da7ea35e201f9aed/config/elasticsearch.yml#L364-L367
for how long an indexing op on a shard must take before it is logged. I
would also like to be choose what level I'm logging at. It would appear
that modifying this line
https://github.com/elasticsearch/elasticsearch/blob/fdf1998f390bf1bb7741c133da7ea35e201f9aed/config/logging.yml#L21 in
logging.yml would allow me to do this. However, unless I am
misunderstanding the purpose of that setting, it is being ignored by
ElasticSearch.
Here is how I came to that conclusion. I have ElasticSearch 1.3.2 running
locally on my Mac. I these config files
https://gist.github.com/tdhopper/b3f07829ebd55dc5703f in ~/es-config.
This elasticsearch.yml file is bare-bones, as you can see. The logging.yml
file only modifies this line
https://github.com/elasticsearch/elasticsearch/blob/0b76b0bf79d340c8938afb03736f8a17f333939b/config/logging.yml#L21 of
the default file. My assumption is that this should mean only WARN level
indexing ops are logged.
However, if I start an ES instance using
elasticsearch --config="/Users/tdhopper/es-config/elasticsearch.yml"
and then run this Python script
import elasticsearch, time
es = elasticsearch.Elasticsearch(hosts="localhost")
while True:
print ".",
es.index(index="index1", doc_type="test_doc", body = {"hot_body": 1})
time.sleep(.5)
my ~/es-logs/elasticsearch_index_indexing_slowlog.log file is immediately
filled up with lines like
[2014-08-22 10:24:52,162][INFO ][index.indexing.slowlog.index] [War
Machine] [index1][2] took[1.4ms], took_millis[1], type[test_doc],
id[WH83A0yvRHaQtQ34_6wncg], routing[], source[{"hot_body":1}]
[2014-08-22 10:24:52,666][INFO ][index.indexing.slowlog.index] [War
Machine] [index1][1] took[1.5ms], took_millis[1], type[test_doc],
id[sErCAr3BR_qWVfp0pnayGw], routing[], source[{"hot_body":1}]
That is, INFO level log statements.
Am I misunderstanding the purpose of this setting or is ES ignoring my
request?
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/855ae52d-8912-4b90-adda-faf5e7158128%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.