Logging of queries for debugging

Elastic Stack Elasticsearch
#1

Hi,

is it possible to log incomming queries? I have a query which results
differ if I execute it via cURL or jQuery.

For debugging it would be great to have the possibility to log incoming
queries.

Best,

Oliver

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#2

You can log slow queries.
http://www.elasticsearch.org/guide/reference/index-modules/slowlog/

So may be setting to something like: index.search.slowlog.threshold.query.trace: 5ms could help?

--
David Pilato | Technical Advocate | Elasticsearch.com
@dadoonet | @elasticsearchfr | @scrutmydocs

Le 31 juil. 2013 à 15:08, "Oliver B. Fischer" mailsink@swe-blog.net a écrit :

Hi,

is it possible to log incomming queries? I have a query which results differ if I execute it via cURL or jQuery.

For debugging it would be great to have the possibility to log incoming queries.

Best,

Oliver

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#3

Hi David,

I set all settings to 1ms but ES logs only that a slow search happened
but not the query itself. And I need the query.

It is very disappointing that ES does not support such basic
development/operations/debugging feature.

Best,

Oliver

Am 31.07.13 15:19, schrieb David Pilato:

You can log slow queries.
http://www.elasticsearch.org/guide/reference/index-modules/slowlog/

So may be setting to something like:
index.search.slowlog.threshold.query.trace: 5ms could help?

--
David Pilato | /Technical Advocate/ | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr |@scrutmydocs
https://twitter.com/scrutmydocs

Le 31 juil. 2013 à 15:08, "Oliver B. Fischer" <mailsink@swe-blog.net
mailto:mailsink@swe-blog.net> a écrit :

Hi,

is it possible to log incomming queries? I have a query which results
differ if I execute it via cURL or jQuery.

For debugging it would be great to have the possibility to log
incoming queries.

Best,

Oliver

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com
mailto:elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#4

May be changing log level in logging.yml will show you some elements.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 août 2013 à 01:07, "Oliver B. Fischer" mailsink@swe-blog.net a écrit :

Hi David,

I set all settings to 1ms but ES logs only that a slow search happened but not the query itself. And I need the query.

It is very disappointing that ES does not support such basic development/operations/debugging feature.

Best,

Oliver

Am 31.07.13 15:19, schrieb David Pilato:

You can log slow queries.
http://www.elasticsearch.org/guide/reference/index-modules/slowlog/

So may be setting to something like:
index.search.slowlog.threshold.query.trace: 5ms could help?

--
David Pilato | /Technical Advocate/ | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr |@scrutmydocs
https://twitter.com/scrutmydocs

Le 31 juil. 2013 à 15:08, "Oliver B. Fischer" <mailsink@swe-blog.net
mailto:mailsink@swe-blog.net> a écrit :

Hi,

is it possible to log incomming queries? I have a query which results
differ if I execute it via cURL or jQuery.

For debugging it would be great to have the possibility to log
incoming queries.

Best,

Oliver

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com
mailto:elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#5

A few months ago, I offered a patch so that lowering the log level in
logging.yml can be used to show the queries.

Best,

Jörg

On Sat, Aug 3, 2013 at 7:22 AM, David Pilato david@pilato.fr wrote:

May be changing log level in logging.yml will show you some elements.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 août 2013 à 01:07, "Oliver B. Fischer" mailsink@swe-blog.net a
écrit :

Hi David,

I set all settings to 1ms but ES logs only that a slow search happened but
not the query itself. And I need the query.

It is very disappointing that ES does not support such basic
development/operations/debugging feature.

Best,

Oliver

Am 31.07.13 15:19, schrieb David Pilato:

You can log slow queries.
http://www.elasticsearch.org/guide/reference/index-modules/slowlog/

So may be setting to something like:
index.search.slowlog.threshold.query.trace: 5ms could help?

--
David Pilato | /Technical Advocate/ | Elasticsearch.com
http://Elasticsearch.com
@dadoonet https://twitter.com/dadoonet | @elasticsearchfr
https://twitter.com/elasticsearchfr |@scrutmydocs
https://twitter.com/scrutmydocs

Le 31 juil. 2013 à 15:08, "Oliver B. Fischer" <mailsink@swe-blog.net
mailto:mailsink@swe-blog.net> a écrit :

Hi,

is it possible to log incomming queries? I have a query which results
differ if I execute it via cURL or jQuery.

For debugging it would be great to have the possibility to log
incoming queries.

Best,

Oliver

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com
mailto:elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#6

Would be great to see this patch included in ES. I consider this patch
as very helpful for the community.

@David: It would be great if you could review this patch and apply it to
ES.

BYe,

Oliver

Am 03.08.13 18:45, schrieb joergprante@gmail.com:

A few months ago, I offered a patch so that lowering the log level in
logging.yml can be used to show the queries.

https://github.com/elasticsearch/elasticsearch/pull/3041

Best,

Jörg

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#7

I was able to capture the query send by jQuery with an capturing session
with Wireshark. Now I know why the jQuery result is different from the
cURL result.

This is of course a workaround...

Am 03.08.13 07:22, schrieb David Pilato:

May be changing log level in logging.yml will show you some elements.

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 3 août 2013 à 01:07, "Oliver B. Fischer" mailsink@swe-blog.net a écrit :

Hi David,

I set all settings to 1ms but ES logs only that a slow search happened but not the query itself. And I need the query.

It is very disappointing that ES does not support such basic development/operations/debugging feature.

Best,

Oliver

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

#8

Hi Oliver,

I got the same issue of getting different results for a elasticsearch query using python requests and a normal curl request.

Is it because of any internal cache issues within elasticsearch? Can you help me solve this.

Thank you,
Santosh

#9