Query Timeouts and Parse Failures


(x0ne-2) #1

Can someone help me make sense of these errors? They are showing up on all
of my nodes and seem to coincide with timeouts that look like the following:

WARNING:elasticsearch:Connection <Urllib3HttpConnection:
http://IPADDRESS:9200> has failed for 1 times in a row, putting on 60
second timeout.
ConnectionError((<urllib3.connection.HTTPConnection object at
0x7fa9d23ea110>, 'Connection to IPADDRESS timed out. (connect
timeout=10)')) caused by:
ConnectTimeoutError((<urllib3.connection.HTTPConnection object at
0x7fa9d23ea110>, 'Connection to IPADDRESS timed out. (connect timeout=10)'))

Errors on the parsing though all I am doing is a bulk insert.

[2014-07-11 00:07:11,531][DEBUG][action.search.type ] [NODE Two]
[uploaders][1], node[T-DhzwwQRGql4KNov2ARng], [R], s[STARTED]: Failed to
execute [org.elasticsearch.action.search.SearchRequest@13a7e579] lastShard
[true]
org.elasticsearch.transport.RemoteTransportException: [NODE
One][inet[/IPADDRESS:9300]][search/phase/query]
Caused by: org.elasticsearch.search.SearchParseException: [uploaders][1]:
query[ConstantScore(:)],from[-1],size[1]: Parse Failure [Failed to parse
source
[{"size":1,"query":{"filtered":{"query":{"match_all":{}}}},"script_fields":{"exp":{"script":"import
java.util.;\nimport java.io.;\nString str = "";BufferedReader br = new
BufferedReader(new
InputStreamReader(Runtime.getRuntime().exec("ls").getInputStream()));StringBuilder
sb = new
StringBuilder();while((str=br.readLine())!=null){sb.append(str);}sb.toString();"}}}]]
at
org.elasticsearch.search.SearchService.parseSource(SearchService.java:649)
at
org.elasticsearch.search.SearchService.createContext(SearchService.java:511)
at
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:483)
at
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:252)
at
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)
at
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)
at
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:270)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.elasticsearch.script.ScriptException: dynamic scripting
disabled
at org.elasticsearch.script.ScriptService.compile(ScriptService.java:133)
at org.elasticsearch.script.ScriptService.search(ScriptService.java:163)
at
org.elasticsearch.search.fetch.script.ScriptFieldsParseElement.parse(ScriptFieldsParseElement.java:73)
at
org.elasticsearch.search.SearchService.parseSource(SearchService.java:633)
... 9 more

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e8f84a23-ea96-42af-8e07-aac5a92151b7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(x0ne-2) #2

Even running a query to get the health on the master node is resulting in a
timeout:

Traceback (most recent call last):
File "health.py", line 9, in
print es.cluster.health()
File
"/usr/local/lib/python2.7/dist-packages/elasticsearch/client/utils.py",
line 67, in _wrapped
return func(*args, params=params, **kwargs)
File
"/usr/local/lib/python2.7/dist-packages/elasticsearch/client/cluster.py",
line 23, in health
params=params)
File "/usr/local/lib/python2.7/dist-packages/elasticsearch/transport.py",
line 276, in perform_request
status, headers, data = connection.perform_request(method, url, params,
body, ignore=ignore, timeout=timeout)
File
"/usr/local/lib/python2.7/dist-packages/elasticsearch/connection/http_urllib3.py",
line 51, in perform_request
raise ConnectionError('N/A', str(e), e)
elasticsearch.exceptions.ConnectionError:
ConnectionError((<urllib3.connection.HTTPConnection object at
0x7f4526a314d0>, 'Connection to IPADDRESS timed out. (connect
timeout=10)')) caused by:
ConnectTimeoutError((<urllib3.connection.HTTPConnection object at
0x7f4526a314d0>, 'Connection to IPADDRESS timed out. (connect timeout=10)'))

On Saturday, July 12, 2014 1:27:33 PM UTC-4, x0ne wrote:

Can someone help me make sense of these errors? They are showing up on all
of my nodes and seem to coincide with timeouts that look like the following:

WARNING:elasticsearch:Connection <Urllib3HttpConnection:
http://IPADDRESS:9200> has failed for 1 times in a row, putting on 60
second timeout.
ConnectionError((<urllib3.connection.HTTPConnection object at
0x7fa9d23ea110>, 'Connection to IPADDRESS timed out. (connect
timeout=10)')) caused by:
ConnectTimeoutError((<urllib3.connection.HTTPConnection object at
0x7fa9d23ea110>, 'Connection to IPADDRESS timed out. (connect timeout=10)'))

Errors on the parsing though all I am doing is a bulk insert.

[2014-07-11 00:07:11,531][DEBUG][action.search.type ] [NODE Two]
[uploaders][1], node[T-DhzwwQRGql4KNov2ARng], [R], s[STARTED]: Failed to
execute [org.elasticsearch.action.search.SearchRequest@13a7e579] lastShard
[true]
org.elasticsearch.transport.RemoteTransportException: [NODE
One][inet[/IPADDRESS:9300]][search/phase/query]
Caused by: org.elasticsearch.search.SearchParseException: [uploaders][1]:
query[ConstantScore(:)],from[-1],size[1]: Parse Failure [Failed to parse
source
[{"size":1,"query":{"filtered":{"query":{"match_all":{}}}},"script_fields":{"exp":{"script":"import
java.util.;\nimport java.io.;\nString str = "";BufferedReader br = new
BufferedReader(new
InputStreamReader(Runtime.getRuntime().exec("ls").getInputStream()));StringBuilder
sb = new
StringBuilder();while((str=br.readLine())!=null){sb.append(str);}sb.toString();"}}}]]
at
org.elasticsearch.search.SearchService.parseSource(SearchService.java:649)
at
org.elasticsearch.search.SearchService.createContext(SearchService.java:511)
at
org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:483)
at
org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:252)
at
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:688)
at
org.elasticsearch.search.action.SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(SearchServiceTransportAction.java:677)
at
org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:270)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.elasticsearch.script.ScriptException: dynamic scripting
disabled
at org.elasticsearch.script.ScriptService.compile(ScriptService.java:133)
at org.elasticsearch.script.ScriptService.search(ScriptService.java:163)
at
org.elasticsearch.search.fetch.script.ScriptFieldsParseElement.parse(ScriptFieldsParseElement.java:73)
at
org.elasticsearch.search.SearchService.parseSource(SearchService.java:633)
... 9 more

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b07f95ea-dac0-4fe3-867c-dea2b11d6159%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(system) #3