Can't use _all index with Kibana 4.1.1

scaissie · August 27, 2015, 7:57pm

I am using Elasticsearch 1.7.1. I'm using Tribe Node with three clusters.
I can query the _all index using curl on the Tribe Node:
curl http://localhost:9200/_all/_search?pretty
But I can't query the _all index from Kibana 4.1.1

To add the _all index to Kibana, I went to Settings->Indicies, unchecked all of the boxes on the "Configure an index pattern" form and added _all to the "Index name or pattern" form field. Kibana was happy with that, until I go to Discover. There I get:
Discover: An error occurred with your request. Reset your inputs and try again.

tbragin · August 28, 2015, 4:12am

Any additional errors in Elasticsearch or Kibana logs? Any errors in developer console in Chrome?

scaissie · August 28, 2015, 3:21pm

Here are the elasticsearch log messages. I didn't see anything interesting in the Kibana logs. I'll add the Chrome developer console messages in another post.

From the elasticsearch log:
[2015-08-28 14:41:23,052][DEBUG][action.search.type ] [aws-usnv-sensu1] [aws-aptk-2015.08.25][4]: Failed to execute [org.elasticsearch.action.search.SearchRequest@19151913] while moving to second phase
java.lang.ClassCastException: java.lang.Long cannot be cast to org.apache.lucene.util.BytesRef
at org.apache.lucene.search.FieldComparator$TermOrdValComparator.compareValues(FieldComparator.java:902)
at org.apache.lucene.search.TopDocs$MergeSortQueue.lessThan(TopDocs.java:172)
at org.apache.lucene.search.TopDocs$MergeSortQueue.lessThan(TopDocs.java:120)
at org.apache.lucene.util.PriorityQueue.upHeap(PriorityQueue.java:225)
at org.apache.lucene.util.PriorityQueue.add(PriorityQueue.java:133)
at org.apache.lucene.search.TopDocs.merge(TopDocs.java:234)
at org.elasticsearch.search.controller.SearchPhaseController.sortDocs(SearchPhaseController.java:239)
at org.elasticsearch.action.search.type.TransportSearchQueryThenFetchAction$AsyncAction.moveToSecondPhase(TransportSearchQueryThenFetchAction.java:89)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.innerMoveToSecondPhase(TransportSearchTypeAction.java:403)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult(TransportSearchTypeAction.java:202)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$1.onResult(TransportSearchTypeAction.java:178)
at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$1.onResult(TransportSearchTypeAction.java:175)
at org.elasticsearch.search.action.SearchServiceTransportAction$6.handleResponse(SearchServiceTransportAction.java:244)
at org.elasticsearch.search.action.SearchServiceTransportAction$6.handleResponse(SearchServiceTransportAction.java:235)
at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:163)
at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:132)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443)
at org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:310)
at org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337)
at org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89)
at org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108)
at org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

scaissie · August 28, 2015, 3:22pm

Chrome developer console messages:

[10713:1299:0828/110210:INFO:CONSOLE(19337)] "TypeError: Cannot read property 'aggs' of undefined
[10713:1299:0828/110211:INFO:CONSOLE(144408)] "[object Object]", source: http://kibana-server:5601/index.js?_b=7489 (144408)
[10713:1299:0828/110311:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running contextMenus.create: Cannot create item with duplicate id translate
[10713:1299:0828/110314:INFO:CONSOLE(45625)] "Root Search Source:", source: http://kibana-server:5601/index.js?_b=7489 (45625)
[10713:1299:0828/110314:INFO:CONSOLE(45923)] "complete in 0.13ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)
[10713:1299:0828/110314:INFO:CONSOLE(45923)] "complete in 0.19ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)
[10713:1299:0828/110314:INFO:CONSOLE(45923)] "complete in 1.89ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)
[10713:1299:0828/110314:INFO:CONSOLE(45923)] "complete in 2.09ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)
[10713:1299:0828/110315:INFO:CONSOLE(45923)] "complete in 0.51ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)
[10713:1299:0828/110346:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running contextMenus.create: Cannot create item with duplicate id translate
[10713:1299:0828/110347:INFO:CONSOLE(45625)] "Root Search Source:", source: http://kibana-server:5601/index.js?_b=7489 (45625)
[10713:1299:0828/110347:INFO:CONSOLE(45923)] "complete in 0.46ms", source: http://kibana-server:5601/index.js?_b=7489 (45923)

spalger · September 1, 2015, 9:34pm

Thanks for the console output @scaissie.

Unfortunately it doesn't really discuss what happened in the request to cause it to fail. Can you find the _msearch request in the network tab for this request and copy/paste the response from elasticsearch here?

scaissie · September 2, 2015, 3:54pm

The response:
{"responses":[{"error":"ReduceSearchPhaseException[Failed to execute phase [query], [reduce] ]; nested: ClassCastException[java.lang.Long cannot be cast to org.apache.lucene.util.BytesRef]; "}]}

inderjeet26 · September 2, 2015, 7:26pm

I am facing the same issue. The response I get in the Network console is :

{"responses":[{"error":"ReduceSearchPhaseException[Failed to execute phase [query], [reduce] ]; nested: ClassCastException; "}]}

I am trying to query a type in the logstash index in Kibana using _type:"aaa" query. It is working for some of the other types I have in the same index _type:"bbb". Pls guide

inderjeet26 · September 3, 2015, 2:39pm

This worked for me https://github.com/elastic/kibana/issues/4593

scaissie · September 3, 2015, 2:57pm

That also worked for me. Many thanks for posting the solution.