Can't search with sort query


(porin poporin) #1

Hello,

We updated Elasticsearch from V0.19 to V1.0 this time.
We used V0.19 data directory when we updated.

Throwing request of search with designation of sort after the update , 500
error is returned.
This error's reason is NullPointerException.

Is this problem bug ? or We are doing something wrong?

We would like to know reason of this problem.

Thank you for any help,
-shouhei

■curl example

curl "http://localhost:9200/u0_sc-vsa/EntityType/_search" -d '
{
"sort": [
{
"s.Name.untouched": {
"order": "asc",
"ignore_unmapped": true
}
}
],
"query": {
"bool": {
"must": [
{
"term": {
"c": "Y0SYndNaR7ujvhyS92nDag"
}
},
{
"term": {
"b": "yOQ16mcGSr-59RgK4AmyBA"
}
},
{
"term": {
"n": "abxoR9sbRtmf5jM8BdPuwA"
}
}
]
}
},
"filter": {
},
"size": 25,
"version": true
}
' -k -i -s

HTTP/1.1 500 Internal Server Error
Content-Type: application/json; charset=UTF-8
Content-Length: 6310

{"error":"SearchPhaseExecutionException[Failed to execute phase [query],
all shards failed; shardFailures
{[jBhjWEptRC2rshVakpEpFg][u0_sc-vsa][1]:
RemoteTransportException[[pcs-perf-es112][inet[/172.20.35.13:9300
]][search/phase/query]]; nested:
QueryPhaseExecutionException[[u0_sc-vsa][1]: query[filtered(+c:Y0SYndNaR7
ujvhyS92nDag +b:yOQ16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[2
5],sort[<custom:"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcomparator.BytesRefFieldCompa
ratorSource@5e2036ee>]: Query Failed [Failed to execute main query]];
nested: ElasticsearchException[java.
lang.NullPointerException]; nested:
UncheckedExecutionException[java.lang.NullPointerException]; nested: N
ullPointerException; }{[jBhjWEptRC2rshVakpEpFg][u0_sc-vsa][2]:
RemoteTransportException[[pcs-perf-es112][i net[/172.20.35.13:9300]][search/phase/query]]; nested:
QueryPhaseExecutionException[[u0_sc-vsa][2]: query[
filtered(+c:Y0SYndNaR7ujvhyS92nDag +b:yOQ16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:Entit
yType)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcompara
tor.BytesRefFieldComparatorSource@7cc504da>]: Query Failed [Failed to
execute main query]]; nested: Elasti
csearchException[java.lang.NullPointerException]; nested:
UncheckedExecutionException[java.lang.NullPointe
rException]; nested: NullPointerException;
}{[ZVpRipO-TNS79hj4Cq6JdQ][u0_sc-vsa][0]: QueryPhaseExecutionEx
ception[[u0_sc-vsa][0]: query[filtered(+c:Y0SYndNaR7ujvhyS92nDag
+b:yOQ16mcGSr-59RgK4AmyBA +n:abxoR9sbRtmf
5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsearc
h.index.fielddata.fieldcomparator.BytesRefFieldComparatorSource@665e6c29>]:
Query Failed [Failed to execut
e main query]]; nested:
ElasticsearchException[java.lang.NullPointerException]; nested:
UncheckedExecution
Exception[java.lang.NullPointerException]; nested: NullPointerException;
}{[jBhjWEptRC2rshVakpEpFg][u0_sc- vsa][9]:
RemoteTransportException[[pcs-perf-es112][inet[/172.20.35.13:9300]][search/phase/query]];
nested:
QueryPhaseExecutionException[[u0_sc-vsa][9]:
query[filtered(+c:Y0SYndNaR7ujvhyS92nDag +b:yOQ16mcGSr-59RgK
4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],sort[<custom:"s.Name.untouc
hed":
org.elasticsearch.index.fielddata.fieldcomparator.BytesRefFieldComparatorSource@4a23326d>]:
Query
Failed [Failed to execute main query]]; nested:
ElasticsearchException[java.lang.NullPointerException]; n
ested: UncheckedExecutionException[java.lang.NullPointerException];
nested: NullPointerException; }{[jBhj
WEptRC2rshVakpEpFg][u0_sc-vsa][7]:
RemoteTransportException[[pcs-perf-es112][inet[/172.20.35.13:9300]][se
arch/phase/query]]; nested: QueryPhaseExecutionException[[u0_sc-vsa][7]:
query[filtered(+c:Y0SYndNaR7ujvh
yS92nDag +b:yOQ16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],
sort[<custom:"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcomparator.BytesRefFieldCompara
torSource@3483aac1>]: Query Failed [Failed to execute main query]];
nested: ElasticsearchException[java.l
ang.NullPointerException]; nested:
UncheckedExecutionException[java.lang.NullPointerException]; nested: N
ullPointerException; }{[jBhjWEptRC2rshVakpEpFg][u0_sc-vsa][8]:
RemoteTransportException[[pcs-perf-es112][
inet[/172.20.35.13:9300]][search/phase/query]]; nested:
QueryPhaseExecutionException[[u0_sc-vsa][8]: quer
y[filtered(+c:Y0SYndNaR7ujvhyS92nDag +b:yOQ16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:En
tityType)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcom
parator.BytesRefFieldComparatorSource@6e4bc352>]: Query Failed [Failed to
execute main query]]; nested: E
lasticsearchException[java.lang.NullPointerException]; nested:
UncheckedExecutionException[java.lang.Null
PointerException]; nested: NullPointerException;
}{[jBhjWEptRC2rshVakpEpFg][u0_sc-vsa][5]: RemoteTranspor
tException[[pcs-perf-es112][inet[/172.20.35.13:9300]][search/phase/query]];
nested: QueryPhaseExecutionEx
ception[[u0_sc-vsa][5]: query[filtered(+c:Y0SYndNaR7ujvhyS92nDag
+b:yOQ16mcGSr-59RgK4AmyBA +n:abxoR9sbRtm
f5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsea
rch.index.fielddata.fieldcomparator.BytesRefFieldComparatorSource@36f2b3aa>]:
Query Failed [Failed to exe
cute main query]]; nested:
ElasticsearchException[java.lang.NullPointerException]; nested:
UncheckedExecu
tionException[java.lang.NullPointerException]; nested:
NullPointerException; }{[ZVpRipO-TNS79hj4Cq6JdQ][u 0_sc-vsa][6]: QueryPhaseExecutionException[[u0_sc-vsa][6]:
query[filtered(+c:Y0SYndNaR7ujvhyS92nDag +b:yO
Q16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],sort[<custom:
"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcomparator.BytesRefFieldComparatorSource@1088
d932>]: Query Failed [Failed to execute main query]]; nested:
ElasticsearchException[java.lang.NullPointe
rException]; nested:
UncheckedExecutionException[java.lang.NullPointerException]; nested:
NullPointerExce
ption; }{[ZVpRipO-TNS79hj4Cq6JdQ][u0_sc-vsa][3]:
QueryPhaseExecutionException[[u0_sc-vsa][3]: query[filte
red(+c:Y0SYndNaR7ujvhyS92nDag +b:yOQ16mcGSr-59RgK4AmyBA
+n:abxoR9sbRtmf5jM8BdPuwA)->cache(_type:EntityTyp
e)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsearch.index.fielddata.fieldcomparator
.BytesRefFieldComparatorSource@4a45312f>]: Query Failed [Failed to execute
main query]]; nested: Elastics
earchException[java.lang.NullPointerException]; nested:
UncheckedExecutionException[java.lang.NullPointer
Exception]; nested: NullPointerException;
}{[ZVpRipO-TNS79hj4Cq6JdQ][u0_sc-vsa][4]: QueryPhaseExecutionEx
ception[[u0_sc-vsa][4]: query[filtered(+c:Y0SYndNaR7ujvhyS92nDag
+b:yOQ16mcGSr-59RgK4AmyBA +n:abxoR9sbRtm
f5jM8BdPuwA)->cache(_type:EntityType)],from[0],size[25],sort[<custom:"s.Name.untouched":
org.elasticsea
rch.index.fielddata.fieldcomparator.BytesRefFieldComparatorSource@417a3e18>]:
Query Failed [Failed to exe
cute main query]]; nested:
ElasticsearchException[java.lang.NullPointerException]; nested:
UncheckedExecu
tionException[java.lang.NullPointerException]; nested:
NullPointerException; }]","status":500}

■Log of elasticserch

[2014-02-07 15:26:58,072][DEBUG][action.search.type ] [XXXX] [u0_sc- vsa][2], node[jBhjWEp
tRC2rshVakpEpFg], [P], s[STARTED]: Failed to execute [org.elasticsearch.
action.search.SearchRequest@12bda05a]
org.elasticsearch.transport.RemoteTransportException: [pcs-perf-es112][inet
[/172.20.35.13:9300]][search/phase/query]
Caused by: org.elasticsearch.search.query.QueryPhaseExecutionException: [
u0_sc-vsa][2]: query[ConstantSc
ore(cache(_type:EntityType))],from[0],size[1],sort[<custom:
"s.Name.untouched": org.elasticsearch.index.f
ielddata.fieldcomparator.BytesRefFieldComparatorSource@7f9b98a7>]: Query
Failed [Failed to execute main query]
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java
:126)
at org.elasticsearch.search.SearchService.executeQueryPhase(
SearchService.java:244)
at org.elasticsearch.search.action.
SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(
SearchServiceTransportAction.java:623)
at org.elasticsearch.search.action.
SearchServiceTransportAction$SearchQueryTransportHandler.messageReceived(
SearchServiceTransportAction.java:612)
at org.elasticsearch.transport.netty.
MessageChannelHandler$RequestHandler.run(MessageChannelHandler.java:270)
at java.util.concurrent.ThreadPoolExecutor.runWorker(
ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: org.elasticsearch.ElasticsearchException: java.lang.
NullPointerException
at org.elasticsearch.index.fielddata.AbstractIndexFieldData.load(
AbstractIndexFieldData.java:75)
at org.elasticsearch.index.fielddata.plain.
AbstractBytesIndexFieldData.load(AbstractBytesIndexFieldData.java:41)
at org.elasticsearch.index.fielddata.fieldcomparator.
BytesRefOrdValComparator.setNextReader(BytesRefOrdValComparator.java:274)
at org.elasticsearch.index.fielddata.fieldcomparator.
BytesRefOrdValComparator$PerSegmentComparator.setNextReader(
BytesRefOrdValComparator.java:157)
at org.apache.lucene.search.
TopFieldCollector$OneComparatorNonScoringCollector.setNextReader(
TopFieldCollector.java:97)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:
612)
at org.elasticsearch.search.internal.ContextIndexSearcher.search(
ContextIndexSearcher.java:173)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:
581)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:
533)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:
510)
at org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:
345)
at org.elasticsearch.search.query.QueryPhase.execute(QueryPhase.java
:115)
... 7 more
Caused by: org.elasticsearch.common.util.concurrent.
UncheckedExecutionException: java.lang.NullPointerException
at org.elasticsearch.common.cache.LocalCache$Segment.get(LocalCache.
java:2201)
at org.elasticsearch.common.cache.LocalCache.get(LocalCache.java:
3934)
at org.elasticsearch.common.cache.LocalCache$LocalManualCache.get(
LocalCache.java:4736)
at org.elasticsearch.indices.fielddata.cache.
IndicesFieldDataCache$IndexFieldCache.load(IndicesFieldDataCache.java:135)
at org.elasticsearch.index.fielddata.AbstractIndexFieldData.load(
AbstractIndexFieldData.java:69)
... 18 more
Caused by: java.lang.NullPointerException

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bba1f709-c24a-4606-adeb-da11d9b6107f%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Binh Ly) #2

Can you try this:

  1. Backup your data dir

  2. Run an optimize on your index (curl -XPOST 'http://localhost:9200/u0_sc-vsa/_optimize?max_num_segments=1')
    and wait until it is completed

  3. Run your above query again

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/72ff3de4-0f71-4b40-b6da-acfa5fc96a6e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(porin poporin) #3

I tried and succeeded.
The problem was solved.

thanks

2014年2月19日水曜日 0時34分57秒 UTC+9 Binh Ly:

Can you try this:

  1. Backup your data dir

  2. Run an optimize on your index (curl -XPOST '
    http://localhost:9200/u0_sc-vsa/_optimize?max_num_segments=1') and wait
    until it is completed

  3. Run your above query again

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5397d6ce-8269-41e6-823d-0d2c6dacf9e0%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #4