[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]];

Elastic Stack Elasticsearch
1

when i search index and use aggregation ，i got this problem which i never catch and use normal before!
the full exception like this:
2015-12-29 12:45:38 ERROR com.eps.search.service.indicator.IndicatorServiceImpl[http-bio-8080-exec-2] 3670133 ms - searchIndicatorResult.error---
org.elasticsearch.action.search.SearchPhaseExecutionException: Failed to execute phase [query], all shards failed; shardFailures {[vCSoIfjWTs2Pk_j6Kno9RQ][fact_indicator][0]: ElasticsearchException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: UncheckedExecutionException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: CircuitBreakingException[[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; }{[vCSoIfjWTs2Pk_j6Kno9RQ][fact_indicator][1]: ElasticsearchException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: UncheckedExecutionException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: CircuitBreakingException[[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; }{[vCSoIfjWTs2Pk_j6Kno9RQ][fact_indicator][2]: ElasticsearchException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: UncheckedExecutionException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: CircuitBreakingException[[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; }{[vCSoIfjWTs2Pk_j6Kno9RQ][fact_indicator][3]: ElasticsearchException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: UncheckedExecutionException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: CircuitBreakingException[[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; }{[vCSoIfjWTs2Pk_j6Kno9RQ][fact_indicator][4]: ElasticsearchException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: UncheckedExecutionException[org.elasticsearch.common.breaker.CircuitBreakingException: [FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; nested: CircuitBreakingException[[FIELDDATA] Data too large, data for [cubeId] would be larger than limit of [155713536/148.5mb]]; }
at org.elasticsearch.action.search.type.TransportSearchDfsQueryThenFetchAction$AsyncAction.onQueryFailure(TransportSearchDfsQueryThenFetchAction.java:137)
at org.elasticsearch.action.search.type.TransportSearchDfsQueryThenFetchAction$AsyncAction$1.onFailure(TransportSearchDfsQueryThenFetchAction.java:118)
at org.elasticsearch.search.action.SearchServiceTransportAction$23.run(SearchServiceTransportAction.java:565)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

esss.png1540×105 6.26 KB

QQ图片20151229124553.png1529×244 25.1 KB

2

You need add more heap or query less data.

3

thanks,but i use this method normally before and never occur it.

where can i set the heap for my query memory？ is in the elasticsearch.yml?

the problem is i query my data and set size 15 already...
one time,i query and the keyword is null.is this occur the problem ?

4

jvm.png789×190 4.35 KB

5

Please don't attach images, copy the text.

How did you install ES?

6

sorry..

ES_CLASSPATH=$ES_CLASSPATH:$ES_HOME/lib/elasticsearch-1.7.1.jar:$ES_HOME/lib/:$ES_HOME/lib/sigar/

if [ "x$ES_MIN_MEM" = "x" ]; then
ES_MIN_MEM=256m
fi
if [ "x$ES_MAX_MEM" = "x" ]; then
ES_MAX_MEM=2g
fi
if [ "x$ES_HEAP_SIZE" != "x" ]; then
ES_MIN_MEM=$ES_HEAP_SIZE
ES_MAX_MEM=$ES_HEAP_SIZE
fi

7

and i install it with elasticsearch-1.7.1.tar.gz in centos 7.0 and just unzip it .
start it whit a elasticsearch-service.

8

You should really use the RPM, it includes things like standard install, config and logging directories as well as service wrappers.