# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1927

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1928

---

## [Validation Failed: 1: id is too long, must be no longer than 512 bytes](https://discuss.elastic.co/t/validation-failed-1-id-is-too-long-must-be-no-longer-than-512-bytes/101924)

<div class="topic-metadata">

**Author:** [@stp\_ra](https://discuss.elastic.co/u/stp_ra)\
**Replies:** 1\
**Last updated:** [October 8, 2017, 11:03am UTC](https://discuss.elastic.co/t/validation-failed-1-id-is-too-long-must-be-no-longer-than-512-bytes/101924 "2017-10-08T11:03:51Z")

</div>

From this closed thread: Id is too long, must be no longer than 512 I understand that \_id cannot be longer than 512 bytes. Now I am stuck. Since there isn't a unique constraint for a field I have chosen to use \_id. Now t…

---

## [Reindex API - Reference doc](https://discuss.elastic.co/t/reindex-api-reference-doc/103140)

<div class="topic-metadata">

**Author:** [@shaharmor](https://discuss.elastic.co/u/shaharmor)\
**Replies:** 10\
**Last updated:** [October 8, 2017, 10:22am UTC](https://discuss.elastic.co/t/reindex-api-reference-doc/103140 "2017-10-08T10:22:46Z")

</div>

Hi, I'm trying to use the Reindex API to update an existing document, but I can't seem to find how to increment the value of the existing field with the value of the new document.

---

## [Unable to index a file in elasticsearch](https://discuss.elastic.co/t/unable-to-index-a-file-in-elasticsearch/102582)

<div class="topic-metadata">

**Author:** [@f1ccb489d33b33a0f12a](https://discuss.elastic.co/u/f1ccb489d33b33a0f12a)\
**Replies:** 5\
**Last updated:** [October 8, 2017, 9:55am UTC](https://discuss.elastic.co/t/unable-to-index-a-file-in-elasticsearch/102582 "2017-10-08T09:55:28Z")

</div>

i'm using elasticsearch 5.6.0 with logstash and filebeats. i'm trying to index my files by the pattern "filebeat-" and then the source file name. when i used a simple string like "hello" the file got indexed correctly.…

---

## [Sorting by Nested Field](https://discuss.elastic.co/t/sorting-by-nested-field/103141)

<div class="topic-metadata">

**Author:** [@Atul\_Harsha](https://discuss.elastic.co/u/Atul_Harsha)\
**Replies:** 4\
**Last updated:** [October 8, 2017, 9:17am UTC](https://discuss.elastic.co/t/sorting-by-nested-field/103141 "2017-10-08T09:17:50Z")

</div>

Error : \[nested\] query does not support \[filter\] Code : GET /\_search { "query": { "nested": { "path": "comments", "filter": { "range": { "comments.date":…

---

## [Big index vs small ones - querying only subset of the data each time](https://discuss.elastic.co/t/big-index-vs-small-ones-querying-only-subset-of-the-data-each-time/103065)

<div class="topic-metadata">

**Author:** [@Oferkes](https://discuss.elastic.co/u/Oferkes)\
**Replies:** 4\
**Last updated:** [October 8, 2017, 5:13am UTC](https://discuss.elastic.co/t/big-index-vs-small-ones-querying-only-subset-of-the-data-each-time/103065 "2017-10-08T05:13:30Z")

</div>

Hi, i have a daily index with a size of 400GB, ~300M documents, and 9 primary shards (no replicas). the indices are created on a daily basis, and for each new index that is created, the previous one is forced merged to…

---

## [AWS Load Balancer for Elasticsearch Cluster](https://discuss.elastic.co/t/aws-load-balancer-for-elasticsearch-cluster/100565)

<div class="topic-metadata">

**Author:** [@bobby259](https://discuss.elastic.co/u/bobby259)\
**Replies:** 2\
**Last updated:** [October 7, 2017, 11:05pm UTC](https://discuss.elastic.co/t/aws-load-balancer-for-elasticsearch-cluster/100565 "2017-10-07T23:05:36Z")

</div>

I have a 3 Master and 4 Data node cluster running on EC2 instances. I want to set-up a Load Balancer infront of my master nodes. While I try doing so, the application load balancer is failing to register the health of ma…

---

## [Sort by price and stock](https://discuss.elastic.co/t/sort-by-price-and-stock/102719)

<div class="topic-metadata">

**Author:** [@juelisjr](https://discuss.elastic.co/u/juelisjr)\
**Replies:** 1\
**Last updated:** [October 7, 2017, 10:35pm UTC](https://discuss.elastic.co/t/sort-by-price-and-stock/102719 "2017-10-07T22:35:13Z")

</div>

Hi. I have a catalog of products and i'm need to sort the result by price and stock. The products with stock equal 0 need to be in end of result but need to be ordered by price. Example: NAME -\> PRICE -\> STOCK Produc…

---

## [Getting availableProcessors is already set to \[1\], rejecting \[1\] IllegalStateException exception](https://discuss.elastic.co/t/getting-availableprocessors-is-already-set-to-1-rejecting-1-illegalstateexception-exception/103082)

<div class="topic-metadata">

**Author:** [@Rohit\_Nigam](https://discuss.elastic.co/u/Rohit_Nigam)\
**Replies:** 1\
**Last updated:** [October 7, 2017, 5:12pm UTC](https://discuss.elastic.co/t/getting-availableprocessors-is-already-set-to-1-rejecting-1-illegalstateexception-exception/103082 "2017-10-07T17:12:38Z")

</div>

Hi I am using transport client to connect to the elastic search cluster and getting this exception java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.IllegalStateException: ava…

---

## [Can I increase the maximum attachment size for ingestion?](https://discuss.elastic.co/t/can-i-increase-the-maximum-attachment-size-for-ingestion/103119)

<div class="topic-metadata">

**Author:** [@warpraptor](https://discuss.elastic.co/u/warpraptor)\
**Replies:** 3\
**Last updated:** [October 7, 2017, 5:04pm UTC](https://discuss.elastic.co/t/can-i-increase-the-maximum-attachment-size-for-ingestion/103119 "2017-10-07T17:04:59Z")

</div>

I'm indexing a collection of PDF documents. The ingestion Attachment processing pipeline is working fine, but there are a few of the documents that are rather large (because they contain images, etc.). This seems to ru…

---

## [How Percolate can perform, qeries on not analyzed index?](https://discuss.elastic.co/t/how-percolate-can-perform-qeries-on-not-analyzed-index/103098)

<div class="topic-metadata">

**Author:** [@sarath\_r\_nair](https://discuss.elastic.co/u/sarath_r_nair)\
**Replies:** 3\
**Last updated:** [October 7, 2017, 11:47am UTC](https://discuss.elastic.co/t/how-percolate-can-perform-qeries-on-not-analyzed-index/103098 "2017-10-07T11:47:46Z")

</div>

So , after so much of digging around , I came to ask it over here . Let me start with a simple use case . curl -XPUT 'localhost:9200/my-index?pretty' -H 'Content-Type: application/json' -d' { "mappings": { …

---

## [Free license import issue for ELK in version 5.6.2 with xpack freeshly installed,](https://discuss.elastic.co/t/free-license-import-issue-for-elk-in-version-5-6-2-with-xpack-freeshly-installed/103084)

<div class="topic-metadata">

**Author:** [@dje2006dje](https://discuss.elastic.co/u/dje2006dje)\
**Replies:** 5\
**Last updated:** [October 7, 2017, 9:25am UTC](https://discuss.elastic.co/t/free-license-import-issue-for-elk-in-version-5-6-2-with-xpack-freeshly-installed/103084 "2017-10-07T09:25:19Z")

</div>

Hello, after installing xpack i can't apply my license because I have this issue (I have no connection to internet from my Windows 2008 R2 server ) : ... d+AA","start\_date\_in\_millis":1507248000000}} Enter host passw…

---

## [Kibana forcemerge time out](https://discuss.elastic.co/t/kibana-forcemerge-time-out/102870)

<div class="topic-metadata">

**Author:** [@yuanhui](https://discuss.elastic.co/u/yuanhui)\
**Replies:** 3\
**Last updated:** [October 6, 2017, 10:36pm UTC](https://discuss.elastic.co/t/kibana-forcemerge-time-out/102870 "2017-10-06T22:36:25Z")

</div>

I try to delete some old data to clean storage space, I use "POST /index/\_forcemerge?only\_expunge\_deletes=true" in Kibana after a delete-by-query, but I get a 502 time out error everytime, what is wrong here?

---

## [Convert SQL query to Java Elastic Query](https://discuss.elastic.co/t/convert-sql-query-to-java-elastic-query/103017)

<div class="topic-metadata">

**Author:** [@kedarsdixit](https://discuss.elastic.co/u/kedarsdixit)\
**Replies:** 1\
**Last updated:** [October 6, 2017, 9:47pm UTC](https://discuss.elastic.co/t/convert-sql-query-to-java-elastic-query/103017 "2017-10-06T21:47:50Z")

</div>

I am using Transport client to query ES. Need to convert below sql query to Java Queries: SELECT id,max(timestamp2) FROM table GROUP BY id AVING timestamp1 \> "2017-07-13T21:01:00.013Z" I know TermsQueryBuilder and Aggr…

---

## [Reclaim deleted documents memory in Elasticsearch](https://discuss.elastic.co/t/reclaim-deleted-documents-memory-in-elasticsearch/103079)

<div class="topic-metadata">

**Author:** [@Manikanth\_Reddy](https://discuss.elastic.co/u/Manikanth_Reddy)\
**Replies:** 4\
**Last updated:** [October 6, 2017, 9:38pm UTC](https://discuss.elastic.co/t/reclaim-deleted-documents-memory-in-elasticsearch/103079 "2017-10-06T21:38:01Z")

</div>

Hi, We have a situation that we are getting some error documents(grokparsefailure) in elasticsearch from logstash. I have deleted all those documents which are around 2million out of 90days data. This is going to be reg…

---

## [Extended\_bounds for sub agg date histogram](https://discuss.elastic.co/t/extended-bounds-for-sub-agg-date-histogram/103081)

<div class="topic-metadata">

**Author:** [@nade](https://discuss.elastic.co/u/nade)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 9:06pm UTC](https://discuss.elastic.co/t/extended-bounds-for-sub-agg-date-histogram/103081 "2017-10-06T21:06:23Z")

</div>

Hello! I am doing the following: date aggregation by month then a sub aggregation by day. The data has holes and I want to extend the sub aggregation by day to have results for each day. My first instinct was to use …

---

## [Settings to make cluster stable](https://discuss.elastic.co/t/settings-to-make-cluster-stable/103075)

<div class="topic-metadata">

**Author:** [@mario12](https://discuss.elastic.co/u/mario12)\
**Replies:** 2\
**Last updated:** [October 6, 2017, 9:00pm UTC](https://discuss.elastic.co/t/settings-to-make-cluster-stable/103075 "2017-10-06T21:00:47Z")

</div>

We are occasionally encountering es cluster instability due to non optimized query. Our developers are working on optimizing queries. When the poor performing queries are sent to es, gc time spikes and cpu utilization sp…

---

## [Installing ICU Plugin?](https://discuss.elastic.co/t/installing-icu-plugin/102164)

<div class="topic-metadata">

**Author:** [@mwbogucki](https://discuss.elastic.co/u/mwbogucki)\
**Replies:** 3\
**Last updated:** [October 6, 2017, 8:37pm UTC](https://discuss.elastic.co/t/installing-icu-plugin/102164 "2017-10-06T20:37:39Z")

</div>

Hello, I'm curious about installing the ICU-Plugin within our cluster. In particular, does this need to be installed on all nodes, or just the data-nodes? We're running ES ver 2.4.1 Thank you. --Mike

---

## [Delete Docs Based on Field with Multiple Lines Inside](https://discuss.elastic.co/t/delete-docs-based-on-field-with-multiple-lines-inside/103076)

<div class="topic-metadata">

**Author:** [@cb2015](https://discuss.elastic.co/u/cb2015)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 8:19pm UTC](https://discuss.elastic.co/t/delete-docs-based-on-field-with-multiple-lines-inside/103076 "2017-10-06T20:19:50Z")

</div>

Hi all, I have a bunch of docs in my index which are stack traces, and therefore have multiple lines. Here is an example: { "\_index": "web-jsp-2017.10.04", "\_type": "logs", "\_id": "AV7zFQERh\_tiaf86dz-0", "\_…

---

## [Templates don't persist after service restart](https://discuss.elastic.co/t/templates-dont-persist-after-service-restart/99633)

<div class="topic-metadata">

**Author:** [@dmtd](https://discuss.elastic.co/u/dmtd)\
**Replies:** 6\
**Last updated:** [October 6, 2017, 8:06pm UTC](https://discuss.elastic.co/t/templates-dont-persist-after-service-restart/99633 "2017-10-06T20:06:25Z")

</div>

So I’m trying to set templates while elasticsearch is not available to the rest of the network, and then restart elasticsearch in a mode that is available to the rest of the network. When elasticsearch is restarted, the …

---

## [Rest client v5.5.0 compatibility with v5.6.x](https://discuss.elastic.co/t/rest-client-v5-5-0-compatibility-with-v5-6-x/102958)

<div class="topic-metadata">

**Author:** [@abhijat](https://discuss.elastic.co/u/abhijat)\
**Replies:** 6\
**Last updated:** [October 6, 2017, 7:06pm UTC](https://discuss.elastic.co/t/rest-client-v5-5-0-compatibility-with-v5-6-x/102958 "2017-10-06T19:06:46Z")

</div>

Are there any known compatibility issues between rest client v5.5.0 trying to index data into elasticsearch 5.6.2? We have been seeing, intermittently, indexing taking more than 10s. We have our app that is using elasti…

---

## [Querying analyzed fields](https://discuss.elastic.co/t/querying-analyzed-fields/102521)

<div class="topic-metadata">

**Author:** [@pkmital](https://discuss.elastic.co/u/pkmital)\
**Replies:** 1\
**Last updated:** [October 6, 2017, 6:46pm UTC](https://discuss.elastic.co/t/querying-analyzed-fields/102521 "2017-10-06T18:46:13Z")

</div>

Hi I'm attempting to set a field as "indexed": "analyzed" in 5.6 without any luck. It seems the "string" type is deprecated, and specifying the "string" type no longer works when specifying the mapping. Even though th…

---

## [Can I combine delimited\_payload\_filter and min\_hash?](https://discuss.elastic.co/t/can-i-combine-delimited-payload-filter-and-min-hash/103059)

<div class="topic-metadata">

**Author:** [@pkmital](https://discuss.elastic.co/u/pkmital)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 6:38pm UTC](https://discuss.elastic.co/t/can-i-combine-delimited-payload-filter-and-min-hash/103059 "2017-10-06T18:38:37Z")

</div>

Hi there, I'm trying to index an array of floating point values representing features, and be able to perform more\_like\_this queries to find similar documents that share similar floating point features in a multidimensi…

---

## [Help with Scripted\_upsert](https://discuss.elastic.co/t/help-with-scripted-upsert/101543)

<div class="topic-metadata">

**Author:** [@karthi01ec](https://discuss.elastic.co/u/karthi01ec)\
**Replies:** 0\
**Last updated:** [September 22, 2017, 11:07pm UTC](https://discuss.elastic.co/t/help-with-scripted-upsert/101543 "2017-09-22T23:07:32Z")

</div>

Hi, I have a 3 node cluster and i have workflow we i create or update the document . I using the groovy script for both create and update . In the update request i set scripted\_upsert = true. My understanding is if the…

---

## [Snapshot restore Failed recovery of index, getting FileAlreadyExistsException](https://discuss.elastic.co/t/snapshot-restore-failed-recovery-of-index-getting-filealreadyexistsexception/100300)

<div class="topic-metadata">

**Author:** [@rinu](https://discuss.elastic.co/u/rinu)\
**Replies:** 9\
**Last updated:** [October 6, 2017, 6:02pm UTC](https://discuss.elastic.co/t/snapshot-restore-failed-recovery-of-index-getting-filealreadyexistsexception/100300 "2017-10-06T18:02:14Z")

</div>

When trying to restore a 2.2 snapshot on 5.1.1 cluster the below exception returned. out of 10 shards, 2 shards failed recovery. Able to restore the same snapshot in 2.2 and 5.5 cluster. Any idea why? there is no memory…

---

## [Getting AggregationExecutionException:could not find the appropriate value context to perform aggregation \[startd\]\];](https://discuss.elastic.co/t/getting-aggregationexecutionexception-could-not-find-the-appropriate-value-context-to-perform-aggregation-startd/103053)

<div class="topic-metadata">

**Author:** [@eswar](https://discuss.elastic.co/u/eswar)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 5:31pm UTC](https://discuss.elastic.co/t/getting-aggregationexecutionexception-could-not-find-the-appropriate-value-context-to-perform-aggregation-startd/103053 "2017-10-06T17:31:50Z")

</div>

I have data in this format { "\_index": "resources", "\_type": "cresource", "\_id": "a1\_6980", "\_score": 1.0, "\_source": { "name": "a1\_6980", "region": "useast", "costs": \[{ "cost": 8.464E-4, "endDate": "2017-02-…

---

## [Date vs date\_range field](https://discuss.elastic.co/t/date-vs-date-range-field/103043)

<div class="topic-metadata">

**Author:** [@covolution](https://discuss.elastic.co/u/covolution)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 4:01pm UTC](https://discuss.elastic.co/t/date-vs-date-range-field/103043 "2017-10-06T16:01:35Z")

</div>

I am wondering how to choose between using a standard date field and the new date\_range field. Any advice? A previous topic suggested that aggregations aren't supported on date\_ranges, is this still the case? If I …

---

## [When does elasticsearch throw 'NoClassDefFoundError'?](https://discuss.elastic.co/t/when-does-elasticsearch-throw-noclassdeffounderror/102995)

<div class="topic-metadata">

**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\
**Replies:** 2\
**Last updated:** [October 6, 2017, 3:57pm UTC](https://discuss.elastic.co/t/when-does-elasticsearch-throw-noclassdeffounderror/102995 "2017-10-06T15:57:14Z")

</div>

Hi I am seeing intermittent exception - java.lang.NoClassDefFoundError: Could not initialize class org.elasticsearch.transport.ReceiveTimeoutTransportException at org.elasticsearch.transport.TransportService$Ti…

---

## [2.3.1 transport client failed to get local cluster state](https://discuss.elastic.co/t/2-3-1-transport-client-failed-to-get-local-cluster-state/103041)

<div class="topic-metadata">

**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 3:49pm UTC](https://discuss.elastic.co/t/2-3-1-transport-client-failed-to-get-local-cluster-state/103041 "2017-10-06T15:49:58Z")

</div>

In 2.3.1 I am seeing an exception similar to the one mentioned here. Below is the exception:-1: INFO \[2017-08-08 20:14:18,019\] \[U:3,129,F:822,T:3,950,M:3,950\] elasticsearch.client.transport:\[TransportClientNodesService…

---

## [Date Histogram Aggregation is not working for me](https://discuss.elastic.co/t/date-histogram-aggregation-is-not-working-for-me/103034)

<div class="topic-metadata">

**Author:** [@Dilip\_Kumar](https://discuss.elastic.co/u/Dilip_Kumar)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 2:51pm UTC](https://discuss.elastic.co/t/date-histogram-aggregation-is-not-working-for-me/103034 "2017-10-06T14:51:43Z")

</div>

Please help me to es query I have store data in es as { "i": \[ { "ap": "com.touchtype.swiftkey", "t": "1507284964" }, { "ap": "com.sly.sangam.mediametadatareader", "t": "1506398555" }, { "ap": "com.flipkart.a…

---

## [Absurd behaviour in ES Cluster while using aliases](https://discuss.elastic.co/t/absurd-behaviour-in-es-cluster-while-using-aliases/103020)

<div class="topic-metadata">

**Author:** [@Yashpal\_Singh](https://discuss.elastic.co/u/Yashpal_Singh)\
**Replies:** 0\
**Last updated:** [October 6, 2017, 1:37pm UTC](https://discuss.elastic.co/t/absurd-behaviour-in-es-cluster-while-using-aliases/103020 "2017-10-06T13:37:44Z")

</div>

We have 3 node cluster namely node\_1, node\_2 and node\_3. Have Created 3 indexes namely Index A, B and C. Config node\_1 index A node\_2 index B node\_3 index c Have created 3 aliased namely X -\> A y -\>A,B z -\>A,B…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1926)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1928)
