# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1512

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1513

---

## [Regarding Data Loss](https://discuss.elastic.co/t/regarding-data-loss/153104)

<div class="topic-metadata">

**Author:** [@muthualagappan](https://discuss.elastic.co/u/muthualagappan)\
**Replies:** 2\
**Last updated:** [October 19, 2018, 5:30am UTC](https://discuss.elastic.co/t/regarding-data-loss/153104 "2018-10-19T05:30:24Z")

</div>

Hello, We are trying to develop a desktop application as well as cloud version (Web Application) which includes elasticsearch as a search engine. Basically we would like use the insert and search client. I read some th…

---

## [Aggregation can't be used for operations?](https://discuss.elastic.co/t/aggregation-cant-be-used-for-operations/152999)

<div class="topic-metadata">

**Author:** [@junkoshimane](https://discuss.elastic.co/u/junkoshimane)\
**Replies:** 2\
**Last updated:** [October 19, 2018, 1:24am UTC](https://discuss.elastic.co/t/aggregation-cant-be-used-for-operations/152999 "2018-10-19T01:24:05Z")

</div>

As far as I check Rally's doc, it seems like that we can't use aggregation as operations for Rally. Is my understanding correct? \[aggregation\] https://www.elastic.co/guide/en/elasticsearch/reference/current/search-agg…

---

## [Function score query returned an invalid score: NaN or -Infinity](https://discuss.elastic.co/t/function-score-query-returned-an-invalid-score-nan-or-infinity/152854)

<div class="topic-metadata">

**Author:** [@lunatic](https://discuss.elastic.co/u/lunatic)\
**Replies:** 2\
**Last updated:** [October 19, 2018, 1:16am UTC](https://discuss.elastic.co/t/function-score-query-returned-an-invalid-score-nan-or-infinity/152854 "2018-10-19T01:16:46Z")

</div>

I have a query using function\_score and field\_value\_factor like this: GET my\_item\_list/doc/\_search { "query": { "function\_score": { "query": { "match\_all": {} }, "field\_value\_factor": { …

---

## [Path\_match vs path\_unmatch](https://discuss.elastic.co/t/path-match-vs-path-unmatch/153082)

<div class="topic-metadata">

**Author:** [@panfng](https://discuss.elastic.co/u/panfng)\
**Replies:** 0\
**Last updated:** [October 18, 2018, 10:49pm UTC](https://discuss.elastic.co/t/path-match-vs-path-unmatch/153082 "2018-10-18T22:49:34Z")

</div>

What happens if path\_match conflicts with path\_unmatch? does path\_unmatch overrides path\_match?

---

## [What is maximum possible value for index.mapping.total\_fields.limit?](https://discuss.elastic.co/t/what-is-maximum-possible-value-for-index-mapping-total-fields-limit/153054)

<div class="topic-metadata">

**Author:** [@melissachang](https://discuss.elastic.co/u/melissachang)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 6:24pm UTC](https://discuss.elastic.co/t/what-is-maximum-possible-value-for-index-mapping-total-fields-limit/153054 "2018-10-18T18:24:13Z")

</div>

Is it Java Long.MAX\_VALUE (2^63-1)? I'm wondering how many fields I can have in my documents -- I'd like tens of thousands.

---

## [ES v5.4.0 Bulk Requests Rejection](https://discuss.elastic.co/t/es-v5-4-0-bulk-requests-rejection/152853)

<div class="topic-metadata">

**Author:** [@Neha\_Sharma1](https://discuss.elastic.co/u/Neha_Sharma1)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 6:19pm UTC](https://discuss.elastic.co/t/es-v5-4-0-bulk-requests-rejection/152853 "2018-10-18T18:19:31Z")

</div>

I have a cluster with data node 7 which has 100+ indexes, with shards number varying from 7-14, with 1 replica. As the indexes are time-series, all of them get created at 12 AM UTC. The problem is that all the primary s…

---

## [Update Java](https://discuss.elastic.co/t/update-java/152989)

<div class="topic-metadata">

**Author:** [@vnitdeepak](https://discuss.elastic.co/u/vnitdeepak)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 5:14pm UTC](https://discuss.elastic.co/t/update-java/152989 "2018-10-18T17:14:20Z")

</div>

How to write following request from java POST index/type/1/\_update { "doc" : { "subcat" : \[ { "name": "Test", "id": \[ { "value": "IP/IP1", "type": "key" }, { "value": "0000151", "type": "value" } \], "rol…

---

## [Java Security Policy does not work](https://discuss.elastic.co/t/java-security-policy-does-not-work/152961)

<div class="topic-metadata">

**Author:** [@zyx\_0312](https://discuss.elastic.co/u/zyx_0312)\
**Replies:** 3\
**Last updated:** [October 18, 2018, 4:27pm UTC](https://discuss.elastic.co/t/java-security-policy-does-not-work/152961 "2018-10-18T16:27:45Z")

</div>

Hi all, I add some files in “modules/transport-netty4”, and use a thrid party jar as dependency. When I start up elasticsearch, it failed, and error message shows in log file: //ERROR org.elasticsearch.bootstrap.Elasti…

---

## [Socket IO with Kibana](https://discuss.elastic.co/t/socket-io-with-kibana/149325)

<div class="topic-metadata">

**Author:** [@shansu90](https://discuss.elastic.co/u/shansu90)\
**Replies:** 0\
**Last updated:** [September 20, 2018, 4:07pm UTC](https://discuss.elastic.co/t/socket-io-with-kibana/149325 "2018-09-20T16:07:31Z")

</div>

Hi there! Can anyone here let me know if it's possible to implement Socket IO with Kibana through API or any other means. As I do not have access to fetch the same from Elasticsearch (company policies). I have plugins…

---

## [Atomic insert/delete/update on multiple indices](https://discuss.elastic.co/t/atomic-insert-delete-update-on-multiple-indices/152864)

<div class="topic-metadata">

**Author:** [@JF2018](https://discuss.elastic.co/u/JF2018)\
**Replies:** 8\
**Last updated:** [October 18, 2018, 2:51pm UTC](https://discuss.elastic.co/t/atomic-insert-delete-update-on-multiple-indices/152864 "2018-10-18T14:51:30Z")

</div>

Hi I struggle with large documents in an index. When we want to extract something via source it is slow since it has to parse the entire source. We could use stored fields, but this seems like a bad solution, when we …

---

## [Elastic as an adhoc query engine](https://discuss.elastic.co/t/elastic-as-an-adhoc-query-engine/152877)

<div class="topic-metadata">

**Author:** [@Carl\_Christianson](https://discuss.elastic.co/u/Carl_Christianson)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 2:39pm UTC](https://discuss.elastic.co/t/elastic-as-an-adhoc-query-engine/152877 "2018-10-18T14:39:51Z")

</div>

So I am noodling different ideas to transform an application that I run. At a high level, I need to be able to support an adhoc query based on a wide range of criteria, and then be able to return back a data set of ID's…

---

## [Point in Polygon query doesn't match document](https://discuss.elastic.co/t/point-in-polygon-query-doesnt-match-document/152133)

<div class="topic-metadata">

**Author:** [@Ganesh\_Kudva](https://discuss.elastic.co/u/Ganesh_Kudva)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 2:26pm UTC](https://discuss.elastic.co/t/point-in-polygon-query-doesnt-match-document/152133 "2018-10-18T14:26:53Z")

</div>

I am trying to perform a Point in Polygon query with latest Elasticsearch(version 6.2.4). This is my index mapping { "check": { "mappings": { "doc": { "properties": { "location": { …

---

## [Query\_string breaks search term on space even when keyword tokenizer is used](https://discuss.elastic.co/t/query-string-breaks-search-term-on-space-even-when-keyword-tokenizer-is-used/152535)

<div class="topic-metadata">

**Author:** [@tomekit](https://discuss.elastic.co/u/tomekit)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 2:26pm UTC](https://discuss.elastic.co/t/query-string-breaks-search-term-on-space-even-when-keyword-tokenizer-is-used/152535 "2018-10-18T14:26:45Z")

</div>

I am using keyword tokenizer for one of my name fields. "analyzer": { "lowercase\_keyword\_analyzer": { "filter": \[ "lowercase" \], "tokeni…

---

## [Search API Limits](https://discuss.elastic.co/t/search-api-limits/152491)

<div class="topic-metadata">

**Author:** [@bakko91](https://discuss.elastic.co/u/bakko91)\
**Replies:** 5\
**Last updated:** [October 18, 2018, 2:14pm UTC](https://discuss.elastic.co/t/search-api-limits/152491 "2018-10-18T14:14:31Z")

</div>

Hi all! I'm new to elastic and also new to the forum, so please forgive me if I ask something stupid or wrong. I have a problem using Search API of Java High Level REST Client because I'm trying to make a request with …

---

## [On an Elasticsearch cluster, how to have a node not allocate shards on it?](https://discuss.elastic.co/t/on-an-elasticsearch-cluster-how-to-have-a-node-not-allocate-shards-on-it/153004)

<div class="topic-metadata">

**Author:** [@dr01](https://discuss.elastic.co/u/dr01)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 1:26pm UTC](https://discuss.elastic.co/t/on-an-elasticsearch-cluster-how-to-have-a-node-not-allocate-shards-on-it/153004 "2018-10-18T13:26:48Z")

</div>

On an Elasticsearch n-node cluster, how can you flag a node so not to have shards allocated on that node (for instance when you're putting the node into maintenance)? Thanks in advance.

---

## [Issue on query string query for URL search](https://discuss.elastic.co/t/issue-on-query-string-query-for-url-search/152863)

<div class="topic-metadata">

**Author:** [@Prashant\_Agrawal](https://discuss.elastic.co/u/Prashant_Agrawal)\
**Replies:** 3\
**Last updated:** [October 18, 2018, 1:18pm UTC](https://discuss.elastic.co/t/issue-on-query-string-query-for-url-search/152863 "2018-10-18T13:18:29Z")

</div>

Hi, I have pretty simple requirement to search the indexed data which has path (windows system path ) in it , but while searching I am getting 0 results. Can someone tell me whats I am doing wrong in this.. POST prasha…

---

## [Delete Index causing surge in query rate EVEN AFTER the delete action is complete](https://discuss.elastic.co/t/delete-index-causing-surge-in-query-rate-even-after-the-delete-action-is-complete/151627)

<div class="topic-metadata">

**Author:** [@Rajiv](https://discuss.elastic.co/u/Rajiv)\
**Replies:** 12\
**Last updated:** [October 18, 2018, 12:41pm UTC](https://discuss.elastic.co/t/delete-index-causing-surge-in-query-rate-even-after-the-delete-action-is-complete/151627 "2018-10-18T12:41:30Z")

</div>

Hello all: We are observing the query rate on our ES cluster. The stat we are looking at is "nodes.indices.search.query\_total" under "GET /\_nodes/stats/indices/search". Here is how the metric looks on our cluster, with…

---

## [Upgrade from 6.2 to 6.4 gives "Authentication of \[elastic\] was terminated by realm \[reserved\]](https://discuss.elastic.co/t/upgrade-from-6-2-to-6-4-gives-authentication-of-elastic-was-terminated-by-realm-reserved/152845)

<div class="topic-metadata">

**Author:** [@yannis\_despotopoulos](https://discuss.elastic.co/u/yannis_despotopoulos)\
**Replies:** 6\
**Last updated:** [October 18, 2018, 11:18am UTC](https://discuss.elastic.co/t/upgrade-from-6-2-to-6-4-gives-authentication-of-elastic-was-terminated-by-realm-reserved/152845 "2018-10-18T11:18:36Z")

</div>

Hello, after upgrading to elastic 6.4 I am getting the following INFO and ERROR messages when elasticsearch starts. \[2018-10-17T14:51:08,064\]\[INFO \]\[o.e.x.s.a.AuthenticationService\] \[\_qmypXi\] Authentication of \[elastic\]…

---

## [Elasticsearch RAM to Disk Ratio](https://discuss.elastic.co/t/elasticsearch-ram-to-disk-ratio/152978)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 11:11am UTC](https://discuss.elastic.co/t/elasticsearch-ram-to-disk-ratio/152978 "2018-10-18T11:11:36Z")

</div>

I was looking into RAM to Disk Ratio and for logging uses cases and I see the proportion as 1:48 to 1:96. So if the server has 128GB RAM can we consider 96\*128GB RAM = 12 TB Of disk space as a max size per node? https:…

---

## [Rally and JDK errors](https://discuss.elastic.co/t/rally-and-jdk-errors/152807)

<div class="topic-metadata">

**Author:** [@Rifat\_Erdem\_Sahin](https://discuss.elastic.co/u/Rifat_Erdem_Sahin)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 8:07am UTC](https://discuss.elastic.co/t/rally-and-jdk-errors/152807 "2018-10-18T08:07:18Z")

</div>

I have installed rally into digital ocean and rally is not running Welcome to Ubuntu 18.04.1 LTS (GNU/Linux 4.15.0-36-generic x86\_64) Documentation: https://help.ubuntu.com Management: https://landscape.canonic…

---

## [How can I ingest pre-existing log files into Elasticsearch for analysis?](https://discuss.elastic.co/t/how-can-i-ingest-pre-existing-log-files-into-elasticsearch-for-analysis/152897)

<div class="topic-metadata">

**Author:** [@pojoguy](https://discuss.elastic.co/u/pojoguy)\
**Replies:** 5\
**Last updated:** [October 18, 2018, 8:05am UTC](https://discuss.elastic.co/t/how-can-i-ingest-pre-existing-log-files-into-elasticsearch-for-analysis/152897 "2018-10-18T08:05:44Z")

</div>

I need to digest logs offline into ELK for analysis. I'm a relative newbie to the ELK architecture, and floundering a bit. I would greatly appreciate any input My problem is I have been sent a mass of historical log fil…

---

## [Unique values of a term in an aggreation](https://discuss.elastic.co/t/unique-values-of-a-term-in-an-aggreation/152616)

<div class="topic-metadata">

**Author:** [@stefws](https://discuss.elastic.co/u/stefws)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 7:50am UTC](https://discuss.elastic.co/t/unique-values-of-a-term-in-an-aggreation/152616 "2018-10-18T07:50:39Z")

</div>

I've been away for too long from ES query construction :sweat\_smile: I'm trying to do a simple query that returns buckets in an aggregation of a string term, for each bucket I would like the unique value of another aggr…

---

## [IP range aggregation](https://discuss.elastic.co/t/ip-range-aggregation/152868)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 7:37am UTC](https://discuss.elastic.co/t/ip-range-aggregation/152868 "2018-10-18T07:37:06Z")

</div>

How exactly do I run an aggregation on a range of IP addresses? Eg., if I need to get sum of 'bytes' on ip ranging like 10.5.0.0-10.5.0.10, how do I do it? I've looked at IP Range aggregations but am finding it a bit d…

---

## [Multiple query in one](https://discuss.elastic.co/t/multiple-query-in-one/152878)

<div class="topic-metadata">

**Author:** [@pdonaire1](https://discuss.elastic.co/u/pdonaire1)\
**Replies:** 1\
**Last updated:** [October 18, 2018, 7:33am UTC](https://discuss.elastic.co/t/multiple-query-in-one/152878 "2018-10-18T07:33:58Z")

</div>

Hello there, I am using ElasticSearch and I want to make a query. I have differents modules: \['a', 'b', 'c', 'd'\]. where a and b have an extra value (companyId) I need to filter the text of all modules, but I need to…

---

## [Storage/Performance optimization](https://discuss.elastic.co/t/storage-performance-optimization/152393)

<div class="topic-metadata">

**Author:** [@Neha\_Sharma1](https://discuss.elastic.co/u/Neha_Sharma1)\
**Replies:** 5\
**Last updated:** [October 18, 2018, 7:33am UTC](https://discuss.elastic.co/t/storage-performance-optimization/152393 "2018-10-18T07:33:02Z")

</div>

We receive approx. 1TB of data everyday(including replica) for 100+ indexes. We currently have 16TB storage spread which stores data for 15 days. Out ES cluster has 2 dedicates MI nodes and 6 Di nodes and 1 MDI node. (M …

---

## [How to use bigdesk for new version (6.2) of elasticsearch](https://discuss.elastic.co/t/how-to-use-bigdesk-for-new-version-6-2-of-elasticsearch/152769)

<div class="topic-metadata">

**Author:** [@atticboy](https://discuss.elastic.co/u/atticboy)\
**Replies:** 4\
**Last updated:** [October 18, 2018, 7:30am UTC](https://discuss.elastic.co/t/how-to-use-bigdesk-for-new-version-6-2-of-elasticsearch/152769 "2018-10-18T07:30:55Z")

</div>

I tried all the methods described in the homepage of bigdesk to connect to es 6.2, but all failed, it says does not support new versions, so is there any way to connect to new version of es with bigdesk, thanks a lot!

---

## [Search\_after ideas](https://discuss.elastic.co/t/search-after-ideas/152909)

<div class="topic-metadata">

**Author:** [@joropito](https://discuss.elastic.co/u/joropito)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 7:27am UTC](https://discuss.elastic.co/t/search-after-ideas/152909 "2018-10-18T07:27:38Z")

</div>

As someone knows, size/from pagination isn't the best way to do paging with large results. I would like to use search\_after but allowing the user to set the page number so I would need the last document \_id for each pag…

---

## [Coping with ES' Use of org.joda.time.MutableDateTime](https://discuss.elastic.co/t/coping-with-es-use-of-org-joda-time-mutabledatetime/152733)

<div class="topic-metadata">

**Author:** [@SpaceMoose](https://discuss.elastic.co/u/SpaceMoose)\
**Replies:** 4\
**Last updated:** [October 18, 2018, 7:27am UTC](https://discuss.elastic.co/t/coping-with-es-use-of-org-joda-time-mutabledatetime/152733 "2018-10-18T07:27:12Z")

</div>

Hello... I'm still struggling with date arithmetic in the ES stack. I tried something that should have been trivial, coding along with an example presented at this url: https://www.codeproject.com/Articles/1179670/Usi…

---

## [Crash Log Entry meaning](https://discuss.elastic.co/t/crash-log-entry-meaning/152938)

<div class="topic-metadata">

**Author:** [@Ali\_Nouman](https://discuss.elastic.co/u/Ali_Nouman)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 7:09am UTC](https://discuss.elastic.co/t/crash-log-entry-meaning/152938 "2018-10-18T07:09:07Z")

</div>

Hi, I have this crash log entry \[2018-10-18T04:42:21,518\]\[WARN \]\[o.e.m.j.JvmGcMonitorService\] \[beppyc\_\] \[gc\]\[young\]\[241875\]\[1751\] duration \[1.4m\], collections \[1\]/\[1.7m\], total \[1.4m\]/\[1.7m\], memory \[509.7mb\]-\>\[445.2mb…

---

## [Highlighting with fvh and fuzziness taking long time in Elasticsearch](https://discuss.elastic.co/t/highlighting-with-fvh-and-fuzziness-taking-long-time-in-elasticsearch/152448)

<div class="topic-metadata">

**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\
**Replies:** 2\
**Last updated:** [October 18, 2018, 6:49am UTC](https://discuss.elastic.co/t/highlighting-with-fvh-and-fuzziness-taking-long-time-in-elasticsearch/152448 "2018-10-18T06:49:25Z")

</div>

Hi all, I have indexed a single document with more than 150 metadata, each with mapping: "ACTIVE": { "type": "text", "term\_vector": "with\_posit…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1511)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1513)
