# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1563

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1564

---

## [Script Engine with JAVA - elasticsearch-6.3.0](https://discuss.elastic.co/t/script-engine-with-java-elasticsearch-6-3-0/146500)

<div class="topic-metadata">

**Author:** [@moni15moni](https://discuss.elastic.co/u/moni15moni)\
**Replies:** 3\
**Last updated:** [August 30, 2018, 6:17pm UTC](https://discuss.elastic.co/t/script-engine-with-java-elasticsearch-6-3-0/146500 "2018-08-30T18:17:53Z")

</div>

Hi Currently I am migrating elasticsearch-6.3.0 ,part of that Have to change script changes to Script Engine. I have written the script using Native language ,java The following syntax i am using to pass the values A…

---

## [Doc-value related warnings filling the log](https://discuss.elastic.co/t/doc-value-related-warnings-filling-the-log/146760)

<div class="topic-metadata">

**Author:** [@mseto](https://discuss.elastic.co/u/mseto)\
**Replies:** 1\
**Last updated:** [August 30, 2018, 6:03pm UTC](https://discuss.elastic.co/t/doc-value-related-warnings-filling-the-log/146760 "2018-08-30T18:03:21Z")

</div>

I am seeing the following warning fill the log - Doc-value field \[@timestamp\] is not using a format. The output will change in 7.0 when doc value fields get formatted based on mappings by default I am wondering which a…

---

## [Doc-value field \[@timestamp\] is not using a format](https://discuss.elastic.co/t/doc-value-field-timestamp-is-not-using-a-format/146546)

<div class="topic-metadata">

**Author:** [@randude](https://discuss.elastic.co/u/randude)\
**Replies:** 1\
**Last updated:** [August 30, 2018, 5:55pm UTC](https://discuss.elastic.co/t/doc-value-field-timestamp-is-not-using-a-format/146546 "2018-08-30T17:55:43Z")

</div>

Hi, I'm getting this WARN after the upgrade to 6.4.0. Can someone explain this? how do I fix this? Thanks. I'm auing the filter date on my logs

---

## [How to get deltas between queries](https://discuss.elastic.co/t/how-to-get-deltas-between-queries/146753)

<div class="topic-metadata">

**Author:** [@dbwest](https://discuss.elastic.co/u/dbwest)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 5:18pm UTC](https://discuss.elastic.co/t/how-to-get-deltas-between-queries/146753 "2018-08-30T17:18:23Z")

</div>

How can I determine the differences between fields in queries in ES? I saw this other post, but there seemed to be no real answer in the thread.

---

## [Backing up an ephemeral Elasticsearch installation](https://discuss.elastic.co/t/backing-up-an-ephemeral-elasticsearch-installation/146751)

<div class="topic-metadata">

**Author:** [@dbwest](https://discuss.elastic.co/u/dbwest)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 5:00pm UTC](https://discuss.elastic.co/t/backing-up-an-ephemeral-elasticsearch-installation/146751 "2018-08-30T17:00:46Z")

</div>

I have an installation of Elasticsearch without persistence running and I need to back it up so we can move it to a persistent setup. What are safe ways to do this and keep the data in the ES database? It is running an…

---

## [Inconsistent doc count](https://discuss.elastic.co/t/inconsistent-doc-count/146589)

<div class="topic-metadata">

**Author:** [@ashokm](https://discuss.elastic.co/u/ashokm)\
**Replies:** 1\
**Last updated:** [August 30, 2018, 4:17pm UTC](https://discuss.elastic.co/t/inconsistent-doc-count/146589 "2018-08-30T16:17:43Z")

</div>

We have a 6 node elasticsearch 2.4.4 cluster. Each index has 2 shards and 1 replica. When we call \_search?size=10, "total" keeps alternating between 257566/257707 in an index. Expected total count is 257707. When i que…

---

## [Elastic+Kibana SizingHe](https://discuss.elastic.co/t/elastic-kibana-sizinghe/146742)

<div class="topic-metadata">

**Author:** [@bigdatapower](https://discuss.elastic.co/u/bigdatapower)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 4:14pm UTC](https://discuss.elastic.co/t/elastic-kibana-sizinghe/146742 "2018-08-30T16:14:41Z")

</div>

Hello. Could anyone please help me to deside how to scale elastic to a multi-server cluster. Current situation: 1 linux machine 2 cores/8GB RAM 1 elastic instance + 1 kibana instance 40 data indexes every month, 1 sh…

---

## [Scripted Similarity - how to get average field length](https://discuss.elastic.co/t/scripted-similarity-how-to-get-average-field-length/146387)

<div class="topic-metadata">

**Author:** [@jjuppe](https://discuss.elastic.co/u/jjuppe)\
**Replies:** 1\
**Last updated:** [August 30, 2018, 4:05pm UTC](https://discuss.elastic.co/t/scripted-similarity-how-to-get-average-field-length/146387 "2018-08-30T16:05:54Z")

</div>

Hello, I am trying to reconstruct the Okapi BM25 default similarity in Elasticsearch. For my specific setting we do not need the inverse document frequency for score calculation. In my research I haven't found a flag t…

---

## [Free disk space monitoring after deleting records](https://discuss.elastic.co/t/free-disk-space-monitoring-after-deleting-records/146651)

<div class="topic-metadata">

**Author:** [@Alessio\_Frabotta](https://discuss.elastic.co/u/Alessio_Frabotta)\
**Replies:** 5\
**Last updated:** [August 30, 2018, 3:04pm UTC](https://discuss.elastic.co/t/free-disk-space-monitoring-after-deleting-records/146651 "2018-08-30T15:04:33Z")

</div>

I deleted a very large number of records via delete\_by\_query but I did not see an increase in free space. Is there any operation to make space available?

---

## [Number of mapped fields](https://discuss.elastic.co/t/number-of-mapped-fields/146728)

<div class="topic-metadata">

**Author:** [@Shuki](https://discuss.elastic.co/u/Shuki)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 2:41pm UTC](https://discuss.elastic.co/t/number-of-mapped-fields/146728 "2018-08-30T14:41:35Z")

</div>

Hey Everyone :slight\_smile: I was wondering if there is a way to query the number of mapped fields within an existing Index. is that possible? In general, i am asking because i want to know how to handle a situation whe…

---

## [Multiple Geopoint field in document](https://discuss.elastic.co/t/multiple-geopoint-field-in-document/146724)

<div class="topic-metadata">

**Author:** [@raphael25](https://discuss.elastic.co/u/raphael25)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 2:23pm UTC](https://discuss.elastic.co/t/multiple-geopoint-field-in-document/146724 "2018-08-30T14:23:47Z")

</div>

Hi , I have a question about the indexing of geopoint If I have documents with multiple geopoint (like 3 field geopoint in the mapping) does ES create an unique R-tree for all the geopoint or a R-tree for each geopoin…

---

## [Docker master failed to Join the cluster](https://discuss.elastic.co/t/docker-master-failed-to-join-the-cluster/146207)

<div class="topic-metadata">

**Author:** [@kkr78](https://discuss.elastic.co/u/kkr78)\
**Replies:** 1\
**Last updated:** [August 29, 2018, 9:10pm UTC](https://discuss.elastic.co/t/docker-master-failed-to-join-the-cluster/146207 "2018-08-29T21:10:33Z")

</div>

I m trying to form 2 data, 2 master and 2 ingest node cluster across two different EC2 servers using docker image. I created Data nodes with explicit port mappings 9200 →9200 and 9300 → 9300 and both joined the cluster s…

---

## [When we reindex from ES2 to ES6, get error :Remote responded with a chunk that was too large. Use a smaller batch size](https://discuss.elastic.co/t/when-we-reindex-from-es2-to-es6-get-error-remote-responded-with-a-chunk-that-was-too-large-use-a-smaller-batch-size/146717)

<div class="topic-metadata">

**Author:** [@showmeall](https://discuss.elastic.co/u/showmeall)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 1:49pm UTC](https://discuss.elastic.co/t/when-we-reindex-from-es2-to-es6-get-error-remote-responded-with-a-chunk-that-was-too-large-use-a-smaller-batch-size/146717 "2018-08-30T13:49:57Z")

</div>

when we reindex get error,the detail info as flow: {"error":{"root\_cause":\[{"type":"illegal\_argument\_exception","reason":"Remote responded with a chunk that was too large. Use a smaller batch size."}\],"type":"illegal\_ar…

---

## [Find Index name associated with ES/data folder](https://discuss.elastic.co/t/find-index-name-associated-with-es-data-folder/146586)

<div class="topic-metadata">

**Author:** [@shine](https://discuss.elastic.co/u/shine)\
**Replies:** 1\
**Last updated:** [August 30, 2018, 1:47pm UTC](https://discuss.elastic.co/t/find-index-name-associated-with-es-data-folder/146586 "2018-08-30T13:47:39Z")

</div>

I had to delete all my data from my elasticsearch/data/nodes/\* folder because index "cust\_name\_abc" had a transaction log read error. Which stopped my entire ELK stack. In the future how do I find the matching elasticse…

---

## [Rollup not triggered](https://discuss.elastic.co/t/rollup-not-triggered/145930)

<div class="topic-metadata">

**Author:** [@ben\_f](https://discuss.elastic.co/u/ben_f)\
**Replies:** 7\
**Last updated:** [August 30, 2018, 1:32pm UTC](https://discuss.elastic.co/t/rollup-not-triggered/145930 "2018-08-30T13:32:56Z")

</div>

Hi, We are trying to use the new rollup feature. trigger\_count increases with time, but others metrics are sticking to 0, and the index remain empty. Are we missing something? Thanks ! PUT \_xpack/rollup/job/testroll…

---

## [java.lang.IllegalStateException: Future got interrupted](https://discuss.elastic.co/t/java-lang-illegalstateexception-future-got-interrupted/146709)

<div class="topic-metadata">

**Author:** [@dr01](https://discuss.elastic.co/u/dr01)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 1:31pm UTC](https://discuss.elastic.co/t/java-lang-illegalstateexception-future-got-interrupted/146709 "2018-08-30T13:31:06Z")

</div>

After a restart, our Elasticsearch cluster is showing this in the logs: \[2018-08-30T14:13:15,111\]\[ERROR\]\[o.e.x.m.c.c.ClusterStatsCollector\] \[myelastic01\] collector \[cluster\_stats\] failed to collect data java.lang.Illega…

---

## [HTTPS access via x-pack problems](https://discuss.elastic.co/t/https-access-via-x-pack-problems/146690)

<div class="topic-metadata">

**Author:** [@Arthur\_Bulakaiev](https://discuss.elastic.co/u/Arthur_Bulakaiev)\
**Replies:** 5\
**Last updated:** [August 30, 2018, 1:24pm UTC](https://discuss.elastic.co/t/https-access-via-x-pack-problems/146690 "2018-08-30T13:24:42Z")

</div>

Hi all! I'm trying to configure an https access to my elasticsearch server and I got stuck with it. My elasticsearch version is 6.2.4, I have installed x-pack for it, and followed this article: https://www.elastic.co/g…

---

## [Compound Must Matches Not Working for Me](https://discuss.elastic.co/t/compound-must-matches-not-working-for-me/146226)

<div class="topic-metadata">

**Author:** [@Douglas\_McQuilken](https://discuss.elastic.co/u/Douglas_McQuilken)\
**Replies:** 9\
**Last updated:** [August 30, 2018, 12:11pm UTC](https://discuss.elastic.co/t/compound-must-matches-not-working-for-me/146226 "2018-08-30T12:11:28Z")

</div>

Everything works fine until I insert a second match statement with a MUST, see below. NOTE: Either individual MUST statement works as expected but in combination... Parses correctly BUT always returns zero hits. Assis…

---

## [Cluster stats - mem](https://discuss.elastic.co/t/cluster-stats-mem/146697)

<div class="topic-metadata">

**Author:** [@paulkeogh](https://discuss.elastic.co/u/paulkeogh)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 11:59am UTC](https://discuss.elastic.co/t/cluster-stats-mem/146697 "2018-08-30T11:59:24Z")

</div>

My cluster returns a stats API response of; .... "mem": { "total": "1.2tb", "total\_in\_bytes": 1350889963520, "free": "3.4gb", "free\_in\_bytes": 3708395520, "used": "1.2tb", …

---

## [Query with bool must and with dis\_max](https://discuss.elastic.co/t/query-with-bool-must-and-with-dis-max/146679)

<div class="topic-metadata">

**Author:** [@c44](https://discuss.elastic.co/u/c44)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 10:32am UTC](https://discuss.elastic.co/t/query-with-bool-must-and-with-dis-max/146679 "2018-08-30T10:32:24Z")

</div>

Hello! I need query with must match and with dis\_max. I have: 1) 'body' =\> \[ 'query' =\> \[ 'dis\_max' =\> \[ 'queries' =\> \[ \['match\_phrase\_prefix' =\> \['description' =\> 'user'\] \] \] \] \] \] 'query' =\> \[ 'bool' …

---

## [Boost in query\_string](https://discuss.elastic.co/t/boost-in-query-string/146683)

<div class="topic-metadata">

**Author:** [@Kirtash](https://discuss.elastic.co/u/Kirtash)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 11:10am UTC](https://discuss.elastic.co/t/boost-in-query-string/146683 "2018-08-30T11:10:16Z")

</div>

Hi! Is possible get that the score in a query\_string with fields multiply for field? I have this search: { "query\_string": { "fields": \["town","city"\], "query": "girondens", "analyze\_…

---

## [How to Configure 2 nodes cluster](https://discuss.elastic.co/t/how-to-configure-2-nodes-cluster/146667)

<div class="topic-metadata">

**Author:** [@katiyar](https://discuss.elastic.co/u/katiyar)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 10:36am UTC](https://discuss.elastic.co/t/how-to-configure-2-nodes-cluster/146667 "2018-08-30T10:36:24Z")

</div>

Hi , I have 2 host servers and i have installed Elasticsearch, Kibana, Logstash in both the nodes. Now i want to configure 2 nodes cluster. Host 1 ( Elasticsearch, Kibana, Logstash ) Host2 ( Elasticsearch, Kibana, L…

---

## [How to use ik analyzer for ingest-attachment](https://discuss.elastic.co/t/how-to-use-ik-analyzer-for-ingest-attachment/146599)

<div class="topic-metadata">

**Author:** [@bluce\_zhang](https://discuss.elastic.co/u/bluce_zhang)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 8:01am UTC](https://discuss.elastic.co/t/how-to-use-ik-analyzer-for-ingest-attachment/146599 "2018-08-30T08:01:54Z")

</div>

Hello, I am using ingest attachment to search document. The requirement need to handle chinese, so we want to use ik as analyzer for attachment.content. But for some reason it's not working, I think it's still using def…

---

## [How to apply aggregations to collapsed/grouped results?](https://discuss.elastic.co/t/how-to-apply-aggregations-to-collapsed-grouped-results/146673)

<div class="topic-metadata">

**Author:** [@TheoVitkovskiy](https://discuss.elastic.co/u/TheoVitkovskiy)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 10:20am UTC](https://discuss.elastic.co/t/how-to-apply-aggregations-to-collapsed-grouped-results/146673 "2018-08-30T10:20:06Z")

</div>

In the documentation for field collapsing it states: The collapsing is applied to the top hits only and does not affect aggregations. My question: On my eCommerce store I want to only include the first item in each gro…

---

## [Query string "OR" on a field](https://discuss.elastic.co/t/query-string-or-on-a-field/146639)

<div class="topic-metadata">

**Author:** [@espogian](https://discuss.elastic.co/u/espogian)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 7:59am UTC](https://discuss.elastic.co/t/query-string-or-on-a-field/146639 "2018-08-30T07:59:51Z")

</div>

Hi, I'm facing an odd situation. I have a text field (string\_value) in a index (let's call it search\_index) which can get the value "OR" (in caps, without quotes). I created a Elasticsearch filter section in Logstash t…

---

## [Elasticsearch5.4 node use nearly 100% heap](https://discuss.elastic.co/t/elasticsearch5-4-node-use-nearly-100-heap/146669)

<div class="topic-metadata">

**Author:** [@bingo](https://discuss.elastic.co/u/bingo)\
**Replies:** 0\
**Last updated:** [August 30, 2018, 10:01am UTC](https://discuss.elastic.co/t/elasticsearch5-4-node-use-nearly-100-heap/146669 "2018-08-30T10:01:36Z")

</div>

I have a four-node es cluster on four hosts, in which there are nearly 1000 indices and 2000 shards. My physical machine has 128G memory and I assigned 60G to the elasticserach node on it. Now I find sometimes all the …

---

## [ES 6.4.0 Field aliases](https://discuss.elastic.co/t/es-6-4-0-field-aliases/146515)

<div class="topic-metadata">

**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 9:36am UTC](https://discuss.elastic.co/t/es-6-4-0-field-aliases/146515 "2018-08-30T09:36:46Z")

</div>

Hi Team, I would like to find out more about how the new field aliases feature works in ES 6.4.0 as the docs seem to be not yet up-to-date. According to this issue #23714, there is now a new field type called alias and…

---

## [Nest problem to select data out of database](https://discuss.elastic.co/t/nest-problem-to-select-data-out-of-database/145518)

<div class="topic-metadata">

**Author:** [@PDAxh](https://discuss.elastic.co/u/PDAxh)\
**Replies:** 2\
**Last updated:** [August 30, 2018, 8:16am UTC](https://discuss.elastic.co/t/nest-problem-to-select-data-out-of-database/145518 "2018-08-30T08:16:49Z")

</div>

Hi! Im pretty new to ES and got a little problem, This one works as it should. public void testCreateIndexBasedOnSelectedOrderId() { var pool = new SingleNodeConnectionPool(new Uri(uri)); var settings = new Connect…

---

## [Loading 500 GB of data / 3500000000 documents to ES cluster](https://discuss.elastic.co/t/loading-500-gb-of-data-3500000000-documents-to-es-cluster/137935)

<div class="topic-metadata">

**Author:** [@pastechecker](https://discuss.elastic.co/u/pastechecker)\
**Replies:** 10\
**Last updated:** [August 30, 2018, 7:54am UTC](https://discuss.elastic.co/t/loading-500-gb-of-data-3500000000-documents-to-es-cluster/137935 "2018-08-30T07:54:54Z")

</div>

Greetings! I have a small cluster with following setup: Hardware: 2x 64 GB RAM, 16 cores CPU, 4x2TB HDD configured in RAID10. There is 1 Gbps connection between the nodes. Configuration: elasticsearch.yml node1.tes…

---

## [Bulk API ID](https://discuss.elastic.co/t/bulk-api-id/146527)

<div class="topic-metadata">

**Author:** [@Pierre2](https://discuss.elastic.co/u/Pierre2)\
**Replies:** 3\
**Last updated:** [August 30, 2018, 7:44am UTC](https://discuss.elastic.co/t/bulk-api-id/146527 "2018-08-30T07:44:10Z")

</div>

Hi To explain the problem there is a schema : I have 3 log sources. First, log files that come from the SBC are processed by logstash and index in elasticsearch. The document ID (\_id) is set to the call ID. Then, t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1562)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1564)
