# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1914

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1915

---

## [Trying to log remote ip through plugin unsuccessfully](https://discuss.elastic.co/t/trying-to-log-remote-ip-through-plugin-unsuccessfully/104800)

<div class="topic-metadata">

**Author:** [@nmeisels](https://discuss.elastic.co/u/nmeisels)\
**Replies:** 0\
**Last updated:** [October 22, 2017, 12:27pm UTC](https://discuss.elastic.co/t/trying-to-log-remote-ip-through-plugin-unsuccessfully/104800 "2017-10-22T12:27:46Z")

</div>

Hi! I have an elasticsearch cluster version 5.6.2. I'm trying to log the remote ip that initiated the request. For some reason when I try logging the ip I get null value. Here is my plugin class: public class Rieman…

---

## [Sorting score and shuffle Adversiting results](https://discuss.elastic.co/t/sorting-score-and-shuffle-adversiting-results/104439)

<div class="topic-metadata">

**Author:** [@lucashfreitas](https://discuss.elastic.co/u/lucashfreitas)\
**Replies:** 1\
**Last updated:** [October 22, 2017, 12:17pm UTC](https://discuss.elastic.co/t/sorting-score-and-shuffle-adversiting-results/104439 "2017-10-22T12:17:12Z")

</div>

Hello guys, My site use elasticsearch query for fetch adversiting data of customers. My query on elastic sort data considering SCORE calculed from score function. (I use score because many properties make a difference …

---

## [Avoiding huge data replication in case of failure](https://discuss.elastic.co/t/avoiding-huge-data-replication-in-case-of-failure/104105)

<div class="topic-metadata">

**Author:** [@666dexlesshermit67](https://discuss.elastic.co/u/666dexlesshermit67)\
**Replies:** 1\
**Last updated:** [October 22, 2017, 12:05pm UTC](https://discuss.elastic.co/t/avoiding-huge-data-replication-in-case-of-failure/104105 "2017-10-22T12:05:18Z")

</div>

Hi, I'm using elastic in a production environment, and I thought of the following scenario: Let's say I have N servers that form a single cluster. I have N-1 replicas defined (overall each servers holds N-1 replica sha…

---

## [ES backup repository exception](https://discuss.elastic.co/t/es-backup-repository-exception/104091)

<div class="topic-metadata">

**Author:** [@ramesh205](https://discuss.elastic.co/u/ramesh205)\
**Replies:** 1\
**Last updated:** [October 22, 2017, 11:56am UTC](https://discuss.elastic.co/t/es-backup-repository-exception/104091 "2017-10-22T11:56:34Z")

</div>

Step1: created local folder and updated that path in es.yml file Step2:created repository PUT /\_snapshot/ESBackup { "type": "fs", "settings": { "location": "jupiterindex3", "compress": "true" }} step3:backup star…

---

## [Why Elastic search need to reindex the entire document when there is a change in the mapping for one field?](https://discuss.elastic.co/t/why-elastic-search-need-to-reindex-the-entire-document-when-there-is-a-change-in-the-mapping-for-one-field/103761)

<div class="topic-metadata">

**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\
**Replies:** 1\
**Last updated:** [October 22, 2017, 11:48am UTC](https://discuss.elastic.co/t/why-elastic-search-need-to-reindex-the-entire-document-when-there-is-a-change-in-the-mapping-for-one-field/103761 "2017-10-22T11:48:46Z")

</div>

Why Elastic search need to reindex the entire document when there is a change in the mapping for one field? It sounds to me that whenever there is change in the mapping (doesn't matter if it is one or few fields) ES wil…

---

## [Cluster health - High level REST client](https://discuss.elastic.co/t/cluster-health-high-level-rest-client/104794)

<div class="topic-metadata">

**Author:** [@eyasso](https://discuss.elastic.co/u/eyasso)\
**Replies:** 3\
**Last updated:** [October 22, 2017, 11:35am UTC](https://discuss.elastic.co/t/cluster-health-high-level-rest-client/104794 "2017-10-22T11:35:11Z")

</div>

Hello, I am looking for a way to get the cluster's health using High level REST client. I found it using transport API and low level REST client but nothing for High level REST client. Anyway to do this purely using Hi…

---

## [Installing a Plugin, certificate store error](https://discuss.elastic.co/t/installing-a-plugin-certificate-store-error/104749)

<div class="topic-metadata">

**Author:** [@Dan\_Rough](https://discuss.elastic.co/u/Dan_Rough)\
**Replies:** 9\
**Last updated:** [October 22, 2017, 9:49am UTC](https://discuss.elastic.co/t/installing-a-plugin-certificate-store-error/104749 "2017-10-22T09:49:07Z")

</div>

Hello, I'm attempting to install the repository-s3 plugin, using the following command: bin/elasticsearch-plugin install repository-s3 I receive an error: Exception in thread "main" javax.net.ssl.SSLHandshakeException…

---

## [Heap usage vs number of shards](https://discuss.elastic.co/t/heap-usage-vs-number-of-shards/104646)

<div class="topic-metadata">

**Author:** [@vahissan](https://discuss.elastic.co/u/vahissan)\
**Replies:** 12\
**Last updated:** [October 22, 2017, 8:16am UTC](https://discuss.elastic.co/t/heap-usage-vs-number-of-shards/104646 "2017-10-22T08:16:07Z")

</div>

We have a 3 node cluster with 128GB RAM in each node. Heap allocated for each node is 31GB. Our expected monthly record count is 8 billion per month. So we have created daily indices to hold data up to 2 years. Now, afte…

---

## [ELASTICSEARCH\_17 - Could not index '862' records: java.io.IOException: listener timeout after waiting for \[30000\] ms](https://discuss.elastic.co/t/elasticsearch-17-could-not-index-862-records-java-io-ioexception-listener-timeout-after-waiting-for-30000-ms/104604)

<div class="topic-metadata">

**Author:** [@Rakesh39](https://discuss.elastic.co/u/Rakesh39)\
**Replies:** 11\
**Last updated:** [October 22, 2017, 8:11am UTC](https://discuss.elastic.co/t/elasticsearch-17-could-not-index-862-records-java-io-ioexception-listener-timeout-after-waiting-for-30000-ms/104604 "2017-10-22T08:11:52Z")

</div>

Hi, We are having multiple issues with elastic search cluster. ELASTICSEARCH\_17 - Could not index '862' records: java.io.IOException: listener timeout after waiting for \[30000\] ms Continuously getting lot of above er…

---

## [How to use ESIntegTestCase in elasticsearch 5.6.3](https://discuss.elastic.co/t/how-to-use-esintegtestcase-in-elasticsearch-5-6-3/104787)

<div class="topic-metadata">

**Author:** [@tavandung12](https://discuss.elastic.co/u/tavandung12)\
**Replies:** 1\
**Last updated:** [October 22, 2017, 6:35am UTC](https://discuss.elastic.co/t/how-to-use-esintegtestcase-in-elasticsearch-5-6-3/104787 "2017-10-22T06:35:05Z")

</div>

Hi, When I run the source code: public class Mytests extends ESIntegTestCase { @Override protected Settings nodeSettings(int nodeOrdinal) { return Settings.builder().put(super.nodeSettings(nodeOrdinal)) …

---

## [PySpark fails to read multiple nested levels of Elasticsearch index](https://discuss.elastic.co/t/pyspark-fails-to-read-multiple-nested-levels-of-elasticsearch-index/104781)

<div class="topic-metadata">

**Author:** [@egel](https://discuss.elastic.co/u/egel)\
**Replies:** 0\
**Last updated:** [October 21, 2017, 9:47pm UTC](https://discuss.elastic.co/t/pyspark-fails-to-read-multiple-nested-levels-of-elasticsearch-index/104781 "2017-10-21T21:47:48Z")

</div>

I'm trying to read document properties that are nested under 3 levels of entities and getting the familiar 'typically this occurs with arrays which are not mapped as single value' error. The document I'm trying to read …

---

## [Searching for a particular phrase in \_all fields generates less number of records comparing to do the same thing on small number of fields](https://discuss.elastic.co/t/searching-for-a-particular-phrase-in-all-fields-generates-less-number-of-records-comparing-to-do-the-same-thing-on-small-number-of-fields/103578)

<div class="topic-metadata">

**Author:** [@Nina\_s](https://discuss.elastic.co/u/Nina_s)\
**Replies:** 1\
**Last updated:** [October 21, 2017, 6:22pm UTC](https://discuss.elastic.co/t/searching-for-a-particular-phrase-in-all-fields-generates-less-number-of-records-comparing-to-do-the-same-thing-on-small-number-of-fields/103578 "2017-10-21T18:22:21Z")

</div>

Hi, I wanted to search for a particular phrase using elasticsearch on both \_all fields and only 2 fields. The phrase is taken from a file listing more than 10000 keywords.: Here is the code: from elasticsearch import E…

---

## [Highlighting with single set of pre and post tags for multi-word phrase search](https://discuss.elastic.co/t/highlighting-with-single-set-of-pre-and-post-tags-for-multi-word-phrase-search/104771)

<div class="topic-metadata">

**Author:** [@Swapnil\_Nawale](https://discuss.elastic.co/u/Swapnil_Nawale)\
**Replies:** 0\
**Last updated:** [October 21, 2017, 6:07pm UTC](https://discuss.elastic.co/t/highlighting-with-single-set-of-pre-and-post-tags-for-multi-word-phrase-search/104771 "2017-10-21T18:07:03Z")

</div>

I am trying to run an elasticsearch match\_phrase query along with the plain highlighter. I need to search for the multi-word phrases. The issue is that the pre and post tags get appended for each word in the multi-word p…

---

## [FileAlreadyExistsException .es\_temp\_file](https://discuss.elastic.co/t/filealreadyexistsexception-es-temp-file/104719)

<div class="topic-metadata">

**Author:** [@vsevolodk](https://discuss.elastic.co/u/vsevolodk)\
**Replies:** 2\
**Last updated:** [October 21, 2017, 5:27pm UTC](https://discuss.elastic.co/t/filealreadyexistsexception-es-temp-file/104719 "2017-10-21T17:27:39Z")

</div>

Hi. I have elasticsearch 5.1.2 and I faced with Caused by: java.nio.file.FileAlreadyExistsException: /usr/share/elasticsearch/data/nodes/0/indices/K1KZ1kgpRTCczI5rm03Q1g/1/.es\_temp\_file at sun.nio.fs.UnixException.tran…

---

## [Aggregation for count values on boolean](https://discuss.elastic.co/t/aggregation-for-count-values-on-boolean/104762)

<div class="topic-metadata">

**Author:** [@StefanGl](https://discuss.elastic.co/u/StefanGl)\
**Replies:** 1\
**Last updated:** [October 21, 2017, 3:07pm UTC](https://discuss.elastic.co/t/aggregation-for-count-values-on-boolean/104762 "2017-10-21T15:07:59Z")

</div>

Hello, I have 100 documents with an boolean field, 80 docs are true, 20 are false. How can I return only the "true" ones in an aggregation? I'm looking for an aggregation similar to this sql: SELECT count(\*) FROM doc…

---

## [Shard placements question after rolling restart](https://discuss.elastic.co/t/shard-placements-question-after-rolling-restart/104760)

<div class="topic-metadata">

**Author:** [@deimosfr](https://discuss.elastic.co/u/deimosfr)\
**Replies:** 3\
**Last updated:** [October 21, 2017, 9:50am UTC](https://discuss.elastic.co/t/shard-placements-question-after-rolling-restart/104760 "2017-10-21T09:50:12Z")

</div>

Hi, I've performed a rolling restart on a 3 nodes cluster. I've a replicas of 1, 4 shards per index and during the rolling restart, rebalance actions occurring makes my cluster always available and that's a good point. …

---

## [Adding a field to the default mapping](https://discuss.elastic.co/t/adding-a-field-to-the-default-mapping/104754)

<div class="topic-metadata">

**Author:** [@pkaeding](https://discuss.elastic.co/u/pkaeding)\
**Replies:** 1\
**Last updated:** [October 20, 2017, 11:29pm UTC](https://discuss.elastic.co/t/adding-a-field-to-the-default-mapping/104754 "2017-10-20T23:29:58Z")

</div>

I am having trouble adding a field (named user.privateAttributes) to an existing \_default\_ mapping. Instead of adding the new field, it is replacing the entire mapping with a new single-field mapping. When I run the sam…

---

## [Span Multi with range query](https://discuss.elastic.co/t/span-multi-with-range-query/102213)

<div class="topic-metadata">

**Author:** [@pravekal](https://discuss.elastic.co/u/pravekal)\
**Replies:** 2\
**Last updated:** [October 20, 2017, 8:28pm UTC](https://discuss.elastic.co/t/span-multi-with-range-query/102213 "2017-10-20T20:28:02Z")

</div>

Hi All, I am trying to do date range query within span\_multi but I get below error. Any suggestions ? Error : "unsupported\_operation\_exception: unsupported inner query, should be org.apache.lucene.search.MultiTermQuery…

---

## [Elasticsearch aggregation order by top hit score with partitions](https://discuss.elastic.co/t/elasticsearch-aggregation-order-by-top-hit-score-with-partitions/102228)

<div class="topic-metadata">

**Author:** [@Wu\_Chun\_Wa](https://discuss.elastic.co/u/Wu_Chun_Wa)\
**Replies:** 3\
**Last updated:** [October 20, 2017, 8:07pm UTC](https://discuss.elastic.co/t/elasticsearch-aggregation-order-by-top-hit-score-with-partitions/102228 "2017-10-20T20:07:44Z")

</div>

I read (Elasticsearch aggregation order by top hit score) and follow it with partitions. The output is very strange. The last partition has the large score. Also, each partition sort the score individually. Current resu…

---

## [Long delay between indexing a document and its availability in search results](https://discuss.elastic.co/t/long-delay-between-indexing-a-document-and-its-availability-in-search-results/103876)

<div class="topic-metadata">

**Author:** [@Michael\_Korbakov](https://discuss.elastic.co/u/Michael_Korbakov)\
**Replies:** 15\
**Last updated:** [October 20, 2017, 8:03pm UTC](https://discuss.elastic.co/t/long-delay-between-indexing-a-document-and-its-availability-in-search-results/103876 "2017-10-20T20:03:41Z")

</div>

Hi all! We are experiencing a problem with ES 5.4.2 on production. About 25% of our indexed documents are only appearing in search results after 3 seconds or more after success response from indexing request. Our cluste…

---

## [Many indices and slow cluster state updates](https://discuss.elastic.co/t/many-indices-and-slow-cluster-state-updates/104721)

<div class="topic-metadata">

**Author:** [@rkrombho](https://discuss.elastic.co/u/rkrombho)\
**Replies:** 3\
**Last updated:** [October 20, 2017, 3:50pm UTC](https://discuss.elastic.co/t/many-indices-and-slow-cluster-state-updates/104721 "2017-10-20T15:50:01Z")

</div>

Hi All, we are about to learn (the hard way) that the index-per-user model is the wrong way to go. Initially we planned for one index per user but with the announcement that types are going to be removed in ES6 we now …

---

## [Can multi match and type phrase be used on \_all](https://discuss.elastic.co/t/can-multi-match-and-type-phrase-be-used-on-all/104722)

<div class="topic-metadata">

**Author:** [@Nina\_s](https://discuss.elastic.co/u/Nina_s)\
**Replies:** 0\
**Last updated:** [October 20, 2017, 3:07pm UTC](https://discuss.elastic.co/t/can-multi-match-and-type-phrase-be-used-on-all/104722 "2017-10-20T15:07:05Z")

</div>

Hi there, Let 's say I have the following code: "multi\_match": { "query": x, "type": "phrase", …

---

## [Elasticsearch 2.1.2: License plugin and Cluster State](https://discuss.elastic.co/t/elasticsearch-2-1-2-license-plugin-and-cluster-state/104704)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 0\
**Last updated:** [October 20, 2017, 1:11pm UTC](https://discuss.elastic.co/t/elasticsearch-2-1-2-license-plugin-and-cluster-state/104704 "2017-10-20T13:11:56Z")

</div>

Hi, I'm preparing for an upgrade to 5.x. As part of that I've uninstalled the marvel-agent and license plugins as our license expired a while back. I've done this on our 3 master nodes so far and am now seeing that the …

---

## [Searching for URLs with a specific TLD](https://discuss.elastic.co/t/searching-for-urls-with-a-specific-tld/104673)

<div class="topic-metadata">

**Author:** [@cuttlefishjones](https://discuss.elastic.co/u/cuttlefishjones)\
**Replies:** 2\
**Last updated:** [October 20, 2017, 12:28pm UTC](https://discuss.elastic.co/t/searching-for-urls-with-a-specific-tld/104673 "2017-10-20T12:28:41Z")

</div>

Simple query, how do I find all matching urls that end in, say '. com'? I can't seem to get it to return anything?

---

## [Unable to install ELK and Kibana 5.6.3](https://discuss.elastic.co/t/unable-to-install-elk-and-kibana-5-6-3/104692)

<div class="topic-metadata">

**Author:** [@Prashanth.kuntla](https://discuss.elastic.co/u/Prashanth.kuntla)\
**Replies:** 1\
**Last updated:** [October 20, 2017, 12:26pm UTC](https://discuss.elastic.co/t/unable-to-install-elk-and-kibana-5-6-3/104692 "2017-10-20T12:26:47Z")

</div>

Hi, I am new to ELK and started learning. I am trying to install the ES and KB on my local windows machine. I am trying to install by running the .bat files in the bin folder. But the servers are not getting started. A…

---

## [Graph explore api for webshop case](https://discuss.elastic.co/t/graph-explore-api-for-webshop-case/99582)

<div class="topic-metadata">

**Author:** [@Malthe](https://discuss.elastic.co/u/Malthe)\
**Replies:** 12\
**Last updated:** [October 20, 2017, 7:40am UTC](https://discuss.elastic.co/t/graph-explore-api-for-webshop-case/99582 "2017-10-20T07:40:42Z")

</div>

Hi Elasticsearch community. I am trying to build a feature with the Explore api, which can tell what other people bought after they have looked at, whatever product you are currently looking at. I have indexed in ES th…

---

## [Max size of scroll window?](https://discuss.elastic.co/t/max-size-of-scroll-window/104645)

<div class="topic-metadata">

**Author:** [@Illidan](https://discuss.elastic.co/u/Illidan)\
**Replies:** 4\
**Last updated:** [October 20, 2017, 7:19am UTC](https://discuss.elastic.co/t/max-size-of-scroll-window/104645 "2017-10-20T07:19:49Z")

</div>

I need to get all documents from index, so for that I using scroll to get all documents in bulks. Since my goal is to perform as less round-trips to elastic as possible, I want bulk size as big as possible. What is the…

---

## [Driving Distance Sort](https://discuss.elastic.co/t/driving-distance-sort/104637)

<div class="topic-metadata">

**Author:** [@paulavijit](https://discuss.elastic.co/u/paulavijit)\
**Replies:** 1\
**Last updated:** [October 20, 2017, 7:05am UTC](https://discuss.elastic.co/t/driving-distance-sort/104637 "2017-10-20T07:05:54Z")

</div>

Is there way to sort by driving distance instead of the crow distance and also display the driving distance. By driving distance I mean the distance between two points as shown in Google Maps, instead of distance betwee…

---

## [Version Conflicts and Options for Resolution](https://discuss.elastic.co/t/version-conflicts-and-options-for-resolution/104657)

<div class="topic-metadata">

**Author:** [@Cen\_giz](https://discuss.elastic.co/u/Cen_giz)\
**Replies:** 0\
**Last updated:** [October 20, 2017, 7:05am UTC](https://discuss.elastic.co/t/version-conflicts-and-options-for-resolution/104657 "2017-10-20T07:05:17Z")

</div>

Hi All, We use Kafka and Flume to ingest partial updates on a big document. Flume is pulling a batch of partial updates and uses the Bulk API to ingest into elastic, in multi tasking environment. In a given batch or ac…

---

## [Indexing without warmup stops 'early'](https://discuss.elastic.co/t/indexing-without-warmup-stops-early/104445)

<div class="topic-metadata">

**Author:** [@jki](https://discuss.elastic.co/u/jki)\
**Replies:** 3\
**Last updated:** [October 20, 2017, 6:35am UTC](https://discuss.elastic.co/t/indexing-without-warmup-stops-early/104445 "2017-10-20T06:35:24Z")

</div>

It appears that Rally settings for "iterations" and "bulk-size" interact in a way that is not documented: On the geonames challenge, changing the schedule for append-no-conflicts-index-only by: deleting "warmup-time-p…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1913)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1915)
