# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1978

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1979

---

## [Elasticsearch highlight wrong response](https://discuss.elastic.co/t/elasticsearch-highlight-wrong-response/97235)

<div class="topic-metadata">

**Author:** [@Vcgoyo](https://discuss.elastic.co/u/Vcgoyo)\
**Replies:** 0\
**Last updated:** [August 16, 2017, 10:40am UTC](https://discuss.elastic.co/t/elasticsearch-highlight-wrong-response/97235 "2017-08-16T10:40:05Z")

</div>

ElasticSearch 5.4.0 I have a problem about the highlight and the searchParse { "from": 0, "size": 10, "query": { "query\_string": { "query": "name:Cam", "fields": \[\], "use\_dis\_max": true, …

---

## [ES 5.5 "Failed to send join request to master" :: AWS EC2 instance](https://discuss.elastic.co/t/es-5-5-failed-to-send-join-request-to-master-aws-ec2-instance/97088)

<div class="topic-metadata">

**Author:** [@abkrim](https://discuss.elastic.co/u/abkrim)\
**Replies:** 0\
**Last updated:** [August 15, 2017, 11:03am UTC](https://discuss.elastic.co/t/es-5-5-failed-to-send-join-request-to-master-aws-ec2-instance/97088 "2017-08-15T11:03:34Z")

</div>

Hi. It’s first time that work with ES with Cluster and AWS EC2 instances. I’m working with ES 5.5.1 on instancd with Ubuntu 16.04 All nodes are up and running All nodes has a Security Group with permissions for all tr…

---

## [Error with curator delete\_index](https://discuss.elastic.co/t/error-with-curator-delete-index/97207)

<div class="topic-metadata">

**Author:** [@legolas\_bilbao](https://discuss.elastic.co/u/legolas_bilbao)\
**Replies:** 5\
**Last updated:** [August 16, 2017, 10:02am UTC](https://discuss.elastic.co/t/error-with-curator-delete-index/97207 "2017-08-16T10:02:11Z")

</div>

Good morning, I wanna delete the older index from kibana and I wanna user curator. First , I’ve get the index that I’ve in kibana curl -XGET 'localhost:9200/\_cat/indices?v&pretty' health status index uuid …

---

## [Need quotation for X-Pack license](https://discuss.elastic.co/t/need-quotation-for-x-pack-license/97204)

<div class="topic-metadata">

**Author:** [@venkattk](https://discuss.elastic.co/u/venkattk)\
**Replies:** 1\
**Last updated:** [August 16, 2017, 8:36am UTC](https://discuss.elastic.co/t/need-quotation-for-x-pack-license/97204 "2017-08-16T08:36:36Z")

</div>

Hi, Please provide the quotation for X-Pack licence asap. Thanks. Regards, Venkat

---

## [Curator snapshot rotation](https://discuss.elastic.co/t/curator-snapshot-rotation/96993)

<div class="topic-metadata">

**Author:** [@dangal](https://discuss.elastic.co/u/dangal)\
**Replies:** 4\
**Last updated:** [August 16, 2017, 8:21am UTC](https://discuss.elastic.co/t/curator-snapshot-rotation/96993 "2017-08-16T08:21:59Z")

</div>

Hi, can we do snapshot rotation concept using curator CLI tool if yes, please explain in detail how we can. Thanks in advance.

---

## [How to create machine learning job to compare two counts?](https://discuss.elastic.co/t/how-to-create-machine-learning-job-to-compare-two-counts/97067)

<div class="topic-metadata">

**Author:** [@vb4t](https://discuss.elastic.co/u/vb4t)\
**Replies:** 2\
**Last updated:** [August 16, 2017, 8:14am UTC](https://discuss.elastic.co/t/how-to-create-machine-learning-job-to-compare-two-counts/97067 "2017-08-16T08:14:21Z")

</div>

Hello. I have an index with application logs from all our servers. The load to the servers is load balanced and I need to create a machine learning job to compare requests count between the servers. Indexed data: SERVER…

---

## [Does elasticsearch-hadoop on spark has data locality on write?](https://discuss.elastic.co/t/does-elasticsearch-hadoop-on-spark-has-data-locality-on-write/97112)

<div class="topic-metadata">

**Author:** [@ov7a](https://discuss.elastic.co/u/ov7a)\
**Replies:** 4\
**Last updated:** [August 15, 2017, 5:38pm UTC](https://discuss.elastic.co/t/does-elasticsearch-hadoop-on-spark-has-data-locality-on-write/97112 "2017-08-15T17:38:41Z")

</div>

Let’s suppose we have a spark cluster with elasticsearch on each node. We’ve created a rdd with documents somehow and want to write them to es. Will the documents be written locally, i.e. if a partition is on node1, al…

---

## [Mapping conflict (without any existing mappings)](https://discuss.elastic.co/t/mapping-conflict-without-any-existing-mappings/97127)

<div class="topic-metadata">

**Author:** [@Yuval](https://discuss.elastic.co/u/Yuval)\
**Replies:** 2\
**Last updated:** [August 16, 2017, 6:13am UTC](https://discuss.elastic.co/t/mapping-conflict-without-any-existing-mappings/97127 "2017-08-16T06:13:22Z")

</div>

Hi, I'm using the elasticsearch's python client, trying to index new data into a non-existing index (there are NO indices in the cluster at all) when indexing the first document, the following exception is thrown: Re…

---

## [MultiPlexing hardware between hadoop and elasticsearch](https://discuss.elastic.co/t/multiplexing-hardware-between-hadoop-and-elasticsearch/97179)

<div class="topic-metadata">

**Author:** [@wangqinghuan](https://discuss.elastic.co/u/wangqinghuan)\
**Replies:** 1\
**Last updated:** [August 16, 2017, 5:24am UTC](https://discuss.elastic.co/t/multiplexing-hardware-between-hadoop-and-elasticsearch/97179 "2017-08-16T05:24:26Z")

</div>

I am using elasticsearch-hadoop-mr. Hadoop cluster is physically separated from ELasticsearch Cluster. And I found the speed that transfer data by networking from elasticsearch to hadoop is too slowly. So ,if hadoop n…

---

## [Help: How to apply dismax query on both parent and nested objects](https://discuss.elastic.co/t/help-how-to-apply-dismax-query-on-both-parent-and-nested-objects/97175)

<div class="topic-metadata">

**Author:** [@king](https://discuss.elastic.co/u/king)\
**Replies:** 0\
**Last updated:** [August 16, 2017, 3:52am UTC](https://discuss.elastic.co/t/help-how-to-apply-dismax-query-on-both-parent-and-nested-objects/97175 "2017-08-16T03:52:33Z")

</div>

I have an uncommon case of searching one term on both parent’s attribute and its nested object’s attribute, and get the max out of them. Example: Parent document has the following attributes: name birth year addresse…

---

## [Elasticsearch service doesn't start upon system reboot](https://discuss.elastic.co/t/elasticsearch-service-doesnt-start-upon-system-reboot/96994)

<div class="topic-metadata">

**Author:** [@Ravi\_Bhushan](https://discuss.elastic.co/u/Ravi_Bhushan)\
**Replies:** 3\
**Last updated:** [August 16, 2017, 2:16am UTC](https://discuss.elastic.co/t/elasticsearch-service-doesnt-start-upon-system-reboot/96994 "2017-08-16T02:16:42Z")

</div>

Hi, My environement is below Elastic Version - "2.3.5" OS - RHEL 7 JAVA Version openjdk version "1.8.0\_141" OpenJDK Runtime Environment (build 1.8.0\_141-b16) Command to start ES - Systemctl start elasticsearch Is…

---

## [Internal load balancing and cross-region replication](https://discuss.elastic.co/t/internal-load-balancing-and-cross-region-replication/96798)

<div class="topic-metadata">

**Author:** [@Steve\_Best](https://discuss.elastic.co/u/Steve_Best)\
**Replies:** 3\
**Last updated:** [August 15, 2017, 11:41pm UTC](https://discuss.elastic.co/t/internal-load-balancing-and-cross-region-replication/96798 "2017-08-15T23:41:45Z")

</div>

Hi folks, we are looking to deploy our stack to 2 different AWS regions for high availability in case one region goes dark for any period of time. I have gotten a cluster up and replicating across the 2 regions over a si…

---

## [Docker ES 5.5.0 Low performance when ingest 1000 docs/sec](https://discuss.elastic.co/t/docker-es-5-5-0-low-performance-when-ingest-1000-docs-sec/97155)

<div class="topic-metadata">

**Author:** [@rodrigongarcia](https://discuss.elastic.co/u/rodrigongarcia)\
**Replies:** 0\
**Last updated:** [August 15, 2017, 10:24pm UTC](https://discuss.elastic.co/t/docker-es-5-5-0-low-performance-when-ingest-1000-docs-sec/97155 "2017-08-15T22:24:53Z")

</div>

Hello, First the general data: Version ES: 5.5.0 Version ingestion: logstash-input-kafka (4.2.0) Operating System: docker - official compiled docker file: FROM docker.elastic.co/logstash/logstash:5.5.0 RUN rm -f /u…

---

## [Query Results differ](https://discuss.elastic.co/t/query-results-differ/96984)

<div class="topic-metadata">

**Author:** [@Velusamy\_Velu](https://discuss.elastic.co/u/Velusamy_Velu)\
**Replies:** 2\
**Last updated:** [August 15, 2017, 9:10pm UTC](https://discuss.elastic.co/t/query-results-differ/96984 "2017-08-15T21:10:59Z")

</div>

We’re running ElasticSearch 5.5.1. Here’s an end point that returns an expected response http://:9200/index/indexType/AV3gv5yWc\_QVZ8-roTdU/ Response: { "\_index":"chemistry", "\_type":"layouts", "\_id":"AV3gv…

---

## [2.3.4 write behaviour with replicas set to 2](https://discuss.elastic.co/t/2-3-4-write-behaviour-with-replicas-set-to-2/97140)

<div class="topic-metadata">

**Author:** [@bw99](https://discuss.elastic.co/u/bw99)\
**Replies:** 2\
**Last updated:** [August 15, 2017, 7:38pm UTC](https://discuss.elastic.co/t/2-3-4-write-behaviour-with-replicas-set-to-2/97140 "2017-08-15T19:38:13Z")

</div>

Hi all, I am trying to understand the behaviour of ES 2.3.4 when replicas are set to 2. The docs say that “index operations only succeed if a quorum (\>replicas/2+1) of active shards are available.” I’m confused by wha…

---

## [Index:no being ignore](https://discuss.elastic.co/t/index-no-being-ignore/97141)

<div class="topic-metadata">

**Author:** [@gchen](https://discuss.elastic.co/u/gchen)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 6:13pm UTC](https://discuss.elastic.co/t/index-no-being-ignore/97141 "2017-08-15T18:13:24Z")

</div>

Hi, I have a field with index option set to ‘no’, but ES is ignoring that option. I updated my doc-type with : -XPUT my\_index/\_mapping/my\_doc\_type { "properties": { "original\_data": { "type": …

---

## [Error saving Spark RDD using rdd.saveToEs](https://discuss.elastic.co/t/error-saving-spark-rdd-using-rdd-savetoes/96888)

<div class="topic-metadata">

**Author:** [@Antonio\_Ye](https://discuss.elastic.co/u/Antonio_Ye)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 5:13pm UTC](https://discuss.elastic.co/t/error-saving-spark-rdd-using-rdd-savetoes/96888 "2017-08-15T17:13:03Z")

</div>

I have a simple Spark data frame which contains a column of JSON strings. When I run the following code: import org.elasticsearch.spark.\_ val df = Seq("""{“name”: “john”, “age”:44}""").toDF(“json”) df.rdd.map(x=\>x.get…

---

## [Does the filter context place all nested queries in the filter context as well?](https://discuss.elastic.co/t/does-the-filter-context-place-all-nested-queries-in-the-filter-context-as-well/97133)

<div class="topic-metadata">

**Author:** [@Daverino](https://discuss.elastic.co/u/Daverino)\
**Replies:** 0\
**Last updated:** [August 15, 2017, 4:36pm UTC](https://discuss.elastic.co/t/does-the-filter-context-place-all-nested-queries-in-the-filter-context-as-well/97133 "2017-08-15T16:36:56Z")

</div>

If I’m using the filter context of either a bool or a constant\_score query, how are nested (i.e. compound) queries treated under them? It makes sense to me that everything under it would be run as filter, but I can’t fi…

---

## [Java with twitter4j and send info to elasticsearch](https://discuss.elastic.co/t/java-with-twitter4j-and-send-info-to-elasticsearch/92541)

<div class="topic-metadata">

**Author:** [@Lbr1](https://discuss.elastic.co/u/Lbr1)\
**Replies:** 20\
**Last updated:** [August 15, 2017, 4:05pm UTC](https://discuss.elastic.co/t/java-with-twitter4j-and-send-info-to-elasticsearch/92541 "2017-08-15T16:05:35Z")

</div>

Good evening, I recently started exploring elasticsearch, as I'm doing a job in java to analyze sentiments in tweets. Initially I was just using java and the tweet4j API. Then I heard about ElasticSearch and started ex…

---

## [Shards per node question](https://discuss.elastic.co/t/shards-per-node-question/97089)

<div class="topic-metadata">

**Author:** [@cis4life](https://discuss.elastic.co/u/cis4life)\
**Replies:** 2\
**Last updated:** [August 15, 2017, 3:48pm UTC](https://discuss.elastic.co/t/shards-per-node-question/97089 "2017-08-15T15:48:55Z")

</div>

Good Day I’m build a test cluster and was given basically the following… 3 Master Nodes 4 Data Nodes A couple Client Nodes A couple Ingestion nodes My question is… The setting for number of shards, is that setti…

---

## [Aggregating even if array is empty](https://discuss.elastic.co/t/aggregating-even-if-array-is-empty/96014)

<div class="topic-metadata">

**Author:** [@Rafi993](https://discuss.elastic.co/u/Rafi993)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 3:32pm UTC](https://discuss.elastic.co/t/aggregating-even-if-array-is-empty/96014 "2017-08-15T15:32:35Z")

</div>

I am trying to do simple aggregation in elastic search using an array my query is as follows { "size":0, "aggs":{ "byTags":{ "terms": { "field": "tags" } …

---

## [Incremental Snapshot details?](https://discuss.elastic.co/t/incremental-snapshot-details/97099)

<div class="topic-metadata">

**Author:** [@lantern77](https://discuss.elastic.co/u/lantern77)\
**Replies:** 5\
**Last updated:** [August 15, 2017, 2:56pm UTC](https://discuss.elastic.co/t/incremental-snapshot-details/97099 "2017-08-15T14:56:21Z")

</div>

Hey Guys, As the ElasticSearch documentation stated snapshots are incremental, https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-snapshots.html#\_snapshot meaning the snapshot will look for differ…

---

## [Why are email addresses compulsory?](https://discuss.elastic.co/t/why-are-email-addresses-compulsory/97105)

<div class="topic-metadata">

**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 2:45pm UTC](https://discuss.elastic.co/t/why-are-email-addresses-compulsory/97105 "2017-08-15T14:45:16Z")

</div>

Kibana won’t let you create a user without specifying an email address (to which it applies some, not checked what exactly, syntax validation). Why? - isn’t it up to me whether I want to specify an email address or not?…

---

## [Are user names case sensitive?](https://discuss.elastic.co/t/are-user-names-case-sensitive/97103)

<div class="topic-metadata">

**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 2:44pm UTC](https://discuss.elastic.co/t/are-user-names-case-sensitive/97103 "2017-08-15T14:44:17Z")

</div>

They appear to be - why? Hasn’t it been best practice for some decades now that user names should be case insensitive?

---

## [QUERY with Terminal](https://discuss.elastic.co/t/query-with-terminal/96864)

<div class="topic-metadata">

**Author:** [@Ehsan](https://discuss.elastic.co/u/Ehsan)\
**Replies:** 5\
**Last updated:** [August 15, 2017, 2:36pm UTC](https://discuss.elastic.co/t/query-with-terminal/96864 "2017-08-15T14:36:54Z")

</div>

Hello EveryOne,ElasticSearch is installed by vendor on my CentOS server.I want to query with terminal to my server.How Can I do that??Also Kibana is Running on my server.

---

## [Machine Learning disabled after installing Basic License](https://discuss.elastic.co/t/machine-learning-disabled-after-installing-basic-license/95775)

<div class="topic-metadata">

**Author:** [@eperpetuo](https://discuss.elastic.co/u/eperpetuo)\
**Replies:** 2\
**Last updated:** [August 15, 2017, 2:32pm UTC](https://discuss.elastic.co/t/machine-learning-disabled-after-installing-basic-license/95775 "2017-08-15T14:32:07Z")

</div>

I’ve just installed the basic license in my Elasticseach cluster in order to use the Monitoring module. However, since I completed the basic license installation, it seems the Machine Learnig module was disabled. Pleas…

---

## [Count of phrase matches per document](https://discuss.elastic.co/t/count-of-phrase-matches-per-document/96762)

<div class="topic-metadata">

**Author:** [@swleighton](https://discuss.elastic.co/u/swleighton)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 2:27pm UTC](https://discuss.elastic.co/t/count-of-phrase-matches-per-document/96762 "2017-08-15T14:27:59Z")

</div>

Hi, I’m using this query to search a field for occurrences of phrases. "query": { "match\_phrase": { "content": "my test phrase" } } I need to calculate how many matches occurred for each phrase per docum…

---

## [Elasticsearch receib=ving data from Nifi](https://discuss.elastic.co/t/elasticsearch-receib-ving-data-from-nifi/97113)

<div class="topic-metadata">

**Author:** [@marwa](https://discuss.elastic.co/u/marwa)\
**Replies:** 0\
**Last updated:** [August 15, 2017, 2:19pm UTC](https://discuss.elastic.co/t/elasticsearch-receib-ving-data-from-nifi/97113 "2017-08-15T14:19:12Z")

</div>

Hi i wanna send data with nifi version 2.0.0. to elasticseach with the version 5.5.0 but i think the problem maintains in the fact that these two versions are not compatible . this error appears when sending data with…

---

## [Listener timeout after waiting for 30000](https://discuss.elastic.co/t/listener-timeout-after-waiting-for-30000/97094)

<div class="topic-metadata">

**Author:** [@prakash024](https://discuss.elastic.co/u/prakash024)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 2:03pm UTC](https://discuss.elastic.co/t/listener-timeout-after-waiting-for-30000/97094 "2017-08-15T14:03:20Z")

</div>

Hi , I am continuously getting this exception while fetching data from elastic search. Below is the exception java.io.IOException: listener timeout after waiting for \[30000\] ms at org.elasticsearch.client.RestClient$S…

---

## [Deduplicating data in ElasticSearch](https://discuss.elastic.co/t/deduplicating-data-in-elasticsearch/96274)

<div class="topic-metadata">

**Author:** [@Rafay\_Khan](https://discuss.elastic.co/u/Rafay_Khan)\
**Replies:** 1\
**Last updated:** [August 15, 2017, 1:52pm UTC](https://discuss.elastic.co/t/deduplicating-data-in-elasticsearch/96274 "2017-08-15T13:52:48Z")

</div>

I am facing a challenge where I need to reduce my indexed data, by clustering similar items into one. Actually, somewhat deduplicating data. For eg. \> --------------------------------------------------------------------…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1977)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1979)
