# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1338

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1339

---

## [Lots of "cluster state update task \[zen-disco-receive(from master " above the warn threshold of 30s"](https://discuss.elastic.co/t/lots-of-cluster-state-update-task-zen-disco-receive-from-master-above-the-warn-threshold-of-30s/175961)

<div class="topic-metadata">

**Author:** [@shjdwxy](https://discuss.elastic.co/u/shjdwxy)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 10:36am UTC](https://discuss.elastic.co/t/lots-of-cluster-state-update-task-zen-disco-receive-from-master-above-the-warn-threshold-of-30s/175961 "2019-04-09T10:36:38Z")

</div>

hi, We use ES for log management and ES cluster is built by hot-cold architecture. One physical host holds one hot node and one cold node. Hot node and cold node share Cpu, memory, but use different storage( ssd for hot…

---

## [Stemmer not working \[ES 6.7.1\]](https://discuss.elastic.co/t/stemmer-not-working-es-6-7-1/175881)

<div class="topic-metadata">

**Author:** [@Matteo\_Pietro\_Peru](https://discuss.elastic.co/u/Matteo_Pietro_Peru)\
**Replies:** 1\
**Last updated:** [April 9, 2019, 10:30am UTC](https://discuss.elastic.co/t/stemmer-not-working-es-6-7-1/175881 "2019-04-09T10:30:32Z")

</div>

Hi everybody, i'have issues using stemmer, following the guidelines at link https://www.elastic.co/guide/en/elasticsearch/reference/6.7/mixing-exact-search-with-stemming.html I created the following index (partial map…

---

## [Display data volume per index on a daily basis](https://discuss.elastic.co/t/display-data-volume-per-index-on-a-daily-basis/175950)

<div class="topic-metadata">

**Author:** [@Ashok2](https://discuss.elastic.co/u/Ashok2)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 9:46am UTC](https://discuss.elastic.co/t/display-data-volume-per-index-on-a-daily-basis/175950 "2019-04-09T09:46:50Z")

</div>

I would like to see for a given date how many documents/logs are created and what is the storage size consumed by the newly created documents/log record I want to know the daily data consumed by customers. Please let m…

---

## [Installing and working with Elastic Maps Service](https://discuss.elastic.co/t/installing-and-working-with-elastic-maps-service/175855)

<div class="topic-metadata">

**Author:** [@ShilpaT](https://discuss.elastic.co/u/ShilpaT)\
**Replies:** 2\
**Last updated:** [April 9, 2019, 9:45am UTC](https://discuss.elastic.co/t/installing-and-working-with-elastic-maps-service/175855 "2019-04-09T09:45:20Z")

</div>

I need to make use of Regional and Country maps in Elasticsearch. For that how do I install Elastic Maps Service?

---

## [Email disabled configure elasticsearch.yml](https://discuss.elastic.co/t/email-disabled-configure-elasticsearch-yml/175994)

<div class="topic-metadata">

**Author:** [@ashok9177](https://discuss.elastic.co/u/ashok9177)\
**Replies:** 0\
**Last updated:** [April 9, 2019, 9:21am UTC](https://discuss.elastic.co/t/email-disabled-configure-elasticsearch-yml/175994 "2019-04-09T09:21:32Z")

</div>

Hi I am using elasticsearch6.5.1, I have configured watcher to receive alerts, and configured gmail, but kibana not showing email. xpack.notification.email.account: gmail\_account: profile: gmail smtp: auth: true st…

---

## [Repository verification exception when creating HDFS Repository](https://discuss.elastic.co/t/repository-verification-exception-when-creating-hdfs-repository/175757)

<div class="topic-metadata">

**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\
**Replies:** 1\
**Last updated:** [April 9, 2019, 9:00am UTC](https://discuss.elastic.co/t/repository-verification-exception-when-creating-hdfs-repository/175757 "2019-04-09T09:00:12Z")

</div>

Hi, I couldn't able to create the HDFS repository on my elasticsearch cluster. Here is the request and response: Could someone please help me how do I resolve this issue. Thanks ! PUT \_snapshot/my\_staging\_hdfs { "ty…

---

## [Geographic](https://discuss.elastic.co/t/geographic/175967)

<div class="topic-metadata">

**Author:** [@arozenbeek](https://discuss.elastic.co/u/arozenbeek)\
**Replies:** 4\
**Last updated:** [April 9, 2019, 8:36am UTC](https://discuss.elastic.co/t/geographic/175967 "2019-04-09T08:36:59Z")

</div>

Hi I am a new user for Elastic. I want to create a geographic file with cities in the Netherlands. I do have a csv-file with longtitude lattitude However I get no data. Can some0dy help me with this

---

## [How to set a id using ElasticClient](https://discuss.elastic.co/t/how-to-set-a-id-using-elasticclient/175821)

<div class="topic-metadata">

**Author:** [@frankm](https://discuss.elastic.co/u/frankm)\
**Replies:** 2\
**Last updated:** [April 8, 2019, 11:19am UTC](https://discuss.elastic.co/t/how-to-set-a-id-using-elasticclient/175821 "2019-04-08T11:19:22Z")

</div>

To avoid duplicates I like to give a document ID to each data set into Elastic. As described at the documentation I like to set a ID while adding a item to Elastic. The description recommend to set the ID like this: P…

---

## [Elasticsearch Geo queries - Java API](https://discuss.elastic.co/t/elasticsearch-geo-queries-java-api/173501)

<div class="topic-metadata">

**Author:** [@AAHM](https://discuss.elastic.co/u/AAHM)\
**Replies:** 6\
**Last updated:** [April 9, 2019, 8:10am UTC](https://discuss.elastic.co/t/elasticsearch-geo-queries-java-api/173501 "2019-04-09T08:10:38Z")

</div>

Hi, We are migrating to ES and need to support different geo queries. We use a geo\_point field type in our mapping. I can see that ES supports geo\_bounding\_box & geo\_distance but I'm trying to figure out whether they ca…

---

## [Query HDFS data using ES and Kibana](https://discuss.elastic.co/t/query-hdfs-data-using-es-and-kibana/175787)

<div class="topic-metadata">

**Author:** [@leekk8](https://discuss.elastic.co/u/leekk8)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 7:50am UTC](https://discuss.elastic.co/t/query-hdfs-data-using-es-and-kibana/175787 "2019-04-09T07:50:20Z")

</div>

Hi, I would like to setup a Kibana GUI to query some log files in HDFS. So, I'm looking at the Hadoop-ES connector if this can help to meet my requirement. However, there are few doubts I have now. Do I need to store …

---

## [Curl: (7) failed to connect to localhost port 9200: connection refused using curl -X PUT "localhost:9200"](https://discuss.elastic.co/t/curl-7-failed-to-connect-to-localhost-port-9200-connection-refused-using-curl-x-put-localhost-9200/175905)

<div class="topic-metadata">

**Author:** [@idris](https://discuss.elastic.co/u/idris)\
**Replies:** 9\
**Last updated:** [April 9, 2019, 7:47am UTC](https://discuss.elastic.co/t/curl-7-failed-to-connect-to-localhost-port-9200-connection-refused-using-curl-x-put-localhost-9200/175905 "2019-04-09T07:47:08Z")

</div>

Need help guys! please I add mappings on Elasticsearch using this command line curl -X PUT "localhost:9200/newsout/\_mapping/test-type" -H 'Content-Type: application/json' -d' { "properties": { "author": { "type": "st…

---

## [Large-scale elasticsearch update cluster setting very slow](https://discuss.elastic.co/t/large-scale-elasticsearch-update-cluster-setting-very-slow/175746)

<div class="topic-metadata">

**Author:** [@caoyue987](https://discuss.elastic.co/u/caoyue987)\
**Replies:** 10\
**Last updated:** [April 9, 2019, 7:24am UTC](https://discuss.elastic.co/t/large-scale-elasticsearch-update-cluster-setting-very-slow/175746 "2019-04-09T07:24:57Z")

</div>

I have an elasticsearch cluster with 3PB data over 100+ nodes,but when I change cluster setting,for example I close an index,it will took ten or twenty minutes.After analysis hot\_threads,I think the reason is rebalance,I…

---

## [Elasticsearch Crashing Due to multiple Hits](https://discuss.elastic.co/t/elasticsearch-crashing-due-to-multiple-hits/175958)

<div class="topic-metadata">

**Author:** [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Replies:** 2\
**Last updated:** [April 9, 2019, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-crashing-due-to-multiple-hits/175958 "2019-04-09T07:21:38Z")

</div>

Hello, My single node Cluster is crashing after sending the multiple hits of query. Can someone suggest me some better ways. Regards

---

## [Elastic Search 2.2 Occupying a lot of ram which leads to GC Memory Pressure](https://discuss.elastic.co/t/elastic-search-2-2-occupying-a-lot-of-ram-which-leads-to-gc-memory-pressure/175528)

<div class="topic-metadata">

**Author:** [@iaskdoubt](https://discuss.elastic.co/u/iaskdoubt)\
**Replies:** 11\
**Last updated:** [April 9, 2019, 6:59am UTC](https://discuss.elastic.co/t/elastic-search-2-2-occupying-a-lot-of-ram-which-leads-to-gc-memory-pressure/175528 "2019-04-09T06:59:28Z")

</div>

Hi, We are indexing around 1000 logs per second with the elasticsearch in Client mode. But as soon as we start the product the elasticsearch occupies around 1 GB of the total heap. This however grows \> 4 gb in a few mi…

---

## [Blocked by: \[FORBIDDEN/5/index read-only (api)\];](https://discuss.elastic.co/t/blocked-by-forbidden-5-index-read-only-api/175956)

<div class="topic-metadata">

**Author:** [@Gnanendra](https://discuss.elastic.co/u/Gnanendra)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 6:50am UTC](https://discuss.elastic.co/t/blocked-by-forbidden-5-index-read-only-api/175956 "2019-04-09T06:50:44Z")

</div>

Hi, I am marked indices read\_only and after apply force merge operation that same indices. i am getting below error. i am doing below steps. please help me. Step1: GET my\_indices/\_settings { "my\_indices" : { "setti…

---

## [Elastic search host unreachable](https://discuss.elastic.co/t/elastic-search-host-unreachable/175963)

<div class="topic-metadata">

**Author:** [@safderali5](https://discuss.elastic.co/u/safderali5)\
**Replies:** 0\
**Last updated:** [April 9, 2019, 6:48am UTC](https://discuss.elastic.co/t/elastic-search-host-unreachable/175963 "2019-04-09T06:48:40Z")

</div>

I am running elasticsearch and logstash in kubernetes. I used statefulset to run ealsticsearch data nodes. The problem arise when i try to upgrade data nodes using rolling upgrade, the logstash cannot connect to elastic …

---

## [Sum Aggregation returning bad value](https://discuss.elastic.co/t/sum-aggregation-returning-bad-value/175538)

<div class="topic-metadata">

**Author:** [@Nerijus\_Oftas](https://discuss.elastic.co/u/Nerijus_Oftas)\
**Replies:** 9\
**Last updated:** [April 9, 2019, 6:27am UTC](https://discuss.elastic.co/t/sum-aggregation-returning-bad-value/175538 "2019-04-09T06:27:34Z")

</div>

Hi, I am using a simple sum aggregation query. It's fine when I have a small count of documents. But if the query needs to aggregate from 10 million filtered documents, the sum value is not correct. I found that the sol…

---

## [Disabling watches installed by elastic](https://discuss.elastic.co/t/disabling-watches-installed-by-elastic/175921)

<div class="topic-metadata">

**Author:** [@Karthik\_Ramachandran](https://discuss.elastic.co/u/Karthik_Ramachandran)\
**Replies:** 0\
**Last updated:** [April 8, 2019, 9:13pm UTC](https://discuss.elastic.co/t/disabling-watches-installed-by-elastic/175921 "2019-04-08T21:13:05Z")

</div>

I would like to disable watches that are installed by default when we enable monitoring against a cluster. (Main Cluster-- MonitoringCLuster). Monitoring cluster has watches that send alerts, which are installed by defau…

---

## [How to migrate data from localhost to Azure host](https://discuss.elastic.co/t/how-to-migrate-data-from-localhost-to-azure-host/175743)

<div class="topic-metadata">

**Author:** [@talqadi7](https://discuss.elastic.co/u/talqadi7)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 6:04am UTC](https://discuss.elastic.co/t/how-to-migrate-data-from-localhost-to-azure-host/175743 "2019-04-09T06:04:24Z")

</div>

Hi, I'm fairly new to ES, and would appreciate any help! I've attempted to follow the two different ways to migrate data that was stated in https://www.elastic.co/guide/en/cloud/current/ec-migrate-data.html However, I'…

---

## [Get jenkins jobs data in to elastic search](https://discuss.elastic.co/t/get-jenkins-jobs-data-in-to-elastic-search/175951)

<div class="topic-metadata">

**Author:** [@syedsfayaz](https://discuss.elastic.co/u/syedsfayaz)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 5:59am UTC](https://discuss.elastic.co/t/get-jenkins-jobs-data-in-to-elastic-search/175951 "2019-04-09T05:59:06Z")

</div>

Hi I am trying to create a dashboard to monitor different components of our software, migrating from one environment to another. Package A Dev --\> test --\> QA --\> UAT --\> Prod Package B Dev --\> test --\> QA --\> UAT …

---

## [Rollback index update](https://discuss.elastic.co/t/rollback-index-update/175831)

<div class="topic-metadata">

**Author:** [@Pottendla\_Nagma](https://discuss.elastic.co/u/Pottendla_Nagma)\
**Replies:** 2\
**Last updated:** [April 9, 2019, 5:51am UTC](https://discuss.elastic.co/t/rollback-index-update/175831 "2019-04-09T05:51:52Z")

</div>

How do i rollback a transaction in ES?

---

## [Data disappearing and new uuid](https://discuss.elastic.co/t/data-disappearing-and-new-uuid/175678)

<div class="topic-metadata">

**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\
**Replies:** 14\
**Last updated:** [April 8, 2019, 8:58am UTC](https://discuss.elastic.co/t/data-disappearing-and-new-uuid/175678 "2019-04-08T08:58:31Z")

</div>

I'm trying to load around 20 GB of data into an index. My problem is that while I do this, all of a sudden the uuid, docs.count and store.size changes after querying: curl http://localhost:9200/\_cat/indices?v An exampl…

---

## [Lifecycle Management rotate on a daily basis](https://discuss.elastic.co/t/lifecycle-management-rotate-on-a-daily-basis/174263)

<div class="topic-metadata">

**Author:** [@gruselglatz](https://discuss.elastic.co/u/gruselglatz)\
**Replies:** 3\
**Last updated:** [April 9, 2019, 5:06am UTC](https://discuss.elastic.co/t/lifecycle-management-rotate-on-a-daily-basis/174263 "2019-04-09T05:06:13Z")

</div>

How do i correctly config ILM to rotate my index on a daily basis and delete the index after 120 days? I tried this config, but it doesn't rotated the index: "logstash" : { "version" : 1, "modified\_date" : "201…

---

## [Can't Download Elasticsearch from Sudan!](https://discuss.elastic.co/t/cant-download-elasticsearch-from-sudan/174672)

<div class="topic-metadata">

**Author:** [@Obay\_Abdelgader](https://discuss.elastic.co/u/Obay_Abdelgader)\
**Replies:** 4\
**Last updated:** [April 9, 2019, 1:12am UTC](https://discuss.elastic.co/t/cant-download-elasticsearch-from-sudan/174672 "2019-04-09T01:12:05Z")

</div>

Hi, I am from Sudan, a country in north Africa. There is an embargo from the US. So we can't buy software from there. However recently the embargo is partially lifted, and some companies are now selling software here,…

---

## [\[ELASTIC CLOUD\] Create Index to Keep Track of Kibana User Logins](https://discuss.elastic.co/t/elastic-cloud-create-index-to-keep-track-of-kibana-user-logins/175931)

<div class="topic-metadata">

**Author:** [@arcane\_scraper](https://discuss.elastic.co/u/arcane_scraper)\
**Replies:** 1\
**Last updated:** [April 9, 2019, 12:56am UTC](https://discuss.elastic.co/t/elastic-cloud-create-index-to-keep-track-of-kibana-user-logins/175931 "2019-04-09T00:56:15Z")

</div>

This is most likely a redundant question but I have failed to find the answer that I am looking for. Background: I have an Elastic Cloud cluster with the platinum subscription. Desired Result: Understand how to creat…

---

## [Run about 1k sequential non-scoring queries hourly, 1-2 times daily query times increase up to 5-6x](https://discuss.elastic.co/t/run-about-1k-sequential-non-scoring-queries-hourly-1-2-times-daily-query-times-increase-up-to-5-6x/175811)

<div class="topic-metadata">

**Author:** [@alantu](https://discuss.elastic.co/u/alantu)\
**Replies:** 4\
**Last updated:** [April 9, 2019, 12:12am UTC](https://discuss.elastic.co/t/run-about-1k-sequential-non-scoring-queries-hourly-1-2-times-daily-query-times-increase-up-to-5-6x/175811 "2019-04-09T00:12:37Z")

</div>

Hello, I am relatively new to Elasticsearch. I'm getting variable query performance and I'd like to understand what is going on. I have a public dataset which I'm indexing into a 1-node cluster on Elasticsearch 6.7. The…

---

## [How to parallelize ES load operation in Spark using the connector lib?](https://discuss.elastic.co/t/how-to-parallelize-es-load-operation-in-spark-using-the-connector-lib/174618)

<div class="topic-metadata">

**Author:** [@traam](https://discuss.elastic.co/u/traam)\
**Replies:** 4\
**Last updated:** [April 8, 2019, 11:10pm UTC](https://discuss.elastic.co/t/how-to-parallelize-es-load-operation-in-spark-using-the-connector-lib/174618 "2019-04-08T23:10:04Z")

</div>

I have a three node Spark cluster (8 cores and 16GB RAM each) in standalone mode. I am using Elasticsearch-hadoop connector to read an ES index. The index is really huge with over 100M documents and has 5 shards and …

---

## [Ingest plugin in Elastic](https://discuss.elastic.co/t/ingest-plugin-in-elastic/175878)

<div class="topic-metadata">

**Author:** [@aditya\_arun](https://discuss.elastic.co/u/aditya_arun)\
**Replies:** 3\
**Last updated:** [April 8, 2019, 10:15pm UTC](https://discuss.elastic.co/t/ingest-plugin-in-elastic/175878 "2019-04-08T22:15:55Z")

</div>

Hi, I wrote an ingest plugin to get some data from a remote endpoint and add that to the incoming document. When I run the plugin to test, I get "java.lang.IllegalArgumentException: java.security.AccessControlException…

---

## [Unable to import csv with floats in 7.x rc2](https://discuss.elastic.co/t/unable-to-import-csv-with-floats-in-7-x-rc2/175918)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 0\
**Last updated:** [April 8, 2019, 8:49pm UTC](https://discuss.elastic.co/t/unable-to-import-csv-with-floats-in-7-x-rc2/175918 "2019-04-08T20:49:00Z")

</div>

Hello, Trying Kibana / ELastic 7.0 rc2 csv importer functionalities. So I have a small test csv which contains some data with a location and 4 floats with the number of dog poo (yes, you read that correctly) collected. …

---

## [Need guidance on search for a list of servers that had software x installed from Kibana/Logstash/filebeat](https://discuss.elastic.co/t/need-guidance-on-search-for-a-list-of-servers-that-had-software-x-installed-from-kibana-logstash-filebeat/170680)

<div class="topic-metadata">

**Author:** [@Lee\_Weng\_Sheng](https://discuss.elastic.co/u/Lee_Weng_Sheng)\
**Replies:** 17\
**Last updated:** [April 8, 2019, 8:42pm UTC](https://discuss.elastic.co/t/need-guidance-on-search-for-a-list-of-servers-that-had-software-x-installed-from-kibana-logstash-filebeat/170680 "2019-04-08T20:42:11Z")

</div>

Hi, I'm not sure whether this should goes to Logstash, Elastic search or other forums. My objective: To search for a list of servers that had software x installed, can someone please give me an advice on what's the be…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1337)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1339)
