# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=774

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 775

---

## [Data node can't find the master on elasticsearch cluster](https://discuss.elastic.co/t/data-node-cant-find-the-master-on-elasticsearch-cluster/254043)

<div class="topic-metadata">

**Author:** [@Pavle\_Ilic](https://discuss.elastic.co/u/Pavle_Ilic)\
**Replies:** 1\
**Last updated:** [November 2, 2020, 6:08pm UTC](https://discuss.elastic.co/t/data-node-cant-find-the-master-on-elasticsearch-cluster/254043 "2020-11-02T18:08:22Z")

</div>

So, I have two elasticsearch servers and wanted to form a cluster with master and data node, but I'm facing some difficulties in connecting them in a same cluster, these are my .yml files and the things I've tried so far…

---

## [Painless create new object](https://discuss.elastic.co/t/painless-create-new-object/254059)

<div class="topic-metadata">

**Author:** [@christophe\_spielmann](https://discuss.elastic.co/u/christophe_spielmann)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 5:07pm UTC](https://discuss.elastic.co/t/painless-create-new-object/254059 "2020-11-02T17:07:06Z")

</div>

I have a rather basic requirement, I would like to add an object to a document with painless within a query for update. This is the object I would like to add '"memoire": { "codeActe": "C", "docType": "M",…

---

## [Gateway timeout while getting the snapshots](https://discuss.elastic.co/t/gateway-timeout-while-getting-the-snapshots/254053)

<div class="topic-metadata">

**Author:** [@Utpal\_Kumar](https://discuss.elastic.co/u/Utpal_Kumar)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 4:41pm UTC](https://discuss.elastic.co/t/gateway-timeout-while-getting-the-snapshots/254053 "2020-11-02T16:41:59Z")

</div>

Hi, I am using elasticsearch version 7.4. I am having a daily backup as snapshot for the indices in azure repository. I get a Gateway timeout while fetching the snapshots. The repository is fine and connected. I have …

---

## [Possible malformed shape detected - ES 7.9.3](https://discuss.elastic.co/t/possible-malformed-shape-detected-es-7-9-3/253804)

<div class="topic-metadata">

**Author:** [@oshan](https://discuss.elastic.co/u/oshan)\
**Replies:** 2\
**Last updated:** [November 2, 2020, 4:18pm UTC](https://discuss.elastic.co/t/possible-malformed-shape-detected-es-7-9-3/253804 "2020-11-02T16:18:31Z")

</div>

ES 7.9.3 throws a exception when I'm indexing this polygon. Possible malformed shape detected.type"":""mapper\_parsing\_exception"",""reason"":""failed to parse field \[ranges.geometry\] of type \[geo\_shape\] polygon and the…

---

## [Cluster state limitations/recommendations in es 7.x](https://discuss.elastic.co/t/cluster-state-limitations-recommendations-in-es-7-x/253458)

<div class="topic-metadata">

**Author:** [@Johan\_Nilsson\_Hansen](https://discuss.elastic.co/u/Johan_Nilsson_Hansen)\
**Replies:** 5\
**Last updated:** [November 2, 2020, 2:48pm UTC](https://discuss.elastic.co/t/cluster-state-limitations-recommendations-in-es-7-x/253458 "2020-11-02T14:48:58Z")

</div>

Hi all, Is there any limitations or recommendation of how large the cluster state can/should be in elasticsearch 7.x? Eg, how many nodes is recommended? How many shards and indices? The context for this question is tha…

---

## [Machine learning jobs: soft and hard limit](https://discuss.elastic.co/t/machine-learning-jobs-soft-and-hard-limit/254023)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 2\
**Last updated:** [November 2, 2020, 2:26pm UTC](https://discuss.elastic.co/t/machine-learning-jobs-soft-and-hard-limit/254023 "2020-11-02T14:26:00Z")

</div>

Hello everybody, I am running elasticsearch machine learning jobs and in some of them I am getting in their memory status: hard\_limit and soft\_limit and other type of error is : Datafeed has missed X documents due to i…

---

## [Shingle filter to allow mismatching spaces](https://discuss.elastic.co/t/shingle-filter-to-allow-mismatching-spaces/253846)

<div class="topic-metadata">

**Author:** [@awarrenlove](https://discuss.elastic.co/u/awarrenlove)\
**Replies:** 4\
**Last updated:** [November 2, 2020, 2:15pm UTC](https://discuss.elastic.co/t/shingle-filter-to-allow-mismatching-spaces/253846 "2020-11-02T14:15:21Z")

</div>

I am trying to solve a problem where users sometimes include an extra space in their search terms, or alternatively a space was missing in the search term compared to what is in the index. In order to do this, I attempte…

---

## [Elasticsearch cluster monitoring](https://discuss.elastic.co/t/elasticsearch-cluster-monitoring/253897)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 2\
**Last updated:** [November 2, 2020, 2:08pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-monitoring/253897 "2020-11-02T14:08:24Z")

</div>

I've successfully setup the 8 node of elasticsearch cluster.In kibana stack monitoring it showing me the disk free space . My question is that is there any setting that it will show me the disk free space of all data no…

---

## [Alternatives to mapping types in Elasticsearch](https://discuss.elastic.co/t/alternatives-to-mapping-types-in-elasticsearch/254007)

<div class="topic-metadata">

**Author:** [@Kanika27](https://discuss.elastic.co/u/Kanika27)\
**Replies:** 3\
**Last updated:** [November 2, 2020, 12:23pm UTC](https://discuss.elastic.co/t/alternatives-to-mapping-types-in-elasticsearch/254007 "2020-11-02T12:23:18Z")

</div>

I understand that the mapping types are being removed, I want to know is their any other way out to have multiple schema in a single index? Something like putting different schema in different shards for one single inde…

---

## [Circuit breaker problem](https://discuss.elastic.co/t/circuit-breaker-problem/253828)

<div class="topic-metadata">

**Author:** [@gborg](https://discuss.elastic.co/u/gborg)\
**Replies:** 3\
**Last updated:** [November 2, 2020, 12:16pm UTC](https://discuss.elastic.co/t/circuit-breaker-problem/253828 "2020-11-02T12:16:47Z")

</div>

So, my situation is: I have a pretty big cluster (10TB) of real time log data, today is a high-load day and I am getting circuit breaker errors ## circuit\_breaking\_exception at \`shard\` 0 \`index\` open--2020.09.30 \`no…

---

## [How to get arrays with variable length into Elasticsearch?](https://discuss.elastic.co/t/how-to-get-arrays-with-variable-length-into-elasticsearch/254020)

<div class="topic-metadata">

**Author:** [@Toontje](https://discuss.elastic.co/u/Toontje)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 12:11pm UTC](https://discuss.elastic.co/t/how-to-get-arrays-with-variable-length-into-elasticsearch/254020 "2020-11-02T12:11:55Z")

</div>

I have log files with a JSON data structure that looks like this: {"windowNumber": 1830323, "timestamp": "2020-09-24T01:26:31.673097Z", "tagData": {"103040840050DDABCD10028300003B93": {"inIntensity": "2542", "inCount": …

---

## [Sorting on keyword not working as expected](https://discuss.elastic.co/t/sorting-on-keyword-not-working-as-expected/253959)

<div class="topic-metadata">

**Author:** [@F\_eq\_kx](https://discuss.elastic.co/u/F_eq_kx)\
**Replies:** 1\
**Last updated:** [November 2, 2020, 11:56am UTC](https://discuss.elastic.co/t/sorting-on-keyword-not-working-as-expected/253959 "2020-11-02T11:56:37Z")

</div>

I am storing Windows UNC paths in a path field with the following mapping: "path": { "type": "text", "fields": { "keyword": { "type": "keyword" }, "tree": { "type"…

---

## [How not to get double entries in my datastream using the Index API](https://discuss.elastic.co/t/how-not-to-get-double-entries-in-my-datastream-using-the-index-api/254015)

<div class="topic-metadata">

**Author:** [@hugohendriks](https://discuss.elastic.co/u/hugohendriks)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 10:53am UTC](https://discuss.elastic.co/t/how-not-to-get-double-entries-in-my-datastream-using-the-index-api/254015 "2020-11-02T10:53:45Z")

</div>

Hi, We are using the Index API to post data to my datastream. I read from a queue and then perform a POST but I do have a timeout setting of 10 seconds. What sometimes happens it seems is that elastic takes more then 10…

---

## [3 Node cluster with docker compose](https://discuss.elastic.co/t/3-node-cluster-with-docker-compose/253998)

<div class="topic-metadata">

**Author:** [@nyquillus](https://discuss.elastic.co/u/nyquillus)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 9:19am UTC](https://discuss.elastic.co/t/3-node-cluster-with-docker-compose/253998 "2020-11-02T09:19:04Z")

</div>

Hi, I'm working on a test environment elastic stack on docker from scratch to get a good grip on things. I started with "sebp/elk" docker image, then i made a docker-compose stack with 2 logstash containers one for dock…

---

## [Failed to process cluster event (put-mapping) within 30s](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s/253987)

<div class="topic-metadata">

**Author:** [@Yasiru\_Kanchana](https://discuss.elastic.co/u/Yasiru_Kanchana)\
**Replies:** 3\
**Last updated:** [November 2, 2020, 8:15am UTC](https://discuss.elastic.co/t/failed-to-process-cluster-event-put-mapping-within-30s/253987 "2020-11-02T08:15:28Z")

</div>

Currently, I am running Elasticsearch in cluster mode and there are 6 nodes. My logs are flooded with below error message. Also we are creating daily basis indexes and each having 10 shards (according to the template). I…

---

## [Date part in index names were removed automatically and the logs inside also removed](https://discuss.elastic.co/t/date-part-in-index-names-were-removed-automatically-and-the-logs-inside-also-removed/253990)

<div class="topic-metadata">

**Author:** [@Ibrahim\_ozbek](https://discuss.elastic.co/u/Ibrahim_ozbek)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 8:13am UTC](https://discuss.elastic.co/t/date-part-in-index-names-were-removed-automatically-and-the-logs-inside-also-removed/253990 "2020-11-02T08:13:11Z")

</div>

I started sending data to elasticsearch via filebeat and metricbeat. The corresponding indexes were created and I worked on dashboards. After two or three days, the filebeat and metricbeat index names changed from filebe…

---

## [Snapshot restore to test server](https://discuss.elastic.co/t/snapshot-restore-to-test-server/253975)

<div class="topic-metadata">

**Author:** [@bhuvaneshdct](https://discuss.elastic.co/u/bhuvaneshdct)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 4:34am UTC](https://discuss.elastic.co/t/snapshot-restore-to-test-server/253975 "2020-11-02T04:34:40Z")

</div>

Im a bit confused about the ES restore process. I have a prod cluster and stage cluster. Prod cluster has daily snapshots enabled. The first time when I restored the snapshot from the prod backup it took a lot more ti…

---

## [Not able to start the elasticsearch service](https://discuss.elastic.co/t/not-able-to-start-the-elasticsearch-service/252722)

<div class="topic-metadata">

**Author:** [@narayask](https://discuss.elastic.co/u/narayask)\
**Replies:** 4\
**Last updated:** [November 2, 2020, 4:08am UTC](https://discuss.elastic.co/t/not-able-to-start-the-elasticsearch-service/252722 "2020-11-02T04:08:14Z")

</div>

Hi Team, Getting below error while starting the elastic service for version elasticsearch-7.8.1-amd64.deb elasticsearch-7.7.0-amd64.deb on ubuntu system and getting below error. Please do the needful. \[2020-10-20T1…

---

## [Transverse through multiple buckets](https://discuss.elastic.co/t/transverse-through-multiple-buckets/253974)

<div class="topic-metadata">

**Author:** [@gokul275](https://discuss.elastic.co/u/gokul275)\
**Replies:** 0\
**Last updated:** [November 2, 2020, 4:01am UTC](https://discuss.elastic.co/t/transverse-through-multiple-buckets/253974 "2020-11-02T04:01:37Z")

</div>

I am trying to achieve bucket script aggregation for value derived from multiple sub aggregation, how to transverse to the derived value My query looks like below POST /sales/\_search { "size": 0, "aggs": { "sales\_p…

---

## [Elasticsearch security - possible to block \_search but allow get/mget?](https://discuss.elastic.co/t/elasticsearch-security-possible-to-block-search-but-allow-get-mget/253847)

<div class="topic-metadata">

**Author:** [@Andy\_Wick](https://discuss.elastic.co/u/Andy_Wick)\
**Replies:** 0\
**Last updated:** [October 30, 2020, 5:08pm UTC](https://discuss.elastic.co/t/elasticsearch-security-possible-to-block-search-but-allow-get-mget/253847 "2020-10-30T17:08:34Z")

</div>

Is it possible to create an elasticsearch user that can do get/mget but not search? It looks like there is only elasticsearch privilege around reading, called "read", and not fine grain control. I could maybe use field f…

---

## [ElasticSearch Logs to Filebeat](https://discuss.elastic.co/t/elasticsearch-logs-to-filebeat/253944)

<div class="topic-metadata">

**Author:** [@Prasad\_Rajassekaran](https://discuss.elastic.co/u/Prasad_Rajassekaran)\
**Replies:** 2\
**Last updated:** [November 2, 2020, 1:41am UTC](https://discuss.elastic.co/t/elasticsearch-logs-to-filebeat/253944 "2020-11-02T01:41:52Z")

</div>

I am a novice to elasticsearch and filebeat. I wish to load all the elasticsearch logs to filebeat. Can you someone guide me please?

---

## [Problems changing type in reindex](https://discuss.elastic.co/t/problems-changing-type-in-reindex/253511)

<div class="topic-metadata">

**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\
**Replies:** 1\
**Last updated:** [November 2, 2020, 12:56am UTC](https://discuss.elastic.co/t/problems-changing-type-in-reindex/253511 "2020-11-02T00:56:17Z")

</div>

I am ES 6.8 -- trying to get stuff tidy to migrate to 7.x Using ruby api to do the reindex : client.reindex source: { index:index\_name, type: 'auth' }, target: { index: new\_index\_name, type: 'doc' },refresh: true The …

---

## [Gradle build task fails with docker errors](https://discuss.elastic.co/t/gradle-build-task-fails-with-docker-errors/253957)

<div class="topic-metadata">

**Author:** [@ankurtrapasiya](https://discuss.elastic.co/u/ankurtrapasiya)\
**Replies:** 0\
**Last updated:** [November 1, 2020, 6:33pm UTC](https://discuss.elastic.co/t/gradle-build-task-fails-with-docker-errors/253957 "2020-11-01T18:33:29Z")

</div>

Hi, I set-up elasticsearch codebase on my local and I see that my setup fails when I try to do gradle build in IDE. Below is the error that I receive. Docker (checked \[/usr/bin/docker, /usr/local/bin/docker\]) is r…

---

## [Score multiple phrases against single document](https://discuss.elastic.co/t/score-multiple-phrases-against-single-document/253948)

<div class="topic-metadata">

**Author:** [@JGor](https://discuss.elastic.co/u/JGor)\
**Replies:** 0\
**Last updated:** [November 1, 2020, 3:54pm UTC](https://discuss.elastic.co/t/score-multiple-phrases-against-single-document/253948 "2020-11-01T15:54:27Z")

</div>

Hi, I'm wondering how I could achieve the following: Let's say I have 100 search phrases (each search phrase contains multiple words), is it possible to construct a query that would check all of them against a text fiel…

---

## [Translate geodistance aggregation query to Java](https://discuss.elastic.co/t/translate-geodistance-aggregation-query-to-java/253947)

<div class="topic-metadata">

**Author:** [@hugofajardo1](https://discuss.elastic.co/u/hugofajardo1)\
**Replies:** 0\
**Last updated:** [November 1, 2020, 3:44pm UTC](https://discuss.elastic.co/t/translate-geodistance-aggregation-query-to-java/253947 "2020-11-01T15:44:08Z")

</div>

I need to translate a geodistance aggregation query to Java. This aggregation is working from Kibana, but I can't do it from Java: GET accidentes/\_search { "aggs": { "location": { "filter": { "geo\_distance": { "di…

---

## [Elasticsearch Slowlog methodology clarification](https://discuss.elastic.co/t/elasticsearch-slowlog-methodology-clarification/253940)

<div class="topic-metadata">

**Author:** [@wittydavid](https://discuss.elastic.co/u/wittydavid)\
**Replies:** 0\
**Last updated:** [November 1, 2020, 2:35pm UTC](https://discuss.elastic.co/t/elasticsearch-slowlog-methodology-clarification/253940 "2020-11-01T14:35:14Z")

</div>

Hi all, I've read through several sources on slowlogs and I can't get my head around how should I configure it. To my understanding the granularity of the elasticsearch logging levels are from low to high: WARN, INFO, …

---

## [Elasticsearch appears to be unreachable or down](https://discuss.elastic.co/t/elasticsearch-appears-to-be-unreachable-or-down/253751)

<div class="topic-metadata">

**Author:** [@rgovinda](https://discuss.elastic.co/u/rgovinda)\
**Replies:** 3\
**Last updated:** [October 31, 2020, 1:44pm UTC](https://discuss.elastic.co/t/elasticsearch-appears-to-be-unreachable-or-down/253751 "2020-10-31T13:44:41Z")

</div>

We suddenly started seeing a huge increase ( from single digits to hundreds) in the error "Attempted to send a bulk request to elasticsearch' but Elasticsearch appears to be unreachable or down!}" This is causing signi…

---

## [Secure elasticsearch with password](https://discuss.elastic.co/t/secure-elasticsearch-with-password/253910)

<div class="topic-metadata">

**Author:** [@Labidi\_Ayoub](https://discuss.elastic.co/u/Labidi_Ayoub)\
**Replies:** 2\
**Last updated:** [October 31, 2020, 10:56pm UTC](https://discuss.elastic.co/t/secure-elasticsearch-with-password/253910 "2020-10-31T22:56:22Z")

</div>

Hello elk community, If it is possible, I want to know how to secure the elasticsearch as for example in Mysql the access with login and password, that is to say the access to the elasticsearch is done by password ?? B…

---

## [No 'Access-Control-Allow-Origin' header is present on requested resource](https://discuss.elastic.co/t/no-access-control-allow-origin-header-is-present-on-requested-resource/253914)

<div class="topic-metadata">

**Author:** [@aideveloper](https://discuss.elastic.co/u/aideveloper)\
**Replies:** 0\
**Last updated:** [October 31, 2020, 10:02pm UTC](https://discuss.elastic.co/t/no-access-control-allow-origin-header-is-present-on-requested-resource/253914 "2020-10-31T22:02:50Z")

</div>

Our elasticsearch setup has the following cors settings in elasticsearch.yml: http.cors.enabled: true http.cors.allow-credentials: true http.cors.allow-origin: "\*" http.cors.allow-methods: OPTIONS,HEAD,GET,POST,PUT,DELE…

---

## [Documents deleted from all indices](https://discuss.elastic.co/t/documents-deleted-from-all-indices/253900)

<div class="topic-metadata">

**Author:** [@venku](https://discuss.elastic.co/u/venku)\
**Replies:** 6\
**Last updated:** [October 31, 2020, 4:22pm UTC](https://discuss.elastic.co/t/documents-deleted-from-all-indices/253900 "2020-10-31T16:22:55Z")

</div>

I am running a single ElasticSearch node for past week and half and my ILM policy was to delete the index if it is 10 days old after the rollover. I have a day or 5GB limit to move from hot to delete phase. However when …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=773)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=775)
