# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=706

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 707

---

## [Coordination Only node and how does it affect cluster](https://discuss.elastic.co/t/coordination-only-node-and-how-does-it-affect-cluster/263769)

<div class="topic-metadata">

**Author:** [@vatsoo](https://discuss.elastic.co/u/vatsoo)\
**Replies:** 1\
**Last updated:** [February 11, 2021, 10:55am UTC](https://discuss.elastic.co/t/coordination-only-node-and-how-does-it-affect-cluster/263769 "2021-02-11T10:55:00Z")

</div>

Hi everyone, I did not find precise information about the topic so asking here. I want to add Coordination only node to the cluster running it on same machine as Kibana is running. Then update Kibana config by setting …

---

## [Using kv and Grok Pattern in Ingest Pipelines](https://discuss.elastic.co/t/using-kv-and-grok-pattern-in-ingest-pipelines/263997)

<div class="topic-metadata">

**Author:** [@geek876](https://discuss.elastic.co/u/geek876)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 10:50am UTC](https://discuss.elastic.co/t/using-kv-and-grok-pattern-in-ingest-pipelines/263997 "2021-02-11T10:50:22Z")

</div>

I am trying to extract a log-pattern \[LEVEL\] (COMPONENT) MESSAGE \[msgid: MESSAGE ID\] example message: \[INFO \] (core.workflow) Start scan, workflow\_id='lms::workflow::WorkflowExecutor(0x259c99f94b0, name = "WF-127.0.…

---

## [Starting elasticsearch in kubernetes](https://discuss.elastic.co/t/starting-elasticsearch-in-kubernetes/263996)

<div class="topic-metadata">

**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 10:46am UTC](https://discuss.elastic.co/t/starting-elasticsearch-in-kubernetes/263996 "2021-02-11T10:46:59Z")

</div>

I am trying to start elasticsearch in kubernetes. I have used the quick starting guide therefore my manifest file looks like this: kind: Elasticsearch metadata: name: elasticsearch namespace: rcc …

---

## [Not able change type of a field string to date using index template](https://discuss.elastic.co/t/not-able-change-type-of-a-field-string-to-date-using-index-template/263995)

<div class="topic-metadata">

**Author:** [@amp](https://discuss.elastic.co/u/amp)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 10:44am UTC](https://discuss.elastic.co/t/not-able-change-type-of-a-field-string-to-date-using-index-template/263995 "2021-02-11T10:44:49Z")

</div>

In elasticsearch 6.3 indexing windows log using Nxlog(3.7). Without any template all the fields indexed as strings. To get a date field we tried to change the Eventdate field as date. But getting parsing error. the be…

---

## [Can't really change "cron schedule for retaining snapshots"](https://discuss.elastic.co/t/cant-really-change-cron-schedule-for-retaining-snapshots/263985)

<div class="topic-metadata">

**Author:** [@NejcK](https://discuss.elastic.co/u/NejcK)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 10:23am UTC](https://discuss.elastic.co/t/cant-really-change-cron-schedule-for-retaining-snapshots/263985 "2021-02-11T10:23:34Z")

</div>

Going to Stack Management -\> Snapshot and Restore -\> Policies you see the "The cron schedule for retaining snapshots is: 0 20,50 \* \* \* ?. I can change the cron schedule (via UI or console, doesn't matter) to a differe…

---

## [Not able to install "logstash-filter-environment" in linux server : handshake\_failure](https://discuss.elastic.co/t/not-able-to-install-logstash-filter-environment-in-linux-server-handshake-failure/263968)

<div class="topic-metadata">

**Author:** [@sureshkk252](https://discuss.elastic.co/u/sureshkk252)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 8:49am UTC](https://discuss.elastic.co/t/not-able-to-install-logstash-filter-environment-in-linux-server-handshake-failure/263968 "2021-02-11T08:49:05Z")

</div>

Hello, i am trying to install "logstash-filter-environment" plugin in a linux server, where i got this error. "Unable to download data from https://rubygems.org - Received fatal alert: handshake\_failure (https://api.rub…

---

## [How should I configure the number of node, shard and replica?](https://discuss.elastic.co/t/how-should-i-configure-the-number-of-node-shard-and-replica/263840)

<div class="topic-metadata">

**Author:** [@rider9581](https://discuss.elastic.co/u/rider9581)\
**Replies:** 17\
**Last updated:** [February 11, 2021, 8:38am UTC](https://discuss.elastic.co/t/how-should-i-configure-the-number-of-node-shard-and-replica/263840 "2021-02-11T08:38:10Z")

</div>

I have one server of the following spec: RAM: 128 GB HDD: 10TB \* 2 SSD: 256 GB CPU: 32 cores and I am going to manage up to 10TB of text data using Elasticsearch 7.9.3. Also, I plan to use Docker for the deployment o…

---

## [Compare two fields in same document without using script](https://discuss.elastic.co/t/compare-two-fields-in-same-document-without-using-script/263955)

<div class="topic-metadata">

**Author:** [@sardar\_nale](https://discuss.elastic.co/u/sardar_nale)\
**Replies:** 1\
**Last updated:** [February 11, 2021, 7:53am UTC](https://discuss.elastic.co/t/compare-two-fields-in-same-document-without-using-script/263955 "2021-02-11T07:53:14Z")

</div>

Hi all, We are using elastic version 7.10.2. I want to compare two fields from a same document.Scripting is disabled in my organization. Kindly help in building below query without using script. Here my query is : nic…

---

## [Correct Index balancing between 2 different datacenter](https://discuss.elastic.co/t/correct-index-balancing-between-2-different-datacenter/263406)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 5\
**Last updated:** [February 11, 2021, 7:41am UTC](https://discuss.elastic.co/t/correct-index-balancing-between-2-different-datacenter/263406 "2021-02-11T07:41:46Z")

</div>

hi there, this is my current scenario: 5 nodes (n1-n2-n3-n4-n5) 1 index with 3 shards and 1 replica 2 datacenter (n1 in DC1, n2 in DC2, n3 in DC1, n4 in DC2, n5 in DC1) shard0 is on n1 and n5 (so in DC1) shard1 is …

---

## [Older indices are not getting deleted after rollover](https://discuss.elastic.co/t/older-indices-are-not-getting-deleted-after-rollover/263953)

<div class="topic-metadata">

**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\
**Replies:** 5\
**Last updated:** [February 11, 2021, 7:04am UTC](https://discuss.elastic.co/t/older-indices-are-not-getting-deleted-after-rollover/263953 "2021-02-11T07:04:10Z")

</div>

i did the following steps created an ilm policy. created an index template and attached the ilm policy to it. finally created an index using create index API. when i checked the index under index management section in…

---

## [ElasticSearch curator Instalation](https://discuss.elastic.co/t/elasticsearch-curator-instalation/263952)

<div class="topic-metadata">

**Author:** [@kasim123](https://discuss.elastic.co/u/kasim123)\
**Replies:** 0\
**Last updated:** [February 11, 2021, 5:51am UTC](https://discuss.elastic.co/t/elasticsearch-curator-instalation/263952 "2021-02-11T05:51:48Z")

</div>

Hi Team, I wanted to install elasticsearch curator in our k8s cluster. What is the best way to have curator in k8s cluster? Is there any helm chart available for elasticsearch curator? Our k8s cluster is running on Fe…

---

## [Certificate error when creation S3 repository for snapshot](https://discuss.elastic.co/t/certificate-error-when-creation-s3-repository-for-snapshot/263947)

<div class="topic-metadata">

**Author:** [@deependra](https://discuss.elastic.co/u/deependra)\
**Replies:** 1\
**Last updated:** [February 11, 2021, 3:59am UTC](https://discuss.elastic.co/t/certificate-error-when-creation-s3-repository-for-snapshot/263947 "2021-02-11T03:59:00Z")

</div>

Hi team, I am trying to create a S3 repository so that I can send snapshot to it and then restore on destination cluster. I am using elasticsearch 5.2.2 version and have installed equivalent s3 repo plugin. OS - cento…

---

## [Master node with 100% CPU](https://discuss.elastic.co/t/master-node-with-100-cpu/263003)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 9\
**Last updated:** [February 10, 2021, 9:36pm UTC](https://discuss.elastic.co/t/master-node-with-100-cpu/263003 "2021-02-10T21:36:32Z")

</div>

we are getting 100% CPU usage for a master node. the cluster is hosted in the Elastic cloud. any help will be appreciated! attached below the tasks (it seems to run /admin/snapshot/delete constantly )

---

## [Optimistic locking](https://discuss.elastic.co/t/optimistic-locking/263847)

<div class="topic-metadata">

**Author:** [@Giovanni\_Di\_Lembo](https://discuss.elastic.co/u/Giovanni_Di_Lembo)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 9:28pm UTC](https://discuss.elastic.co/t/optimistic-locking/263847 "2021-02-10T21:28:11Z")

</div>

Hi all and sorry for poor english I wonder if it's correct to talk about concurrency in elasticsearch . Exists an optimistic locks for document in elasticsearch? I found this page , I wonder if it is usefull lock docu…

---

## [Cluster Node Down](https://discuss.elastic.co/t/cluster-node-down/263853)

<div class="topic-metadata">

**Author:** [@Tahir\_Khan](https://discuss.elastic.co/u/Tahir_Khan)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 9:24pm UTC](https://discuss.elastic.co/t/cluster-node-down/263853 "2021-02-10T21:24:59Z")

</div>

How can i know the cluster node is down through API i was trying with \_cluster/health but its not giving the details about the node down server. I have checked other API as well but didnt got anything. Is there anyway…

---

## [Ingest pipeline error - ailed to parse with all enclosed parsers](https://discuss.elastic.co/t/ingest-pipeline-error-ailed-to-parse-with-all-enclosed-parsers/263809)

<div class="topic-metadata">

**Author:** [@Glenn\_Glashagen](https://discuss.elastic.co/u/Glenn_Glashagen)\
**Replies:** 5\
**Last updated:** [February 10, 2021, 9:12pm UTC](https://discuss.elastic.co/t/ingest-pipeline-error-ailed-to-parse-with-all-enclosed-parsers/263809 "2021-02-10T21:12:04Z")

</div>

Hello everybody, I'm recently encountering problem with my ingestion pipeline, where part of if tries to parse a date. If it fails to do so, it should continue and not create the fields time\_log and rest\_message. This …

---

## [Path.data and path.log not used](https://discuss.elastic.co/t/path-data-and-path-log-not-used/263912)

<div class="topic-metadata">

**Author:** [@Mark\_Pevec](https://discuss.elastic.co/u/Mark_Pevec)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 7:00pm UTC](https://discuss.elastic.co/t/path-data-and-path-log-not-used/263912 "2021-02-10T19:00:14Z")

</div>

I am running Elasticsearch on VMs in Google Cloud (using the standard latest 7.x debian package installation) and am trying out different configurations. I recently tried to run a cluster with VMs with local SSD (local …

---

## [Pg\_trgm similarity ( text, text ) → real (postgresql Function) on ElasticSearch](https://discuss.elastic.co/t/pg-trgm-similarity-text-text-real-postgresql-function-on-elasticsearch/263920)

<div class="topic-metadata">

**Author:** [@zied\_marouani](https://discuss.elastic.co/u/zied_marouani)\
**Replies:** 0\
**Last updated:** [February 10, 2021, 6:34pm UTC](https://discuss.elastic.co/t/pg-trgm-similarity-text-text-real-postgresql-function-on-elasticsearch/263920 "2021-02-10T18:34:47Z")

</div>

Hello , i'm trying to imrpove the search time for a text from a postgresql database using Elasticsearch , the problem is the search returns a nameof product with best score using "similarity" function in Postgresql exam…

---

## [Update index with static value instead of scripted field](https://discuss.elastic.co/t/update-index-with-static-value-instead-of-scripted-field/263890)

<div class="topic-metadata">

**Author:** [@stevezemlicka](https://discuss.elastic.co/u/stevezemlicka)\
**Replies:** 2\
**Last updated:** [February 10, 2021, 4:45pm UTC](https://discuss.elastic.co/t/update-index-with-static-value-instead-of-scripted-field/263890 "2021-02-10T16:45:49Z")

</div>

I have a scripted field generating the hour of the day in a particular index. Unfortunately due to the size and the necessary complexity (result of timezone challenges), it is making some Kibana visualizations slow. Us…

---

## [Elastic and LocalStack](https://discuss.elastic.co/t/elastic-and-localstack/263804)

<div class="topic-metadata">

**Author:** [@Sergiodive](https://discuss.elastic.co/u/Sergiodive)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 2:42pm UTC](https://discuss.elastic.co/t/elastic-and-localstack/263804 "2021-02-10T14:42:30Z")

</div>

Hello I am running Elasticsearch 7.10 with a localstack s3 instance. The issue is when i try to register a repository. If i do this curl -X PUT "localhost:9200/\_snapshot/repo1?pretty" -H 'Content-Type: application/…

---

## [Snapshot restore failed shards](https://discuss.elastic.co/t/snapshot-restore-failed-shards/263884)

<div class="topic-metadata">

**Author:** [@sld](https://discuss.elastic.co/u/sld)\
**Replies:** 0\
**Last updated:** [February 10, 2021, 2:21pm UTC](https://discuss.elastic.co/t/snapshot-restore-failed-shards/263884 "2021-02-10T14:21:04Z")

</div>

I am setting up an automated process to test my latest elasticsearch snapshots. The snapshots are taken using slm and the snapshot data is synced from the production cluster to a local server. On the local server I have…

---

## [Is it possible to specify date range on Elastic snapshots?](https://discuss.elastic.co/t/is-it-possible-to-specify-date-range-on-elastic-snapshots/263881)

<div class="topic-metadata">

**Author:** [@eeijlar](https://discuss.elastic.co/u/eeijlar)\
**Replies:** 2\
**Last updated:** [February 10, 2021, 2:06pm UTC](https://discuss.elastic.co/t/is-it-possible-to-specify-date-range-on-elastic-snapshots/263881 "2021-02-10T14:06:41Z")

</div>

With reference to the following documentation: Is it possible to specify a time range for a snapshot? I can't see what the period for the snapshot is. Is it the last day/week/month?

---

## [Repository-s3 plugin does not support S3-compatible services as documentation says](https://discuss.elastic.co/t/repository-s3-plugin-does-not-support-s3-compatible-services-as-documentation-says/263866)

<div class="topic-metadata">

**Author:** [@Krzysztof\_Szymanski](https://discuss.elastic.co/u/Krzysztof_Szymanski)\
**Replies:** 2\
**Last updated:** [February 10, 2021, 1:30pm UTC](https://discuss.elastic.co/t/repository-s3-plugin-does-not-support-s3-compatible-services-as-documentation-says/263866 "2021-02-10T13:30:16Z")

</div>

Hi is there anyone who achieve configuring repository-s3 plugin to work with S3-compatible service like CEPH. I completely follow the documentation (and many forums) and try to configure it but every time I failed. I did…

---

## [Encrypt/hide custom headers in watchers](https://discuss.elastic.co/t/encrypt-hide-custom-headers-in-watchers/263875)

<div class="topic-metadata">

**Author:** [@Smirra](https://discuss.elastic.co/u/Smirra)\
**Replies:** 0\
**Last updated:** [February 10, 2021, 1:03pm UTC](https://discuss.elastic.co/t/encrypt-hide-custom-headers-in-watchers/263875 "2021-02-10T13:03:11Z")

</div>

Hey! I have finished a webhook connection for a watcher. This webhook uses alot of custom headers and Bearer token authorization. All this is possible and working great with the headers. One issue that has come up though…

---

## [ILM phase don't delete indexes (els 7.9)](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-els-7-9/263704)

<div class="topic-metadata">

**Author:** [@zakabluk](https://discuss.elastic.co/u/zakabluk)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 11:08am UTC](https://discuss.elastic.co/t/ilm-phase-dont-delete-indexes-els-7-9/263704 "2021-02-10T11:08:06Z")

</div>

My ILM policy PUT \_ilm/policy/delete-after-7-days { "policy": { "phases": { "hot": { "min\_age": "0ms", "actions": { "set\_priority": { "priority": 100 } …

---

## [Logs are not getting logged continuously](https://discuss.elastic.co/t/logs-are-not-getting-logged-continuously/263081)

<div class="topic-metadata">

**Author:** [@Bilal\_Malik](https://discuss.elastic.co/u/Bilal_Malik)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 10:31am UTC](https://discuss.elastic.co/t/logs-are-not-getting-logged-continuously/263081 "2021-02-10T10:31:46Z")

</div>

Hi, Elastic search is showing very strange behavior from yesterday, it was working perfectly, but now it is missing logs after every ten minutes. It just logs for 5 minutes then shows a gap for the next 10 minutes. Plea…

---

## [ES 7.8.0 plugin development - onIndexModule questions](https://discuss.elastic.co/t/es-7-8-0-plugin-development-onindexmodule-questions/263848)

<div class="topic-metadata">

**Author:** [@Tom\_Elias](https://discuss.elastic.co/u/Tom_Elias)\
**Replies:** 0\
**Last updated:** [February 10, 2021, 10:16am UTC](https://discuss.elastic.co/t/es-7-8-0-plugin-development-onindexmodule-questions/263848 "2021-02-10T10:16:15Z")

</div>

Hello, I am currently developing a plugin for Elasticsearch and trying out the new dense\_vector data type. what i'm currently trying to do is register a PostIndexOperationListener and IndexOperationEventListener object…

---

## [Nested query max value](https://discuss.elastic.co/t/nested-query-max-value/263569)

<div class="topic-metadata">

**Author:** [@sivanzakay](https://discuss.elastic.co/u/sivanzakay)\
**Replies:** 1\
**Last updated:** [February 10, 2021, 10:04am UTC](https://discuss.elastic.co/t/nested-query-max-value/263569 "2021-02-10T10:04:15Z")

</div>

For a set of documents like this: { "took" : 1, "timed\_out" : false, "\_shards" : { "total" : 1, "successful" : 1, "skipped" : 0, "failed" : 0 }, "hits" : { "total" : { "value" : 3, "relation" : "eq" }, "ma…

---

## [Running tasks get terminated when cluster is upgraded from 6.6.2 to 7.10.2 using full cluster restart upgrade approach](https://discuss.elastic.co/t/running-tasks-get-terminated-when-cluster-is-upgraded-from-6-6-2-to-7-10-2-using-full-cluster-restart-upgrade-approach/263668)

<div class="topic-metadata">

**Author:** [@yabhishek](https://discuss.elastic.co/u/yabhishek)\
**Replies:** 7\
**Last updated:** [February 10, 2021, 9:26am UTC](https://discuss.elastic.co/t/running-tasks-get-terminated-when-cluster-is-upgraded-from-6-6-2-to-7-10-2-using-full-cluster-restart-upgrade-approach/263668 "2021-02-10T09:26:39Z")

</div>

Hi I tried to upgrade my elasticsearch cluster running version 6.6.2 to version 7.10.2 using full cluster restart upgrade approach. Before performing upgrade, I had some tasks running as can be seen in the following ou…

---

## [Start from zero with a new cluster](https://discuss.elastic.co/t/start-from-zero-with-a-new-cluster/263843)

<div class="topic-metadata">

**Author:** [@grillo](https://discuss.elastic.co/u/grillo)\
**Replies:** 0\
**Last updated:** [February 10, 2021, 8:12am UTC](https://discuss.elastic.co/t/start-from-zero-with-a-new-cluster/263843 "2021-02-10T08:12:14Z")

</div>

Hi all, I've been working with this ELK solution for a few years and I can't restart all the nodes in a cluster to ... start from zero with a new cluster 1st - Delete all stored data I can delete indexes ... (from com…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=705)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=707)
