# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=842

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 843

---

## [Related ES 5.3 buffer memory issue](https://discuss.elastic.co/t/related-es-5-3-buffer-memory-issue/243355)

<div class="topic-metadata">

**Author:** [@Sourabh\_Korde](https://discuss.elastic.co/u/Sourabh_Korde)\
**Replies:** 2\
**Last updated:** [August 6, 2020, 7:39am UTC](https://discuss.elastic.co/t/related-es-5-3-buffer-memory-issue/243355 "2020-08-06T07:39:58Z")

</div>

I am using ES 5.3 version with high level REST client. When am requesting lengthy description its showing exception like \[ERROR|2020-07-21 11:37:23.971|VACS|37891724|VACS-27229170-20200721:113703-963|hsbc-search-servic…

---

## [Elastic Cloud availability zones](https://discuss.elastic.co/t/elastic-cloud-availability-zones/243859)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 3\
**Last updated:** [August 6, 2020, 7:24am UTC](https://discuss.elastic.co/t/elastic-cloud-availability-zones/243859 "2020-08-06T07:24:21Z")

</div>

Hello, In the cloud management when choosing , when choosing 2 availability zones, is the data replicated or splitted between data centers, but does it also mean, that both data centers are participating queries effort…

---

## [Csv reports from elasticsearch curl command](https://discuss.elastic.co/t/csv-reports-from-elasticsearch-curl-command/243965)

<div class="topic-metadata">

**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\
**Replies:** 1\
**Last updated:** [August 6, 2020, 7:21am UTC](https://discuss.elastic.co/t/csv-reports-from-elasticsearch-curl-command/243965 "2020-08-06T07:21:08Z")

</div>

Hi All, I m trying to get curl command reports in csv format rather than json. Is there a way to achieve it.

---

## [Help with process cluster event timeout exception](https://discuss.elastic.co/t/help-with-process-cluster-event-timeout-exception/243959)

<div class="topic-metadata">

**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\
**Replies:** 1\
**Last updated:** [August 6, 2020, 7:20am UTC](https://discuss.elastic.co/t/help-with-process-cluster-event-timeout-exception/243959 "2020-08-06T07:20:48Z")

</div>

Hi There, I have an index which consists only 8 documents, but while inserting that, I have got the Cluster Event Exception, When I try it after few seconds, then it worked fine. This is a big problem for me. This is t…

---

## [Custom similarity without TF/IDF scoring](https://discuss.elastic.co/t/custom-similarity-without-tf-idf-scoring/243930)

<div class="topic-metadata">

**Author:** [@Alex\_D](https://discuss.elastic.co/u/Alex_D)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 8:24pm UTC](https://discuss.elastic.co/t/custom-similarity-without-tf-idf-scoring/243930 "2020-08-05T20:24:21Z")

</div>

Hi all ! It isn't necessary to use TF / IDF scoring relevance for my full-text search task. I am trying to receive score in range 0-100 based only on doc.length variable. My formula: "similarity": { "custom\_similar…

---

## [ILM settings not being applied](https://discuss.elastic.co/t/ilm-settings-not-being-applied/243643)

<div class="topic-metadata">

**Author:** [@wardallen](https://discuss.elastic.co/u/wardallen)\
**Replies:** 4\
**Last updated:** [August 6, 2020, 6:55am UTC](https://discuss.elastic.co/t/ilm-settings-not-being-applied/243643 "2020-08-06T06:55:36Z")

</div>

I have a logstash index storing data that will be used in reporting, but only ever for the last 5 minutes. Hence, I want to have a very aggressive deletion policy. Roll the index every 15 minutes Delete the rolled (ol…

---

## [Unable to start ElasticSearch after install on CENTOS 7](https://discuss.elastic.co/t/unable-to-start-elasticsearch-after-install-on-centos-7/243733)

<div class="topic-metadata">

**Author:** [@ian-hosting](https://discuss.elastic.co/u/ian-hosting)\
**Replies:** 13\
**Last updated:** [August 6, 2020, 6:27am UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-after-install-on-centos-7/243733 "2020-08-06T06:27:37Z")

</div>

Hi Went through the steps to install the latest ElasticSearch via rpm and all seemed to go well but when I try to start it, there is an error First time attempting to install this so am a bit lost as to where to look f…

---

## [How can I install systemd module into the ES serverinstalled from the archive?](https://discuss.elastic.co/t/how-can-i-install-systemd-module-into-the-es-serverinstalled-from-the-archive/243656)

<div class="topic-metadata">

**Author:** [@takh777](https://discuss.elastic.co/u/takh777)\
**Replies:** 4\
**Last updated:** [August 6, 2020, 5:34am UTC](https://discuss.elastic.co/t/how-can-i-install-systemd-module-into-the-es-serverinstalled-from-the-archive/243656 "2020-08-06T05:34:11Z")

</div>

I've installed Elasticsearch 7.6 from archive (not RPM) on Cent OS 7 and configuring it. ( I cannot use RPM release of ES in this case, due to a requrement from other software.) Now I could launch the server via comman…

---

## [Failed to load plugin class \[org.elasticsearch.xpack.core.XPackPlugin\]](https://discuss.elastic.co/t/failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin/243766)

<div class="topic-metadata">

**Author:** [@junhuangli](https://discuss.elastic.co/u/junhuangli)\
**Replies:** 8\
**Last updated:** [August 6, 2020, 5:10am UTC](https://discuss.elastic.co/t/failed-to-load-plugin-class-org-elasticsearch-xpack-core-xpackplugin/243766 "2020-08-06T05:10:26Z")

</div>

Getting the following exception when I try to enable the native ssl cert for es. I have check the permission for "/etc/identity/ca/cacerts.pem". It was also used for envoy proxy and it is working fine with envoy. Any ide…

---

## [Rollup job and how to create new record every minute](https://discuss.elastic.co/t/rollup-job-and-how-to-create-new-record-every-minute/243951)

<div class="topic-metadata">

**Author:** [@GraceYu](https://discuss.elastic.co/u/GraceYu)\
**Replies:** 0\
**Last updated:** [August 6, 2020, 3:33am UTC](https://discuss.elastic.co/t/rollup-job-and-how-to-create-new-record-every-minute/243951 "2020-08-06T03:33:18Z")

</div>

Hi all, I am new to rollup job and would like to schedule to get max and count for an index. I am using sample tutorial index sensor with cron run every minute \*/1 \* \* \* \* ?. The issue is the rollup index is created an…

---

## [Elastic Search Bulk API (Delete) vs DeleteByQuery](https://discuss.elastic.co/t/elastic-search-bulk-api-delete-vs-deletebyquery/243617)

<div class="topic-metadata">

**Author:** [@jbiju94](https://discuss.elastic.co/u/jbiju94)\
**Replies:** 4\
**Last updated:** [August 6, 2020, 3:26am UTC](https://discuss.elastic.co/t/elastic-search-bulk-api-delete-vs-deletebyquery/243617 "2020-08-06T03:26:00Z")

</div>

My requirement is to delete a particular document (with doc\_id) from multiple indices in one go. But the catch is that I am not aware which all indices would have this doc and I will have to fire a delete request for the…

---

## [Azure self managed elasticsearch - how to add a node](https://discuss.elastic.co/t/azure-self-managed-elasticsearch-how-to-add-a-node/243948)

<div class="topic-metadata">

**Author:** [@jpatel](https://discuss.elastic.co/u/jpatel)\
**Replies:** 0\
**Last updated:** [August 6, 2020, 1:27am UTC](https://discuss.elastic.co/t/azure-self-managed-elasticsearch-how-to-add-a-node/243948 "2020-08-06T01:27:02Z")

</div>

How do I add a node to the self managed ES cluster running on Azure ? I understand that if it was VM based (and not from market place self-managed), I would add a VM, install ES and modify yml file to add the node. Than…

---

## [Upsert Document on the basis of datetime format](https://discuss.elastic.co/t/upsert-document-on-the-basis-of-datetime-format/243864)

<div class="topic-metadata">

**Author:** [@rishabh\_jain](https://discuss.elastic.co/u/rishabh_jain)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 12:22pm UTC](https://discuss.elastic.co/t/upsert-document-on-the-basis-of-datetime-format/243864 "2020-08-05T12:22:31Z")

</div>

Hello, If I wanted to update an existing document if it satisfies the condition. See an example below: Index: test\_index Add tweet and lastupdated fields to document 1 as below. Please note that the lastupdated fiel…

---

## [Upload multiple synonyms txt files in Elastic Search](https://discuss.elastic.co/t/upload-multiple-synonyms-txt-files-in-elastic-search/243932)

<div class="topic-metadata">

**Author:** [@shefu](https://discuss.elastic.co/u/shefu)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 8:47pm UTC](https://discuss.elastic.co/t/upload-multiple-synonyms-txt-files-in-elastic-search/243932 "2020-08-05T20:47:03Z")

</div>

I have implemented "one index per language" approach in Elastic search as we have multiple languages. Each index will have its own mapping based on language. Defined Synonyms for each language and mapped to specific map…

---

## [Painless script issue in date comparision](https://discuss.elastic.co/t/painless-script-issue-in-date-comparision/243927)

<div class="topic-metadata">

**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 8:08pm UTC](https://discuss.elastic.co/t/painless-script-issue-in-date-comparision/243927 "2020-08-05T20:08:39Z")

</div>

I have written a painless script to get the time difference between two date fields, but i'm not getting the correct answer. default\_date : 01-01-1970 00:00:00 result.taskslatable\_duration.value : 01-01-1970 00:40:00 b…

---

## [Upgrade assistant long reindex time](https://discuss.elastic.co/t/upgrade-assistant-long-reindex-time/243923)

<div class="topic-metadata">

**Author:** [@Tudor\_Frincu](https://discuss.elastic.co/u/Tudor_Frincu)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 7:47pm UTC](https://discuss.elastic.co/t/upgrade-assistant-long-reindex-time/243923 "2020-08-05T19:47:34Z")

</div>

Hello, I have a elasticsearch cluster that we just migrated from 5.6.4 to 6.8.10. The cluster has 3 master nodes, 3 client nodes and 3 data nodes. They have the following resources allocated: master node : CPU 1000MH…

---

## [How can I use query match AND instead of comma?](https://discuss.elastic.co/t/how-can-i-use-query-match-and-instead-of-comma/243712)

<div class="topic-metadata">

**Author:** [@Yusuf\_Karatoprak](https://discuss.elastic.co/u/Yusuf_Karatoprak)\
**Replies:** 1\
**Last updated:** [August 5, 2020, 7:08pm UTC](https://discuss.elastic.co/t/how-can-i-use-query-match-and-instead-of-comma/243712 "2020-08-05T19:08:04Z")

</div>

Hi; My question is really simple but I couldn't find any solution for that ? I have a 3 columns "why, target,rate,similarto" . This is a kind of recommendation system . target is "A Hotel", similarto is "B Hotel, C Hote…

---

## [How to configure a cluster with enable X-Pac(security)?](https://discuss.elastic.co/t/how-to-configure-a-cluster-with-enable-x-pac-security/243801)

<div class="topic-metadata">

**Author:** [@HenriqueNogueira](https://discuss.elastic.co/u/HenriqueNogueira)\
**Replies:** 9\
**Last updated:** [August 5, 2020, 6:17pm UTC](https://discuss.elastic.co/t/how-to-configure-a-cluster-with-enable-x-pac-security/243801 "2020-08-05T18:17:16Z")

</div>

I'm using version 7.8.1 with x-pac enabled and I can't get my second node to connect to my cluster, what should I do?

---

## [Where are index templates and lifecycle policies stored?](https://discuss.elastic.co/t/where-are-index-templates-and-lifecycle-policies-stored/243910)

<div class="topic-metadata">

**Author:** [@steven1](https://discuss.elastic.co/u/steven1)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 5:54pm UTC](https://discuss.elastic.co/t/where-are-index-templates-and-lifecycle-policies-stored/243910 "2020-08-05T17:54:05Z")

</div>

Our cluster was shutdown and we had to recover the data nodes. It is now missing all of our index templates and index lifecycles. Index data and other settings seem ok. I'm look for where this data is stored and the p…

---

## [Search query retrieving data from Kibana Dev Console But no hits from Postman](https://discuss.elastic.co/t/search-query-retrieving-data-from-kibana-dev-console-but-no-hits-from-postman/243222)

<div class="topic-metadata">

**Author:** [@allAbout\_Gaming](https://discuss.elastic.co/u/allAbout_Gaming)\
**Replies:** 4\
**Last updated:** [August 5, 2020, 5:36pm UTC](https://discuss.elastic.co/t/search-query-retrieving-data-from-kibana-dev-console-but-no-hits-from-postman/243222 "2020-08-05T17:36:39Z")

</div>

Hi All, The below search query is retrieving data when we run in Dev console in Kibana But when we run from postman it returns 0 hits. Please help. { "query":{ "match": { "name": "ABC" } } }

---

## [Are hashes/objects saved in order?](https://discuss.elastic.co/t/are-hashes-objects-saved-in-order/243881)

<div class="topic-metadata">

**Author:** [@spdoes](https://discuss.elastic.co/u/spdoes)\
**Replies:** 10\
**Last updated:** [August 5, 2020, 5:33pm UTC](https://discuss.elastic.co/t/are-hashes-objects-saved-in-order/243881 "2020-08-05T17:33:15Z")

</div>

if I insert this field in this order: "name\_of\_field": {"first":1,"second":2,"third":3} will it always save in the same order as I inserted ? Based on my test, inserting multiple objects like that can make it save it …

---

## [Create a new index to store alerts](https://discuss.elastic.co/t/create-a-new-index-to-store-alerts/241003)

<div class="topic-metadata">

**Author:** [@robertitox](https://discuss.elastic.co/u/robertitox)\
**Replies:** 8\
**Last updated:** [August 5, 2020, 4:24pm UTC](https://discuss.elastic.co/t/create-a-new-index-to-store-alerts/241003 "2020-08-05T16:24:39Z")

</div>

Dear all, I have an ELK 7.8.0 server running OK. I want to create some alerts for different events, and because I have the ELK open source version, I just can create two type of connectors: Index and Server Log. I'd lik…

---

## [Aggregating relevance \_score with nested text fields](https://discuss.elastic.co/t/aggregating-relevance-score-with-nested-text-fields/243892)

<div class="topic-metadata">

**Author:** [@zp230](https://discuss.elastic.co/u/zp230)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 3:31pm UTC](https://discuss.elastic.co/t/aggregating-relevance-score-with-nested-text-fields/243892 "2020-08-05T15:31:58Z")

</div>

I am having difficulties finding documentation or discussions about how to aggregate the \_score field for nested text fields. The structure of my index includes one nested field. The structure of a single document is a l…

---

## [Version conflict on update\_by\_query](https://discuss.elastic.co/t/version-conflict-on-update-by-query/243762)

<div class="topic-metadata">

**Author:** [@redec](https://discuss.elastic.co/u/redec)\
**Replies:** 1\
**Last updated:** [August 5, 2020, 4:00pm UTC](https://discuss.elastic.co/t/version-conflict-on-update-by-query/243762 "2020-08-05T16:00:49Z")

</div>

I'm seeing some behavior that I can't explain...and all the googling I've done indicates it should not be possible. I have a single client application, issuing an update\_by\_query which updates a few thousand documents..…

---

## [Retrieve synonyms list from database](https://discuss.elastic.co/t/retrieve-synonyms-list-from-database/243897)

<div class="topic-metadata">

**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\
**Replies:** 1\
**Last updated:** [August 5, 2020, 3:55pm UTC](https://discuss.elastic.co/t/retrieve-synonyms-list-from-database/243897 "2020-08-05T15:55:26Z")

</div>

Is it possible to configure Elasticsearch to retrieve synonyms list from database instead of file?

---

## [Pipeline remove processor not removing all fields](https://discuss.elastic.co/t/pipeline-remove-processor-not-removing-all-fields/243879)

<div class="topic-metadata">

**Author:** [@chapmantrain](https://discuss.elastic.co/u/chapmantrain)\
**Replies:** 3\
**Last updated:** [August 5, 2020, 3:16pm UTC](https://discuss.elastic.co/t/pipeline-remove-processor-not-removing-all-fields/243879 "2020-08-05T15:16:35Z")

</div>

I have an ingest pipeline to remove some fields for a reindex. However, the pipeline is not removing the last field. I have changed the order and it always leaves the last field in line. I am Version: 6.4.2 { "reindex…

---

## [ES Cluster Perf is lower than single node ES](https://discuss.elastic.co/t/es-cluster-perf-is-lower-than-single-node-es/243424)

<div class="topic-metadata">

**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\
**Replies:** 8\
**Last updated:** [August 5, 2020, 1:59pm UTC](https://discuss.elastic.co/t/es-cluster-perf-is-lower-than-single-node-es/243424 "2020-08-05T13:59:56Z")

</div>

Hi I am using ES veriosn 6.6.0 I use es for heavy load index, almost 20MBPS, ~80K rps HW deatails, each node is 88CPUc(44 core), 32GB(ES)+32GB(lucen) RAM, 5 SSDs RAID 10. each index is of size 60GB primary, total 120…

---

## [Deploying ELK three nodes cluster with Ansible](https://discuss.elastic.co/t/deploying-elk-three-nodes-cluster-with-ansible/243878)

<div class="topic-metadata">

**Author:** [@BlessingEzeama](https://discuss.elastic.co/u/BlessingEzeama)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 1:54pm UTC](https://discuss.elastic.co/t/deploying-elk-three-nodes-cluster-with-ansible/243878 "2020-08-05T13:54:46Z")

</div>

I am trying to deploy ELK three node cluster with Ansible but i cannot find my way around it. I followed a guide but it was not helpful. How do i go about it please?

---

## [Best solution for de-duplication of alerts whilst using additional lookback time](https://discuss.elastic.co/t/best-solution-for-de-duplication-of-alerts-whilst-using-additional-lookback-time/243027)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 2\
**Last updated:** [August 5, 2020, 12:41pm UTC](https://discuss.elastic.co/t/best-solution-for-de-duplication-of-alerts-whilst-using-additional-lookback-time/243027 "2020-08-05T12:41:20Z")

</div>

Hi, An issue we are facing with real-time timestamps is the log processing time. Even if log processing time is less than a second to go through the pipeline, there is still a chance this log is missed due to the nature…

---

## [Timezone issue in ingesting a document](https://discuss.elastic.co/t/timezone-issue-in-ingesting-a-document/243843)

<div class="topic-metadata">

**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\
**Replies:** 0\
**Last updated:** [August 5, 2020, 9:53am UTC](https://discuss.elastic.co/t/timezone-issue-in-ingesting-a-document/243843 "2020-08-05T09:53:30Z")

</div>

Hi All, I am ingesting documents into ELK using logstash http\_poller plugin, there is a static field i have added as "default\_date" and the value for this date field i had mentioned as "01-01-1970 00:00:00" default\_da…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=841)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=843)
