# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=862 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 863 --- ## [ES 5.x - delete by query](https://discuss.elastic.co/t/es-5-x-delete-by-query/241006)
**Author:** [@natasha\_adewar](https://discuss.elastic.co/u/natasha_adewar)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 3:48pm UTC](https://discuss.elastic.co/t/es-5-x-delete-by-query/241006 "2020-07-13T15:48:23Z")
Is anyone running delete by-query cron on large live indexes where insert and update of documents is happening at the same time for ES 5.x? How to optimize the performance of this cron ? How often should we run these c… --- ## [Upper limits on replication and recovery heap usage](https://discuss.elastic.co/t/upper-limits-on-replication-and-recovery-heap-usage/240985)
**Author:** [@Pradyumna\_Achar](https://discuss.elastic.co/u/Pradyumna_Achar)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 3:06pm UTC](https://discuss.elastic.co/t/upper-limits-on-replication-and-recovery-heap-usage/240985 "2020-07-13T15:06:34Z")
Hello, I'm running into a strange situation with elasticsearch. I would like to estimate the Xmx needed for running elasticsearch data nodes while accounting for the heap needed during recovery. All my documents are sm… --- ## [Security.Permissions Exceptions in Elastic.Net.ConnectionConfiguration in wcf dot net applications](https://discuss.elastic.co/t/security-permissions-exceptions-in-elastic-net-connectionconfiguration-in-wcf-dot-net-applications/240990)
**Author:** [@ajvenkatesh4228](https://discuss.elastic.co/u/ajvenkatesh4228)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 2:08pm UTC](https://discuss.elastic.co/t/security-permissions-exceptions-in-elastic-net-connectionconfiguration-in-wcf-dot-net-applications/240990 "2020-07-13T14:08:14Z")
Hi Folks, Hope, anyone helps on this to get an answer for this : I am working in a wcf dot net applications - I am logging in elastic search, it works in my local windows 10 machine, when hosting the wcf application in … --- ## [Configure logstash with Cloud ID](https://discuss.elastic.co/t/configure-logstash-with-cloud-id/240989)
**Author:** [@Samson\_Nelson](https://discuss.elastic.co/u/Samson_Nelson)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 2:07pm UTC](https://discuss.elastic.co/t/configure-logstash-with-cloud-id/240989 "2020-07-13T14:07:44Z")
Goal: Using Filebeat and Logstash, filter / ship kubernetes pod logs to our hosted elasticsearch instance. Problem: According to the documentation there are two ways to configure Logstash ,with Cloud ID and without Clou… --- ## [Full text search all Indexes but filter out blog posts that aren't published](https://discuss.elastic.co/t/full-text-search-all-indexes-but-filter-out-blog-posts-that-arent-published/240557)
**Author:** [@Revekius](https://discuss.elastic.co/u/Revekius)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 1:53pm UTC](https://discuss.elastic.co/t/full-text-search-all-indexes-but-filter-out-blog-posts-that-arent-published/240557 "2020-07-13T13:53:14Z")
Hi, I would like to do the following in Elasticsearch 7.8. Do a full text search with fuzzy searching enabled on all indexes Do a secondary search for a specific term on all indexes Filter out on the publishedDate for… --- ## [Frequent cluster\_block\_exception Kibana logstash](https://discuss.elastic.co/t/frequent-cluster-block-exception-kibana-logstash/240945)
**Author:** [@Sai\_Avinash\_Duddupud](https://discuss.elastic.co/u/Sai_Avinash_Duddupud)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 1:44pm UTC](https://discuss.elastic.co/t/frequent-cluster-block-exception-kibana-logstash/240945 "2020-07-13T13:44:38Z")
Hi all, I am getting the following errors in my logstash logs. \[INFO \] 2020-07-13 07:29:08.401 \[\[main\]\>worker0\] elasticsearch - retrying failed action with response code: 429 ({"type"=\>"cluster\_block\_exception", "reaso… --- ## [Which is the main master in 3 dedicated master node?](https://discuss.elastic.co/t/which-is-the-main-master-in-3-dedicated-master-node/240264)
**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\ **Replies:** 13\ **Last updated:** [July 13, 2020, 12:50pm UTC](https://discuss.elastic.co/t/which-is-the-main-master-in-3-dedicated-master-node/240264 "2020-07-13T12:50:36Z")
Suppose I have a 3 dedicated master node and 4 data nodes. At a moment are all 3 acting as a master or is there a supreme master between them so that when it goes down another is elected as Supreme Master ? Are 3 master… --- ## [Use painless script in transform aggregation](https://discuss.elastic.co/t/use-painless-script-in-transform-aggregation/240600)
**Author:** [@DILIP\_SHARMA](https://discuss.elastic.co/u/DILIP_SHARMA)\ **Replies:** 6\ **Last updated:** [July 13, 2020, 12:28pm UTC](https://discuss.elastic.co/t/use-painless-script-in-transform-aggregation/240600 "2020-07-13T12:28:26Z")
Hi i am running 7.6.2 Elastic search and kibana , and i was trying simple painless script in transform aggregation . POST \_transform/\_preview { "source": { "index": "testindex\*" }, "pivot": { "group\_… --- ## [Official apt repository (451 Unavailable For Legal Reasons)](https://discuss.elastic.co/t/official-apt-repository-451-unavailable-for-legal-reasons/232494)
**Author:** [@vdt\_mik](https://discuss.elastic.co/u/vdt_mik)\ **Replies:** 74\ **Last updated:** [July 13, 2020, 12:21pm UTC](https://discuss.elastic.co/t/official-apt-repository-451-unavailable-for-legal-reasons/232494 "2020-07-13T12:21:20Z")
Hi! I faced this problem in my VM on the DigitalOcean(Europe region). I tried to do an apt update in my Debian 9 VM. But I recieved this message: Ign:1 http://deb.debian.org/debian stretch InRelease Hit:2 http://securi… --- ## [Elastic Cloud (SaaS) Upgrade x.coordinating.x configuration is not available for editing](https://discuss.elastic.co/t/elastic-cloud-saas-upgrade-x-coordinating-x-configuration-is-not-available-for-editing/240952)
**Author:** [@piotr.pawlak3](https://discuss.elastic.co/u/piotr.pawlak3)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 12:20pm UTC](https://discuss.elastic.co/t/elastic-cloud-saas-upgrade-x-coordinating-x-configuration-is-not-available-for-editing/240952 "2020-07-13T12:20:50Z")
Hi, I am unable to upgrade from GUI of Elastic Cloud SaaS from 7.4.2 to 7.7.1 or 7.8.0, due to Deployment \> Edit "Your changes cannot be applied The requested cluster configuration change is not permitted. Value of … --- ## [Natural Sort Support](https://discuss.elastic.co/t/natural-sort-support/240961)
**Author:** [@Eugene\_Kiba](https://discuss.elastic.co/u/Eugene_Kiba)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 11:51am UTC](https://discuss.elastic.co/t/natural-sort-support/240961 "2020-07-13T11:51:10Z")
Is there a native natural sort in ES engine? If not, how to achieve this functionality? This plugin seems to be outdated and not supported anymore: https://github.com/jprante/elasticsearch-analysis-naturalsort --- ## [Dump JSON directly in to ElasticSearch](https://discuss.elastic.co/t/dump-json-directly-in-to-elasticsearch/240940)
**Author:** [@saurabhbhatt](https://discuss.elastic.co/u/saurabhbhatt)\ **Replies:** 4\ **Last updated:** [July 13, 2020, 11:41am UTC](https://discuss.elastic.co/t/dump-json-directly-in-to-elasticsearch/240940 "2020-07-13T11:41:14Z")
Hi, I have this requirement of dumping big JSON file with over 700K records into ES directly. However the JSON I have is formatted in PRETTY array format as below: STRING 1: indent preformatted text by 4 spaces \[ {… --- ## [Error in building and running Elasticsearch Source Code in IntelliJ IDEA](https://discuss.elastic.co/t/error-in-building-and-running-elasticsearch-source-code-in-intellij-idea/240957)
**Author:** [@bhavya](https://discuss.elastic.co/u/bhavya)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 11:36am UTC](https://discuss.elastic.co/t/error-in-building-and-running-elasticsearch-source-code-in-intellij-idea/240957 "2020-07-13T11:36:13Z")
I want to import and run Elasticsearch source code into an IntelliJ IDEA project, for that : I have cloned the latest Elasticsearch Source Code from the official Github repository https://github.com/elastic/elasticsea… --- ## [Overwriting auto-generated \_id value with existing value in doc body](https://discuss.elastic.co/t/overwriting-auto-generated-id-value-with-existing-value-in-doc-body/240865)
**Author:** [@Shachar0n](https://discuss.elastic.co/u/Shachar0n)\ **Replies:** 3\ **Last updated:** [July 13, 2020, 10:49am UTC](https://discuss.elastic.co/t/overwriting-auto-generated-id-value-with-existing-value-in-doc-body/240865 "2020-07-13T10:49:40Z")
Hi Guys, We are implementing discovery service over emails meta data for a large stream of emails, and we are trying to use some self-generated email ID as primary key for each doc in elasticsearch (overwrite the \_id fi… --- ## [Deletion in ES getting 403](https://discuss.elastic.co/t/deletion-in-es-getting-403/240915)
**Author:** [@inandi](https://discuss.elastic.co/u/inandi)\ **Replies:** 3\ **Last updated:** [July 13, 2020, 10:42am UTC](https://discuss.elastic.co/t/deletion-in-es-getting-403/240915 "2020-07-13T10:42:44Z")
trying to delete from es using this query POST /logstash-2020.06.17/\_delete\_by\_query { "query": { "match": { "tags": "AuditLog" } } } getting this error message { "took": 62, "timed\_out": false, … --- ## [How to subtract two values in elasticsearch](https://discuss.elastic.co/t/how-to-subtract-two-values-in-elasticsearch/240824)
**Author:** [@adi0509](https://discuss.elastic.co/u/adi0509)\ **Replies:** 10\ **Last updated:** [July 13, 2020, 10:36am UTC](https://discuss.elastic.co/t/how-to-subtract-two-values-in-elasticsearch/240824 "2020-07-13T10:36:23Z")
if my logs looks like this, { name: "A1",X: 10} { name: "A1",Y: 8 } { name: "A2",X: 15} { name: "A2",Y: 1 } then how can I subtract (X-Y) which have same name? What I want is, for name "A1" X-Y = 10-8 = 2 for nam… --- ## [Replace dot with Space is not working](https://discuss.elastic.co/t/replace-dot-with-space-is-not-working/240664)
**Author:** [@KrishK](https://discuss.elastic.co/u/KrishK)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 10:31am UTC](https://discuss.elastic.co/t/replace-dot-with-space-is-not-working/240664 "2020-07-13T10:31:19Z")
Hi Support, I have created a large index and I am facing issue related filename search. Below is the mapping example. PUT split\_test { "settings":{ "index" : { "number\_of\_… --- ## [Elasticsearch.py dump conversion](https://discuss.elastic.co/t/elasticsearch-py-dump-conversion/240939)
**Author:** [@Koen\_Wouters1](https://discuss.elastic.co/u/Koen_Wouters1)\ **Replies:** 0\ **Last updated:** [July 13, 2020, 9:52am UTC](https://discuss.elastic.co/t/elasticsearch-py-dump-conversion/240939 "2020-07-13T09:52:06Z")
Up till now we used simple sh scripts to load JSON files as bulk to ES, but we want to change this to the python client. I am however struggling to figure out how we can do this without completely rewriting our JSON crea… --- ## [Will Increasing the setting script.max\_compilations\_rate from 75/5m to 300/m effect perfomance?](https://discuss.elastic.co/t/will-increasing-the-setting-script-max-compilations-rate-from-75-5m-to-300-m-effect-perfomance/240781)
**Author:** [@Sravanti](https://discuss.elastic.co/u/Sravanti)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 9:45am UTC](https://discuss.elastic.co/t/will-increasing-the-setting-script-max-compilations-rate-from-75-5m-to-300-m-effect-perfomance/240781 "2020-07-13T09:45:13Z")
I'm getting remote transport exception while executing painless scripts. Need to know if it will really effect performance, if we increase from its actual limit i.e 75/5m to 200-300/1m. if not, is there any alternative … --- ## [Upgrade from elastic 5.6 to 7](https://discuss.elastic.co/t/upgrade-from-elastic-5-6-to-7/240933)
**Author:** [@amitkle](https://discuss.elastic.co/u/amitkle)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 9:37am UTC](https://discuss.elastic.co/t/upgrade-from-elastic-5-6-to-7/240933 "2020-07-13T09:37:46Z")
Hello, We are currently running elastic 5.6. We are switching servers and we wanted to take this opportunity to upgrade to elastic 7. Our original plan was to backup our indexes -\> load the backups to elastic 6.8 on th… --- ## [Geo\_shape: False positives when the polygon has aligned points](https://discuss.elastic.co/t/geo-shape-false-positives-when-the-polygon-has-aligned-points/240725)
**Author:** [@franck.valentin](https://discuss.elastic.co/u/franck.valentin)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 9:18am UTC](https://discuss.elastic.co/t/geo-shape-false-positives-when-the-polygon-has-aligned-points/240725 "2020-07-13T09:18:16Z")
Hi, I got false positives when searching intersections with a polygon that have aligned points: For example, after indexing the following FeatureCollection (directly from Kibana): { "type": "FeatureCollect… --- ## [Is there any way to adjust the edge weights in Graph by myself?](https://discuss.elastic.co/t/is-there-any-way-to-adjust-the-edge-weights-in-graph-by-myself/240873)
**Author:** [@op71](https://discuss.elastic.co/u/op71)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 9:13am UTC](https://discuss.elastic.co/t/is-there-any-way-to-adjust-the-edge-weights-in-graph-by-myself/240873 "2020-07-13T09:13:52Z")
I would like to use the Graph feature of Elasticsearch right now. Is there any way to adjust the edge weights in Graph by myself? I want to increase the weights on certain nodes. --- ## [I want to import a 3GB system file to ELK in one go](https://discuss.elastic.co/t/i-want-to-import-a-3gb-system-file-to-elk-in-one-go/240572)
**Author:** [@Deepika\_Rawat](https://discuss.elastic.co/u/Deepika_Rawat)\ **Replies:** 21\ **Last updated:** [July 13, 2020, 9:08am UTC](https://discuss.elastic.co/t/i-want-to-import-a-3gb-system-file-to-elk-in-one-go/240572 "2020-07-13T09:08:52Z")
But it is showing Disk error.I installed graylog now but it is also not working .Will anyone be able to tell me how to read a 3 GB file in ELK or any other free open source software just like ELK if you will be able to t… --- ## [Why can't I get the result?](https://discuss.elastic.co/t/why-cant-i-get-the-result/240910)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 3\ **Last updated:** [July 13, 2020, 9:08am UTC](https://discuss.elastic.co/t/why-cant-i-get-the-result/240910 "2020-07-13T09:08:11Z")
GET abp\_schedulerlogs\_dev/\_search { "query": { "bool": { "must": { "term":{ "JobInfoId":"08d814f9-470e-4082-8333-6d6de194863e" } }, "filter": { "te… --- ## [Cluster going RED after mapper-size plugin installed](https://discuss.elastic.co/t/cluster-going-red-after-mapper-size-plugin-installed/240898)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 6\ **Last updated:** [July 13, 2020, 8:11am UTC](https://discuss.elastic.co/t/cluster-going-red-after-mapper-size-plugin-installed/240898 "2020-07-13T08:11:17Z")
Hello, elasticsearch version 7.6.2 I have installed mapper-size plugin on 3 nodes out of 5 I have in the cluster. Restarting each node after the installation. I have noticed that one index is going into RED status al… --- ## [Index got corrupted without any crash](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895)
**Author:** [@chelawatankit](https://discuss.elastic.co/u/chelawatankit)\ **Replies:** 8\ **Last updated:** [July 13, 2020, 7:41am UTC](https://discuss.elastic.co/t/index-got-corrupted-without-any-crash/240895 "2020-07-13T07:41:16Z")
Hi, We have one single node elastic cluster which was running fine till last week. From last week we saw frequently one index got corrupted and went in 'RED' state without any system crash and disk space problem. When … --- ## [Using the Elastic Stack as database for big data](https://discuss.elastic.co/t/using-the-elastic-stack-as-database-for-big-data/237276)
**Author:** [@TiTanT](https://discuss.elastic.co/u/TiTanT)\ **Replies:** 4\ **Last updated:** [July 13, 2020, 7:26am UTC](https://discuss.elastic.co/t/using-the-elastic-stack-as-database-for-big-data/237276 "2020-07-13T07:26:31Z")
Hi Guys, I wanted to know if it is a good idea to use the elastic stack as database for big data. The data is used to do data science stuff later. Further the database should scale and enable a lot of read and write ac… --- ## [Questions about recovering cluster](https://discuss.elastic.co/t/questions-about-recovering-cluster/240774)
**Author:** [@spdoes](https://discuss.elastic.co/u/spdoes)\ **Replies:** 2\ **Last updated:** [July 13, 2020, 7:25am UTC](https://discuss.elastic.co/t/questions-about-recovering-cluster/240774 "2020-07-13T07:25:57Z")
I had a cluster of 2 nodes with id: 8Z1G5AyPTSCq7grGsAiMTw and id:\_9nxYpwyR\_ekow9NqicxBw Now I only have access to one of the nodes\[\_9nxYpwyR\_ekow9NqicxBw\], however I can´t start ES even if I set the cluster.initial\_mas… --- ## [There are some problems in my NEST Client search, can you help me solve it?](https://discuss.elastic.co/t/there-are-some-problems-in-my-nest-client-search-can-you-help-me-solve-it/240129)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 7:15am UTC](https://discuss.elastic.co/t/there-are-some-problems-in-my-nest-client-search-can-you-help-me-solve-it/240129 "2020-07-13T07:15:46Z")
I need to find the log with jobid xxx, but the result is different every time after running the following code; I want to use the CreateTime field in reverse order, the following code is not successful; I want to implem… --- ## [NEST Bulk Error](https://discuss.elastic.co/t/nest-bulk-error/240460)
**Author:** [@subin1](https://discuss.elastic.co/u/subin1)\ **Replies:** 1\ **Last updated:** [July 13, 2020, 7:10am UTC](https://discuss.elastic.co/t/nest-bulk-error/240460 "2020-07-13T07:10:43Z")
Hello Evenyone, When i use NEST to bulk index an document,the client returned an error "Validation Failed: 1: type is missing",the code is as follow,please help me. var client = new ElasticClient(settings);… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=861) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=863)