# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=728 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 729 --- ## [Elastic clound 100% memory on instances, snapshot is stuck in IN\_PROGRESS](https://discuss.elastic.co/t/elastic-clound-100-memory-on-instances-snapshot-is-stuck-in-in-progress/260439)
**Author:** [@birdy1980](https://discuss.elastic.co/u/birdy1980)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 12:00pm UTC](https://discuss.elastic.co/t/elastic-clound-100-memory-on-instances-snapshot-is-stuck-in-in-progress/260439 "2021-01-11T12:00:27Z")
Hello, On one of our cloud deployments we have a bit of a problem. The memory usage grew to 100%. It is a high availability cluster in 2 zones, with a third instance as tiebreaker. We want to upgrade the instance to ha… --- ## [Elasticsearch returns different values from DSL and SQL query](https://discuss.elastic.co/t/elasticsearch-returns-different-values-from-dsl-and-sql-query/259984)
**Author:** [@pkshara](https://discuss.elastic.co/u/pkshara)\ **Replies:** 9\ **Last updated:** [January 11, 2021, 10:53am UTC](https://discuss.elastic.co/t/elasticsearch-returns-different-values-from-dsl-and-sql-query/259984 "2021-01-11T10:53:18Z")
I am trying to query index using dsl and sql method, while comparing the results i found that the values are different.Below are the query and required details. DSL query and result SQL query and result Result f… --- ## [Elasticearch cannot start](https://discuss.elastic.co/t/elasticearch-cannot-start/260701)
**Author:** [@Leonadius](https://discuss.elastic.co/u/Leonadius)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 10:39am UTC](https://discuss.elastic.co/t/elasticearch-cannot-start/260701 "2021-01-11T10:39:27Z")
Hi, I have a problem where i cannot start the elasticsearch. This is what i get from the logs. \[2021-01-11T15:59:36,658\]\[ERROR\]\[o.e.b.ElasticsearchUncaughtExceptionHandler\] \[vm-elastic-mlearning\] fatal error in thread … --- ## [Regex vs range filter](https://discuss.elastic.co/t/regex-vs-range-filter/260658)
**Author:** [@aniaks](https://discuss.elastic.co/u/aniaks)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 10:21am UTC](https://discuss.elastic.co/t/regex-vs-range-filter/260658 "2021-01-11T10:21:01Z")
Which filter is performance effective on a number field regex or range filter ? Also on a text field ... Using regex filter is performance effective ? --- ## [Elasticsearch string query char to char](https://discuss.elastic.co/t/elasticsearch-string-query-char-to-char/258818)
**Author:** [@adrian-arapiles](https://discuss.elastic.co/u/adrian-arapiles)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 9:29am UTC](https://discuss.elastic.co/t/elasticsearch-string-query-char-to-char/258818 "2021-01-11T09:29:39Z")
Hi, I need an index with phash indexed (64 length) and I have to query comparing char to char, for example: "d1b269d06ec8158d62333679ab6693e6bccd43761692e6c26527dcddd84c8196" "81b069d20e4154ed7b8371b3aa4596619c6d1ee45… --- ## [Elasticsearch data transfer and queries are very slow](https://discuss.elastic.co/t/elasticsearch-data-transfer-and-queries-are-very-slow/260420)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 9:19am UTC](https://discuss.elastic.co/t/elasticsearch-data-transfer-and-queries-are-very-slow/260420 "2021-01-11T09:19:56Z")
Elasticsearch, queries and data transfer are very slow and I am getting timeout errors. I found this information in the log files of the data nodes. Elasticsearch and Kibana version 7.4.2 I have 13 nodes (3 master ,10 … --- ## [Unassigned shards: NODE\_LEFT (Cloud)](https://discuss.elastic.co/t/unassigned-shards-node-left-cloud/260444)
**Author:** [@bogdan\_copocean](https://discuss.elastic.co/u/bogdan_copocean)\ **Replies:** 3\ **Last updated:** [January 11, 2021, 7:47am UTC](https://discuss.elastic.co/t/unassigned-shards-node-left-cloud/260444 "2021-01-11T07:47:10Z")
Hello guys, I encountered a few problems with my Elasticsearch cluster (on cloud) and exactly, i have around 25 unassigned shards with the reason NODE\_LEFT and one with REPLICA\_ADDED (after I tried to add a replica). I… --- ## [Troubles with heap, gc. Node fault](https://discuss.elastic.co/t/troubles-with-heap-gc-node-fault/259616)
**Author:** [@ThreatInter](https://discuss.elastic.co/u/ThreatInter)\ **Replies:** 16\ **Last updated:** [January 11, 2021, 7:30am UTC](https://discuss.elastic.co/t/troubles-with-heap-gc-node-fault/259616 "2021-01-11T07:30:00Z")
Hello again, my new topic about our problem. We have ES cluster with 3 nodes. Each 128 Gb RAM, 31 GB Heap, there our jvm.options: -Xms31g -Xmx31g ## GC configuration #-XX:+UseConcMarkSweepGC #-XX:CMSInitiatingOccupanc… --- ## [How does document size affect ElasticSearch performance?](https://discuss.elastic.co/t/how-does-document-size-affect-elasticsearch-performance/260648)
**Author:** [@sanchita.jha](https://discuss.elastic.co/u/sanchita.jha)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 7:26am UTC](https://discuss.elastic.co/t/how-does-document-size-affect-elasticsearch-performance/260648 "2021-01-11T07:26:24Z")
Planning to increase document size in elastic, from 4KB to ~100KB each. What is the performance impact with document size increase? The new fields will have to be additonality used to calculate/modify final scores of do… --- ## [About the 7.x version of the search.max\_buckets parameter](https://discuss.elastic.co/t/about-the-7-x-version-of-the-search-max-buckets-parameter/260512)
**Author:** [@liwanjie](https://discuss.elastic.co/u/liwanjie)\ **Replies:** 2\ **Last updated:** [January 11, 2021, 7:04am UTC](https://discuss.elastic.co/t/about-the-7-x-version-of-the-search-max-buckets-parameter/260512 "2021-01-11T07:04:58Z")
I would like to ask if the check\_buckets\_step\_size parameter is added in 7.7.0. Has the max\_bucketsparameter been repealed in subsequent releases (including the latest 7.10.0)? If not repealed, are there any defaults? --- ## [Elasticsearch index error](https://discuss.elastic.co/t/elasticsearch-index-error/260634)
**Author:** [@abu.sayeed](https://discuss.elastic.co/u/abu.sayeed)\ **Replies:** 4\ **Last updated:** [January 11, 2021, 6:06am UTC](https://discuss.elastic.co/t/elasticsearch-index-error/260634 "2021-01-11T06:06:30Z")
elasticsearch.yml network.host: localhost http.port: 9200 transport.host: localhost transport.tcp.port: 9300 discovery.seed\_hosts: localhost:9300 cluster.initial\_master\_nodes: ${HOSTNAME} action.auto\_create\_inde… --- ## [Logs are no longer sent to elasticsearch](https://discuss.elastic.co/t/logs-are-no-longer-sent-to-elasticsearch/260378)
**Author:** [@Falikou1](https://discuss.elastic.co/u/Falikou1)\ **Replies:** 3\ **Last updated:** [January 11, 2021, 4:46am UTC](https://discuss.elastic.co/t/logs-are-no-longer-sent-to-elasticsearch/260378 "2021-01-11T04:46:20Z")
I receive the logs in logstash, but the logs are no longer sent to elasticsearch. Can you help me? Below are the logs in logstash: \[root@scs90104vu logstash\]# tail -f /var/log/logstash/logstash-plain.log \[2021-01-06T… --- ## [Error when importing data from maraidb](https://discuss.elastic.co/t/error-when-importing-data-from-maraidb/260665)
**Author:** [@Tails](https://discuss.elastic.co/u/Tails)\ **Replies:** 0\ **Last updated:** [January 11, 2021, 4:07am UTC](https://discuss.elastic.co/t/error-when-importing-data-from-maraidb/260665 "2021-01-11T04:07:08Z")
I installed the ik plugin to elasticsearch and I have the following errors when importing from mariadb. \[2021-01-11T11:49:38,392\]\[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[6611aaa54ebe00de3255376c35e28d779a2b6f627197… --- ## [Object field vs Individual field](https://discuss.elastic.co/t/object-field-vs-individual-field/260527)
**Author:** [@naghaveer\_r](https://discuss.elastic.co/u/naghaveer_r)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 12:22am UTC](https://discuss.elastic.co/t/object-field-vs-individual-field/260527 "2021-01-11T00:22:19Z")
I have two fields "support.agent" and "support.resolution". If I can map these field as an Object type, I'll be able to fetch them together and also provides more readability "support": { "properties": { … --- ## [Custom data format not working in elasticsearch](https://discuss.elastic.co/t/custom-data-format-not-working-in-elasticsearch/260530)
**Author:** [@gavin-orange](https://discuss.elastic.co/u/gavin-orange)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 12:20am UTC](https://discuss.elastic.co/t/custom-data-format-not-working-in-elasticsearch/260530 "2021-01-11T00:20:57Z")
I am using the filebeat to transfer nginx access log to elasticsearch with json format . access.log { "@timestamp": "05/Jan/2021:13:38:28 +0800", "pid": "52336", "connection": "217062444", "connection\_requests": "18", … --- ## [Elastic 5 \> 7: Decrease Storage Usage?](https://discuss.elastic.co/t/elastic-5-7-decrease-storage-usage/260594)
**Author:** [@myspacebarisbroken](https://discuss.elastic.co/u/myspacebarisbroken)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 12:15am UTC](https://discuss.elastic.co/t/elastic-5-7-decrease-storage-usage/260594 "2021-01-11T00:15:54Z")
Hi! I'm upgrading my ES cluster from V 5 to V7, I've noticed that space usage has significantly been reduced, is that normal? my V5 cluster: 10B Documents, ~2.2 TB V7 Cluster: 10B Documents, ~1.5 TB (Same exact docum… --- ## [How to configure rolling OR delete after X time of data dir , to prevent "out of space" error](https://discuss.elastic.co/t/how-to-configure-rolling-or-delete-after-x-time-of-data-dir-to-prevent-out-of-space-error/260639)
**Author:** [@umen](https://discuss.elastic.co/u/umen)\ **Replies:** 1\ **Last updated:** [January 11, 2021, 12:10am UTC](https://discuss.elastic.co/t/how-to-configure-rolling-or-delete-after-x-time-of-data-dir-to-prevent-out-of-space-error/260639 "2021-01-11T00:10:10Z")
i configured the cluster to claim 5g for the data dir volumeClaimTemplates: - metadata: name: elasticsearch-data spec: accessModes: - ReadWriteOnce resources: requ… --- ## [Multi-Tenancy and Indexes / Aliases / Routing](https://discuss.elastic.co/t/multi-tenancy-and-indexes-aliases-routing/260655)
**Author:** [@nickdb93](https://discuss.elastic.co/u/nickdb93)\ **Replies:** 0\ **Last updated:** [January 10, 2021, 6:16pm UTC](https://discuss.elastic.co/t/multi-tenancy-and-indexes-aliases-routing/260655 "2021-01-10T18:16:31Z")
I know that how one deals with multi-tenancy is really based on use-case, but I just cannot seem to figure out the best approach to take, even after reading some examples. My use case is as such. Organizations are te… --- ## [How could I use in ingest pipeline the Logstash translate filter?](https://discuss.elastic.co/t/how-could-i-use-in-ingest-pipeline-the-logstash-translate-filter/259697)
**Author:** [@marcosvrrs](https://discuss.elastic.co/u/marcosvrrs)\ **Replies:** 4\ **Last updated:** [January 10, 2021, 2:36pm UTC](https://discuss.elastic.co/t/how-could-i-use-in-ingest-pipeline-the-logstash-translate-filter/259697 "2021-01-10T14:36:32Z")
I have a field with some error codes mapped as keyword values that I make some plots. It's not friendly to some people to look at these codes, so I want to change these error codes to a description that I will map as key… --- ## [Weird memory growth (ES 7.9)](https://discuss.elastic.co/t/weird-memory-growth-es-7-9/260479)
**Author:** [@zanettea](https://discuss.elastic.co/u/zanettea)\ **Replies:** 2\ **Last updated:** [January 10, 2021, 12:12pm UTC](https://discuss.elastic.co/t/weird-memory-growth-es-7-9/260479 "2021-01-10T12:12:53Z")
Hello, we are experiencing anomalous memory usage in a memory constrained cluster of 3 nodes running ES 7.9. We set 2GB heap size with 4 GB overall available RAM. After some days of normal operation where there are mainl… --- ## [Mapping data, tokenizer](https://discuss.elastic.co/t/mapping-data-tokenizer/260629)
**Author:** [@Jaroslav\_Zeman](https://discuss.elastic.co/u/Jaroslav_Zeman)\ **Replies:** 2\ **Last updated:** [January 10, 2021, 11:06am UTC](https://discuss.elastic.co/t/mapping-data-tokenizer/260629 "2021-01-10T11:06:26Z")
Hi I am a beginner in using elasticsearch, and I have a few questions on how best to store the data in elasticsearch with respect to the maximum search speed. In the relational database, I have the following three enti… --- ## [Increasing ‘index.mapping.nested\_objects.limit’ setting](https://discuss.elastic.co/t/increasing-index-mapping-nested-objects-limit-setting/260633)
**Author:** [@kliakos](https://discuss.elastic.co/u/kliakos)\ **Replies:** 0\ **Last updated:** [January 10, 2021, 9:11am UTC](https://discuss.elastic.co/t/increasing-index-mapping-nested-objects-limit-setting/260633 "2021-01-10T09:11:46Z")
I have the same problem as this https://discuss.elastic.co/t/increasing-index-mapping-nested-objects-limit-settings-value-has-no-effect/228242. The new setting, although applied to the index, doesn't seem to have any ef… --- ## [Moving elasticsearch storage directory](https://discuss.elastic.co/t/moving-elasticsearch-storage-directory/260611)
**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\ **Replies:** 2\ **Last updated:** [January 9, 2021, 5:45pm UTC](https://discuss.elastic.co/t/moving-elasticsearch-storage-directory/260611 "2021-01-09T17:45:15Z")
I've been using the elastic stack for last one year to capture research data (mainly using honeypots hosted on cloud service providers.) I'm using a three-node cluster to capture the data. 2 nodes are data nodes 1 nod… --- ## [Shards failure](https://discuss.elastic.co/t/shards-failure/258185)
**Author:** [@droidus](https://discuss.elastic.co/u/droidus)\ **Replies:** 1\ **Last updated:** [January 9, 2021, 3:17pm UTC](https://discuss.elastic.co/t/shards-failure/258185 "2021-01-09T15:17:25Z")
Here is what I am seeing: How do I resolve this? --- ## [5.6 \> 7.9 upgrade, auto\_generate\_phrase\_query alternatives?](https://discuss.elastic.co/t/5-6-7-9-upgrade-auto-generate-phrase-query-alternatives/260164)
**Author:** [@myspacebarisbroken](https://discuss.elastic.co/u/myspacebarisbroken)\ **Replies:** 3\ **Last updated:** [January 9, 2021, 7:26am UTC](https://discuss.elastic.co/t/5-6-7-9-upgrade-auto-generate-phrase-query-alternatives/260164 "2021-01-09T07:26:16Z")
Hello, I'm upgrading my codebase's ElasticSearch from 5.6 to 7.x due to some features I'd like to explore. I'm currently using GoLang & "github.com/olivere/elastic/v5" specifically. However, auto\_generate\_phrase\_query… --- ## [Performance impacts of track\_scores on sorted queries](https://discuss.elastic.co/t/performance-impacts-of-track-scores-on-sorted-queries/260578)
**Author:** [@AlanN](https://discuss.elastic.co/u/AlanN)\ **Replies:** 1\ **Last updated:** [January 9, 2021, 6:57am UTC](https://discuss.elastic.co/t/performance-impacts-of-track-scores-on-sorted-queries/260578 "2021-01-09T06:57:12Z")
Hi, I'm attempting to wrap my head around what the performance hit is on queries with and without the track\_scores flag flipped in the sort during queries in our ElasticSearch 6.8 cluster. Unfortunately it's pretty bus… --- ## [Deleting individual indexes from a datastream](https://discuss.elastic.co/t/deleting-individual-indexes-from-a-datastream/259924)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 2\ **Last updated:** [January 8, 2021, 10:04pm UTC](https://discuss.elastic.co/t/deleting-individual-indexes-from-a-datastream/259924 "2021-01-08T22:04:39Z")
I have a datastream which I set up recently and as a check I set to rollover every day so I could see that it was woking as expected. That was just before Christmas and I saw it roll over once... I came back today and … --- ## [Error when configure email account elasticseach.yml - Elastic Cloud](https://discuss.elastic.co/t/error-when-configure-email-account-elasticseach-yml-elastic-cloud/260560)
**Author:** [@Tornis](https://discuss.elastic.co/u/Tornis)\ **Replies:** 3\ **Last updated:** [January 8, 2021, 7:49pm UTC](https://discuss.elastic.co/t/error-when-configure-email-account-elasticseach-yml-elastic-cloud/260560 "2021-01-08T19:49:50Z")
Hello guys, We have the problem when configuring SMTP more in ELastic Cloud SaaS Error when configure email account elasticseach.ymlfor sending alerts. When saving the configuration we get the following error: Your cha… --- ## [Coordinating Node](https://discuss.elastic.co/t/coordinating-node/260570)
**Author:** [@leemase004](https://discuss.elastic.co/u/leemase004)\ **Replies:** 3\ **Last updated:** [January 8, 2021, 6:44pm UTC](https://discuss.elastic.co/t/coordinating-node/260570 "2021-01-08T18:44:04Z")
Via the elasticsearch engineer 1 class regarding the Coordinating node it states: • Configure your client to round-robin between multiple nodes ‒ avoid having single points of failure/creating hotspots ‒ do NOT send r… --- ## [ILM stuck at check-allocation on transition to Cold Node](https://discuss.elastic.co/t/ilm-stuck-at-check-allocation-on-transition-to-cold-node/260490)
**Author:** [@Charles\_Ferguson](https://discuss.elastic.co/u/Charles_Ferguson)\ **Replies:** 1\ **Last updated:** [January 8, 2021, 6:06pm UTC](https://discuss.elastic.co/t/ilm-stuck-at-check-allocation-on-transition-to-cold-node/260490 "2021-01-08T18:06:44Z")
Hi folks, We are having an issue whereour index life cycle policy is not completing the check-allocation phase to the cold nodes. It doesn't seem to be causing any errors just waiting and never completing. Interestingly… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=727) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=729)