# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=891 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 892 --- ## [Hanging active search threads](https://discuss.elastic.co/t/hanging-active-search-threads/237079)
**Author:** [@Tibor\_Schmidt](https://discuss.elastic.co/u/Tibor_Schmidt)\ **Replies:** 0\ **Last updated:** [June 15, 2020, 7:05am UTC](https://discuss.elastic.co/t/hanging-active-search-threads/237079 "2020-06-15T07:05:38Z")
Hey, we're having issues with timeouting search queries on our 61 node es cluster. elasticsearch.exceptions.ConnectionTimeout: ConnectionTimeout caused by - ReadTimeoutError(HTTPSConnectionPool(host='XXXXXX', port=9200… --- ## [ES fatal error when applying filters in Kibana](https://discuss.elastic.co/t/es-fatal-error-when-applying-filters-in-kibana/236304)
**Author:** [@AlessandroKP](https://discuss.elastic.co/u/AlessandroKP)\ **Replies:** 1\ **Last updated:** [June 15, 2020, 7:04am UTC](https://discuss.elastic.co/t/es-fatal-error-when-applying-filters-in-kibana/236304 "2020-06-15T07:04:03Z")
Hi all, my Elasticsearch cluster keeps crashing whenever I do the following thing: go to the "Discover" section of Kibana (or any visualization or dashboard) and apply a filter to a field of type keyword (through the "… --- ## [About es aggregation query index filtering, and the number of accurate aggregation results returned](https://discuss.elastic.co/t/about-es-aggregation-query-index-filtering-and-the-number-of-accurate-aggregation-results-returned/237063)
**Author:** [@NiFeng](https://discuss.elastic.co/u/NiFeng)\ **Replies:** 1\ **Last updated:** [June 15, 2020, 5:17am UTC](https://discuss.elastic.co/t/about-es-aggregation-query-index-filtering-and-the-number-of-accurate-aggregation-results-returned/237063 "2020-06-15T05:17:02Z")
First of all, I want to accurately control the amount of large data and the number of results under multidimensional aggregation statistics. Second, I would also like to filter the results of the polymerization, similar… --- ## [Point to any machine in the cluster?](https://discuss.elastic.co/t/point-to-any-machine-in-the-cluster/236595)
**Author:** [@pszm](https://discuss.elastic.co/u/pszm)\ **Replies:** 3\ **Last updated:** [June 15, 2020, 5:03am UTC](https://discuss.elastic.co/t/point-to-any-machine-in-the-cluster/236595 "2020-06-15T05:03:18Z")
I am sure this is a basic question but I just don't see it answered in any clear way. We are running a Ruby on Rails 5 app using the elasticsearch-rails gem. We have a cluster of 3 machines for ElasticSearch. Can we po… --- ## [SQL like joins on Elastic Search](https://discuss.elastic.co/t/sql-like-joins-on-elastic-search/237056)
**Author:** [@skv325](https://discuss.elastic.co/u/skv325)\ **Replies:** 1\ **Last updated:** [June 15, 2020, 5:03am UTC](https://discuss.elastic.co/t/sql-like-joins-on-elastic-search/237056 "2020-06-15T05:03:09Z")
Hello, Does ES support Sql like joins on different indexes? Currently I have to load indexes contents \[with some filtering\] into memory and use Linq to do the join which is very slow. Is any workaround? Thanks --- ## [Nested Objects in Elastic](https://discuss.elastic.co/t/nested-objects-in-elastic/236321)
**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\ **Replies:** 2\ **Last updated:** [June 15, 2020, 4:15am UTC](https://discuss.elastic.co/t/nested-objects-in-elastic/236321 "2020-06-15T04:15:00Z")
Hi, I have a data in the following format. I'm trying with ELastic 7.6 and using Kibana. {"l1f1":"f1Value","l1f2":\[{"l2f1":"l1f1Value","l2f2":"l2f2Value","l2f3":"l2f3Value"}\]} I want to index this data using bulk inse… --- ## [How do i find out "stale primary" quickly](https://discuss.elastic.co/t/how-do-i-find-out-stale-primary-quickly/237049)
**Author:** [@yc1024](https://discuss.elastic.co/u/yc1024)\ **Replies:** 0\ **Last updated:** [June 15, 2020, 3:09am UTC](https://discuss.elastic.co/t/how-do-i-find-out-stale-primary-quickly/237049 "2020-06-15T03:09:43Z")
There are 50,000 shards and 70 nodes in my cluster.I have two nodes with hardware failure，I want to use allocate\_stale\_primary for recovery. How can I quickly find out the "stale primary". curl -X POST "http://localhos… --- ## [Count instances of a field in Elasticsearch index](https://discuss.elastic.co/t/count-instances-of-a-field-in-elasticsearch-index/236907)
**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\ **Replies:** 3\ **Last updated:** [June 15, 2020, 2:08am UTC](https://discuss.elastic.co/t/count-instances-of-a-field-in-elasticsearch-index/236907 "2020-06-15T02:08:07Z")
How to count the instances of a particular field, across all documents, in a given Elasticsearch index. For example, if I've got the following documents in index goober : { '\_id':'foo', 'field1':'a value', … --- ## [Is it possible to Snapshot ALL indices and exclude some?](https://discuss.elastic.co/t/is-it-possible-to-snapshot-all-indices-and-exclude-some/237047)
**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\ **Replies:** 0\ **Last updated:** [June 15, 2020, 1:58am UTC](https://discuss.elastic.co/t/is-it-possible-to-snapshot-all-indices-and-exclude-some/237047 "2020-06-15T01:58:42Z")
Hey there, The use case is: I want to default snapshot all indices. But, I want to leave out a few of them. The environment I am working on is dynamic, and new indices are created daily. I want to determine with each … --- ## [Scripted fields not working on multiline Events](https://discuss.elastic.co/t/scripted-fields-not-working-on-multiline-events/236554)
**Author:** [@amityadav](https://discuss.elastic.co/u/amityadav)\ **Replies:** 0\ **Last updated:** [June 10, 2020, 4:55pm UTC](https://discuss.elastic.co/t/scripted-fields-not-working-on-multiline-events/236554 "2020-06-10T16:55:54Z")
I am using multiline codec in my logstash config file in input section to merge few lines of log file. Lines 5,6,7,8,9 are getting merged into a single line and the same is visible in Kibana screen for message and sub\_cl… --- ## [Is SLM supported on Elasticsearch 6.8?](https://discuss.elastic.co/t/is-slm-supported-on-elasticsearch-6-8/236692)
**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\ **Replies:** 1\ **Last updated:** [June 14, 2020, 11:47pm UTC](https://discuss.elastic.co/t/is-slm-supported-on-elasticsearch-6-8/236692 "2020-06-14T23:47:53Z")
Hi, We have a couple clusters on 6.8 and we're looking into implementing SLM for scheduled snapshots. I'm looking at the documentation and searching on the internet for it but I can't find anything suggesting that SLM i… --- ## [Issue with \_update command](https://discuss.elastic.co/t/issue-with-update-command/236841)
**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\ **Replies:** 0\ **Last updated:** [June 12, 2020, 7:27am UTC](https://discuss.elastic.co/t/issue-with-update-command/236841 "2020-06-12T07:27:39Z")
Hi, I've a data in the following format. { "uTestTokenId": "8488DA03-447F-46DF-B431-03C027674A16", "vTestTokenNumber": "", "uCycleId": "0FDDDE67-6793-4093-9790-9E3611356C8B", "uPupil… --- ## [Elasticsearch vs Oracle](https://discuss.elastic.co/t/elasticsearch-vs-oracle/236968)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 3\ **Last updated:** [June 14, 2020, 11:19pm UTC](https://discuss.elastic.co/t/elasticsearch-vs-oracle/236968 "2020-06-14T23:19:40Z")
Hi, I am a student and my project is about Elastic Stack. the company I work for is currently using oracle for managing its data. they want assess Elasticsearch as a replacement. according to my project success they … --- ## [Optimize multiple queries with the same filters](https://discuss.elastic.co/t/optimize-multiple-queries-with-the-same-filters/236925)
**Author:** [@solenom85](https://discuss.elastic.co/u/solenom85)\ **Replies:** 1\ **Last updated:** [June 14, 2020, 3:28pm UTC](https://discuss.elastic.co/t/optimize-multiple-queries-with-the-same-filters/236925 "2020-06-14T15:28:35Z")
Hi I have a question related with optimization, I have a page lets call it global page that haves N components on each. Each component will perform an elasticsearch query that is going to be composed of two parts Quer… --- ## [CorruptIndexException missing .si file](https://discuss.elastic.co/t/corruptindexexception-missing-si-file/236994)
**Author:** [@keduadoi](https://discuss.elastic.co/u/keduadoi)\ **Replies:** 4\ **Last updated:** [June 14, 2020, 10:20am UTC](https://discuss.elastic.co/t/corruptindexexception-missing-si-file/236994 "2020-06-14T10:20:44Z")
Our cluster has 3 nodes, primary shards are about 10K, and replica = 1. The cluster had worked normally until 1 cluster showed error message: \[root@server2014 ~\]# uncaught exception in thread \[main\] ElasticsearchExcept… --- ## [Failed to create shard, failure IOException\[failed to obtain in-memory shard lock\]](https://discuss.elastic.co/t/failed-to-create-shard-failure-ioexception-failed-to-obtain-in-memory-shard-lock/236973)
**Author:** [@jthoni](https://discuss.elastic.co/u/jthoni)\ **Replies:** 4\ **Last updated:** [June 14, 2020, 7:50am UTC](https://discuss.elastic.co/t/failed-to-create-shard-failure-ioexception-failed-to-obtain-in-memory-shard-lock/236973 "2020-06-14T07:50:03Z")
We just rebuilt our cluster and are running into a problem we have not had before. We see almost constant relocating. During this process, we will eventually (every couple hours) run into a node or two stuck in Uninitial… --- ## [Dedicated master nodes: JVM usage](https://discuss.elastic.co/t/dedicated-master-nodes-jvm-usage/237000)
**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\ **Replies:** 0\ **Last updated:** [June 13, 2020, 11:18pm UTC](https://discuss.elastic.co/t/dedicated-master-nodes-jvm-usage/237000 "2020-06-13T23:18:35Z")
We have 3 dedicated master nodes in the cluster, and I have noticed from ES monitoring that their JVM does get used, even though only one master is active at any time. Do the inactive master nodes perform tasks? I’ve ass… --- ## [Is there any way to handle the time format returned by elasticsearch?](https://discuss.elastic.co/t/is-there-any-way-to-handle-the-time-format-returned-by-elasticsearch/236964)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 1:38pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-handle-the-time-format-returned-by-elasticsearch/236964 "2020-06-13T13:38:36Z")
Convert to YYYY.MM.DD HH:mm:ss --- ## [How can I avoid indexing duplicate data into Elasticsearch, how define my keys?](https://discuss.elastic.co/t/how-can-i-avoid-indexing-duplicate-data-into-elasticsearch-how-define-my-keys/236976)
**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 11:12am UTC](https://discuss.elastic.co/t/how-can-i-avoid-indexing-duplicate-data-into-elasticsearch-how-define-my-keys/236976 "2020-06-13T11:12:37Z")
Hi, I am using only one index with one default document type and I have the same 4 keys for each record in my index. when I am indexing records that are already exists in my elastic db, duplicate data is created becau… --- ## [SearchSourceBuilder not functional on Android (Bug)](https://discuss.elastic.co/t/searchsourcebuilder-not-functional-on-android-bug/236946)
**Author:** [@jhud](https://discuss.elastic.co/u/jhud)\ **Replies:** 3\ **Last updated:** [June 13, 2020, 9:54am UTC](https://discuss.elastic.co/t/searchsourcebuilder-not-functional-on-android-bug/236946 "2020-06-13T09:54:05Z")
Our team is trying to use the Elasticsearch Java High Level REST Client 7.7.1 on an Android device. So far we've only been indexing data, not querying, and that code has been functional. But when trying to simply instant… --- ## [Too many File Descriptors open](https://discuss.elastic.co/t/too-many-file-descriptors-open/236820)
**Author:** [@Goutham\_Pratapa](https://discuss.elastic.co/u/Goutham_Pratapa)\ **Replies:** 5\ **Last updated:** [June 13, 2020, 8:15am UTC](https://discuss.elastic.co/t/too-many-file-descriptors-open/236820 "2020-06-13T08:15:56Z")
Hi all, In our Dev-environment (ES single node setup) we have seen that the open file descriptors for elastic search are 27491596. (base) root@root:~$ lsof | awk '{print $2}'| uniq -c | sort -rn | head The output… --- ## [What is the best english stemmer for elasticsearch](https://discuss.elastic.co/t/what-is-the-best-english-stemmer-for-elasticsearch/236965)
**Author:** [@WAFA\_Mardiney](https://discuss.elastic.co/u/WAFA_Mardiney)\ **Replies:** 0\ **Last updated:** [June 13, 2020, 7:41am UTC](https://discuss.elastic.co/t/what-is-the-best-english-stemmer-for-elasticsearch/236965 "2020-06-13T07:41:39Z")
I've been looking through each stemmer is provided by elasticsearch but none of them is giving me the result I want, what I'm really interested is the word 'Recovery' I want it to be 'Recover' or 'Recov' ,the user will e… --- ## [From wich node the Watcher alerts are send? from elastic or kibana?](https://discuss.elastic.co/t/from-wich-node-the-watcher-alerts-are-send-from-elastic-or-kibana/236921)
**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 2:10am UTC](https://discuss.elastic.co/t/from-wich-node-the-watcher-alerts-are-send-from-elastic-or-kibana/236921 "2020-06-13T02:10:24Z")
HI, From wich node the Watcher alerts are send? I have to ask for internet access to send alerts to MS Teams , but Im not sure from where they are sended --- ## [How many client nodes should be in an es cluster?](https://discuss.elastic.co/t/how-many-client-nodes-should-be-in-an-es-cluster/236872)
**Author:** [@Bowen\_Liu](https://discuss.elastic.co/u/Bowen_Liu)\ **Replies:** 2\ **Last updated:** [June 13, 2020, 2:05am UTC](https://discuss.elastic.co/t/how-many-client-nodes-should-be-in-an-es-cluster/236872 "2020-06-13T02:05:31Z")
Hey, guys, we have some concerns about how many client nodes should be in a es cluster. Now we have a es cluster with total 36 nodes: 3 master nodes, 5 client nodes and 28 datanodes. We have approximate 10TB, which abou… --- ## [ILM No Copies After N number days](https://discuss.elastic.co/t/ilm-no-copies-after-n-number-days/236932)
**Author:** [@contregm](https://discuss.elastic.co/u/contregm)\ **Replies:** 1\ **Last updated:** [June 13, 2020, 1:19am UTC](https://discuss.elastic.co/t/ilm-no-copies-after-n-number-days/236932 "2020-06-13T01:19:14Z")
Is it possible using an environment where basically all nodes are considered hot to just use ILM to say after a certain number of days drop the replica for an index and only have the single primary copy with no replicas?… --- ## [Need own unqiue ID with Bulk insert](https://discuss.elastic.co/t/need-own-unqiue-id-with-bulk-insert/235599)
**Author:** [@elasticitm](https://discuss.elastic.co/u/elasticitm)\ **Replies:** 11\ **Last updated:** [June 12, 2020, 9:35pm UTC](https://discuss.elastic.co/t/need-own-unqiue-id-with-bulk-insert/235599 "2020-06-12T21:35:52Z")
Hallo @all, I've switched from a older elasticsearch version to the current 7.7 and now getting troubles using unique id's. In the newer elasticsearch version the "\_id" is set automatically to a short one and this brea… --- ## [Upgrade ELK stack](https://discuss.elastic.co/t/upgrade-elk-stack/236590)
**Author:** [@anjana1](https://discuss.elastic.co/u/anjana1)\ **Replies:** 22\ **Last updated:** [June 12, 2020, 8:04pm UTC](https://discuss.elastic.co/t/upgrade-elk-stack/236590 "2020-06-12T20:04:05Z")
What is the right way to perform an upgrade of the stack to preserve the data .. I am trying to upgrade from 7.6 to 7.7.1 I am having challenges in upgrading without data loss. I went through the documentation and its… --- ## [Testing different circuitbreakers](https://discuss.elastic.co/t/testing-different-circuitbreakers/236934)
**Author:** [@dinesh\_gnanasamy](https://discuss.elastic.co/u/dinesh_gnanasamy)\ **Replies:** 0\ **Last updated:** [June 12, 2020, 6:57pm UTC](https://discuss.elastic.co/t/testing-different-circuitbreakers/236934 "2020-06-12T18:57:02Z")
I am trying to test various circuitbreakers to gain better understanding for tuning various breaker limits .. for example, for tuning indices.breaker.request.limit on a cluster with 50% indexing and 50% querying load cha… --- ## [License on premise price](https://discuss.elastic.co/t/license-on-premise-price/236854)
**Author:** [@Felix\_Valembois](https://discuss.elastic.co/u/Felix_Valembois)\ **Replies:** 3\ **Last updated:** [June 12, 2020, 2:43pm UTC](https://discuss.elastic.co/t/license-on-premise-price/236854 "2020-06-12T14:43:26Z")
hello, I was wondering if the license Gold and Platinum could not be on cloud and what would be the price for those solution. On other forums i do have found an approximate price for the gold and platinum (depending on… --- ## [Is there a node limit on the Basic licence? of 7.7](https://discuss.elastic.co/t/is-there-a-node-limit-on-the-basic-licence-of-7-7/236885)
**Author:** [@Anthony\_Whitehead](https://discuss.elastic.co/u/Anthony_Whitehead)\ **Replies:** 4\ **Last updated:** [June 12, 2020, 2:31pm UTC](https://discuss.elastic.co/t/is-there-a-node-limit-on-the-basic-licence-of-7-7/236885 "2020-06-12T14:31:28Z")
A colleague told me that when moving from Elastic 5.6 to 6.8 that the basic licence didn't work as we had more than 100 nodes (on premise). I don't have access to the actual message. Is this correct as I'm investigating… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=890) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=892)