# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=634 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 635 --- ## [Phrase proximity with simple\_query\_string and NEST](https://discuss.elastic.co/t/phrase-proximity-with-simple-query-string-and-nest/275002)
**Author:** [@DMinovski](https://discuss.elastic.co/u/DMinovski)\ **Replies:** 1\ **Last updated:** [June 4, 2021, 6:33pm UTC](https://discuss.elastic.co/t/phrase-proximity-with-simple-query-string-and-nest/275002 "2021-06-04T18:33:20Z")
I'm using the simple\_query\_string with the tilde ~ operator to specify proximity between words in a phrase, and it works. The simple query has other functions that match doesn't provide. { "simple\_qu… --- ## [How to apply custom shard selection algorithm in Elasticsearch?](https://discuss.elastic.co/t/how-to-apply-custom-shard-selection-algorithm-in-elasticsearch/274994)
**Author:** [@Yashasvi\_Raj\_Pant](https://discuss.elastic.co/u/Yashasvi_Raj_Pant)\ **Replies:** 0\ **Last updated:** [June 4, 2021, 2:18pm UTC](https://discuss.elastic.co/t/how-to-apply-custom-shard-selection-algorithm-in-elasticsearch/274994 "2021-06-04T14:18:54Z")
I came across some papers where custom shard selection algorithms like ReDDE, Sushi, and Rank-S are applied instead of default ones. One of them is here. How can we apply a custom shard selection algorithm in Elasticsear… --- ## [Disaster recovery in elasticsearch](https://discuss.elastic.co/t/disaster-recovery-in-elasticsearch/274984)
**Author:** [@dddddddddddddddd](https://discuss.elastic.co/u/dddddddddddddddd)\ **Replies:** 1\ **Last updated:** [June 4, 2021, 1:29pm UTC](https://discuss.elastic.co/t/disaster-recovery-in-elasticsearch/274984 "2021-06-04T13:29:39Z")
hi everyone I hope this message finds you well, so in elasticsearch I have 3 nodes, 2 masters nodes and a data node, so if the 2 masters nodes fail can I find all data in the third data node ? regards --- ## [Elastic IoT - Facing Ingest Speed "Light Barrier" at 10K docs/sec](https://discuss.elastic.co/t/elastic-iot-facing-ingest-speed-light-barrier-at-10k-docs-sec/274971)
**Author:** [@ibexit](https://discuss.elastic.co/u/ibexit)\ **Replies:** 1\ **Last updated:** [June 4, 2021, 11:28am UTC](https://discuss.elastic.co/t/elastic-iot-facing-ingest-speed-light-barrier-at-10k-docs-sec/274971 "2021-06-04T11:28:42Z")
We´ve set up a bare-metal elastic cluster with high CPU, max ram, and fast local flash storage in hot trier and followed all official preflight checklist and write optimization guides: 3 Dedicated Master Nodes, 2 Dedic… --- ## [Hash algo to use with file realm](https://discuss.elastic.co/t/hash-algo-to-use-with-file-realm/274905)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 3\ **Last updated:** [June 4, 2021, 7:49am UTC](https://discuss.elastic.co/t/hash-algo-to-use-with-file-realm/274905 "2021-06-04T07:49:56Z")
Using ES 7.13.0 , platinium licence, security enabled. Using File-based user authentication | Elasticsearch Guide \[7.13\] | Elastic. I am trying to setup "users" file, with username:password. What is exactly the hash a… --- ## [Relevancy of Old article](https://discuss.elastic.co/t/relevancy-of-old-article/274622)
**Author:** [@sj123](https://discuss.elastic.co/u/sj123)\ **Replies:** 9\ **Last updated:** [June 4, 2021, 7:35am UTC](https://discuss.elastic.co/t/relevancy-of-old-article/274622 "2021-06-04T07:35:19Z")
Hi, I am quite new to elasticsearch. I have been reading this article Elasticsearch as a NoSQL Database | Elastic Blog\[Elasticsearch as a NoSQL Database\](https://Elasticsearch as a NoSQL Database). This was posted in 201… --- ## [Rally logs shows max\_connections=1, but the doc said at least 256? And what does max\_connections really do? it seems es client didn't support this param](https://discuss.elastic.co/t/rally-logs-shows-max-connections-1-but-the-doc-said-at-least-256-and-what-does-max-connections-really-do-it-seems-es-client-didnt-support-this-param/274818)
**Author:** [@GITnewfish](https://discuss.elastic.co/u/GITnewfish)\ **Replies:** 1\ **Last updated:** [June 4, 2021, 12:08am UTC](https://discuss.elastic.co/t/rally-logs-shows-max-connections-1-but-the-doc-said-at-least-256-and-what-does-max-connections-really-do-it-seems-es-client-didnt-support-this-param/274818 "2021-06-04T00:08:57Z")
as the title said, I'm confused what does max\_connections really do? it seems es client didn't support this param. the rally command: esrally race --pipeline=benchmark-only --track=test --target-hosts=$target\_hosts --… --- ## [Got response code '401' contacting Elasticsearch at URL](https://discuss.elastic.co/t/got-response-code-401-contacting-elasticsearch-at-url/274608)
**Author:** [@vaclav1](https://discuss.elastic.co/u/vaclav1)\ **Replies:** 5\ **Last updated:** [June 4, 2021, 6:08am UTC](https://discuss.elastic.co/t/got-response-code-401-contacting-elasticsearch-at-url/274608 "2021-06-04T06:08:19Z")
Dear team, I have enabled TLS on cluster and wanted to switch communication between logstash and Elasticsearch to secure protocol. After I set up all I received following error while starting logstash (btw. password is … --- ## [Esrally error executing./esrally configure command](https://discuss.elastic.co/t/esrally-error-executing-esrally-configure-command/274894)
**Author:** [@liuliugang](https://discuss.elastic.co/u/liuliugang)\ **Replies:** 2\ **Last updated:** [June 4, 2021, 3:38am UTC](https://discuss.elastic.co/t/esrally-error-executing-esrally-configure-command/274894 "2021-06-04T03:38:16Z")
Please give advice or comments,thanks \[root@xm-ls001 bin\]# ./esrally configure Traceback (most recent call last): File "./esrally", line 7, in from esrally.rally import main File "/usr/local/python3.7/lib/python3.7… --- ## [Is there a way to rebalance data nodes by disk space and not shards?](https://discuss.elastic.co/t/is-there-a-way-to-rebalance-data-nodes-by-disk-space-and-not-shards/274799)
**Author:** [@danksim](https://discuss.elastic.co/u/danksim)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 9:39pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-rebalance-data-nodes-by-disk-space-and-not-shards/274799 "2021-06-03T21:39:47Z")
Is there a way to rebalance data nodes by disk space and not shards? I have a cluster that has a total of 846 indices but 273 of them have KBs of data while the rest have around 7GBs each since they rollover at 7GB. Thi… --- ## [Reading Cluster Settings in Plugin](https://discuss.elastic.co/t/reading-cluster-settings-in-plugin/274920)
**Author:** [@jessebs](https://discuss.elastic.co/u/jessebs)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:32pm UTC](https://discuss.elastic.co/t/reading-cluster-settings-in-plugin/274920 "2021-06-03T20:32:12Z")
I am writing a plugin and would like to configure it through the cluster settings API. I found some examples of using a non-default plugin constructor which receives Settings, but these settings only seem to contain wha… --- ## [Occasional Index Management timeout](https://discuss.elastic.co/t/occasional-index-management-timeout/273969)
**Author:** [@ethompson](https://discuss.elastic.co/u/ethompson)\ **Replies:** 10\ **Last updated:** [June 3, 2021, 7:18pm UTC](https://discuss.elastic.co/t/occasional-index-management-timeout/273969 "2021-06-03T19:18:11Z")
Occasionally (generally at least once per day) when attempting to access data in Kibana, I'll get a strange series of timeouts. I generally first notice it because Discover view gets an error saying "Error: Could not loc… --- ## [Winlogbeat or Endpoint Security](https://discuss.elastic.co/t/winlogbeat-or-endpoint-security/274909)
**Author:** [@lepepa9493](https://discuss.elastic.co/u/lepepa9493)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 6:20pm UTC](https://discuss.elastic.co/t/winlogbeat-or-endpoint-security/274909 "2021-06-03T18:20:36Z")
hi! What is the difference between the data winlogbeat and endpoint security send? Do I need both? Thanks for your advice --- ## [ESRALLY Continuous index](https://discuss.elastic.co/t/esrally-continuous-index/274800)
**Author:** [@contregm](https://discuss.elastic.co/u/contregm)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 3:15pm UTC](https://discuss.elastic.co/t/esrally-continuous-index/274800 "2021-06-03T15:15:17Z")
I haven't run it in a while but I am trying to run the esrally elastic logs-continuous-index-and-query but cannot seem to find the data for this anymore. --- ## [Elasticsearch](https://discuss.elastic.co/t/elasticsearch/274889)
**Author:** [@Roshaan\_Zafar](https://discuss.elastic.co/u/Roshaan_Zafar)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 2:48pm UTC](https://discuss.elastic.co/t/elasticsearch/274889 "2021-06-03T14:48:54Z")
Hi I just wanted to know that is elasticsearch platinum only cloud based not locally? Actually I am asking because I need to connect odbc elastic with power bi and it supports elasticsearch platinum only while I wanted… --- ## [Logstash data not visible in Kibana](https://discuss.elastic.co/t/logstash-data-not-visible-in-kibana/274880)
**Author:** [@Reszel](https://discuss.elastic.co/u/Reszel)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 2:05pm UTC](https://discuss.elastic.co/t/logstash-data-not-visible-in-kibana/274880 "2021-06-03T14:05:38Z")
Hello guys, I'm newbie to ELK and i was trying to connect Logstash to Kibana/Elastic with my own configuration. Logstash seems to be running, but Kibana can't see any data, when i try to create index pattern. Here is my … --- ## [Pagination with field collapse](https://discuss.elastic.co/t/pagination-with-field-collapse/274863)
**Author:** [@schawla](https://discuss.elastic.co/u/schawla)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 11:27am UTC](https://discuss.elastic.co/t/pagination-with-field-collapse/274863 "2021-06-03T11:27:01Z")
How is it possible to implement pagination in elastic search when we are field collapsing and returning top 5 results from each index. GET /my-index-000001/\_search { "query": { "match": { "message": "GET /se… --- ## [Elasticsearch-rest-high-level-client-6.8.13 vs Elastic server 7.5.2](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707)
**Author:** [@Prabaharan\_Kathiresa](https://discuss.elastic.co/u/Prabaharan_Kathiresa)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 10:33am UTC](https://discuss.elastic.co/t/elasticsearch-rest-high-level-client-6-8-13-vs-elastic-server-7-5-2/274707 "2021-06-03T10:33:16Z")
Hi Team We are trying to upgrade elastic server from 6.8.5 to 7.5.2. Now our micro services are using elasticsearch-rest-high-level-client version 6.8.13. We don't see any problems in communication between elastic serv… --- ## [Create dynamically type](https://discuss.elastic.co/t/create-dynamically-type/274788)
**Author:** [@Abdoul\_Kande](https://discuss.elastic.co/u/Abdoul_Kande)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 10:12am UTC](https://discuss.elastic.co/t/create-dynamically-type/274788 "2021-06-03T10:12:00Z")
How can i create dynamically type in index ? Or in \_doc, create multiple \_type --- ## [SQL DISTINCT Pair of Values in Elasticsearch](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583)
**Author:** [@rknd](https://discuss.elastic.co/u/rknd)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 9:59am UTC](https://discuss.elastic.co/t/sql-distinct-pair-of-values-in-elasticsearch/274583 "2021-06-03T09:59:49Z")
I want to ask how to use SQL DISTINCT Pair of Values in Elasticsearch . Like below, SELECT distinct username, city from country\_table I can run below query for just one field. In the aggs json, I can only see "username… --- ## [Multi phase deduplication on query-time](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846)
**Author:** [@osmanmesutozcan](https://discuss.elastic.co/u/osmanmesutozcan)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 9:40am UTC](https://discuss.elastic.co/t/multi-phase-deduplication-on-query-time/274846 "2021-06-03T09:40:42Z")
Alright so I think I have a somewhat interesting query problem to solve. Any help is appreciated. I need to do a multi phase deduplication on query time. To elaborate more, my data is shared between multiple tenants and… --- ## [Aggregation fails silently when ran on huge data, instead of error returns the default response of 10 docs and hits](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412)
**Author:** [@rohit.shisode](https://discuss.elastic.co/u/rohit.shisode)\ **Replies:** 5\ **Last updated:** [June 3, 2021, 9:38am UTC](https://discuss.elastic.co/t/aggregation-fails-silently-when-ran-on-huge-data-instead-of-error-returns-the-default-response-of-10-docs-and-hits/273412 "2021-06-03T09:38:22Z")
Stack details - ES version - 7.10.1 Kibana version - 7.10.1 Java high level client version - 7.2.0 I have a production cluster of 4 nodes where huge amounts of data is stored in one of the index (approx 30M+ docs, ea… --- ## [Elasticsearch Split Processor preserve\_trailing value](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836)
**Author:** [@jeje232](https://discuss.elastic.co/u/jeje232)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:41am UTC](https://discuss.elastic.co/t/elasticsearch-split-processor-preserve-trailing-value/274836 "2021-06-03T08:41:26Z")
Hi, I have the follwing message and try to to split values and remove at the same time the empty value with preserve\_trailing: Members\[ xxx.xxx.xxx.xxx:xxxx … --- ## [How Sliced Scan Works in the background?](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274832)
**Author:** [@arkash20](https://discuss.elastic.co/u/arkash20)\ **Replies:** 0\ **Last updated:** [June 3, 2021, 8:23am UTC](https://discuss.elastic.co/t/how-sliced-scan-works-in-the-background/274832 "2021-06-03T08:23:08Z")
Hi, I used scan method to retrieve data from a huge indice we have (200M records), using multiprocessing. For that I used sliced scan and set it to 6 slices, as the number of my shards. Now here comes the theory questi… --- ## [Can we use index pattern if we allow only alias in roles](https://discuss.elastic.co/t/can-we-use-index-pattern-if-we-allow-only-alias-in-roles/274725)
**Author:** [@kannan\_raj](https://discuss.elastic.co/u/kannan_raj)\ **Replies:** 4\ **Last updated:** [June 3, 2021, 7:11am UTC](https://discuss.elastic.co/t/can-we-use-index-pattern-if-we-allow-only-alias-in-roles/274725 "2021-06-03T07:11:27Z")
unable to query the data by using index patterns. just assume the index name is test-20210602-00001 and the alias is testing. role is GET /\_xpack/security/role/test?pretty { "cluster": \[\], "indices": \[ … --- ## [BUG: Elasticsearch ignoring node.roles after upgrade from 7.6.1](https://discuss.elastic.co/t/bug-elasticsearch-ignoring-node-roles-after-upgrade-from-7-6-1/274465)
**Author:** [@mverbeek](https://discuss.elastic.co/u/mverbeek)\ **Replies:** 14\ **Last updated:** [June 3, 2021, 7:08am UTC](https://discuss.elastic.co/t/bug-elasticsearch-ignoring-node-roles-after-upgrade-from-7-6-1/274465 "2021-06-03T07:08:03Z")
Hello everyone, When upgrading from 7.6.1 to 7.10.2, I replaced the old node.master and node.data setting to the new node.roles setting. I changed 2 of the 5 data nodes to data\_cold only. But if the node has already bee… --- ## [Hdfs repository analysis check failed](https://discuss.elastic.co/t/hdfs-repository-analysis-check-failed/274815)
**Author:** [@zhoutiekui](https://discuss.elastic.co/u/zhoutiekui)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 7:07am UTC](https://discuss.elastic.co/t/hdfs-repository-analysis-check-failed/274815 "2021-06-03T07:07:35Z")
dear all, I tried to use the opensource hdfs as a snapshot repository, and when I excute the analysis API, there is an error below: POST /\_snapshot/06031016/\_analyze?blob\_count=10&max\_blob\_size=1mb&timeout=120s&concurr… --- ## [Installing Elasticsearch on a VM outside of the Internet](https://discuss.elastic.co/t/installing-elasticsearch-on-a-vm-outside-of-the-internet/274756)
**Author:** [@jyde](https://discuss.elastic.co/u/jyde)\ **Replies:** 2\ **Last updated:** [June 3, 2021, 7:04am UTC](https://discuss.elastic.co/t/installing-elasticsearch-on-a-vm-outside-of-the-internet/274756 "2021-06-03T07:04:23Z")
Hi, I am tring to install ELK on a VM (let's name it foomachine) which is not connected to the Internet. With MobaXTerm, I have put the tar.gz file of the lastest version of Elasticsearch on foomachine, more precisely … --- ## [\[o.e.b.Bootstrap \] \[node1\] node validation exception](https://discuss.elastic.co/t/o-e-b-bootstrap-node1-node-validation-exception/274740)
**Author:** [@mohamed\_el\_mannouti](https://discuss.elastic.co/u/mohamed_el_mannouti)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 12:08am UTC](https://discuss.elastic.co/t/o-e-b-bootstrap-node1-node-validation-exception/274740 "2021-06-03T00:08:48Z")
right after restarting my server --- ## [Error : circuit\_breaking\_exception](https://discuss.elastic.co/t/error-circuit-breaking-exception/274741)
**Author:** [@jvidin](https://discuss.elastic.co/u/jvidin)\ **Replies:** 1\ **Last updated:** [June 3, 2021, 12:07am UTC](https://discuss.elastic.co/t/error-circuit-breaking-exception/274741 "2021-06-03T00:07:55Z")
Hi all , Im new to elastic , im recently receiving this error with some frequency. I have a cluster of 3 and all indices set to shards=2 and replicas=2 Should i look into some special setting to overpass such error ? … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=633) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=635)