# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=491 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 492 --- ## [Remaining shards after using allocation.exclude](https://discuss.elastic.co/t/remaining-shards-after-using-allocation-exclude/297349)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 3\ **Last updated:** [February 17, 2022, 8:39am UTC](https://discuss.elastic.co/t/remaining-shards-after-using-allocation-exclude/297349 "2022-02-17T08:39:46Z")
Hey! I wanted to drain one out of the 9 nodes and I used allocation.exclude attribute: PUT \_cluster/settings { "transient": { "cluster.routing.allocation.exclude.\_ip" : "1.2.3.4" } } The problem is that after … --- ## [Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED ip:9200](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-ip-9200/297338)
**Author:** [@devopshulk](https://discuss.elastic.co/u/devopshulk)\ **Replies:** 6\ **Last updated:** [February 17, 2022, 7:46am UTC](https://discuss.elastic.co/t/unable-to-retrieve-version-information-from-elasticsearch-nodes-connect-econnrefused-ip-9200/297338 "2022-02-17T07:46:09Z")
"message":"Unable to retrieve version information from Elasticsearch nodes. self signed certificate in certificate chain","log":{"level":"ERROR","logger":"Elasticsearch-service"}, --- ## [How to compress data when write into es](https://discuss.elastic.co/t/how-to-compress-data-when-write-into-es/297371)
**Author:** [@dalei2019](https://discuss.elastic.co/u/dalei2019)\ **Replies:** 4\ **Last updated:** [February 17, 2022, 7:42am UTC](https://discuss.elastic.co/t/how-to-compress-data-when-write-into-es/297371 "2022-02-17T07:42:20Z")
Hi team, I want to build an ES cluster for services in other regions, so ES needs to be exposed to the public network. The amount of data transferred is 2 T /day , it's huge . So I expect to compress before writing in… --- ## [Set a global TLS CA for security, snapshot , reindex etc](https://discuss.elastic.co/t/set-a-global-tls-ca-for-security-snapshot-reindex-etc/297389)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 2\ **Last updated:** [February 17, 2022, 7:18am UTC](https://discuss.elastic.co/t/set-a-global-tls-ca-for-security-snapshot-reindex-etc/297389 "2022-02-17T07:18:38Z")
Dont know if this is possible already? How to setup TLS CA for everything: snapshot S3 against custom repositories clustering security TLS --- ## [Shard Failed: marking and sending shard failed due to \[failed recovery\]](https://discuss.elastic.co/t/shard-failed-marking-and-sending-shard-failed-due-to-failed-recovery/297352)
**Author:** [@ethical20](https://discuss.elastic.co/u/ethical20)\ **Replies:** 2\ **Last updated:** [February 17, 2022, 6:24am UTC](https://discuss.elastic.co/t/shard-failed-marking-and-sending-shard-failed-due-to-failed-recovery/297352 "2022-02-17T06:24:21Z")
Hi, I've installed a new windows ELK stack for testing, worked once but then got the below errors when trying to run again. I can see that there are issues with shards, but don't know how to fix this. \[2022-02-16T11:… --- ## [Include & Exclude of 500k ids in a search query](https://discuss.elastic.co/t/include-exclude-of-500k-ids-in-a-search-query/296428)
**Author:** [@sanders\_2345](https://discuss.elastic.co/u/sanders_2345)\ **Replies:** 4\ **Last updated:** [February 8, 2022, 12:32pm UTC](https://discuss.elastic.co/t/include-exclude-of-500k-ids-in-a-search-query/296428 "2022-02-08T12:32:52Z")
Problem statement: We've millions of ids stored in another Id store. These ids we're generating from the application & will be as same es doc id. Here, for certain use-cases, we want to include & exclude these ids in a … --- ## [Logstash not getting rolled over](https://discuss.elastic.co/t/logstash-not-getting-rolled-over/297022)
**Author:** [@jwilfreds](https://discuss.elastic.co/u/jwilfreds)\ **Replies:** 7\ **Last updated:** [February 16, 2022, 2:47pm UTC](https://discuss.elastic.co/t/logstash-not-getting-rolled-over/297022 "2022-02-16T14:47:40Z")
The logstash file is not getting rolled over. the setup was set for 5 MB and the lifecyle policy added to it. But it grew to 100 GB. No one noticed it until we started getting the server utilization alerts. How do I crea… --- ## [Unassigned Shards elastic 7.6.0](https://discuss.elastic.co/t/unassigned-shards-elastic-7-6-0/297431)
**Author:** [@yuswanul](https://discuss.elastic.co/u/yuswanul)\ **Replies:** 4\ **Last updated:** [February 17, 2022, 1:45am UTC](https://discuss.elastic.co/t/unassigned-shards-elastic-7-6-0/297431 "2022-02-17T01:45:02Z")
So, Here is the condition. some of my index are unassigned and the status is red. then i assign it manually using this command POST \_cluster/reroute { "commands": \[ { "allocate\_empty\_primary": { … --- ## [Elastic pod exit code 60](https://discuss.elastic.co/t/elastic-pod-exit-code-60/297322)
**Author:** [@cps598](https://discuss.elastic.co/u/cps598)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:28am UTC](https://discuss.elastic.co/t/elastic-pod-exit-code-60/297322 "2022-02-17T01:28:42Z")
I can't delete one of the indexes and the return value is "60". What is "60" mean in return value? Thanks. --- ## [ES\_API point to Cluster IP](https://discuss.elastic.co/t/es-api-point-to-cluster-ip/297325)
**Author:** [@Wan\_Nur\_Athirah\_Wan](https://discuss.elastic.co/u/Wan_Nur_Athirah_Wan)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:28am UTC](https://discuss.elastic.co/t/es-api-point-to-cluster-ip/297325 "2022-02-17T01:28:36Z")
Hai everyone. Just curious about one thing regarding Elasticsearch. Before this we know that ES\_API can link to ES database IP. Can I get accurate information if ES\_API can also point to cluster IP? Thanks a lot. --- ## [Multi-indice facet filtering](https://discuss.elastic.co/t/multi-indice-facet-filtering/297391)
**Author:** [@merijnkruithof](https://discuss.elastic.co/u/merijnkruithof)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:13am UTC](https://discuss.elastic.co/t/multi-indice-facet-filtering/297391 "2022-02-17T01:13:18Z")
Hi all, I'm very new to Elasticsearch, so I hope that you guys understand what I'm saying. We have two indices (training\_programs and vacancies). Those indices share some fields, such as education\_level, and fields tha… --- ## [API key: unable to find apikey with id \](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id-id/297401)
**Author:** [@inbox.ex](https://discuss.elastic.co/u/inbox.ex)\ **Replies:** 1\ **Last updated:** [February 17, 2022, 1:11am UTC](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id-id/297401 "2022-02-17T01:11:12Z")
I was able to create ApiKey from Elasticsearch console. But, when i try to Post Document to the ES url using PostMan, i am getting this error. (subject). does it take time for the apikey to become effective ? the url … --- ## [Configuring the Transport Client to work with a Secured Cluster](https://discuss.elastic.co/t/configuring-the-transport-client-to-work-with-a-secured-cluster/296476)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 9:40pm UTC](https://discuss.elastic.co/t/configuring-the-transport-client-to-work-with-a-secured-cluster/296476 "2022-02-16T21:40:31Z")
hey there, following this doc page I was trying to use Transport Client. ES cluster is already configured to use SSL and Basic Auth and it works properly. I would like to give an answer to my doubt, following step #4, … --- ## [Filter on rank\_features](https://discuss.elastic.co/t/filter-on-rank-features/297181)
**Author:** [@dvisz-inf](https://discuss.elastic.co/u/dvisz-inf)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 7:13pm UTC](https://discuss.elastic.co/t/filter-on-rank-features/297181 "2022-02-16T19:13:05Z")
Hi all Back in 2017/2018 I attended Elasticon in San Francisco and got to meet a bunch of the engineers there. It was a really good experience and I got to have a lot of questions answered. One in particular was buggin… --- ## [Scripted metric aggregation inside nested aggregation: \`params.\_source\` is empty in map script](https://discuss.elastic.co/t/scripted-metric-aggregation-inside-nested-aggregation-params-source-is-empty-in-map-script/297237)
**Author:** [@asupranovich](https://discuss.elastic.co/u/asupranovich)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 2:58pm UTC](https://discuss.elastic.co/t/scripted-metric-aggregation-inside-nested-aggregation-params-source-is-empty-in-map-script/297237 "2022-02-16T14:58:49Z")
Hi community! My Elasticsearch version is 7.7.0. I'm facing a weird issue for my aggregation query. Let's say we have a car index, car data model looks like below: { "vin": "08c00679-8a58-11ec-9745-1aed518f8637", … --- ## [Java Client API data indexed but not available in a search, works in debug mode](https://discuss.elastic.co/t/java-client-api-data-indexed-but-not-available-in-a-search-works-in-debug-mode/297399)
**Author:** [@vmassol](https://discuss.elastic.co/u/vmassol)\ **Replies:** 2\ **Last updated:** [February 16, 2022, 5:56pm UTC](https://discuss.elastic.co/t/java-client-api-data-indexed-but-not-available-in-a-search-works-in-debug-mode/297399 "2022-02-16T17:56:02Z")
Hi guys, I'm a bit stuck on a problem I don't understand. I'm basically doing the following, using the Java Client API in ES 7.17: RestClient restClient = RestClient.builder("...some url...") … --- ## [Latest Transform questions](https://discuss.elastic.co/t/latest-transform-questions/297293)
**Author:** [@iamtheschmitzer](https://discuss.elastic.co/u/iamtheschmitzer)\ **Replies:** 6\ **Last updated:** [February 16, 2022, 5:25pm UTC](https://discuss.elastic.co/t/latest-transform-questions/297293 "2022-02-16T17:25:06Z")
Creating a latest transform using the API, I need to provide a set of unique\_keys, which can be a list of field names. Some questions: How do I reference a field in a sub object? Like within foo there is a key bar th… --- ## [Mapping Json Object and Array under the same field](https://discuss.elastic.co/t/mapping-json-object-and-array-under-the-same-field/294853)
**Author:** [@Remi\_Czternasty](https://discuss.elastic.co/u/Remi_Czternasty)\ **Replies:** 2\ **Last updated:** [February 16, 2022, 4:38pm UTC](https://discuss.elastic.co/t/mapping-json-object-and-array-under-the-same-field/294853 "2022-02-16T16:38:23Z")
Hello, I'm trying to ingests logs that are json documents. As I don't know the structure of each possible logs, I'm looking into dynamic templates. And I encounter an issue because I have a case where a field is an obje… --- ## [ILM Error duration cannot be negative](https://discuss.elastic.co/t/ilm-error-duration-cannot-be-negative/297222)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 4\ **Last updated:** [February 16, 2022, 3:30pm UTC](https://discuss.elastic.co/t/ilm-error-duration-cannot-be-negative/297222 "2022-02-16T15:30:39Z")
running elk stack version 7.16.2. GET .siem-signals-default-000010/\_ilm/explain { "error" : { "root\_cause" : \[ { "type" : "illegal\_argument\_exception", "reason" : "duration cannot be negativ… --- ## [Passing variables form changes to operations](https://discuss.elastic.co/t/passing-variables-form-changes-to-operations/297353)
**Author:** [@marek\_duciuc](https://discuss.elastic.co/u/marek_duciuc)\ **Replies:** 0\ **Last updated:** [February 16, 2022, 10:32am UTC](https://discuss.elastic.co/t/passing-variables-form-changes-to-operations/297353 "2022-02-16T10:32:08Z")
My operation file looks like: { "name": "match-all-query\_id", "operation-type": "search", "body": { "query": { "match\_all": {} }, "\_source": false } }, { "name": "match-all-quer… --- ## [Change template and ILM policy from an existing Datastream](https://discuss.elastic.co/t/change-template-and-ilm-policy-from-an-existing-datastream/296608)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 8\ **Last updated:** [February 16, 2022, 9:56am UTC](https://discuss.elastic.co/t/change-template-and-ilm-policy-from-an-existing-datastream/296608 "2022-02-16T09:56:38Z")
Hey! In our Elasticsearch we use Datastreams which split our data to several streams like bellow. So all the Datastreams have the same template and ILM policy. Since one of them has increased a lot I want to apply diff… --- ## [Switching policies for an index](https://discuss.elastic.co/t/switching-policies-for-an-index/296200)
**Author:** [@Angelos](https://discuss.elastic.co/u/Angelos)\ **Replies:** 5\ **Last updated:** [February 16, 2022, 9:51am UTC](https://discuss.elastic.co/t/switching-policies-for-an-index/296200 "2022-02-16T09:51:39Z")
Hey! Is there any documentation on switching ilm policies for 7.10.0. I could find only for other versions like here: Switching policies for an index | Elasticsearch Guide \[7.4\] | Elastic My question is: Can I switch … --- ## [Stop elasticsearch cluster safely](https://discuss.elastic.co/t/stop-elasticsearch-cluster-safely/297327)
**Author:** [@vikia.4293ok](https://discuss.elastic.co/u/vikia.4293ok)\ **Replies:** 6\ **Last updated:** [February 16, 2022, 8:42am UTC](https://discuss.elastic.co/t/stop-elasticsearch-cluster-safely/297327 "2022-02-16T08:42:34Z")
Hello, there. If anyone has faced a similar problem, I would really appreciate your advice. We stop/start Elasticsearch cluster in develop envrionment everyday to reduce costs. But, sometimes, we find that some index\`… --- ## [Getting "master not discovered or elected yet, an election requires at least 2 nodes" after enabling SSL/HTTPS](https://discuss.elastic.co/t/getting-master-not-discovered-or-elected-yet-an-election-requires-at-least-2-nodes-after-enabling-ssl-https/296950)
**Author:** [@cgnusr01](https://discuss.elastic.co/u/cgnusr01)\ **Replies:** 10\ **Last updated:** [February 16, 2022, 8:11am UTC](https://discuss.elastic.co/t/getting-master-not-discovered-or-elected-yet-an-election-requires-at-least-2-nodes-after-enabling-ssl-https/296950 "2022-02-16T08:11:54Z")
I recently upgraded Elastic from version: 7.2 to version 7.16.1 with a rolling update and there were no problems. After some time and after following the instructions here: Set up basic security for the Elastic Stack | E… --- ## [I set it to niofs but the performance was too poor](https://discuss.elastic.co/t/i-set-it-to-niofs-but-the-performance-was-too-poor/297091)
**Author:** [@slowup](https://discuss.elastic.co/u/slowup)\ **Replies:** 4\ **Last updated:** [February 16, 2022, 8:02am UTC](https://discuss.elastic.co/t/i-set-it-to-niofs-but-the-performance-was-too-poor/297091 "2022-02-16T08:02:05Z")
Performance tests were conducted with niofs and hybridfs, but in the case of niofs, 100 TPS hybridfs came out 680 TPS. Why is that? Do you have any documentation that goes deeper into niofs, mmapfs, and hybridfs? Help m… --- ## [ELK upgrade from 7.8.0 to 7.17.0](https://discuss.elastic.co/t/elk-upgrade-from-7-8-0-to-7-17-0/297333)
**Author:** [@nandatibco](https://discuss.elastic.co/u/nandatibco)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 7:31am UTC](https://discuss.elastic.co/t/elk-upgrade-from-7-8-0-to-7-17-0/297333 "2022-02-16T07:31:19Z")
Hello all, I'm planning to upgrade ELK stack from 7.8.0 to 7.17.0, please suggest if I need to take care of any scenarios and risks that I may encounter during this upgrade. Thanks, Nandakishor --- ## [Change background color and text conditionally - OpenSearch Dashboard](https://discuss.elastic.co/t/change-background-color-and-text-conditionally-opensearch-dashboard/297262)
**Author:** [@Raphael\_Carneiro](https://discuss.elastic.co/u/Raphael_Carneiro)\ **Replies:** 3\ **Last updated:** [February 16, 2022, 7:28am UTC](https://discuss.elastic.co/t/change-background-color-and-text-conditionally-opensearch-dashboard/297262 "2022-02-16T07:28:51Z")
Hi, I want to build a very simple visualization based on Count aggregation to be added to a dashboard. This visualization should look just like this: This text and background should change between OK/NOK based on a c… --- ## [Elastic search pagination to log server](https://discuss.elastic.co/t/elastic-search-pagination-to-log-server/296922)
**Author:** [@sramana235](https://discuss.elastic.co/u/sramana235)\ **Replies:** 4\ **Last updated:** [February 16, 2022, 7:12am UTC](https://discuss.elastic.co/t/elastic-search-pagination-to-log-server/296922 "2022-02-16T07:12:37Z")
Hello friends. I have a question today, so I'm writing it down. I'm going to write it down in detail today. I ask for your understanding of my poor English skills. I have a question when building a log server using E… --- ## [CCR connection issue](https://discuss.elastic.co/t/ccr-connection-issue/297312)
**Author:** [@sonujatav35](https://discuss.elastic.co/u/sonujatav35)\ **Replies:** 1\ **Last updated:** [February 16, 2022, 1:48am UTC](https://discuss.elastic.co/t/ccr-connection-issue/297312 "2022-02-16T01:48:18Z")
Hi, I am trying to setup CCR in our test. While setting up the remote cluster getting some issue. Using platinum license on both cluster. Below status is showing for remote cluster. Can anyone advise me on this whic… --- ## [Re-indexing into schema with new multifields](https://discuss.elastic.co/t/re-indexing-into-schema-with-new-multifields/297203)
**Author:** [@Chris\_Gatihi](https://discuss.elastic.co/u/Chris_Gatihi)\ **Replies:** 2\ **Last updated:** [February 16, 2022, 1:32am UTC](https://discuss.elastic.co/t/re-indexing-into-schema-with-new-multifields/297203 "2022-02-16T01:32:33Z")
Hi, Let's say, for the sake of simplicity, I have an index "a" with only this field in the schema: "foo": { "type": "keyword", } And then I create a new index "b" with a new multifield … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=490) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=492)