# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=83 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 84 --- ## [Self-Monitoring in Elasticsearch 8.11 stopped working](https://discuss.elastic.co/t/self-monitoring-in-elasticsearch-8-11-stopped-working/365412)
**Author:** [@nitesh.srivastava](https://discuss.elastic.co/u/nitesh.srivastava)\ **Replies:** 2\ **Last updated:** [August 23, 2024, 5:04pm UTC](https://discuss.elastic.co/t/self-monitoring-in-elasticsearch-8-11-stopped-working/365412 "2024-08-23T17:04:18Z")
Hello All, The Self-Monitoring in our Elasticsearch 8.11 environment all of a sudden has stopped working. This is how it used to look last week: But, it looks like this now: And, I get this error when I go to t… --- ## [Shard activity always happening in ElasticSearch 8.12 version](https://discuss.elastic.co/t/shard-activity-always-happening-in-elasticsearch-8-12-version/364906)
**Author:** [@Amit\_Shukla](https://discuss.elastic.co/u/Amit_Shukla)\ **Replies:** 7\ **Last updated:** [August 23, 2024, 3:54pm UTC](https://discuss.elastic.co/t/shard-activity-always-happening-in-elasticsearch-8-12-version/364906 "2024-08-23T15:54:46Z")
We have upgraded Elasticsearch to 8.12 and changed index level settings to have shards per node as 4 , which was earlier 2. Somehow everytime some shard recovery is happening and shards are moving from one node to anoth… --- ## [How to increase the thread pool size](https://discuss.elastic.co/t/how-to-increase-the-thread-pool-size/365433)
**Author:** [@Rakhshunda\_Noorein\_J](https://discuss.elastic.co/u/Rakhshunda_Noorein_J)\ **Replies:** 7\ **Last updated:** [August 23, 2024, 10:37am UTC](https://discuss.elastic.co/t/how-to-increase-the-thread-pool-size/365433 "2024-08-23T10:37:46Z")
Hey, My elasticsearch cluster has 1 node with 3 processors, 32gb ram memory, 24 index with 1 shard each. Thread pool queue size = 1000 how many concurrent search requests my cluster can handle? How can I increase the… --- ## [Renaming of auto-generated field names (created by Postgres connector)](https://discuss.elastic.co/t/renaming-of-auto-generated-field-names-created-by-postgres-connector/364612)
**Author:** [@andrej.peplinski](https://discuss.elastic.co/u/andrej.peplinski)\ **Replies:** 3\ **Last updated:** [August 23, 2024, 9:54am UTC](https://discuss.elastic.co/t/renaming-of-auto-generated-field-names-created-by-postgres-connector/364612 "2024-08-23T09:54:28Z")
Dear Elastic team, I am currently using an Elasticsearch docker cluster with a Postgres connector and Kibana using a basic license. I am able to synchronize my data but find the default field names that are being genera… --- ## [Shard balance is by default is confusing, can someone pls explain?](https://discuss.elastic.co/t/shard-balance-is-by-default-is-confusing-can-someone-pls-explain/364048)
**Author:** [@mannoj87](https://discuss.elastic.co/u/mannoj87)\ **Replies:** 8\ **Last updated:** [August 23, 2024, 6:54am UTC](https://discuss.elastic.co/t/shard-balance-is-by-default-is-confusing-can-someone-pls-explain/364048 "2024-08-23T06:54:01Z")
Below is the default values for balance. ES 8.9. "disk\_usage": "2.0E-11", "index": "0.55", "threshold": "1.0", "shard": "0.45", "write\_load": "10.0" Fyi : In above default values… --- ## [Keycloak OIDC authentication with basic license](https://discuss.elastic.co/t/keycloak-oidc-authentication-with-basic-license/362055)
**Author:** [@trwillis](https://discuss.elastic.co/u/trwillis)\ **Replies:** 8\ **Last updated:** [August 23, 2024, 6:24am UTC](https://discuss.elastic.co/t/keycloak-oidc-authentication-with-basic-license/362055 "2024-08-23T06:24:34Z")
Can I implement OIDC integration via Keycloak with the Elasticsearch basic license or do I need enterprise? --- ## [Issue with updation of record in latest Transform](https://discuss.elastic.co/t/issue-with-updation-of-record-in-latest-transform/365340)
**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\ **Replies:** 2\ **Last updated:** [August 23, 2024, 3:46am UTC](https://discuss.elastic.co/t/issue-with-updation-of-record-in-latest-transform/365340 "2024-08-23T03:46:51Z")
We are using Elasticsearch latest transforms to fetch latest records in our index based on sync time as ingest.time and sort as extractDatetime. The transformation involves fields like extractDatetime and ingest.time, w… --- ## [PutPipelineAsync conversion from vb.net to c#](https://discuss.elastic.co/t/putpipelineasync-conversion-from-vb-net-to-c/365411)
**Author:** [@kvickery](https://discuss.elastic.co/u/kvickery)\ **Replies:** 0\ **Last updated:** [August 22, 2024, 9:22pm UTC](https://discuss.elastic.co/t/putpipelineasync-conversion-from-vb-net-to-c/365411 "2024-08-22T21:22:05Z")
I am trying to convert some vb.net code for some old Elasticsearch over to C# with Elasticsearch 8. Simply converting to C# gives me the code below, but I am getting "cannot convert lambda expression to type field (or fi… --- ## [Multi nodes cluster only finds one node](https://discuss.elastic.co/t/multi-nodes-cluster-only-finds-one-node/365403)
**Author:** [@rachelyang](https://discuss.elastic.co/u/rachelyang)\ **Replies:** 4\ **Last updated:** [August 22, 2024, 8:56pm UTC](https://discuss.elastic.co/t/multi-nodes-cluster-only-finds-one-node/365403 "2024-08-22T20:56:11Z")
I installed Elasticsearch version 8.15. I set up a cluster with two nodes. I have configured in elasticsearch.yml like this: discovery.seed\_hosts: \["cvnode1","cvnode2"\] But, when I checked cluster health, I got one nod… --- ## [ILM and determining the destination index without a lookup](https://discuss.elastic.co/t/ilm-and-determining-the-destination-index-without-a-lookup/365386)
**Author:** [@diegomansua](https://discuss.elastic.co/u/diegomansua)\ **Replies:** 2\ **Last updated:** [August 22, 2024, 1:55pm UTC](https://discuss.elastic.co/t/ilm-and-determining-the-destination-index-without-a-lookup/365386 "2024-08-22T13:55:53Z")
Hello, I'm using ILM to automatically rollover indices monthly. I have to bulk insert (or rather, upsert) a bunch of documents with pre-assigned ids, and I want to ensure that there won't be duplicates in different ind… --- ## [Having issues with brower navigation back to search page in NextJS](https://discuss.elastic.co/t/having-issues-with-brower-navigation-back-to-search-page-in-nextjs/365383)
**Author:** [@Justin\_Schoen](https://discuss.elastic.co/u/Justin_Schoen)\ **Replies:** 0\ **Last updated:** [August 22, 2024, 12:52pm UTC](https://discuss.elastic.co/t/having-issues-with-brower-navigation-back-to-search-page-in-nextjs/365383 "2024-08-22T12:52:23Z")
Background: We are using Elasticsearch We are using the search-ui package for react We are using Nextjs What's happening? We have a search page that's using the SearchProvider component to wrap all the filters, results… --- ## [Cat API Info required](https://discuss.elastic.co/t/cat-api-info-required/365334)
**Author:** [@gchakkalakkal](https://discuss.elastic.co/u/gchakkalakkal)\ **Replies:** 4\ **Last updated:** [August 22, 2024, 10:44am UTC](https://discuss.elastic.co/t/cat-api-info-required/365334 "2024-08-22T10:44:22Z")
Hi Team, We wanted to know if all \_cat API are always served from master node? Even if it is fired from data node will it hit master node for getting response. e.g \_cat/indices?v --- ## [Upgrading elastic search & kibana from 6.6.1 to 7.x or 8.x](https://discuss.elastic.co/t/upgrading-elastic-search-kibana-from-6-6-1-to-7-x-or-8-x/365100)
**Author:** [@Mariajosephina](https://discuss.elastic.co/u/Mariajosephina)\ **Replies:** 10\ **Last updated:** [August 22, 2024, 10:37am UTC](https://discuss.elastic.co/t/upgrading-elastic-search-kibana-from-6-6-1-to-7-x-or-8-x/365100 "2024-08-22T10:37:16Z")
Hi @all This is regarding a query on upgrading Elasticsearch & kibana. The current version of Elastic search & Kibana in our organization is 6.6.1 used to storing RPA logs. I am planning to upgrade to 7.x or 8.x Cou… --- ## [Cluster privileges manage\_security does give user right to alle CRUD operations on a role](https://discuss.elastic.co/t/cluster-privileges-manage-security-does-give-user-right-to-alle-crud-operations-on-a-role/365196)
**Author:** [@fgjensen](https://discuss.elastic.co/u/fgjensen)\ **Replies:** 4\ **Last updated:** [August 22, 2024, 9:07am UTC](https://discuss.elastic.co/t/cluster-privileges-manage-security-does-give-user-right-to-alle-crud-operations-on-a-role/365196 "2024-08-22T09:07:17Z")
This issue is happens on Elasticsearch and Kibana version 8.15.0 (upgraded many times). A role has been created by the Elastic user. According to Kibana 8.15.0 documentation the cluster security privileges manage\_securi… --- ## [Streamlining Configuration Management for a Large Elasticsearch Cluster](https://discuss.elastic.co/t/streamlining-configuration-management-for-a-large-elasticsearch-cluster/364573)
**Author:** [@bdn](https://discuss.elastic.co/u/bdn)\ **Replies:** 2\ **Last updated:** [August 16, 2024, 3:21am UTC](https://discuss.elastic.co/t/streamlining-configuration-management-for-a-large-elasticsearch-cluster/364573 "2024-08-16T03:21:43Z")
I have 25+ Elasticsearch cluster nodes where I have configured ingestion, data, and master nodes. Any changes to the Elasticsearch configuration need to be updated on each cluster node individually. For instance, if I ne… --- ## [Handling different flows in data streams](https://discuss.elastic.co/t/handling-different-flows-in-data-streams/365342)
**Author:** [@Zain\_Ul\_Abideen](https://discuss.elastic.co/u/Zain_Ul_Abideen)\ **Replies:** 1\ **Last updated:** [August 22, 2024, 7:36am UTC](https://discuss.elastic.co/t/handling-different-flows-in-data-streams/365342 "2024-08-22T07:36:13Z")
Hello, I have been using data streams for my business flow logs, each flow has the different log structure. I have couple of solutions in mind: Having same structure for each flow and keep stringified version of log o… --- ## [Unable to parse response body due to 429 Too Many Requests error during bulk save](https://discuss.elastic.co/t/unable-to-parse-response-body-due-to-429-too-many-requests-error-during-bulk-save/365337)
**Author:** [@eirena](https://discuss.elastic.co/u/eirena)\ **Replies:** 4\ **Last updated:** [August 22, 2024, 7:05am UTC](https://discuss.elastic.co/t/unable-to-parse-response-body-due-to-429-too-many-requests-error-during-bulk-save/365337 "2024-08-22T07:05:54Z")
Hi :slight\_smile: We are experiencing 429 error during bulk save in our prod environment. The problem is intermittent and occurs only once a week, making it hard to reproduce in our test environment. We have the follo… --- ## [Field based limit using simple query string query](https://discuss.elastic.co/t/field-based-limit-using-simple-query-string-query/365336)
**Author:** [@jahedi](https://discuss.elastic.co/u/jahedi)\ **Replies:** 1\ **Last updated:** [August 22, 2024, 6:33am UTC](https://discuss.elastic.co/t/field-based-limit-using-simple-query-string-query/365336 "2024-08-22T06:33:28Z")
Hi, Consider a elastic document has a filed named site. We can use query string query to limit the search results to the related site just like this: GET my\_index/\_search { "query": { "query\_string": { "defau… --- ## [Modifying Elasticsearch Mapping and Reindexing Real-Time Data](https://discuss.elastic.co/t/modifying-elasticsearch-mapping-and-reindexing-real-time-data/365275)
**Author:** [@Monica\_Andhare](https://discuss.elastic.co/u/Monica_Andhare)\ **Replies:** 2\ **Last updated:** [August 22, 2024, 5:54am UTC](https://discuss.elastic.co/t/modifying-elasticsearch-mapping-and-reindexing-real-time-data/365275 "2024-08-22T05:54:37Z")
Hi, Is there any way to modify the mapping of an Elasticsearch index without needing to reindex the data? If not, what is the most optimal approach to reindex an index that is receiving real-time data? --- ## [Cannot use ignore\_unavailable in DeleteRequest in Elasticsearch Java API Client](https://discuss.elastic.co/t/cannot-use-ignore-unavailable-in-deleterequest-in-elasticsearch-java-api-client/365323)
**Author:** [@elvin](https://discuss.elastic.co/u/elvin)\ **Replies:** 5\ **Last updated:** [August 22, 2024, 5:40am UTC](https://discuss.elastic.co/t/cannot-use-ignore-unavailable-in-deleterequest-in-elasticsearch-java-api-client/365323 "2024-08-22T05:40:13Z")
I am using the official Java API Client for Elasticsearch. : Introduction | Elasticsearch Java API Client \[7.17\] | Elastic When deleting I cannot use ignore\_unavailable elasticsearchClient .delete(idx -\> idx.in… --- ## [Setup Elasticsearch + Grafana](https://discuss.elastic.co/t/setup-elasticsearch-grafana/365308)
**Author:** [@vished](https://discuss.elastic.co/u/vished)\ **Replies:** 0\ **Last updated:** [August 21, 2024, 8:02pm UTC](https://discuss.elastic.co/t/setup-elasticsearch-grafana/365308 "2024-08-21T20:02:30Z")
Hello, I´m currently struggeling to setup: Docker Elasticssearch Filebeat with Grafana Currently I´m getting always this issue: "No date field named @timestamp found" I cannot post any links, therefore it´s ver… --- ## [Same query returning different result each time](https://discuss.elastic.co/t/same-query-returning-different-result-each-time/365230)
**Author:** [@Santanu112](https://discuss.elastic.co/u/Santanu112)\ **Replies:** 6\ **Last updated:** [August 21, 2024, 6:29pm UTC](https://discuss.elastic.co/t/same-query-returning-different-result-each-time/365230 "2024-08-21T18:29:22Z")
I have more than 50 documents with same score cause they have same name . I am searching top 10 document using "size" and "sort" parameter . Is it ok that every time i am getting different top 10 document ? "size": "10"… --- ## [ERROR: no\_shard\_available\_action\_exception after restoring the snapshot](https://discuss.elastic.co/t/error-no-shard-available-action-exception-after-restoring-the-snapshot/365021)
**Author:** [@cassper](https://discuss.elastic.co/u/cassper)\ **Replies:** 3\ **Last updated:** [August 21, 2024, 4:40pm UTC](https://discuss.elastic.co/t/error-no-shard-available-action-exception-after-restoring-the-snapshot/365021 "2024-08-21T16:40:31Z")
Hello, I am using ES 8.13 docker and try to restore the snapshot. I am using \_restore ES API. \_snapshot/my\_repository/snapshot\_1/\_restore?wait\_for\_completion=true { "indices": "test-000001" } Result - { "snaps… --- ## [S3 snapshot repository setup](https://discuss.elastic.co/t/s3-snapshot-repository-setup/365231)
**Author:** [@mealbert23](https://discuss.elastic.co/u/mealbert23)\ **Replies:** 0\ **Last updated:** [August 20, 2024, 9:19pm UTC](https://discuss.elastic.co/t/s3-snapshot-repository-setup/365231 "2024-08-20T21:19:22Z")
Hi, I have a elasticsearch and kibana 8.14.2 running on an aws eks infrastructure. I am trying to now configure the s3 repository for snapshots and restores. After much searching around and filtering through old stori… --- ## [Search rejected due to missing shards \[\[tasklist-flownode-instance-1.0.0\_\]\[0\]\]. Consider using \`allow\_partial\_search\_results\` setting to bypass this error](https://discuss.elastic.co/t/search-rejected-due-to-missing-shards-tasklist-flownode-instance-1-0-0-0-consider-using-allow-partial-search-results-setting-to-bypass-this-error/365248)
**Author:** [@mlngupta](https://discuss.elastic.co/u/mlngupta)\ **Replies:** 14\ **Last updated:** [August 21, 2024, 8:57am UTC](https://discuss.elastic.co/t/search-rejected-due-to-missing-shards-tasklist-flownode-instance-1-0-0-0-consider-using-allow-partial-search-results-setting-to-bypass-this-error/365248 "2024-08-21T08:57:37Z")
Hi Team, We have Elasticsearch running with 7 node and version 7.17.1 running on EKS pods. Recently we noticed that the issue with one of the node due to PVC got issue because of EFS\_CSI driver. Once issue fixed PVC re… --- ## [Migration Question/Advice \[HP-\>Dell, Centos-\>Debian, 7.17-\>8.15\]](https://discuss.elastic.co/t/migration-question-advice-hp-dell-centos-debian-7-17-8-15/365227)
**Author:** [@numpty-boy](https://discuss.elastic.co/u/numpty-boy)\ **Replies:** 2\ **Last updated:** [August 21, 2024, 8:23am UTC](https://discuss.elastic.co/t/migration-question-advice-hp-dell-centos-debian-7-17-8-15/365227 "2024-08-21T08:23:48Z")
Hi Team, I have a three node cluster running the latest version of 7.17. I've run the migration assistant and we're clean. Bad news is its running on ancient H/W with centos7. All three machines run master and data role… --- ## [Ingest data to DataStream Through Filebeat](https://discuss.elastic.co/t/ingest-data-to-datastream-through-filebeat/364510)
**Author:** [@Debasis\_Mallick](https://discuss.elastic.co/u/Debasis_Mallick)\ **Replies:** 21\ **Last updated:** [August 20, 2024, 7:30am UTC](https://discuss.elastic.co/t/ingest-data-to-datastream-through-filebeat/364510 "2024-08-20T07:30:24Z")
Hi Team, Could you please advise how can we ingest data to data streams by using filebeat. Thanks, Debasis --- ## [How to set up hostname correctly when generating certificates for cluster nodes](https://discuss.elastic.co/t/how-to-set-up-hostname-correctly-when-generating-certificates-for-cluster-nodes/365224)
**Author:** [@jack\_a](https://discuss.elastic.co/u/jack_a)\ **Replies:** 1\ **Last updated:** [August 21, 2024, 2:04am UTC](https://discuss.elastic.co/t/how-to-set-up-hostname-correctly-when-generating-certificates-for-cluster-nodes/365224 "2024-08-21T02:04:23Z")
I am trying to follow Tutorial 2: Securing a self-managed Elastic Stack and in step 3.1 there is a place that asks for hostnames and the IP addresses that will be used to connect to my cluster. So assuming i have 3 VMs n… --- ## [Multi-million indices cluster](https://discuss.elastic.co/t/multi-million-indices-cluster/365160)
**Author:** [@xambr](https://discuss.elastic.co/u/xambr)\ **Replies:** 6\ **Last updated:** [August 20, 2024, 2:54pm UTC](https://discuss.elastic.co/t/multi-million-indices-cluster/365160 "2024-08-20T14:54:54Z")
We're considering deploying an Elasticsearch cluster to support many thousands of users, each with unique and potentially conflicting data mappings. Additionally, the data corpus size varies significantly between users. … --- ## [Stop elastic shard store on old elastic node](https://discuss.elastic.co/t/stop-elastic-shard-store-on-old-elastic-node/365175)
**Author:** [@Julian\_Fazri](https://discuss.elastic.co/u/Julian_Fazri)\ **Replies:** 10\ **Last updated:** [August 20, 2024, 4:43pm UTC](https://discuss.elastic.co/t/stop-elastic-shard-store-on-old-elastic-node/365175 "2024-08-20T16:43:06Z")
Hi All, I want to migrate existing elastic nodes to the new nodes using the join cluster method, So I don't have to backup-restore the data and kibana feature configuration. The details are below: I have 3 existing el… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=82) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=84)