# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=257

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 258

---

## [Bulk insert in elasticsearch datastream using elasticsearch-java 8.6.2](https://discuss.elastic.co/t/bulk-insert-in-elasticsearch-datastream-using-elasticsearch-java-8-6-2/333744)

<div class="topic-metadata">

**Author:** [@ayanarora0101](https://discuss.elastic.co/u/ayanarora0101)\
**Replies:** 0\
**Last updated:** [May 18, 2023, 8:54am UTC](https://discuss.elastic.co/t/bulk-insert-in-elasticsearch-datastream-using-elasticsearch-java-8-6-2/333744 "2023-05-18T08:54:55Z")

</div>

I'm trying to bulk insert documents in datastream in elasticsearch using java with (ElasticsearchClient) (elasticsearch-java) 8.6.2. I checked documentation of elasticsearch-java and found information around bulk indexi…

---

## [Is there a limit for number of routing values](https://discuss.elastic.co/t/is-there-a-limit-for-number-of-routing-values/333719)

<div class="topic-metadata">

**Author:** [@alper](https://discuss.elastic.co/u/alper)\
**Replies:** 1\
**Last updated:** [May 18, 2023, 7:01am UTC](https://discuss.elastic.co/t/is-there-a-limit-for-number-of-routing-values/333719 "2023-05-18T07:01:14Z")

</div>

Hi, The index contains one routing field and has 50 shards. I use the routing field in search requests. I do, however, wonder if there would be a performance problem if I sent 1000 routing values in a single query. Sho…

---

## [Elastic shard balancing / allocation](https://discuss.elastic.co/t/elastic-shard-balancing-allocation/333713)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 0\
**Last updated:** [May 18, 2023, 4:54am UTC](https://discuss.elastic.co/t/elastic-shard-balancing-allocation/333713 "2023-05-18T04:54:50Z")

</div>

Hi We are on Elastic 8.6 with 38 hot data nodes and ingesting about 140 different indices Top 10 indices have indexing rate about 15-50K events/sec. 20 indices has 1-20 K events/sec. And remaining 100 indices indexin…

---

## [New index es not being created after index 'reset' v7.17.9](https://discuss.elastic.co/t/new-index-es-not-being-created-after-index-reset-v7-17-9/333712)

<div class="topic-metadata">

**Author:** [@Bruceclegg](https://discuss.elastic.co/u/Bruceclegg)\
**Replies:** 0\
**Last updated:** [May 18, 2023, 4:33am UTC](https://discuss.elastic.co/t/new-index-es-not-being-created-after-index-reset-v7-17-9/333712 "2023-05-18T04:33:07Z")

</div>

I'm working on fixing our onsite elasticsearch 7.17.9 cluster. I've got a small 3 node cluster capturing our production data. Right now all of the logs get loaded into a single index that I use cron and curator to manu…

---

## [Add ILM to existing index 7.17.9](https://discuss.elastic.co/t/add-ilm-to-existing-index-7-17-9/333003)

<div class="topic-metadata">

**Author:** [@Bruceclegg](https://discuss.elastic.co/u/Bruceclegg)\
**Replies:** 6\
**Last updated:** [May 18, 2023, 4:15am UTC](https://discuss.elastic.co/t/add-ilm-to-existing-index-7-17-9/333003 "2023-05-18T04:15:46Z")

</div>

I have an existing index I've applied the 30 day default lifecycle management policy to. But it doesn't seem to be working. I've read through the documentation and I/m obviously missing something. The index I'm attemp…

---

## [Elasticsearch Java Client 8.7 String List to FieldAndFormat List](https://discuss.elastic.co/t/elasticsearch-java-client-8-7-string-list-to-fieldandformat-list/333677)

<div class="topic-metadata">

**Author:** [@tcpeiris](https://discuss.elastic.co/u/tcpeiris)\
**Replies:** 2\
**Last updated:** [May 18, 2023, 3:38am UTC](https://discuss.elastic.co/t/elasticsearch-java-client-8-7-string-list-to-fieldandformat-list/333677 "2023-05-18T03:38:43Z")

</div>

How do I pass Java String List to .fields as FieldAndFormat in search(req -\> req.index(index).fields())

---

## [Automatically balance Shard allocation](https://discuss.elastic.co/t/automatically-balance-shard-allocation/333682)

<div class="topic-metadata">

**Author:** [@NishuGoel](https://discuss.elastic.co/u/NishuGoel)\
**Replies:** 1\
**Last updated:** [May 18, 2023, 1:11am UTC](https://discuss.elastic.co/t/automatically-balance-shard-allocation/333682 "2023-05-18T01:11:36Z")

</div>

A maintenance applied by "System" today caused a restart of a node in our production cluster The restarted node started reallocating shards, not receiving traffic after 2 hours and the remaining 2 nodes were under huge …

---

## [Is it possible to migrate data from one cluster to another using Snapshot and Restore](https://discuss.elastic.co/t/is-it-possible-to-migrate-data-from-one-cluster-to-another-using-snapshot-and-restore/333694)

<div class="topic-metadata">

**Author:** [@Abhilash\_B](https://discuss.elastic.co/u/Abhilash_B)\
**Replies:** 1\
**Last updated:** [May 18, 2023, 1:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-migrate-data-from-one-cluster-to-another-using-snapshot-and-restore/333694 "2023-05-18T01:06:00Z")

</div>

Hi Team, I am planning to migrate data from some indices using the snapshot and restore method. Is it possible to snapshot the indices from Cluster1 to one repository and then restore the same snapshot to Cluster2?

---

## [Elastic Heap size calculation not correct with K8S 1.26](https://discuss.elastic.co/t/elastic-heap-size-calculation-not-correct-with-k8s-1-26/333528)

<div class="topic-metadata">

**Author:** [@lineconnect](https://discuss.elastic.co/u/lineconnect)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 11:58pm UTC](https://discuss.elastic.co/t/elastic-heap-size-calculation-not-correct-with-k8s-1-26/333528 "2023-05-17T23:58:03Z")

</div>

Hi, we run several elastic clusters(all with 3 nodes). And until now without any issues until we've upgraded vom k8s version 1.24.8. We don't have any JVM options set and the calculation from elastic was always fine. …

---

## [Get source of queries hitting indexes](https://discuss.elastic.co/t/get-source-of-queries-hitting-indexes/333250)

<div class="topic-metadata">

**Author:** [@callumdowling](https://discuss.elastic.co/u/callumdowling)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 11:52pm UTC](https://discuss.elastic.co/t/get-source-of-queries-hitting-indexes/333250 "2023-05-17T23:52:41Z")

</div>

Hi all, just wondering if this is possible. We have several tiers in elastic cloud, we would like to see when the frozen tier is being rules/dashboards/queries for our indexes so we can go through and optimise. Is there…

---

## [Can we connect to multiple clusters in JAVA using High level rest client](https://discuss.elastic.co/t/can-we-connect-to-multiple-clusters-in-java-using-high-level-rest-client/333310)

<div class="topic-metadata">

**Author:** [@Umang\_Pachaury](https://discuss.elastic.co/u/Umang_Pachaury)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 11:13pm UTC](https://discuss.elastic.co/t/can-we-connect-to-multiple-clusters-in-java-using-high-level-rest-client/333310 "2023-05-17T23:13:32Z")

</div>

Hi team, I have a question about high level rest client lets suppose I have 2 clusters running on two different machines and those clusters have an index with the same name. I have a Java application which fetches dat…

---

## [Elasticsearch Aggregations](https://discuss.elastic.co/t/elasticsearch-aggregations/333615)

<div class="topic-metadata">

**Author:** [@JulioAlbuquerque](https://discuss.elastic.co/u/JulioAlbuquerque)\
**Replies:** 4\
**Last updated:** [May 17, 2023, 10:27pm UTC](https://discuss.elastic.co/t/elasticsearch-aggregations/333615 "2023-05-17T22:27:08Z")

</div>

I have a project in NodeJS with TypeScript that uses the library "@elastic/elasticsearch": "^8.7.0", to connect the server with Elastic Search 8.7.1. I'm trying to make a query where I retrieve the frequency of words fr…

---

## [Which is better RAM allocation strategy?](https://discuss.elastic.co/t/which-is-better-ram-allocation-strategy/333497)

<div class="topic-metadata">

**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\
**Replies:** 4\
**Last updated:** [May 17, 2023, 6:07pm UTC](https://discuss.elastic.co/t/which-is-better-ram-allocation-strategy/333497 "2023-05-17T18:07:07Z")

</div>

If I have a data node with 128GB of RAM. Is it better to allocate 64GB to ES and 64GB to system? Or would it be ok (or even better) to allocate say 100GB to ES and leave 28GB to system? Our system is write heavy; ther…

---

## [Kibana and logstash can't run using docker-compose](https://discuss.elastic.co/t/kibana-and-logstash-cant-run-using-docker-compose/333498)

<div class="topic-metadata">

**Author:** [@Fatiha](https://discuss.elastic.co/u/Fatiha)\
**Replies:** 2\
**Last updated:** [May 17, 2023, 5:52pm UTC](https://discuss.elastic.co/t/kibana-and-logstash-cant-run-using-docker-compose/333498 "2023-05-17T17:52:13Z")

</div>

hi ,hello everyone I run the elastic and logstash and kibana and mysql containers using docker-compose this the configuration that i use in my docker-compose file version: '3' services: mysql: container\_name: mysq…

---

## [Painless Script Error, Creating New Variable on Data View](https://discuss.elastic.co/t/painless-script-error-creating-new-variable-on-data-view/333599)

<div class="topic-metadata">

**Author:** [@marscar](https://discuss.elastic.co/u/marscar)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 3:59pm UTC](https://discuss.elastic.co/t/painless-script-error-creating-new-variable-on-data-view/333599 "2023-05-17T15:59:42Z")

</div>

Hello! I am trying to create a new variable on a Data View using this painless script, but when trying to save, I am getting the generic error "Invalid Painless Script". The error also tells be to fix the highlighted err…

---

## [How do Searchable Snapshot snapshots get cleaned up?](https://discuss.elastic.co/t/how-do-searchable-snapshot-snapshots-get-cleaned-up/329831)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 15\
**Last updated:** [May 17, 2023, 3:54pm UTC](https://discuss.elastic.co/t/how-do-searchable-snapshot-snapshots-get-cleaned-up/329831 "2023-05-17T15:54:36Z")

</div>

Hello All, I was curious if anyone knew the answer to the question: How do searchable snapshot snapshots get cleaned up. To explain the question a bit more, I'll use the below example: I have: A snapshot reposito…

---

## [How to integrate in-house ticketing tool with ELK using API's](https://discuss.elastic.co/t/how-to-integrate-in-house-ticketing-tool-with-elk-using-apis/333645)

<div class="topic-metadata">

**Author:** [@DhananjayPatil](https://discuss.elastic.co/u/DhananjayPatil)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 3:42pm UTC](https://discuss.elastic.co/t/how-to-integrate-in-house-ticketing-tool-with-elk-using-apis/333645 "2023-05-17T15:42:41Z")

</div>

Hi Everyone, I am currently working on integrating our in-house ticketing tool with ELK. Specifically, I would like to fetch data from ELK and automatically create incidents in our ticketing tool when specific conditions…

---

## [How to upgrade ELK on docker from 8.4.3 to 8.7.0](https://discuss.elastic.co/t/how-to-upgrade-elk-on-docker-from-8-4-3-to-8-7-0/331352)

<div class="topic-metadata">

**Author:** [@Thales\_Eduardo](https://discuss.elastic.co/u/Thales_Eduardo)\
**Replies:** 2\
**Last updated:** [May 17, 2023, 2:48pm UTC](https://discuss.elastic.co/t/how-to-upgrade-elk-on-docker-from-8-4-3-to-8-7-0/331352 "2023-05-17T14:48:21Z")

</div>

I have an elastdocker (elk version 8.4.3) in production for some time and I would like to upgrade the elk version (8.4.3 to 8.7.0). Volumes are configured on the instance to use persistent storage. The procedure would …

---

## [EFK Stack on Kubernetes - Collecting logs from default namespace](https://discuss.elastic.co/t/efk-stack-on-kubernetes-collecting-logs-from-default-namespace/333672)

<div class="topic-metadata">

**Author:** [@daniela09](https://discuss.elastic.co/u/daniela09)\
**Replies:** 0\
**Last updated:** [May 17, 2023, 2:31pm UTC](https://discuss.elastic.co/t/efk-stack-on-kubernetes-collecting-logs-from-default-namespace/333672 "2023-05-17T14:31:22Z")

</div>

Hi, I am using EFK stack on Kubernetes, I want to configure fluentd to collect logs from one specific namespace, the default namespace. This is my fleuntd config file: \<label @FLUENT\_LOG\> \<match fluent.\*\*\> …

---

## [Getting Logstash output cannot be used with Fleet Server integration in Fleet Server Policy. Please create a new ElasticSearch output](https://discuss.elastic.co/t/getting-logstash-output-cannot-be-used-with-fleet-server-integration-in-fleet-server-policy-please-create-a-new-elasticsearch-output/330980)

<div class="topic-metadata">

**Author:** [@mehdi-lamrani](https://discuss.elastic.co/u/mehdi-lamrani)\
**Replies:** 5\
**Last updated:** [May 17, 2023, 2:24pm UTC](https://discuss.elastic.co/t/getting-logstash-output-cannot-be-used-with-fleet-server-integration-in-fleet-server-policy-please-create-a-new-elasticsearch-output/330980 "2023-05-17T14:24:34Z")

</div>

This is pretty straightforward as you can see : I get this after trying to configure a logstash output on Fleet and going through all the steps. I dont know what to do with this error message as it does not make sens…

---

## [Failed to obtain node locks, tried \[/usr/share/elasticsearch/data\]; maybe these locations are not writable or multiple nodes were started](https://discuss.elastic.co/t/failed-to-obtain-node-locks-tried-usr-share-elasticsearch-data-maybe-these-locations-are-not-writable-or-multiple-nodes-were-started/333657)

<div class="topic-metadata">

**Author:** [@Resul\_Zoroglu](https://discuss.elastic.co/u/Resul_Zoroglu)\
**Replies:** 0\
**Last updated:** [May 17, 2023, 12:54pm UTC](https://discuss.elastic.co/t/failed-to-obtain-node-locks-tried-usr-share-elasticsearch-data-maybe-these-locations-are-not-writable-or-multiple-nodes-were-started/333657 "2023-05-17T12:54:40Z")

</div>

I installed elasticsearch on kubernetes using helm. elasticsearch version: 8.5.1 pods do not stand up. Error in pods log: {"@timestamp":"2023-05-17T12:50:32.223Z", "log.level":"ERROR", "message":"fatal exception while…

---

## [Can I reload after a setting change in elasticsearch.yml?](https://discuss.elastic.co/t/can-i-reload-after-a-setting-change-in-elasticsearch-yml/333565)

<div class="topic-metadata">

**Author:** [@GenSSC](https://discuss.elastic.co/u/GenSSC)\
**Replies:** 6\
**Last updated:** [May 16, 2023, 2:40pm UTC](https://discuss.elastic.co/t/can-i-reload-after-a-setting-change-in-elasticsearch-yml/333565 "2023-05-16T14:40:30Z")

</div>

Is there a way to only reload the settings and not the whole stack ?

---

## [CAPACITY test over the years for STORAGE RAM and so](https://discuss.elastic.co/t/capacity-test-over-the-years-for-storage-ram-and-so/333644)

<div class="topic-metadata">

**Author:** [@Dor\_Steinberg](https://discuss.elastic.co/u/Dor_Steinberg)\
**Replies:** 0\
**Last updated:** [May 17, 2023, 9:34am UTC](https://discuss.elastic.co/t/capacity-test-over-the-years-for-storage-ram-and-so/333644 "2023-05-17T09:34:52Z")

</div>

i have number of indexes I would be happy to know if there is a certain formula or what is the correct way to determine how much CAPACITY is needed in 4 years thanks for the help

---

## [Ignore\_z\_value is not supported](https://discuss.elastic.co/t/ignore-z-value-is-not-supported/333571)

<div class="topic-metadata">

**Author:** [@gabi939](https://discuss.elastic.co/u/gabi939)\
**Replies:** 2\
**Last updated:** [May 17, 2023, 7:45am UTC](https://discuss.elastic.co/t/ignore-z-value-is-not-supported/333571 "2023-05-17T07:45:05Z")

</div>

Elasticsearch Version 7.7.0 Java Version 1.8.0\_252 OS Version Ubuntu 18.04 Problem Description According to: I should be able to use parameter ignore\_z\_value to ignore z values indexed to geo\_point field. But it do…

---

## [Guidance on mapping and query](https://discuss.elastic.co/t/guidance-on-mapping-and-query/333592)

<div class="topic-metadata">

**Author:** [@ichbindermike](https://discuss.elastic.co/u/ichbindermike)\
**Replies:** 2\
**Last updated:** [May 17, 2023, 6:55am UTC](https://discuss.elastic.co/t/guidance-on-mapping-and-query/333592 "2023-05-17T06:55:27Z")

</div>

I have a question on what might be the best approach to structure my data. I have 8 indices that each contain about 4-7 fields (different ones), but I would like to search across all indices and multiple of those fields.…

---

## [Elasticsearch snapshot/restore to s3](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-to-s3/330517)

<div class="topic-metadata">

**Author:** [@sraman](https://discuss.elastic.co/u/sraman)\
**Replies:** 30\
**Last updated:** [May 17, 2023, 5:27am UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-to-s3/330517 "2023-05-17T05:27:31Z")

</div>

Hi, I have installed elasticsearch 8.6.2 & kibana 8.6.2 on the same standalone server for testing purpose. Planning to place the data snapshot to S3 and restore, but facing issues while creating the repository(it's not…

---

## [Ingest data from 3 databases](https://discuss.elastic.co/t/ingest-data-from-3-databases/330624)

<div class="topic-metadata">

**Author:** [@baba72210](https://discuss.elastic.co/u/baba72210)\
**Replies:** 4\
**Last updated:** [May 17, 2023, 3:45am UTC](https://discuss.elastic.co/t/ingest-data-from-3-databases/330624 "2023-05-17T03:45:39Z")

</div>

Hi everyone, I have a project where I need to index data from 3 differents databases to be able to search for revelant information. I have a Cassandra, a MSSQL and a mongoDB. Do you think it would be possible to use the…

---

## [Elasticsearch createTranslogSyncProcessor part of source code, log level Setting is not appropriate?](https://discuss.elastic.co/t/elasticsearch-createtranslogsyncprocessor-part-of-source-code-log-level-setting-is-not-appropriate/332539)

<div class="topic-metadata">

**Author:** [@yujie\_wang](https://discuss.elastic.co/u/yujie_wang)\
**Replies:** 1\
**Last updated:** [May 17, 2023, 3:21am UTC](https://discuss.elastic.co/t/elasticsearch-createtranslogsyncprocessor-part-of-source-code-log-level-setting-is-not-appropriate/332539 "2023-05-17T03:21:16Z")

</div>

Hi, Recently, I've been reading the source code of the latest version (8.7.1) of Elasticsearch and I have a question about the log level settings that I can't figure out. I noticed that the "failed to sync translog" is…

---

## [java.lang.IllegalArgumentException: unknown setting \[node.data\] please check that any required plugins are installed, or check the breaking changes documentation for removed settings](https://discuss.elastic.co/t/java-lang-illegalargumentexception-unknown-setting-node-data-please-check-that-any-required-plugins-are-installed-or-check-the-breaking-changes-documentation-for-removed-settings/333558)

<div class="topic-metadata">

**Author:** [@tungnx1](https://discuss.elastic.co/u/tungnx1)\
**Replies:** 2\
**Last updated:** [May 17, 2023, 2:55am UTC](https://discuss.elastic.co/t/java-lang-illegalargumentexception-unknown-setting-node-data-please-check-that-any-required-plugins-are-installed-or-check-the-breaking-changes-documentation-for-removed-settings/333558 "2023-05-17T02:55:06Z")

</div>

help !!! i setup Cluster Elasticsearch. After config file elasticsearch.yml node.name: es-data-1 node.data: true Log: java.lang.IllegalArgumentException: unknown setting \[node.data\] please check that any required pl…

---

## [Kibana and logstash can't run using docker-compose](https://discuss.elastic.co/t/kibana-and-logstash-cant-run-using-docker-compose/333566)

<div class="topic-metadata">

**Author:** [@Fatiha](https://discuss.elastic.co/u/Fatiha)\
**Replies:** 1\
**Last updated:** [May 16, 2023, 11:48pm UTC](https://discuss.elastic.co/t/kibana-and-logstash-cant-run-using-docker-compose/333566 "2023-05-16T23:48:35Z")

</div>

hi ,hello everyone I run the elastic and logstash and kibana and mysql containers using docker-compose this the configuration that i use in my docker-compose file version: '3' services: mysql: container\_name: mysql ho…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=256)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=258)
