# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=91 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 92 --- ## [ElasticSearch application hosted on separate server stops responding to Liferay Server](https://discuss.elastic.co/t/elasticsearch-application-hosted-on-separate-server-stops-responding-to-liferay-server/363935)
**Author:** [@DineshA](https://discuss.elastic.co/u/DineshA)\ **Replies:** 0\ **Last updated:** [July 29, 2024, 1:58am UTC](https://discuss.elastic.co/t/elasticsearch-application-hosted-on-separate-server-stops-responding-to-liferay-server/363935 "2024-07-29T01:58:43Z")
Elastic Search services which are hosted on another server stops responding to Liferay application Server and it is intermittent and then have to restart Elasticsearch Service and then liferay application server is able … --- ## [Validation Failed: 1: id is too long, must be no longer than 512 bytes but was: 548;](https://discuss.elastic.co/t/validation-failed-1-id-is-too-long-must-be-no-longer-than-512-bytes-but-was-548/363875)
**Author:** [@sibasish.palo](https://discuss.elastic.co/u/sibasish.palo)\ **Replies:** 1\ **Last updated:** [July 28, 2024, 10:20pm UTC](https://discuss.elastic.co/t/validation-failed-1-id-is-too-long-must-be-no-longer-than-512-bytes-but-was-548/363875 "2024-07-28T22:20:46Z")
we are migrating from an old elasticsearch version to 8.12 and for some documents we are seeing validation error like Validation Failed: 1: id is too long, must be no longer than 512 bytes but was: 548; i know its a che… --- ## [Index aliases vs index templates, what to use?](https://discuss.elastic.co/t/index-aliases-vs-index-templates-what-to-use/363923)
**Author:** [@Carl\_jo](https://discuss.elastic.co/u/Carl_jo)\ **Replies:** 2\ **Last updated:** [July 28, 2024, 12:27pm UTC](https://discuss.elastic.co/t/index-aliases-vs-index-templates-what-to-use/363923 "2024-07-28T12:27:11Z")
Can anybody tell me the difference between index aliases and index templates. When to use each one, and what are their main advantages? Will it work for an9 whatsapp? --- ## [The search for full words or terms does not work correctly](https://discuss.elastic.co/t/the-search-for-full-words-or-terms-does-not-work-correctly/363527)
**Author:** [@Rainbow\_Sprinkles](https://discuss.elastic.co/u/Rainbow_Sprinkles)\ **Replies:** 14\ **Last updated:** [July 27, 2024, 11:59am UTC](https://discuss.elastic.co/t/the-search-for-full-words-or-terms-does-not-work-correctly/363527 "2024-07-27T11:59:35Z")
Dear talents, I hope everyone is doing well. Could you kindly review the statement below and suggest possible fixes? The keyword is "alt legal". Currently, the search engine is expected to display titles that either c… --- ## [Elasticsearch Failing to start](https://discuss.elastic.co/t/elasticsearch-failing-to-start/363879)
**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\ **Replies:** 3\ **Last updated:** [July 26, 2024, 7:57pm UTC](https://discuss.elastic.co/t/elasticsearch-failing-to-start/363879 "2024-07-26T19:57:53Z")
Hello I attempt to install elasticsearch on new node, but its failling to start Any help would be great: Jul 26 09:54:04 \<\> systemd-entrypoint\[1933\]: Exception in thread "main" org.apache.lucene.index.CorruptIndexExcep… --- ## [NestedAggregation in co.elastic.clients:elasticsearch-java](https://discuss.elastic.co/t/nestedaggregation-in-co-elastic-clients-elasticsearch-java/363829)
**Author:** [@S\_R](https://discuss.elastic.co/u/S_R)\ **Replies:** 4\ **Last updated:** [July 26, 2024, 1:47pm UTC](https://discuss.elastic.co/t/nestedaggregation-in-co-elastic-clients-elasticsearch-java/363829 "2024-07-26T13:47:08Z")
Hi, I'm currently migrating my project to use the new client co.elastic.clients:elasticsearch-java:7.17.22. Previously, with org.elasticsearch:elasticsearch:7.8.1, I created nested aggregations in my JUnit tests like th… --- ## [Shards are not relocated from excluded data nodes](https://discuss.elastic.co/t/shards-are-not-relocated-from-excluded-data-nodes/363860)
**Author:** [@a06ced31bae02498a46d](https://discuss.elastic.co/u/a06ced31bae02498a46d)\ **Replies:** 2\ **Last updated:** [July 26, 2024, 1:09pm UTC](https://discuss.elastic.co/t/shards-are-not-relocated-from-excluded-data-nodes/363860 "2024-07-26T13:09:00Z")
When excluding certain nodes with cluster.routing.allocation.exclude.\_ip setting most of the shards are moved off of the nodes. However, some nodes are still having a few shards. First 2 nodes here have 1 shard each eve… --- ## [I am not able to get metrics from the machines that enrolled outside the network](https://discuss.elastic.co/t/i-am-not-able-to-get-metrics-from-the-machines-that-enrolled-outside-the-network/363862)
**Author:** [@Rohan\_sirohi](https://discuss.elastic.co/u/Rohan_sirohi)\ **Replies:** 0\ **Last updated:** [July 26, 2024, 12:54pm UTC](https://discuss.elastic.co/t/i-am-not-able-to-get-metrics-from-the-machines-that-enrolled-outside-the-network/363862 "2024-07-26T12:54:26Z")
Hi All, I have checked numerous forums but haven't found a solution, so I am raising this question here because of my unique setup. I have Elasticsearch and Kibana running on a Proxmox server inside containers. My entir… --- ## [Elastic crash, nodes timed out](https://discuss.elastic.co/t/elastic-crash-nodes-timed-out/363764)
**Author:** [@PustyB](https://discuss.elastic.co/u/PustyB)\ **Replies:** 1\ **Last updated:** [July 26, 2024, 10:34am UTC](https://discuss.elastic.co/t/elastic-crash-nodes-timed-out/363764 "2024-07-26T10:34:33Z")
Hi. I have an elastic cluster on Kubernetes. Since yesterday I am facing the problem of kubernetes nodes stopping. 3 nodes (64GB RAM) The last logs it reads before crashing are: {"@timestamp":"2024-07-25T05:44:12.428Z… --- ## [Elasticsearch opening around 200 ports to communicate internally in single node setup beside http and tcp port configured](https://discuss.elastic.co/t/elasticsearch-opening-around-200-ports-to-communicate-internally-in-single-node-setup-beside-http-and-tcp-port-configured/363821)
**Author:** [@Sheik\_Mohammed\_Shaw](https://discuss.elastic.co/u/Sheik_Mohammed_Shaw)\ **Replies:** 1\ **Last updated:** [July 26, 2024, 9:07am UTC](https://discuss.elastic.co/t/elasticsearch-opening-around-200-ports-to-communicate-internally-in-single-node-setup-beside-http-and-tcp-port-configured/363821 "2024-07-26T09:07:26Z")
Elasticsearch is opening many ports to communicate with itself, in a single-node setup. Is this the expected behavior? If yes kindly mention why around 100 connections established within itself? I tested with various … --- ## [A copy of this shard is already allocated to this node](https://discuss.elastic.co/t/a-copy-of-this-shard-is-already-allocated-to-this-node/362138)
**Author:** [@Sam\_Rybkin](https://discuss.elastic.co/u/Sam_Rybkin)\ **Replies:** 5\ **Last updated:** [July 26, 2024, 8:33am UTC](https://discuss.elastic.co/t/a-copy-of-this-shard-is-already-allocated-to-this-node/362138 "2024-07-26T08:33:47Z")
Hi we have next kibana settings: GET /.kibana/\_settings { ".kibana\_2" : { "settings" : { "index" : { "number\_of\_shards" : "1", "auto\_expand\_replicas" : "false", "provided\_name" : ".ki… --- ## [Global Aggregation on nested fields with filters](https://discuss.elastic.co/t/global-aggregation-on-nested-fields-with-filters/363023)
**Author:** [@Bhavyagc](https://discuss.elastic.co/u/Bhavyagc)\ **Replies:** 3\ **Last updated:** [July 26, 2024, 4:13am UTC](https://discuss.elastic.co/t/global-aggregation-on-nested-fields-with-filters/363023 "2024-07-26T04:13:36Z")
I am facing issues with aggregations on nested field. Below are the mapping fields. { "mappings": { "properties": { "autocomplete": { "type": "text", "analyzer": "autocomplete", "fiel… --- ## [Creating a Geo Enrich Policy for existing Index, encountering error when adding the enriched field to existing documents by Reindexing](https://discuss.elastic.co/t/creating-a-geo-enrich-policy-for-existing-index-encountering-error-when-adding-the-enriched-field-to-existing-documents-by-reindexing/363804)
**Author:** [@jlogan](https://discuss.elastic.co/u/jlogan)\ **Replies:** 2\ **Last updated:** [July 26, 2024, 2:25am UTC](https://discuss.elastic.co/t/creating-a-geo-enrich-policy-for-existing-index-encountering-error-when-adding-the-enriched-field-to-existing-documents-by-reindexing/363804 "2024-07-26T02:25:04Z")
Hi there! I'm trying to create an Enrich Policy using geo\_match for the first time and wanted to test it by applying it to an existing index and documents within it. I've added the field that I intend to populate with t… --- ## [When a custom transaction ends, does the prior/parent transaction continue?](https://discuss.elastic.co/t/when-a-custom-transaction-ends-does-the-prior-parent-transaction-continue/363793)
**Author:** [@dantoomey](https://discuss.elastic.co/u/dantoomey)\ **Replies:** 3\ **Last updated:** [July 25, 2024, 5:06pm UTC](https://discuss.elastic.co/t/when-a-custom-transaction-ends-does-the-prior-parent-transaction-continue/363793 "2024-07-25T17:06:35Z")
We have created a custom transaction on part of our code. When the custom transaction ends, does the prior transaction continue operating? --- ## [Index refresh and replication behaviour](https://discuss.elastic.co/t/index-refresh-and-replication-behaviour/363798)
**Author:** [@Sergii1](https://discuss.elastic.co/u/Sergii1)\ **Replies:** 3\ **Last updated:** [July 25, 2024, 4:19pm UTC](https://discuss.elastic.co/t/index-refresh-and-replication-behaviour/363798 "2024-07-25T16:19:26Z")
I am struggling to understand if the index refresh operation makes data available for search immediately on both primary and replica shards. On one hand, it seems that replication and index refreshing are completely ind… --- ## [How to perform atomic operations using a java client](https://discuss.elastic.co/t/how-to-perform-atomic-operations-using-a-java-client/363769)
**Author:** [@Kotomi\_Ichinose](https://discuss.elastic.co/u/Kotomi_Ichinose)\ **Replies:** 1\ **Last updated:** [July 25, 2024, 3:35pm UTC](https://discuss.elastic.co/t/how-to-perform-atomic-operations-using-a-java-client/363769 "2024-07-25T15:35:06Z")
java client I want to do the following with a java client. I couldn't find a way to do it in the documentation. POST \_aliases { "actions": \[ { "remove": { "index": "logs-nginx.access-prod", … --- ## [Slowlog message's entries grok](https://discuss.elastic.co/t/slowlog-messages-entries-grok/363794)
**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\ **Replies:** 0\ **Last updated:** [July 25, 2024, 2:45pm UTC](https://discuss.elastic.co/t/slowlog-messages-entries-grok/363794 "2024-07-25T14:45:52Z")
Hey there, to investigate possible issues I used to collect slowlog entries. Obviously, query field is very important but I saw during these years that there isn't any easy way to analyze it. I mean, generally I use a … --- ## [Elasticsearch spends all CPU time decompressing till restart](https://discuss.elastic.co/t/elasticsearch-spends-all-cpu-time-decompressing-till-restart/363706)
**Author:** [@spinscale](https://discuss.elastic.co/u/spinscale)\ **Replies:** 2\ **Last updated:** [July 25, 2024, 1:46pm UTC](https://discuss.elastic.co/t/elasticsearch-spends-all-cpu-time-decompressing-till-restart/363706 "2024-07-25T13:46:55Z")
Hey, I have a fun issue here, that I am unable to pinpoint. We have a relatively old 7.9.0 cluster (spare me be upgrade preach, I've been doing that for months for this cluster :shushing\_face:), that suddenly jumps from… --- ## [PySpark writing to ES: "Cannot detect ES version"](https://discuss.elastic.co/t/pyspark-writing-to-es-cannot-detect-es-version/363662)
**Author:** [@rzotti-sd](https://discuss.elastic.co/u/rzotti-sd)\ **Replies:** 9\ **Last updated:** [July 24, 2024, 11:55pm UTC](https://discuss.elastic.co/t/pyspark-writing-to-es-cannot-detect-es-version/363662 "2024-07-24T23:55:44Z")
I'm using the following PySpark code to write a DataFrame to an Elasticsearch cluster hosted in Elastic Cloud. df.writeStream.outputMode("append") .format("org.elasticsearch.spark.sql") .option("checkpoi… --- ## [Searching non-indexed fields throwing error](https://discuss.elastic.co/t/searching-non-indexed-fields-throwing-error/363404)
**Author:** [@sibasish.palo](https://discuss.elastic.co/u/sibasish.palo)\ **Replies:** 5\ **Last updated:** [July 24, 2024, 9:17pm UTC](https://discuss.elastic.co/t/searching-non-indexed-fields-throwing-error/363404 "2024-07-24T21:17:17Z")
we have some fields which are marked as below old version "field1": { "type": "string", "index": "no" } v8 "field1": { "type": "text", "index": false } e… --- ## [ElasticSearch Java API Client - Create index with type mapping](https://discuss.elastic.co/t/elasticsearch-java-api-client-create-index-with-type-mapping/363736)
**Author:** [@sweller](https://discuss.elastic.co/u/sweller)\ **Replies:** 1\ **Last updated:** [July 24, 2024, 9:14pm UTC](https://discuss.elastic.co/t/elasticsearch-java-api-client-create-index-with-type-mapping/363736 "2024-07-24T21:14:35Z")
I am migrating some code which uses the old rest high level client to the Java API Client (Starting at 7.17.22 with plans to migrate to 8.X immediately after), and am trying to recreate the mapping for a CreateIndexReque… --- ## [What to do when flattening data is too expensive (another join question)](https://discuss.elastic.co/t/what-to-do-when-flattening-data-is-too-expensive-another-join-question/363743)
**Author:** [@Ian\_Simpson](https://discuss.elastic.co/u/Ian_Simpson)\ **Replies:** 0\ **Last updated:** [July 24, 2024, 8:10pm UTC](https://discuss.elastic.co/t/what-to-do-when-flattening-data-is-too-expensive-another-join-question/363743 "2024-07-24T20:10:14Z")
We are in the process of brainstorming ways to redesign some of our indices. We have a 3-tier data structure that looks something like this: Root Entity (light text meta-data with some dates) |- File Attachments (large … --- ## [Search multiple documents](https://discuss.elastic.co/t/search-multiple-documents/363655)
**Author:** [@raymondtam](https://discuss.elastic.co/u/raymondtam)\ **Replies:** 1\ **Last updated:** [July 24, 2024, 8:10pm UTC](https://discuss.elastic.co/t/search-multiple-documents/363655 "2024-07-24T20:10:50Z")
I have 2 indexes - People and Vehicles. Index "People" has a field "IsVisible" while index "Vehicles" does not have this property. Now I want to search "Raymond" on these 2 indexes. However, the search only happens on "… --- ## [Upsert large amount of documents based on the property value](https://discuss.elastic.co/t/upsert-large-amount-of-documents-based-on-the-property-value/362494)
**Author:** [@CTO\_Servefast](https://discuss.elastic.co/u/CTO_Servefast)\ **Replies:** 10\ **Last updated:** [July 24, 2024, 7:52pm UTC](https://discuss.elastic.co/t/upsert-large-amount-of-documents-based-on-the-property-value/362494 "2024-07-24T19:52:19Z")
Is it possible to use Bulk API to upsert large number of documents 100, 1000 ... but i want them to be inserted based on a query for example based on my userId property Use case for this is that we need to handle thousa… --- ## [Advanced Sync Rule Query skip due Table not having primary key](https://discuss.elastic.co/t/advanced-sync-rule-query-skip-due-table-not-having-primary-key/363731)
**Author:** [@sebaV\_20](https://discuss.elastic.co/u/sebaV_20)\ **Replies:** 0\ **Last updated:** [July 24, 2024, 4:40pm UTC](https://discuss.elastic.co/t/advanced-sync-rule-query-skip-due-table-not-having-primary-key/363731 "2024-07-24T16:40:59Z")
Hello ! Basically what the title says. I have everything working fine, i can ingest data and all with big queries and JOINS. The "issue" i'm having is with a particular table that i need to use in one of my queries. Th… --- ## [New Index with latest timestamp](https://discuss.elastic.co/t/new-index-with-latest-timestamp/363573)
**Author:** [@Ankita\_Pachauri](https://discuss.elastic.co/u/Ankita_Pachauri)\ **Replies:** 2\ **Last updated:** [July 24, 2024, 2:37pm UTC](https://discuss.elastic.co/t/new-index-with-latest-timestamp/363573 "2024-07-24T14:37:01Z")
Hi All, I have an index that contains time series data, essentially the status of different servers. I want to create another index from this index which should always have the latest value of data present by timestamp,… --- ## [Elastic Usage Disk Filtered By Date](https://discuss.elastic.co/t/elastic-usage-disk-filtered-by-date/363668)
**Author:** [@zerratriani](https://discuss.elastic.co/u/zerratriani)\ **Replies:** 1\ **Last updated:** [July 24, 2024, 2:25pm UTC](https://discuss.elastic.co/t/elastic-usage-disk-filtered-by-date/363668 "2024-07-24T14:25:55Z")
I have an Elasticsearch cluster and want to know the memory usage of all indices over the past 3 months. This way, I can request additional resources using accurate data. I am using the command /\_cat/indices?v, which pr… --- ## [Cannot create an enrollment token to enrol a new elasticsearch node](https://discuss.elastic.co/t/cannot-create-an-enrollment-token-to-enrol-a-new-elasticsearch-node/363697)
**Author:** [@adrian.cunnelly](https://discuss.elastic.co/u/adrian.cunnelly)\ **Replies:** 1\ **Last updated:** [July 24, 2024, 12:50pm UTC](https://discuss.elastic.co/t/cannot-create-an-enrollment-token-to-enrol-a-new-elasticsearch-node/363697 "2024-07-24T12:50:34Z")
I have an elasticsearch 8.14 cluster running with 5 nodes with security enabled using own generated certificates. Everything is running fine but I now need to add 2 ingest only nodes. I am trying to create the enrollme… --- ## [Automatic Index Creation](https://discuss.elastic.co/t/automatic-index-creation/361788)
**Author:** [@Debasis\_Mallick](https://discuss.elastic.co/u/Debasis_Mallick)\ **Replies:** 66\ **Last updated:** [July 24, 2024, 12:47pm UTC](https://discuss.elastic.co/t/automatic-index-creation/361788 "2024-07-24T12:47:44Z")
Hi Team, We had a requirement to create an index automatically by reading the content of the CSV files. Within the CSV files, there is a field named "timestamp" where data is received in epoch format. The objective is t… --- ## [Pinned query not good with KNN search](https://discuss.elastic.co/t/pinned-query-not-good-with-knn-search/358210)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 6\ **Last updated:** [July 24, 2024, 12:09pm UTC](https://discuss.elastic.co/t/pinned-query-not-good-with-knn-search/358210 "2024-07-24T12:09:24Z")
Hi, When using a normal knn query this works: "knn": \[ { "inner\_hits": { "\_source": false, "fields": \[ "passages.text" \] }, "field": "passages.vector.predicted\_value", "k":… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=90) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=92)