# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=126 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 127 --- ## [502 Timeout with Delete by query](https://discuss.elastic.co/t/502-timeout-with-delete-by-query/357053)
**Author:** [@Musled](https://discuss.elastic.co/u/Musled)\ **Replies:** 7\ **Last updated:** [April 9, 2024, 2:43pm UTC](https://discuss.elastic.co/t/502-timeout-with-delete-by-query/357053 "2024-04-09T14:43:15Z")
Hello there ! I have a problem when I run this query: \`POST /logs-nginx.cpcu.prod/\_delete\_by\_query { "query": { "range": { "@timestamp": { "lt": "now-30d" } } } } Basically I w… --- ## [Elasticsearch POST API call gives 401 unauthorized](https://discuss.elastic.co/t/elasticsearch-post-api-call-gives-401-unauthorized/356786)
**Author:** [@ashutos](https://discuss.elastic.co/u/ashutos)\ **Replies:** 11\ **Last updated:** [April 9, 2024, 2:14pm UTC](https://discuss.elastic.co/t/elasticsearch-post-api-call-gives-401-unauthorized/356786 "2024-04-09T14:14:00Z")
Hello, We are using ELasticsearch 6.8 version and have enabled https for same. Accessing the URL is fine and it is also able to communicate with Kibana. However we are trying to send some data using POST method to elas… --- ## [Elasticsearch shards current usage](https://discuss.elastic.co/t/elasticsearch-shards-current-usage/357027)
**Author:** [@Ashwin\_Subramanian](https://discuss.elastic.co/u/Ashwin_Subramanian)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 6:13am UTC](https://discuss.elastic.co/t/elasticsearch-shards-current-usage/357027 "2024-04-09T06:13:41Z")
Hi team, My customer is using Cortex XSOAR with ES. From the UI under ES monitoring, they notice Elasticsearch shard's current usage is 100%. Is it okay to have 100%. Why the shards' current usage is 100% Kindly someon… --- ## [Conditional boosting of results based on the # of conditions that are true](https://discuss.elastic.co/t/conditional-boosting-of-results-based-on-the-of-conditions-that-are-true/357022)
**Author:** [@pekadad](https://discuss.elastic.co/u/pekadad)\ **Replies:** 0\ **Last updated:** [April 8, 2024, 10:27pm UTC](https://discuss.elastic.co/t/conditional-boosting-of-results-based-on-the-of-conditions-that-are-true/357022 "2024-04-08T22:27:45Z")
I am trying to determine if it is feasible to include boosting of results based on a number of conditions that might or might not be true for each result. We have implemented some boosting using a function\_score clause … --- ## [Web Crawler API](https://discuss.elastic.co/t/web-crawler-api/355608)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 1\ **Last updated:** [April 9, 2024, 12:30pm UTC](https://discuss.elastic.co/t/web-crawler-api/355608 "2024-04-09T12:30:54Z")
Hi, I got a couple of questions regarding the Web Crawlers API's (App Search's crawler & Elastic Web Crawler): Why does the more powerful web crawler (Elastic Web Crawler) not have an API while the App Search crawler… --- ## [How to avoid incomplete garbage collection by G1GC causing high cpu usage on Elasticsearch nodes?](https://discuss.elastic.co/t/how-to-avoid-incomplete-garbage-collection-by-g1gc-causing-high-cpu-usage-on-elasticsearch-nodes/357032)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 6\ **Last updated:** [April 9, 2024, 12:30pm UTC](https://discuss.elastic.co/t/how-to-avoid-incomplete-garbage-collection-by-g1gc-causing-high-cpu-usage-on-elasticsearch-nodes/357032 "2024-04-09T12:30:05Z")
This was an issue I encountered before: I asked the same question on another forum, and someone replied as follows: In the ThreadLocal's ThreadLocalMap, there is a table. Excessive usage can result in most Entry eleme… --- ## [Difference Vector search & Semantic Search](https://discuss.elastic.co/t/difference-vector-search-semantic-search/356969)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 2\ **Last updated:** [April 9, 2024, 12:12pm UTC](https://discuss.elastic.co/t/difference-vector-search-semantic-search/356969 "2024-04-09T12:12:16Z")
Hello, From what can be seen on the Subscription page it seems that Vector Search & Semantic Search are different. Vector Search IS included in the free/basic tier, whereas Semantic Search IS NOT included in the free/b… --- ## [Problem elastic "document\_parsing\_exception" type field](https://discuss.elastic.co/t/problem-elastic-document-parsing-exception-type-field/356690)
**Author:** [@San9](https://discuss.elastic.co/u/San9)\ **Replies:** 14\ **Last updated:** [April 9, 2024, 12:09pm UTC](https://discuss.elastic.co/t/problem-elastic-document-parsing-exception-type-field/356690 "2024-04-09T12:09:12Z")
Hello, I have encountered a common problem that many Elastic users face, but I have not yet found an answer to it and I do not understand how to solve it so that I do not lose messages that are sent by Elastic. I use fi… --- ## [Socket exception with connection reset on Elasticsearch Webhook to Microsoft Teams](https://discuss.elastic.co/t/socket-exception-with-connection-reset-on-elasticsearch-webhook-to-microsoft-teams/357051)
**Author:** [@Dragan\_Fazekas](https://discuss.elastic.co/u/Dragan_Fazekas)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 9:56am UTC](https://discuss.elastic.co/t/socket-exception-with-connection-reset-on-elasticsearch-webhook-to-microsoft-teams/357051 "2024-04-09T09:56:16Z")
I'm seeking assistance regarding an issue I'm encountering with an Elasticsearch watcher webhooks action specifically the "TeamsPost". The problem occurs when my application attempts to send a webhook to Microsoft Teams … --- ## [Search query failed within the elasticsearch cluster](https://discuss.elastic.co/t/search-query-failed-within-the-elasticsearch-cluster/357044)
**Author:** [@wite](https://discuss.elastic.co/u/wite)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 9:34am UTC](https://discuss.elastic.co/t/search-query-failed-within-the-elasticsearch-cluster/357044 "2024-04-09T09:34:22Z")
Hello, I had my elastic instance running fine in my security onion deployment but for some reason am getting the "search query failure within the elasticsearch cluster" and when i check GET /\_cat/health?v on the dev cons… --- ## [Multi index search, with kNN on one index](https://discuss.elastic.co/t/multi-index-search-with-knn-on-one-index/357040)
**Author:** [@Nick\_Dart](https://discuss.elastic.co/u/Nick_Dart)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 8:31am UTC](https://discuss.elastic.co/t/multi-index-search-with-knn-on-one-index/357040 "2024-04-09T08:31:26Z")
I have two indices, one with users and one with user posts. I want to search both indices simultaneously, and rank them. As part of this search, i want to do a kNN search as well as a standard text search. However, the k… --- ## [Even when async translog is enabled, can having replicas greater than or equal to 1 ensure that data is not lost?](https://discuss.elastic.co/t/even-when-async-translog-is-enabled-can-having-replicas-greater-than-or-equal-to-1-ensure-that-data-is-not-lost/356973)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 3\ **Last updated:** [April 9, 2024, 8:25am UTC](https://discuss.elastic.co/t/even-when-async-translog-is-enabled-can-having-replicas-greater-than-or-equal-to-1-ensure-that-data-is-not-lost/356973 "2024-04-09T08:25:37Z")
My understanding is as follows: User requests are first sent to the primary shard, then synchronized to all replica shards. After all shards complete the write operation, Elasticsearch returns success to the user. If a… --- ## [Elasticsearch 8.5.2 SLM Exclude index and datastream does not work](https://discuss.elastic.co/t/elasticsearch-8-5-2-slm-exclude-index-and-datastream-does-not-work/357029)
**Author:** [@Gautier\_Franchini](https://discuss.elastic.co/u/Gautier_Franchini)\ **Replies:** 3\ **Last updated:** [April 9, 2024, 8:09am UTC](https://discuss.elastic.co/t/elasticsearch-8-5-2-slm-exclude-index-and-datastream-does-not-work/357029 "2024-04-09T08:09:01Z")
Dear community members, using SLM policy I would like to exclue some indices and datastream from y daily backup; using the policy below doesn't gives me any ERROR ; but it's NOT applied as expected; Because doing a 'GET … --- ## [TRACE Logs](https://discuss.elastic.co/t/trace-logs/357036)
**Author:** [@Abhishek\_Sinha](https://discuss.elastic.co/u/Abhishek_Sinha)\ **Replies:** 0\ **Last updated:** [April 9, 2024, 7:03am UTC](https://discuss.elastic.co/t/trace-logs/357036 "2024-04-09T07:03:48Z")
@dadoonet Getting the trace logs every time I hit any request internally inside my project. The issue came when I added solr dependency in my project : 'org.apache.solr', name: 'solr-solrj', version: '9.4.1' These are… --- ## [Vector Search in ElasticSearch + Filtering using other fields](https://discuss.elastic.co/t/vector-search-in-elasticsearch-filtering-using-other-fields/356032)
**Author:** [@anuj99](https://discuss.elastic.co/u/anuj99)\ **Replies:** 3\ **Last updated:** [April 9, 2024, 6:41am UTC](https://discuss.elastic.co/t/vector-search-in-elasticsearch-filtering-using-other-fields/356032 "2024-04-09T06:41:54Z")
Following is the use case: I am storing vectors and meta data for a document in a single index. However, if there is any change in the vector, I also need to fetch the meta data and then update the document in the index… --- ## [Using rally with a managed elastic deployment](https://discuss.elastic.co/t/using-rally-with-a-managed-elastic-deployment/356012)
**Author:** [@cvarano](https://discuss.elastic.co/u/cvarano)\ **Replies:** 2\ **Last updated:** [April 8, 2024, 9:29pm UTC](https://discuss.elastic.co/t/using-rally-with-a-managed-elastic-deployment/356012 "2024-04-08T21:29:42Z")
We have a deployment in Elastic cloud running Elasticsearch, but I don't see in the Rally docs how to point to or auth Elastic-managed deployments; I only see local ES setup and ES Serverless setup. Any guidance appreci… --- ## [What is an easy way to convert an index to an alias that gets rolled over by ILM?](https://discuss.elastic.co/t/what-is-an-easy-way-to-convert-an-index-to-an-alias-that-gets-rolled-over-by-ilm/356926)
**Author:** [@jerrac](https://discuss.elastic.co/u/jerrac)\ **Replies:** 2\ **Last updated:** [April 8, 2024, 5:39pm UTC](https://discuss.elastic.co/t/what-is-an-easy-way-to-convert-an-index-to-an-alias-that-gets-rolled-over-by-ilm/356926 "2024-04-08T17:39:39Z")
So, during maintenance Friday evening I found that one of my indexes is well over 300-400GB in size and is using up most of my disk space. I had messed up the configuration of the index/alias I have Filebeat pointed at.… --- ## [Aggregation that includes non-matching items](https://discuss.elastic.co/t/aggregation-that-includes-non-matching-items/356986)
**Author:** [@mschoettl](https://discuss.elastic.co/u/mschoettl)\ **Replies:** 0\ **Last updated:** [April 8, 2024, 3:02pm UTC](https://discuss.elastic.co/t/aggregation-that-includes-non-matching-items/356986 "2024-04-08T15:02:06Z")
Hi, we use Elasticsearch to drive an ecommerce shop. The index consists of products, let's assume there are 100 products there is a field called "color". 50 products have the color red and 50 products have the color blu… --- ## [Can interleaved distribution of index shards prevent high load on one index from affecting other indexes?](https://discuss.elastic.co/t/can-interleaved-distribution-of-index-shards-prevent-high-load-on-one-index-from-affecting-other-indexes/356978)
**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\ **Replies:** 0\ **Last updated:** [April 8, 2024, 1:44pm UTC](https://discuss.elastic.co/t/can-interleaved-distribution-of-index-shards-prevent-high-load-on-one-index-from-affecting-other-indexes/356978 "2024-04-08T13:44:46Z")
Suppose I have three nodes A, B, C and three indexes index1, index2, index3, each with one primary shard and one replica shard. If I distribute the shards as follows: A index1,index2 B index2,index3 C index3,index1 I… --- ## [How can I use ILM with elasticsearch-oss:7.9.3?](https://discuss.elastic.co/t/how-can-i-use-ilm-with-elasticsearch-oss-7-9-3/356829)
**Author:** [@inguemom76](https://discuss.elastic.co/u/inguemom76)\ **Replies:** 3\ **Last updated:** [April 8, 2024, 11:53am UTC](https://discuss.elastic.co/t/how-can-i-use-ilm-with-elasticsearch-oss-7-9-3/356829 "2024-04-08T11:53:32Z")
Hello Team, I am using elasticsearch-oss:7.9.3. But I want to add ILM policy for delete policy but \_idm index is not found in DB so push command is failed. I just wanted to know, If I wanted to use idm policy in ELK… --- ## [Debugging in Elastic Search](https://discuss.elastic.co/t/debugging-in-elastic-search/356651)
**Author:** [@ShubhamSaxena8](https://discuss.elastic.co/u/ShubhamSaxena8)\ **Replies:** 12\ **Last updated:** [April 8, 2024, 10:51am UTC](https://discuss.elastic.co/t/debugging-in-elastic-search/356651 "2024-04-08T10:51:23Z")
Hello Team, I need some suggestion related to debugging in Elasticsearch. I am kind of stuck because I am not getting any errors in Elastic console or dotnet console. I am trying to implement centralized logging system… --- ## [Request to extract metadata fields in the self-hosted content extraction service](https://discuss.elastic.co/t/request-to-extract-metadata-fields-in-the-self-hosted-content-extraction-service/354131)
**Author:** [@jan.stap](https://discuss.elastic.co/u/jan.stap)\ **Replies:** 7\ **Last updated:** [April 8, 2024, 9:29am UTC](https://discuss.elastic.co/t/request-to-extract-metadata-fields-in-the-self-hosted-content-extraction-service/354131 "2024-04-08T09:29:24Z")
Hi, I'm using the self-hosted content extraction service to be able to ingest office documents larger than 10 MBytes via the Elastic S3 connector, which we need for a client project. I notice that only the document con… --- ## [Best multilingual ML model for semantic search?](https://discuss.elastic.co/t/best-multilingual-ml-model-for-semantic-search/356667)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 2\ **Last updated:** [April 8, 2024, 8:30am UTC](https://discuss.elastic.co/t/best-multilingual-ml-model-for-semantic-search/356667 "2024-04-08T08:30:19Z")
Hello! As the title said I am looking for the best ML models to use for semantic search. I was wondering what models everyone here recommends. The models need to be multilingual! I wrote this post because this seems to… --- ## [Need nodejs listener/Observer to detect new document in the index](https://discuss.elastic.co/t/need-nodejs-listener-observer-to-detect-new-document-in-the-index/356940)
**Author:** [@brijeshp.sdei](https://discuss.elastic.co/u/brijeshp.sdei)\ **Replies:** 3\ **Last updated:** [April 8, 2024, 6:24am UTC](https://discuss.elastic.co/t/need-nodejs-listener-observer-to-detect-new-document-in-the-index/356940 "2024-04-08T06:24:08Z")
Please help me to detect addition of new document in the elasticsearch (@elastic/elasticsearch nodejs plugin) (from logstash) and have to trigger javascript function --- ## [Reindex remote cluster connection timeout](https://discuss.elastic.co/t/reindex-remote-cluster-connection-timeout/356922)
**Author:** [@neoaddix](https://discuss.elastic.co/u/neoaddix)\ **Replies:** 4\ **Last updated:** [April 8, 2024, 6:19am UTC](https://discuss.elastic.co/t/reindex-remote-cluster-connection-timeout/356922 "2024-04-08T06:19:02Z")
I'm trying to reindex an index from a remote cluster POST \_reindex?wait\_for\_completion=false { "source": { "remote": { "host": "https://remote-cluster.eu-west-1.aws.found.io:9200", "username": "xxx", … --- ## [Can the java High Level REST client use a socks5 proxy?](https://discuss.elastic.co/t/can-the-java-high-level-rest-client-use-a-socks5-proxy/356910)
**Author:** [@Jamshid](https://discuss.elastic.co/u/Jamshid)\ **Replies:** 1\ **Last updated:** [April 7, 2024, 10:48am UTC](https://discuss.elastic.co/t/can-the-java-high-level-rest-client-use-a-socks5-proxy/356910 "2024-04-07T10:48:51Z")
Can the (deprecated) java HLRC be made to use a socks5 proxy? I'm trying to make a java app talk to elasticsearch and other containers running in a private network via their internal, not published, ports. I'm running th… --- ## [What happens stemming-wise in this situation?](https://discuss.elastic.co/t/what-happens-stemming-wise-in-this-situation/356908)
**Author:** [@mrodent](https://discuss.elastic.co/u/mrodent)\ **Replies:** 0\ **Last updated:** [April 6, 2024, 5:42pm UTC](https://discuss.elastic.co/t/what-happens-stemming-wise-in-this-situation/356908 "2024-04-06T17:42:52Z")
I have implemented a simple module where .docx (Word) files in a directory tree are parsed and each one split into multiple (overlapping) 10-line "Lucene documents", and entered into an index using the \_bulk endpoint ...… --- ## [Use ilm for rollup indices](https://discuss.elastic.co/t/use-ilm-for-rollup-indices/356904)
**Author:** [@lstoneir](https://discuss.elastic.co/u/lstoneir)\ **Replies:** 0\ **Last updated:** [April 6, 2024, 12:38pm UTC](https://discuss.elastic.co/t/use-ilm-for-rollup-indices/356904 "2024-04-06T12:38:04Z")
Hi everybody, Is there any way to use ilm in rollup indices !? --- ## [Elasticsearch index placement on specific nodes](https://discuss.elastic.co/t/elasticsearch-index-placement-on-specific-nodes/356875)
**Author:** [@jaykb77](https://discuss.elastic.co/u/jaykb77)\ **Replies:** 4\ **Last updated:** [April 6, 2024, 8:54am UTC](https://discuss.elastic.co/t/elasticsearch-index-placement-on-specific-nodes/356875 "2024-04-06T08:54:41Z")
Hi all, I know that we can set 'cluster.routing.allocation.awareness.attributes' to route shards and replicas based on this configuration. However, I need a configuration where indices created with a specific template, … --- ## [Elasticsearch high CPU usage due to one index and replica doesnt help](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-due-to-one-index-and-replica-doesnt-help/356899)
**Author:** [@jaykb77](https://discuss.elastic.co/u/jaykb77)\ **Replies:** 3\ **Last updated:** [April 6, 2024, 8:50am UTC](https://discuss.elastic.co/t/elasticsearch-high-cpu-usage-due-to-one-index-and-replica-doesnt-help/356899 "2024-04-06T08:50:35Z")
Hi all, We have an ES cluster spanning different cloud regions, say region1 and region2. We have below configuration on elasticsearch.yml (this one for region1 machines) so an index with 1p:1r will have a either a prima… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=125) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=127)