# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=322 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 323 --- ## [Security in elasticsearch](https://discuss.elastic.co/t/security-in-elasticsearch/322119)
**Author:** [@alex\_96](https://discuss.elastic.co/u/alex_96)\ **Replies:** 4\ **Last updated:** [December 29, 2022, 3:58pm UTC](https://discuss.elastic.co/t/security-in-elasticsearch/322119 "2022-12-29T15:58:27Z")
Hello everyone, such a question, I recently set up elasticsearch 7.17, when I created certificates, I caught myself thinking that I didn’t fully understand the meaning, I hope you can help me. as I understand it, there… --- ## [Ingest-attachment not found](https://discuss.elastic.co/t/ingest-attachment-not-found/322150)
**Author:** [@WhatCouldGoWrong](https://discuss.elastic.co/u/WhatCouldGoWrong)\ **Replies:** 7\ **Last updated:** [December 29, 2022, 2:53pm UTC](https://discuss.elastic.co/t/ingest-attachment-not-found/322150 "2022-12-29T14:53:08Z")
Hi, I'm trying to install the ingest-attachment (using elasticsearch-plugin install ingest-attachment). I'm behind a proxy, so I use this line: sudo CLI\_JAVA\_OPTS="-Dhttp.proxyHost=192.168.0.1 -Dhttp.proxyPort=8080 -D… --- ## [Elasticsearch ingest large of data](https://discuss.elastic.co/t/elasticsearch-ingest-large-of-data/322099)
**Author:** [@m3bgwad](https://discuss.elastic.co/u/m3bgwad)\ **Replies:** 5\ **Last updated:** [December 29, 2022, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-ingest-large-of-data/322099 "2022-12-29T13:24:47Z")
is there capability of Elasticsearch to ingest amount large of data at a rate of 300TB in the year after that archive data in offline storage? what is challenges facing me to ingest that much volume? --- ## [Index created via python not seen in UI and vice-versa](https://discuss.elastic.co/t/index-created-via-python-not-seen-in-ui-and-vice-versa/321923)
**Author:** [@nikhilkvn](https://discuss.elastic.co/u/nikhilkvn)\ **Replies:** 1\ **Last updated:** [December 29, 2022, 1:14pm UTC](https://discuss.elastic.co/t/index-created-via-python-not-seen-in-ui-and-vice-versa/321923 "2022-12-29T13:14:07Z")
This is weird. Index created via Dev-Console is not seen in the Python-client. Index created via Python-client is not seen on Dev-Console. Both ways I am able to write/Read data. But have to choose only one way I am … --- ## [Recurring index corruption](https://discuss.elastic.co/t/recurring-index-corruption/322144)
**Author:** [@Sebastiano](https://discuss.elastic.co/u/Sebastiano)\ **Replies:** 11\ **Last updated:** [December 29, 2022, 1:07pm UTC](https://discuss.elastic.co/t/recurring-index-corruption/322144 "2022-12-29T13:07:27Z")
Hi, we are experimenting setting up an ELK cluster using Azure Container Instances. We successfully setup the cluster and we started using it to push log entries, generated by our distributed system, using and Azure Ev… --- ## [How to configure ILM hot phase, when cluster has only warm nodes](https://discuss.elastic.co/t/how-to-configure-ilm-hot-phase-when-cluster-has-only-warm-nodes/322118)
**Author:** [@hiruni.insyncit.net](https://discuss.elastic.co/u/hiruni.insyncit.net)\ **Replies:** 3\ **Last updated:** [December 28, 2022, 8:16pm UTC](https://discuss.elastic.co/t/how-to-configure-ilm-hot-phase-when-cluster-has-only-warm-nodes/322118 "2022-12-28T20:16:34Z")
Hi, Elasticsearch version: 8.1.2 It has 4 warm nodes(no hot nodes). I want to configure ILM policy in this cluster. So, how can configure hot-warm ILM policy in Elastic cluster which has only warm node. Thank you...… --- ## [Cluster yellow b/c .security-7 index in unassigned state](https://discuss.elastic.co/t/cluster-yellow-b-c-security-7-index-in-unassigned-state/322112)
**Author:** [@Dimitry\_Feigin](https://discuss.elastic.co/u/Dimitry_Feigin)\ **Replies:** 2\ **Last updated:** [December 28, 2022, 7:06pm UTC](https://discuss.elastic.co/t/cluster-yellow-b-c-security-7-index-in-unassigned-state/322112 "2022-12-28T19:06:53Z")
We started the upgrade of the cluster that was in green state. The upgrade (through ansible) failed on node1 while it was not able to download rpm. We found the issue and fixed. Now the cluster after restart w/o any actu… --- ## [API key: unable to find apikey with id](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id/322104)
**Author:** [@chaserb](https://discuss.elastic.co/u/chaserb)\ **Replies:** 2\ **Last updated:** [December 28, 2022, 5:20pm UTC](https://discuss.elastic.co/t/api-key-unable-to-find-apikey-with-id/322104 "2022-12-28T17:20:26Z")
I appear to be having the same issue that @inbox.ex was having here, in that I'm receiving 401 when interacting with the Elastcisearch endpoint. According to this doc, I've created an API key for my deployment, and now I… --- ## [Restored from snapshoots 2 master nodes but several indecies are in unassigned state](https://discuss.elastic.co/t/restored-from-snapshoots-2-master-nodes-but-several-indecies-are-in-unassigned-state/322113)
**Author:** [@Dimitry\_Feigin](https://discuss.elastic.co/u/Dimitry_Feigin)\ **Replies:** 3\ **Last updated:** [December 28, 2022, 4:57pm UTC](https://discuss.elastic.co/t/restored-from-snapshoots-2-master-nodes-but-several-indecies-are-in-unassigned-state/322113 "2022-12-28T16:57:03Z")
We had 3 node cluster where all nodes were masters. We accidently deleted 2 master nodes. We restore them from snapshots. However we have several indecies in unassign state:| externalkeyhandler-000005 4 p START… --- ## [Has anyone worked with Language Analyzers, Arabic analyzer in specific?](https://discuss.elastic.co/t/has-anyone-worked-with-language-analyzers-arabic-analyzer-in-specific/316611)
**Author:** [@Hassan\_Abbas](https://discuss.elastic.co/u/Hassan_Abbas)\ **Replies:** 1\ **Last updated:** [December 28, 2022, 3:41pm UTC](https://discuss.elastic.co/t/has-anyone-worked-with-language-analyzers-arabic-analyzer-in-specific/316611 "2022-12-28T15:41:37Z")
I'm finding difficulties implementing the analyzer on a certain field that will be used in a search function for an Arabic news platform --- ## [(413) Request Entity Too Large Error In Filebeat Logs](https://discuss.elastic.co/t/413-request-entity-too-large-error-in-filebeat-logs/322108)
**Author:** [@vijaykumar](https://discuss.elastic.co/u/vijaykumar)\ **Replies:** 0\ **Last updated:** [December 28, 2022, 3:32pm UTC](https://discuss.elastic.co/t/413-request-entity-too-large-error-in-filebeat-logs/322108 "2022-12-28T15:32:42Z")
I setup EFK Stack Using Helm Chart and versions of Elasticsearch Kibana and filebeat are 7.17.3 Helm Chart Link: Used default values.yaml file across all three components Installation is successful Filebeat indexe… --- ## [JVM heap recommendations on k8s cluster](https://discuss.elastic.co/t/jvm-heap-recommendations-on-k8s-cluster/322017)
**Author:** [@vangap](https://discuss.elastic.co/u/vangap)\ **Replies:** 5\ **Last updated:** [December 28, 2022, 3:02pm UTC](https://discuss.elastic.co/t/jvm-heap-recommendations-on-k8s-cluster/322017 "2022-12-28T15:02:05Z")
Hi, I would like to know what is the recommendation about the heap size when operating ES nodes in a k8s cluster. I have referred this and it is not fully clear what is the recommendation. Manage compute resources | Ela… --- ## [Sql where condition with case is not converting to bool query](https://discuss.elastic.co/t/sql-where-condition-with-case-is-not-converting-to-bool-query/322071)
**Author:** [@Alok.Singh](https://discuss.elastic.co/u/Alok.Singh)\ **Replies:** 0\ **Last updated:** [December 28, 2022, 6:47am UTC](https://discuss.elastic.co/t/sql-where-condition-with-case-is-not-converting-to-bool-query/322071 "2022-12-28T06:47:49Z")
Hello @elastic I have a view called V1, I want to filter data based on role. If role is 1 or 2 then role can see all record else for other role they can see only those record which is assign to them. sql query: select… --- ## [API intgrations](https://discuss.elastic.co/t/api-intgrations/321627)
**Author:** [@m3bgwad](https://discuss.elastic.co/u/m3bgwad)\ **Replies:** 4\ **Last updated:** [December 28, 2022, 1:08pm UTC](https://discuss.elastic.co/t/api-intgrations/321627 "2022-12-28T13:08:46Z")
hello everyone, What is the best way to exploit Elasticsearch RESTful API to integrate with other services can supported APIs? --- ## [How to add an analyzer that can remove duplicate tokens from the analyzed field?](https://discuss.elastic.co/t/how-to-add-an-analyzer-that-can-remove-duplicate-tokens-from-the-analyzed-field/322098)
**Author:** [@hemangr8](https://discuss.elastic.co/u/hemangr8)\ **Replies:** 0\ **Last updated:** [December 28, 2022, 12:45pm UTC](https://discuss.elastic.co/t/how-to-add-an-analyzer-that-can-remove-duplicate-tokens-from-the-analyzed-field/322098 "2022-12-28T12:45:00Z")
I want to add a token filter in my custom analyzer to remove duplicate tokens in the text field while matching. Eg: Input: "random petrol pump, beside random2 petrol pump" After analyzer: \["random", "petrol", "pump", "… --- ## [ElasticS Billing API](https://discuss.elastic.co/t/elastics-billing-api/321385)
**Author:** [@bh03](https://discuss.elastic.co/u/bh03)\ **Replies:** 1\ **Last updated:** [December 28, 2022, 10:43am UTC](https://discuss.elastic.co/t/elastics-billing-api/321385 "2022-12-28T10:43:59Z")
Hi all, Currently, i am trying to fetch the billing details of my organization using the below API call curl -XGET https://api.elastic-cloud.com/api/v1/billing/costs/{organization\_id} \\ -H "Authorization: ApiKey $EC\_AP… --- ## [Do I need track\_total\_hits for reindex java api command?](https://discuss.elastic.co/t/do-i-need-track-total-hits-for-reindex-java-api-command/322058)
**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\ **Replies:** 1\ **Last updated:** [December 28, 2022, 8:36am UTC](https://discuss.elastic.co/t/do-i-need-track-total-hits-for-reindex-java-api-command/322058 "2022-12-28T08:36:20Z")
The title says it all. I have a query for time range within the reindex command. Just wondering if "track\_total\_hits" is necessary. My doc size will be in the millions. --- ## [Questions about terms aggregations and too many buckets exception](https://discuss.elastic.co/t/questions-about-terms-aggregations-and-too-many-buckets-exception/322060)
**Author:** [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Replies:** 0\ **Last updated:** [December 28, 2022, 12:35am UTC](https://discuss.elastic.co/t/questions-about-terms-aggregations-and-too-many-buckets-exception/322060 "2022-12-28T00:35:25Z")
A question about internals, so hopefully I can get some response regarding some vague questions. :slight\_smile: Do not actually have access to the cluster to test out hypothesis. First of all, according to the docs "… --- ## [Unable to Parse response body for response bla... bla... from TicketService(module) in Java Spring Data Elasticsearch](https://discuss.elastic.co/t/unable-to-parse-response-body-for-response-bla-bla-from-ticketservice-module-in-java-spring-data-elasticsearch/322052)
**Author:** [@Davut](https://discuss.elastic.co/u/Davut)\ **Replies:** 0\ **Last updated:** [December 27, 2022, 7:12pm UTC](https://discuss.elastic.co/t/unable-to-parse-response-body-for-response-bla-bla-from-ticketservice-module-in-java-spring-data-elasticsearch/322052 "2022-12-27T19:12:54Z")
I m take same error. I have account-service,ticket-service,notification-service,eureka-service.(Java spring cloud microservice app) Ticket-service is using elasticsearch. Ticket-service database is mysql 8.0.31 on docker… --- ## [ALLOCATION\_FAILED while draining nodes](https://discuss.elastic.co/t/allocation-failed-while-draining-nodes/322048)
**Author:** [@Reg\_Dancy](https://discuss.elastic.co/u/Reg_Dancy)\ **Replies:** 0\ **Last updated:** [December 27, 2022, 6:24pm UTC](https://discuss.elastic.co/t/allocation-failed-while-draining-nodes/322048 "2022-12-27T18:24:07Z")
Hello all, I was draining each node in my cluster one at a time. All of a sudden the draining paused. I received the error below: $ curl -s -H 'content-type: application/json' -XGET http://localhost:9200/\_cluster/alloca… --- ## [Hot nodes are having high cpu usage](https://discuss.elastic.co/t/hot-nodes-are-having-high-cpu-usage/322046)
**Author:** [@vamsi2](https://discuss.elastic.co/u/vamsi2)\ **Replies:** 1\ **Last updated:** [December 27, 2022, 6:10pm UTC](https://discuss.elastic.co/t/hot-nodes-are-having-high-cpu-usage/322046 "2022-12-27T18:10:13Z")
Hello, Currently I'm having three hot nodes and all the three hot nodes are having high % of CPU usage which is around 80%-100%. So can I add dedicated coordinating and Ingest instance which will help me to solve this … --- ## [Compare current data with previous day's data based on time](https://discuss.elastic.co/t/compare-current-data-with-previous-days-data-based-on-time/320197)
**Author:** [@viveks](https://discuss.elastic.co/u/viveks)\ **Replies:** 1\ **Last updated:** [December 27, 2022, 5:49pm UTC](https://discuss.elastic.co/t/compare-current-data-with-previous-days-data-based-on-time/320197 "2022-12-27T17:49:05Z")
Hi, I have events that are generated throughout the day based on API processing. These events are available in Elastic and are generated throughout the day. I am trying to figure out a way to create an alert when the num… --- ## [Updating ES records : Ingestion lag and Search returns empty](https://discuss.elastic.co/t/updating-es-records-ingestion-lag-and-search-returns-empty/321167)
**Author:** [@VV1002](https://discuss.elastic.co/u/VV1002)\ **Replies:** 0\ **Last updated:** [December 13, 2022, 10:41pm UTC](https://discuss.elastic.co/t/updating-es-records-ingestion-lag-and-search-returns-empty/321167 "2022-12-13T22:41:45Z")
Hi ES team, We currently have a Nodejs import script running to process our XML,HTML files followed by ingestion to ES. The XML,HTML files are uploaded in S3 bucket and queued up in the SQS triggering the Lambda functio… --- ## [Anonymous access](https://discuss.elastic.co/t/anonymous-access/322033)
**Author:** [@Bhanuji\_paluri](https://discuss.elastic.co/u/Bhanuji_paluri)\ **Replies:** 1\ **Last updated:** [December 27, 2022, 3:59pm UTC](https://discuss.elastic.co/t/anonymous-access/322033 "2022-12-27T15:59:42Z")
Hi Team, User would like to change Elasticsearch config to allow anonymous to post data to our Elastic search. No other accesses like read or delete shall be given to anonymous. --- ## [Failed to setup automated snapshot with elastic operator](https://discuss.elastic.co/t/failed-to-setup-automated-snapshot-with-elastic-operator/322041)
**Author:** [@Mahmoud\_Yasser](https://discuss.elastic.co/u/Mahmoud_Yasser)\ **Replies:** 0\ **Last updated:** [December 27, 2022, 2:27pm UTC](https://discuss.elastic.co/t/failed-to-setup-automated-snapshot-with-elastic-operator/322041 "2022-12-27T14:27:33Z")
I'm launching 3 elastic nodes using elastic operator and i tried to set up automated snapshots for these instances. I used elastic operator 2.5.0 on Kubernetes version v1.23.11-gke.300 and used Elasticsearch version 8.5… --- ## [I have a issue: \[es/index\] failed: \[index\_not\_found\_exception\] no such index when I write data into datastream using java client 8.5.3](https://discuss.elastic.co/t/i-have-a-issue-es-index-failed-index-not-found-exception-no-such-index-when-i-write-data-into-datastream-using-java-client-8-5-3/322035)
**Author:** [@xuxiao415](https://discuss.elastic.co/u/xuxiao415)\ **Replies:** 0\ **Last updated:** [December 27, 2022, 11:38am UTC](https://discuss.elastic.co/t/i-have-a-issue-es-index-failed-index-not-found-exception-no-such-index-when-i-write-data-into-datastream-using-java-client-8-5-3/322035 "2022-12-27T11:38:53Z")
I have a es cluster with three data nodes. I create a data stream: myindex. when I write data into data stream using java client 8.5.3, I met a problem: co.elastic.clients.elasticsearch.\_types.ElasticsearchException: \[e… --- ## [Elastic search Reindex Count of Document not match](https://discuss.elastic.co/t/elastic-search-reindex-count-of-document-not-match/321898)
**Author:** [@Voon\_see\_hong](https://discuss.elastic.co/u/Voon_see_hong)\ **Replies:** 11\ **Last updated:** [December 27, 2022, 8:37am UTC](https://discuss.elastic.co/t/elastic-search-reindex-count-of-document-not-match/321898 "2022-12-27T08:37:00Z")
hi all, i face a weird situation here where i ran reindex POST \_reindex?wait\_for\_completion=false { "source": { "index": "stage-user" }, "conflicts": "proceed", "dest": {"index": "stage-user-test-v1", "op\_… --- ## [How to use multiple snapshot repository directory's](https://discuss.elastic.co/t/how-to-use-multiple-snapshot-repository-directorys/321991)
**Author:** [@Santhosh\_K](https://discuss.elastic.co/u/Santhosh_K)\ **Replies:** 2\ **Last updated:** [December 27, 2022, 5:26am UTC](https://discuss.elastic.co/t/how-to-use-multiple-snapshot-repository-directorys/321991 "2022-12-27T05:26:37Z")
Hi, I have to use multiple snapshot repositories, Does that support multiple directories, if so, how? I want to know how to put multiple snapshot repository directory's in elasticsearch.yml file. And what about singl… --- ## [Needs suggestion to execute painless script as part of HTTP filter plugin](https://discuss.elastic.co/t/needs-suggestion-to-execute-painless-script-as-part-of-http-filter-plugin/321981)
**Author:** [@rvadiga](https://discuss.elastic.co/u/rvadiga)\ **Replies:** 1\ **Last updated:** [December 27, 2022, 4:32am UTC](https://discuss.elastic.co/t/needs-suggestion-to-execute-painless-script-as-part-of-http-filter-plugin/321981 "2022-12-27T04:32:17Z")
Hello, I have a requirement to execute(via GET) a painless script to find a maximum value of a field in http logstash filter. I am getting parse error as the keyword 'max' is not understood by http filter. Do we have … --- ## [Matching documents with subset of queries in Percolation Index](https://discuss.elastic.co/t/matching-documents-with-subset-of-queries-in-percolation-index/322019)
**Author:** [@aneeshkoya](https://discuss.elastic.co/u/aneeshkoya)\ **Replies:** 0\ **Last updated:** [December 27, 2022, 3:41am UTC](https://discuss.elastic.co/t/matching-documents-with-subset-of-queries-in-percolation-index/322019 "2022-12-27T03:41:12Z")
Each individual document is matched against all the queries stored in the associated percolation index. This can affect the performance of the percolate queries where documents need to be matched with only a subset of qu… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=321) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=323)