# Latest **URL:** https://discuss.elastic.co/latest.md?page=722 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 723 --- ## [During scale in of logstash through HPA data remains in the persistence queue](https://discuss.elastic.co/t/during-scale-in-of-logstash-through-hpa-data-remains-in-the-persistence-queue/329307)
**Author:** [@prashant1](https://discuss.elastic.co/u/prashant1)\ **Replies:** 0\ **Last updated:** [April 4, 2023, 10:42am UTC](https://discuss.elastic.co/t/during-scale-in-of-logstash-through-hpa-data-remains-in-the-persistence-queue/329307 "2023-04-04T10:42:31Z")
Problem Statement :- In our environment we are sending application logs from Fluentd to logstash where persistent queues are enabled. HPA is enabled on the logstash pod so when the load increases so logstash pods scale … --- ## [Elastic creating new Index on Bulk Api even though mapping is already provided](https://discuss.elastic.co/t/elastic-creating-new-index-on-bulk-api-even-though-mapping-is-already-provided/329294)
**Author:** [@suresh\_chaudhari](https://discuss.elastic.co/u/suresh_chaudhari)\ **Replies:** 5\ **Last updated:** [April 4, 2023, 10:39am UTC](https://discuss.elastic.co/t/elastic-creating-new-index-on-bulk-api-even-though-mapping-is-already-provided/329294 "2023-04-04T10:39:27Z")
Hi Community Members Using Elastic 8 with JAVA client.I first created template of mapping like below Index Name=A is created two in elastic 8 server instead of overwritingalready present mapping file { "settings": {… --- ## [Java API enforces specifying both min and max in extended bounds unlike RHLC](https://discuss.elastic.co/t/java-api-enforces-specifying-both-min-and-max-in-extended-bounds-unlike-rhlc/329202)
**Author:** [@awojcik64](https://discuss.elastic.co/u/awojcik64)\ **Replies:** 0\ **Last updated:** [April 3, 2023, 11:47am UTC](https://discuss.elastic.co/t/java-api-enforces-specifying-both-min-and-max-in-extended-bounds-unlike-rhlc/329202 "2023-04-03T11:47:20Z")
Hello, Edit: tested on dockerized Elasticsearch 7.17.7, 7.17.9, client version is 7.17.9 During migration to Java API client (from rest high level client) I've encountered an inconsistency regarding extended bounds in … --- ## [Mongodb/logstash connect error](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799)
**Author:** [@jskang](https://discuss.elastic.co/u/jskang)\ **Replies:** 18\ **Last updated:** [April 4, 2023, 9:57am UTC](https://discuss.elastic.co/t/mongodb-logstash-connect-error/328799 "2023-04-04T09:57:48Z")
This is an error message when running logstash. error message: Using bundled JDK: /home/admin/lg-862/jdk Sending Logstash logs to /home/admin/lg-862/logs which is now configured via log4j2.properties \[2023-03-29T18:2… --- ## [Need help to push pm2 logs into ELK server](https://discuss.elastic.co/t/need-help-to-push-pm2-logs-into-elk-server/329176)
**Author:** [@SUNA](https://discuss.elastic.co/u/SUNA)\ **Replies:** 7\ **Last updated:** [April 4, 2023, 9:16am UTC](https://discuss.elastic.co/t/need-help-to-push-pm2-logs-into-elk-server/329176 "2023-04-04T09:16:55Z")
Hi Team, Could you please help to push pm2 service logs for nodejs application into ELK server. --- ## [Old question but at a loss http\_request which is larger than the limit of \[\*\*\*\*\*/4.1gb\]](https://discuss.elastic.co/t/old-question-but-at-a-loss-http-request-which-is-larger-than-the-limit-of-4-1gb/329295)
**Author:** [@uschellh](https://discuss.elastic.co/u/uschellh)\ **Replies:** 2\ **Last updated:** [April 4, 2023, 8:54am UTC](https://discuss.elastic.co/t/old-question-but-at-a-loss-http-request-which-is-larger-than-the-limit-of-4-1gb/329295 "2023-04-04T08:54:54Z")
Hello, i already increased Java Heap sizes for graylog-server which is 4.3.13 and elasticsearch . According to the nodes overview, my settings for graylog of 8/12 gb are not filled. Elasticsearch can do searches (someti… --- ## [Guidance on infrastructure](https://discuss.elastic.co/t/guidance-on-infrastructure/329192)
**Author:** [@Noam\_Huri](https://discuss.elastic.co/u/Noam_Huri)\ **Replies:** 3\ **Last updated:** [April 4, 2023, 8:41am UTC](https://discuss.elastic.co/t/guidance-on-infrastructure/329192 "2023-04-04T08:41:57Z")
Hi Community, I am reaching out for your help to implement a unified search system for our global customers. Our goal is to seamlessly search through various content sources, including our community, knowledge base, tec… --- ## [\[WARN \]\[o.e.c.c.ClusterFormationFailureHelper\] \[node1\] master not discovered yet, this node has not previously joined a bootstrapped cluster](https://discuss.elastic.co/t/warn-o-e-c-c-clusterformationfailurehelper-node1-master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped-cluster/329267)
**Author:** [@Raghulvishal](https://discuss.elastic.co/u/Raghulvishal)\ **Replies:** 9\ **Last updated:** [April 4, 2023, 7:56am UTC](https://discuss.elastic.co/t/warn-o-e-c-c-clusterformationfailurehelper-node1-master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped-cluster/329267 "2023-04-04T07:56:16Z")
Hi Team, I am using ES 8.6 version and configured 3 nodes,while starting the node i'am getting master not discovered yet exception. This is my elastic .yml given below. cluster.name: es-8\_6 node.name: node1 path.dat… --- ## [Best method for calculating text embedding for a KNN search?](https://discuss.elastic.co/t/best-method-for-calculating-text-embedding-for-a-knn-search/329258)
**Author:** [@scott\_root](https://discuss.elastic.co/u/scott_root)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 7:50am UTC](https://discuss.elastic.co/t/best-method-for-calculating-text-embedding-for-a-knn-search/329258 "2023-04-04T07:50:15Z")
Hello, I am using Elastic Cloud and am using pre-trained ML models for text/semantic search and for image search. Currently, in order to do a text KNN search I have to make two API calls to ES, first to get the text em… --- ## [Failed to enable unit](https://discuss.elastic.co/t/failed-to-enable-unit/329289)
**Author:** [@bhargav.burugupalli](https://discuss.elastic.co/u/bhargav.burugupalli)\ **Replies:** 0\ **Last updated:** [April 4, 2023, 7:45am UTC](https://discuss.elastic.co/t/failed-to-enable-unit/329289 "2023-04-04T07:45:37Z")
Hello everyone, Good day ! I was trying to setup Elastic search on a RHEL machine in our office network. And following through this link.Install Elasticsearch with RPM | Elasticsearch Guide \[8.7\] | Elastic When I am t… --- ## [Delay in logs in filebeat for only one index](https://discuss.elastic.co/t/delay-in-logs-in-filebeat-for-only-one-index/329282)
**Author:** [@ks-ak](https://discuss.elastic.co/u/ks-ak)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 7:24am UTC](https://discuss.elastic.co/t/delay-in-logs-in-filebeat-for-only-one-index/329282 "2023-04-04T07:24:08Z")
Hi! I have filebeat with multiple indexes and one particular index is causing the issue and other indexes are sending logs without delayi.e., Sending logs to Kibana is getting delayed by 6 hours for the particular index… --- ## [\[apm\] Question to event.outcome relationship between transaction and span](https://discuss.elastic.co/t/apm-question-to-event-outcome-relationship-between-transaction-and-span/328363)
**Author:** [@dacothe](https://discuss.elastic.co/u/dacothe)\ **Replies:** 2\ **Last updated:** [April 4, 2023, 7:20am UTC](https://discuss.elastic.co/t/apm-question-to-event-outcome-relationship-between-transaction-and-span/328363 "2023-04-04T07:20:04Z")
Kibana version: 7.16.3 Elasticsearch version: 7.16.3 APM Server version: 7.16.3 APM Agent language and version: Java 1.30 Browser version: Chrome 110.0.5481.100 Original install method (e.g. download page, yum, deb… --- ## [Shield Licensing in 2023](https://discuss.elastic.co/t/shield-licensing-in-2023/329272)
**Author:** [@ovidiutirsa-en](https://discuss.elastic.co/u/ovidiutirsa-en)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 7:09am UTC](https://discuss.elastic.co/t/shield-licensing-in-2023/329272 "2023-04-04T07:09:41Z")
Hello, We are currently self hosting a very old version of Elasticsearch (2.0) and are in need of extending our Shield plugin license. Is there a way to contact someone from ES for pricing? Querying on emails did not h… --- ## [Elastic agent fails to install on Centos 7](https://discuss.elastic.co/t/elastic-agent-fails-to-install-on-centos-7/329260)
**Author:** [@sblack](https://discuss.elastic.co/u/sblack)\ **Replies:** 10\ **Last updated:** [April 4, 2023, 4:21am UTC](https://discuss.elastic.co/t/elastic-agent-fails-to-install-on-centos-7/329260 "2023-04-04T04:21:19Z")
Hi, I am getting the following error message when attempting to install Fleet agent: Installed as a system package, installation will not be altered. Error: failed to execute enroll command: fork/exec /usr/bin/elastic-… --- ## [Setting up monitoring cluster](https://discuss.elastic.co/t/setting-up-monitoring-cluster/329106)
**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 4:11am UTC](https://discuss.elastic.co/t/setting-up-monitoring-cluster/329106 "2023-04-04T04:11:18Z")
I have cluster running 7.17 and want to setup monitoring cluster with 8.x version can I use metricbeat 8.x on elastic cluster running 7.17? they way I understand metricbeat is just going to pull data from cluster/node… --- ## [Would be a good idea to turn all data nodes into non-eligible masters?](https://discuss.elastic.co/t/would-be-a-good-idea-to-turn-all-data-nodes-into-non-eligible-masters/329261)
**Author:** [@Bruno\_Arruda](https://discuss.elastic.co/u/Bruno_Arruda)\ **Replies:** 2\ **Last updated:** [April 4, 2023, 3:57am UTC](https://discuss.elastic.co/t/would-be-a-good-idea-to-turn-all-data-nodes-into-non-eligible-masters/329261 "2023-04-04T03:57:08Z")
Hi, Actually I have a cluster with 4 master nodes and 10 data nodes on a Kubernetes Cluster. Basically, each node causes my cluster to scale new hosts because of the anti-affinity default behavior, so my k8s got 14 node… --- ## [No services found in kibana services tab](https://discuss.elastic.co/t/no-services-found-in-kibana-services-tab/329001)
**Author:** [@APandey](https://discuss.elastic.co/u/APandey)\ **Replies:** 5\ **Last updated:** [April 4, 2023, 2:43am UTC](https://discuss.elastic.co/t/no-services-found-in-kibana-services-tab/329001 "2023-04-04T02:43:56Z")
Hi everyone, I have upgraded the ELK stack on my server from version 8.1.1 to 8.6.2. After upgrading when I went to see the services running in Kibana, no services were visible there also in traces tab no traces were co… --- ## [Determine a document's origin](https://discuss.elastic.co/t/determine-a-documents-origin/329253)
**Author:** [@etnachtman](https://discuss.elastic.co/u/etnachtman)\ **Replies:** 3\ **Last updated:** [April 4, 2023, 2:39am UTC](https://discuss.elastic.co/t/determine-a-documents-origin/329253 "2023-04-04T02:39:33Z")
Is there a way to glean additional information on what generated a document in elasticsearch? I'm working with an inherited reporting architecture and found some visualizations that are using an index pattern I'm not fa… --- ## [Filter Vector Points by Class (Maps)](https://discuss.elastic.co/t/filter-vector-points-by-class-maps/329234)
**Author:** [@m.hanna](https://discuss.elastic.co/u/m.hanna)\ **Replies:** 4\ **Last updated:** [April 4, 2023, 1:51am UTC](https://discuss.elastic.co/t/filter-vector-points-by-class-maps/329234 "2023-04-04T01:51:54Z")
We have a map server on a disconnected network that is serving vector tiles only (tileserver-gl-light). I can create a basemap in the Elastic Maps, but would like to be able to filter the points by class. For example, "p… --- ## [How to set timezone when use python sdk?](https://discuss.elastic.co/t/how-to-set-timezone-when-use-python-sdk/329011)
**Author:** [@KeithTt](https://discuss.elastic.co/u/KeithTt)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 1:49am UTC](https://discuss.elastic.co/t/how-to-set-timezone-when-use-python-sdk/329011 "2023-04-04T01:49:09Z")
{ "\_index": "mysql\_backup\_stat", "\_type": "\_doc", "\_id": "addb-m15-2023-03-31T02:31:22.920268+08:00", "\_version": 1, "\_score": null, "\_source": { "timestamp": "2023-03-31T02:31:22.920268+08:00", "host… --- ## [Kafka 0 partition metadata cannot be read in logstash6.8, other partitions can. Sample configuration:](https://discuss.elastic.co/t/kafka-0-partition-metadata-cannot-be-read-in-logstash6-8-other-partitions-can-sample-configuration/329055)
**Author:** [@angus](https://discuss.elastic.co/u/angus)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 1:45am UTC](https://discuss.elastic.co/t/kafka-0-partition-metadata-cannot-be-read-in-logstash6-8-other-partitions-can-sample-configuration/329055 "2023-04-04T01:45:44Z")
kafka 0 partition metadata cannot be read in logstash6.8, other partitions can. Sample configuration: input { kafka { client\_id =\> "ycUsrRdNews" consumer\_threads =\> 4 bootstrap\_servers =\> "${KAFKA\_BOOTSTRAP\_SERVE… --- ## [Elasticsearch - getting Circuit breaker exception with sudden spike in Heap usage](https://discuss.elastic.co/t/elasticsearch-getting-circuit-breaker-exception-with-sudden-spike-in-heap-usage/329231)
**Author:** [@navaneethan](https://discuss.elastic.co/u/navaneethan)\ **Replies:** 1\ **Last updated:** [April 4, 2023, 1:33am UTC](https://discuss.elastic.co/t/elasticsearch-getting-circuit-breaker-exception-with-sudden-spike-in-heap-usage/329231 "2023-04-04T01:33:07Z")
We are having ES 7.3.2 in production and we are getting circuit breaker exception when the heap usage increases suddenly, we have also tested for the same in es 7.17 and 8.x in local but is there any improvement in lates… --- ## [Snowflake -Pyspark numPartitions support](https://discuss.elastic.co/t/snowflake-pyspark-numpartitions-support/329203)
**Author:** [@digitalspecz](https://discuss.elastic.co/u/digitalspecz)\ **Replies:** 2\ **Last updated:** [April 4, 2023, 1:30am UTC](https://discuss.elastic.co/t/snowflake-pyspark-numpartitions-support/329203 "2023-04-04T01:30:14Z")
We're attempting to run the snowflake query with Pyspark, and we've set numPartitions to 10 and submitted a spark query. However, when I checked the Snowflake History tab. As far as I can tell, only one query is being ex… --- ## [S3 Access Denied error while verifying repository for snapshot and restore](https://discuss.elastic.co/t/s3-access-denied-error-while-verifying-repository-for-snapshot-and-restore/329263)
**Author:** [@shawnmin](https://discuss.elastic.co/u/shawnmin)\ **Replies:** 0\ **Last updated:** [April 4, 2023, 1:17am UTC](https://discuss.elastic.co/t/s3-access-denied-error-while-verifying-repository-for-snapshot-and-restore/329263 "2023-04-04T01:17:27Z")
Hi, I am working on Snapshot and Restore to ensure that my Elasticsearch indices are securely backed-up and stored. I've set up an EFK stack on my AWS EKS cluster. I've deployed the stack using Helm in Bitnami chart. I a… --- ## [Elasalert2のエラーに関して](https://discuss.elastic.co/t/elasalert2/329262)
**Author:** [@YUUTA.INOUE-JPN](https://discuss.elastic.co/u/YUUTA.INOUE-JPN)\ **Replies:** 0\ **Last updated:** [April 4, 2023, 1:07am UTC](https://discuss.elastic.co/t/elasalert2/329262 "2023-04-04T01:07:28Z")
お世話になります elasrticsearch と kibana を使用して、異常なイベントについて管理者にメールを送信できるようにしたいと考えています。 この目的で elastalert2 を使用していますが、フィルターがエラーになっています。 この問題に多くの時間を費やしましたが、解決できませんでした。 どうか思い当たる事や解決法に関するノウハウがございましたらご教示いただけますと幸いです よろしくお願いいたします 私の… --- ## [ILM policy for a index which only delets 30 days data without deleting the index please check the below policy is write or wrong?](https://discuss.elastic.co/t/ilm-policy-for-a-index-which-only-delets-30-days-data-without-deleting-the-index-please-check-the-below-policy-is-write-or-wrong/329022)
**Author:** [@Bibhudutta\_Mohanty](https://discuss.elastic.co/u/Bibhudutta_Mohanty)\ **Replies:** 4\ **Last updated:** [April 3, 2023, 9:51pm UTC](https://discuss.elastic.co/t/ilm-policy-for-a-index-which-only-delets-30-days-data-without-deleting-the-index-please-check-the-below-policy-is-write-or-wrong/329022 "2023-04-03T21:51:46Z")
please any one can check the code is write according to this situation PUT \_ilm/policy/my\_policy { "policy": { "phases": { "hot": { "actions": { "rollover": { "max\_age": "30d" } } }, "delete": { "min\_age": "… --- ## [Fluentd configuration is not creating indexes in elasticsearch](https://discuss.elastic.co/t/fluentd-configuration-is-not-creating-indexes-in-elasticsearch/328876)
**Author:** [@sc9501](https://discuss.elastic.co/u/sc9501)\ **Replies:** 12\ **Last updated:** [April 3, 2023, 9:50pm UTC](https://discuss.elastic.co/t/fluentd-configuration-is-not-creating-indexes-in-elasticsearch/328876 "2023-04-03T21:50:33Z")
Hello everyone, I need some help with the EFK stack. I've already installed Elasticsearch, Kibana and Fluentd with their respective Helm charts in a k8s environment. Every pod is running fine but I'm my Fluentd configu… --- ## [Reference one dashboard from another?](https://discuss.elastic.co/t/reference-one-dashboard-from-another/327623)
**Author:** [@smchamberlin](https://discuss.elastic.co/u/smchamberlin)\ **Replies:** 1\ **Last updated:** [April 3, 2023, 9:11pm UTC](https://discuss.elastic.co/t/reference-one-dashboard-from-another/327623 "2023-04-03T21:11:25Z")
Hello, We have various dashboards that are interconnected, some provide more details like a "drill down". Instead of going out to the top-level view and selecting a new dashboard, is there any way to load or reference … --- ## [How do I enable data collection in the elastic agent of my fleet server?](https://discuss.elastic.co/t/how-do-i-enable-data-collection-in-the-elastic-agent-of-my-fleet-server/329251)
**Author:** [@WowSuchLogs](https://discuss.elastic.co/u/WowSuchLogs)\ **Replies:** 0\ **Last updated:** [April 3, 2023, 9:08pm UTC](https://discuss.elastic.co/t/how-do-i-enable-data-collection-in-the-elastic-agent-of-my-fleet-server/329251 "2023-04-03T21:08:43Z")
Hello, I'm learning ES in a home lab consisting in a server running a cluster of ES/Kibana docker nodes and I installed the fleet server on the docker host itself. I'd like to monitor Docker through the agent of the fl… --- ## [Issues with snapshots](https://discuss.elastic.co/t/issues-with-snapshots/329142)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 5\ **Last updated:** [April 3, 2023, 7:30pm UTC](https://discuss.elastic.co/t/issues-with-snapshots/329142 "2023-04-03T19:30:06Z")
I am struggling to understand how one is expected to use the snapshot system to provide a reliable back up. I understand that individual snapshots are incremental, but presumably only within repositories? I have set up… [Previous page](https://discuss.elastic.co/latest.md?page=721) [Next page](https://discuss.elastic.co/latest.md?page=723)