# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=150 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 151 --- ## [Not able to RUN update-ca-certificates](https://discuss.elastic.co/t/not-able-to-run-update-ca-certificates/368597)
**Author:** [@Pankaj\_Agarwal](https://discuss.elastic.co/u/Pankaj_Agarwal)\ **Replies:** 1\ **Last updated:** [October 19, 2024, 11:05am UTC](https://discuss.elastic.co/t/not-able-to-run-update-ca-certificates/368597 "2024-10-19T11:05:03Z")
Hi, I am facing an error while installing the S3 plugin. It's giving an error for the certificate chain while downloading the S3 zip because I have Zscaler installed on my laptop, and the certificate chain is breaking fo… --- ## [Can I able to ignore Duplicate match it is effecting on entire relevance score](https://discuss.elastic.co/t/can-i-able-to-ignore-duplicate-match-it-is-effecting-on-entire-relevance-score/369088)
**Author:** [@Anand\_Konagala](https://discuss.elastic.co/u/Anand_Konagala)\ **Replies:** 0\ **Last updated:** [October 19, 2024, 5:00am UTC](https://discuss.elastic.co/t/can-i-able-to-ignore-duplicate-match-it-is-effecting-on-entire-relevance-score/369088 "2024-10-19T05:00:42Z")
Hello, When I perform a querying on Elasticsearch the duplicate matches also take score by Inverse Document Frequency and come top of the results. Can I ignore the duplicate matching. top document, "highlight": { … --- ## [Elastic Cloudtrail for Cognito integration](https://discuss.elastic.co/t/elastic-cloudtrail-for-cognito-integration/368858)
**Author:** [@sami-obvio](https://discuss.elastic.co/u/sami-obvio)\ **Replies:** 2\ **Last updated:** [October 18, 2024, 8:31pm UTC](https://discuss.elastic.co/t/elastic-cloudtrail-for-cognito-integration/368858 "2024-10-18T20:31:05Z")
Hi I am writing logs from my AWS Cognito service to an S3 bucket I want to read those logs and ingest them in an Elastic Cloud instance using the AWS integration Cognito generats logs in an S3 bucket with the followin… --- ## [Bandwith Utilization - SNMP Interface](https://discuss.elastic.co/t/bandwith-utilization-snmp-interface/369080)
**Author:** [@erikg](https://discuss.elastic.co/u/erikg)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 5:57pm UTC](https://discuss.elastic.co/t/bandwith-utilization-snmp-interface/369080 "2024-10-18T17:57:05Z")
Hello, How do I build a visualization to show the bandwith utilization of an interface. I am polling once every 1hour. My data looks like: --- ## [Partial update vs re-index 20 To 30 million records every day](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043)
**Author:** [@Sasiganth\_Manikandan](https://discuss.elastic.co/u/Sasiganth_Manikandan)\ **Replies:** 3\ **Last updated:** [October 18, 2024, 4:37pm UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043 "2024-10-18T16:37:23Z")
My index contains 300 millions documents. Every document has the same structure. Each document contains 40 to 50 fields, such as first\_name, last\_name, nick\_name, weight, height, preferred\_language, preferred\_currency, e… --- ## [What's the difference between using multiple single-vector records vs. one record with multiple vectors in OpenSearch?](https://discuss.elastic.co/t/whats-the-difference-between-using-multiple-single-vector-records-vs-one-record-with-multiple-vectors-in-opensearch/369069)
**Author:** [@cheesydown](https://discuss.elastic.co/u/cheesydown)\ **Replies:** 5\ **Last updated:** [October 18, 2024, 4:29pm UTC](https://discuss.elastic.co/t/whats-the-difference-between-using-multiple-single-vector-records-vs-one-record-with-multiple-vectors-in-opensearch/369069 "2024-10-18T16:29:51Z")
I'm trying to move my company's Pinecone-based vector DB to use OpenSearch's k-NN search. One of the main motivations is that we want something that can support multi-vector search. Currently I've made an OpenSearch ind… --- ## [Detect newly inserted documents in an index](https://discuss.elastic.co/t/detect-newly-inserted-documents-in-an-index/368978)
**Author:** [@Saanchita\_V](https://discuss.elastic.co/u/Saanchita_V)\ **Replies:** 8\ **Last updated:** [October 18, 2024, 2:32pm UTC](https://discuss.elastic.co/t/detect-newly-inserted-documents-in-an-index/368978 "2024-10-18T14:32:33Z")
Okay so here is my usecase I have an index say one with say 200000 documents( these documents are very bulky ) in a source elastic server Now I am migrating all the data to another server (we'll call it target elastic … --- ## [Logstash Action](https://discuss.elastic.co/t/logstash-action/369054)
**Author:** [@Tam2](https://discuss.elastic.co/u/Tam2)\ **Replies:** 2\ **Last updated:** [October 18, 2024, 1:43pm UTC](https://discuss.elastic.co/t/logstash-action/369054 "2024-10-18T13:43:36Z")
I'm currently upgrading logstash + elasticsearch from 7.x to 8.x but am getting this error within the logstash pipeline \[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[790066835755a2e9e8ffb361aa7273a3b82493ee370893269ac96… --- ## [Localizing Kibana into Unsupported Languages](https://discuss.elastic.co/t/localizing-kibana-into-unsupported-languages/369062)
**Author:** [@avm-1](https://discuss.elastic.co/u/avm-1)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 1:16pm UTC](https://discuss.elastic.co/t/localizing-kibana-into-unsupported-languages/369062 "2024-10-18T13:16:34Z")
Hello everyone! I'm running Kibana in Docker and looking for a way to fully localize it. I created a separate file ru-RU.json, added translations to it, made changes to kibana/x-pack/.i18nrc.json and kibana/node\_modules/… --- ## [Can I delete empty system indices?](https://discuss.elastic.co/t/can-i-delete-empty-system-indices/369057)
**Author:** [@bianca\_s](https://discuss.elastic.co/u/bianca_s)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 12:30pm UTC](https://discuss.elastic.co/t/can-i-delete-empty-system-indices/369057 "2024-10-18T12:30:46Z")
Hi all, as we have reached the shard limit of 1000 shards per node, we want to clean up some unnecessary indices in our cluster. We have noticed that there are quite a lot of system indices that are actually fully empt… --- ## [PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target](https://discuss.elastic.co/t/pkix-path-building-failed-sun-security-provider-certpath-suncertpathbuilderexception-unable-to-find-valid-certification-path-to-requested-target/369053)
**Author:** [@abkrim](https://discuss.elastic.co/u/abkrim)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 12:13pm UTC](https://discuss.elastic.co/t/pkix-path-building-failed-sun-security-provider-certpath-suncertpathbuilderexception-unable-to-find-valid-certification-path-to-requested-target/369053 "2024-10-18T12:13:24Z")
Scenario: Two single-node clusters (semi-production) Remote cluster configured successfully on both Cluster Migration cluster.name: sitelight node.name: node-0 path.data: /var/lib/elasticsearch path.logs: /var/log/elas… --- ## [KNN search returns an empty result set when num\_candidates is less than the filtered doc count](https://discuss.elastic.co/t/knn-search-returns-an-empty-result-set-when-num-candidates-is-less-than-the-filtered-doc-count/368349)
**Author:** [@Jamie123](https://discuss.elastic.co/u/Jamie123)\ **Replies:** 10\ **Last updated:** [October 18, 2024, 9:33am UTC](https://discuss.elastic.co/t/knn-search-returns-an-empty-result-set-when-num-candidates-is-less-than-the-filtered-doc-count/368349 "2024-10-18T09:33:37Z")
I have a problem with my knn query. I am applying a knn search with a filter clause (pre-filter). This filter contains a range filter that filters on a date field in combination with some term or wildcard queries on keyw… --- ## [Apply different settings per node role](https://discuss.elastic.co/t/apply-different-settings-per-node-role/369025)
**Author:** [@andy-w00d](https://discuss.elastic.co/u/andy-w00d)\ **Replies:** 1\ **Last updated:** [October 18, 2024, 9:25am UTC](https://discuss.elastic.co/t/apply-different-settings-per-node-role/369025 "2024-10-18T09:25:08Z")
I have a cluster with coordinating nodes that are relatively much smaller than data nodes - 4Gi vs 256Gi memory, respectively. I am starting to see indexing pressure rejections from the coordinating stage, only on the co… --- ## [Copy to dashboard dialog displays only 5 dashboards in dropdown](https://discuss.elastic.co/t/copy-to-dashboard-dialog-displays-only-5-dashboards-in-dropdown/369007)
**Author:** [@allatrue](https://discuss.elastic.co/u/allatrue)\ **Replies:** 2\ **Last updated:** [October 18, 2024, 7:55am UTC](https://discuss.elastic.co/t/copy-to-dashboard-dialog-displays-only-5-dashboards-in-dropdown/369007 "2024-10-18T07:55:23Z")
Hello Elastic-Community, we experience a strange issue while copying a visualization panel to another existing dashboard. The dropdown list contains only 5 dashboards. And these dashboards are ones with the oldest chang… --- ## [What is the hardware requirement for packetbeat?](https://discuss.elastic.co/t/what-is-the-hardware-requirement-for-packetbeat/369045)
**Author:** [@yumeko](https://discuss.elastic.co/u/yumeko)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 7:47am UTC](https://discuss.elastic.co/t/what-is-the-hardware-requirement-for-packetbeat/369045 "2024-10-18T07:47:58Z")
Hello, We currently have a DNS server with the following specifications: CPU: 3 vCPU RAM: 3 GB Disk: 110 GB We plan to install Packetbeat to monitor traffic on port 53. The average traffic volume on this port is aro… --- ## [Some logs are not displayed in the index](https://discuss.elastic.co/t/some-logs-are-not-displayed-in-the-index/369037)
**Author:** [@Vladimir\_Fomin1](https://discuss.elastic.co/u/Vladimir_Fomin1)\ **Replies:** 0\ **Last updated:** [October 18, 2024, 6:30am UTC](https://discuss.elastic.co/t/some-logs-are-not-displayed-in-the-index/369037 "2024-10-18T06:30:53Z")
Logs come to Logstash, are parsed there and then sent to Elasticsearch in index cnv-tariffication-service-%{+YYYY.MM.dd}. But I don't see all the necessary logs in the index, only a part of them. I'm also testing a way… --- ## [Document annotated classes are not being added to Elastic search context after upgrading to spring data elastic search 5.2](https://discuss.elastic.co/t/document-annotated-classes-are-not-being-added-to-elastic-search-context-after-upgrading-to-spring-data-elastic-search-5-2/369036)
**Author:** [@Suchithra\_Nair](https://discuss.elastic.co/u/Suchithra_Nair)\ **Replies:** 1\ **Last updated:** [October 18, 2024, 6:13am UTC](https://discuss.elastic.co/t/document-annotated-classes-are-not-being-added-to-elastic-search-context-after-upgrading-to-spring-data-elastic-search-5-2/369036 "2024-10-18T06:13:18Z")
I am upgrading my service to springboot 3, Elastic search v8 and spring data Elasticsearch 5.2. For resolving indexes, I am using SimpleElasticsearchMappingContext to get the persistent entities currently. However, after… --- ## [Help me I am new to ELK. I want to ingest mysql logs(error logs, slow query logs and also a general logs)](https://discuss.elastic.co/t/help-me-i-am-new-to-elk-i-want-to-ingest-mysql-logs-error-logs-slow-query-logs-and-also-a-general-logs/368883)
**Author:** [@FJT](https://discuss.elastic.co/u/FJT)\ **Replies:** 6\ **Last updated:** [October 17, 2024, 3:30am UTC](https://discuss.elastic.co/t/help-me-i-am-new-to-elk-i-want-to-ingest-mysql-logs-error-logs-slow-query-logs-and-also-a-general-logs/368883 "2024-10-17T03:30:43Z")
I want to ingest mysql logs(error logs, slow query logs and also a general logs) Can you like help me what is the most appropriate approach? --- ## [Logstash fails after upgrading to version - 8.15.1](https://discuss.elastic.co/t/logstash-fails-after-upgrading-to-version-8-15-1/366333)
**Author:** [@mohanss08](https://discuss.elastic.co/u/mohanss08)\ **Replies:** 18\ **Last updated:** [October 18, 2024, 4:35am UTC](https://discuss.elastic.co/t/logstash-fails-after-upgrading-to-version-8-15-1/366333 "2024-10-18T04:35:07Z")
Hi Team, Today i upgraded my Elasticsearch, Logstash, and Kibana stack from version 8.6.2 to 8.15.1. My setup is based on Docker Compose. After the upgrade, the Logstash container fails to start and throws the following… --- ## [ML Anomaly Detection jobs gives very low score for absense of events](https://discuss.elastic.co/t/ml-anomaly-detection-jobs-gives-very-low-score-for-absense-of-events/366963)
**Author:** [@GlebCA](https://discuss.elastic.co/u/GlebCA)\ **Replies:** 5\ **Last updated:** [October 18, 2024, 2:38am UTC](https://discuss.elastic.co/t/ml-anomaly-detection-jobs-gives-very-low-score-for-absense-of-events/366963 "2024-10-18T02:38:05Z")
Hi, I like to monitor # of specific logs event and raise an alert when flow is out of boundaries. Initially I was going to use moving average for it but found that Elastic does not support it and ML anomaly detection is… --- ## [Standalone Elastic Agent Integration Add Policy Not Working](https://discuss.elastic.co/t/standalone-elastic-agent-integration-add-policy-not-working/369030)
**Author:** [@elasticfantastik](https://discuss.elastic.co/u/elasticfantastik)\ **Replies:** 0\ **Last updated:** [October 17, 2024, 11:07pm UTC](https://discuss.elastic.co/t/standalone-elastic-agent-integration-add-policy-not-working/369030 "2024-10-17T23:07:58Z")
We have two standalone elastic agents that are running on separate machines. One policy is called "aws\_agent\_policy", the other is "azure\_agent\_policy". They are both largely identical except differing in a few of the in… --- ## [Logstash Pipeline crash](https://discuss.elastic.co/t/logstash-pipeline-crash/369001)
**Author:** [@hunter32](https://discuss.elastic.co/u/hunter32)\ **Replies:** 5\ **Last updated:** [October 17, 2024, 10:20pm UTC](https://discuss.elastic.co/t/logstash-pipeline-crash/369001 "2024-10-17T22:20:23Z")
We are getting some infrequent crashes with logstash. They seem to always be NoMethodFound errors on test\_for\_inclusion. When it failed no of my error logging is happen so I can not find the location in my pipeline that … --- ## [Node went down but other cluster nodes reporting green and no decrease in # nodes](https://discuss.elastic.co/t/node-went-down-but-other-cluster-nodes-reporting-green-and-no-decrease-in-nodes/368951)
**Author:** [@buitcj](https://discuss.elastic.co/u/buitcj)\ **Replies:** 1\ **Last updated:** [October 17, 2024, 9:03pm UTC](https://discuss.elastic.co/t/node-went-down-but-other-cluster-nodes-reporting-green-and-no-decrease-in-nodes/368951 "2024-10-17T21:03:28Z")
I have an environment with a 3 node cluster and the cluster/health endpoint showed 3 nodes and GREEN. After one node came down and remained down for 20 minutes, the two remaining nodes continued to report 3 nodes and GRE… --- ## [Terms aggregation on high cardinality field](https://discuss.elastic.co/t/terms-aggregation-on-high-cardinality-field/367196)
**Author:** [@ivan83](https://discuss.elastic.co/u/ivan83)\ **Replies:** 6\ **Last updated:** [October 17, 2024, 8:41pm UTC](https://discuss.elastic.co/t/terms-aggregation-on-high-cardinality-field/367196 "2024-10-17T20:41:32Z")
Hello! I am sharing the issue that I am having here hoping that someone can help me. We are executing terms on a field which has super high cardinality. I am talking about 40 million unique entries that represents prod… --- ## [Logstash Fortinet Grok Pattern](https://discuss.elastic.co/t/logstash-fortinet-grok-pattern/369019)
**Author:** [@dfir](https://discuss.elastic.co/u/dfir)\ **Replies:** 5\ **Last updated:** [October 17, 2024, 8:05pm UTC](https://discuss.elastic.co/t/logstash-fortinet-grok-pattern/369019 "2024-10-17T20:05:55Z")
HI All: I am working on another GROK pattern and hitting some snags. Here are the details: Sample Log Line: logver=0702071577 idseq=237867271677022888 itime=1723855010 devid="FGT60E4Q17040542" devname="central-il-cu"… --- ## [Kibana iframe autoscroll issue](https://discuss.elastic.co/t/kibana-iframe-autoscroll-issue/369021)
**Author:** [@Ankit\_Guleria](https://discuss.elastic.co/u/Ankit_Guleria)\ **Replies:** 0\ **Last updated:** [October 17, 2024, 5:51pm UTC](https://discuss.elastic.co/t/kibana-iframe-autoscroll-issue/369021 "2024-10-17T17:51:42Z")
Hi, I am using kibana iframe in a lengthy web page and due to some autofocus issue the page is scrolling down to kibana iframe. I have tried js query or other things to resolve it but I am back to bottom of the page. … --- ## [Logstash Java Errors](https://discuss.elastic.co/t/logstash-java-errors/368038)
**Author:** [@dfir](https://discuss.elastic.co/u/dfir)\ **Replies:** 12\ **Last updated:** [October 17, 2024, 5:20pm UTC](https://discuss.elastic.co/t/logstash-java-errors/368038 "2024-10-17T17:20:46Z")
HI All: Is anyone familiar with the below logstash error? I am trying to run a basic Combined apache log GROK Filter. match =\> { "message" =\> "%{COMBINEDAPACHELOG}" } \[2024-09-30T20:13:10,962\]\[WARN \]\[filewatch.readmo… --- ## [Filebeat servce cannot start on my OS](https://discuss.elastic.co/t/filebeat-servce-cannot-start-on-my-os/368977)
**Author:** [@alex\_zolat](https://discuss.elastic.co/u/alex_zolat)\ **Replies:** 2\ **Last updated:** [October 17, 2024, 3:22pm UTC](https://discuss.elastic.co/t/filebeat-servce-cannot-start-on-my-os/368977 "2024-10-17T15:22:49Z")
My filebeat service cannot start and is showing follow log in follow path: /var/log/filebeat/filebeat.log-20241017.ndjson {"log.level":"error","@timestamp":"2024-10-17T10:58:05.253+0330","log.logger":"input","log.orig… --- ## [Migrating from java client 1.4.2 to the 8 client](https://discuss.elastic.co/t/migrating-from-java-client-1-4-2-to-the-8-client/366949)
**Author:** [@intrepid1](https://discuss.elastic.co/u/intrepid1)\ **Replies:** 2\ **Last updated:** [October 17, 2024, 3:14pm UTC](https://discuss.elastic.co/t/migrating-from-java-client-1-4-2-to-the-8-client/366949 "2024-10-17T15:14:04Z")
Hi there, I have been tasked with migrating an ancient Elasticsearch v1.5.1 cluster and the associated java service using the Elasticsearch 1.4.2 java client (elasticsearch-1.4.2.jar). Whilst the migration of the cluste… --- ## [Translate from DSL to SQL](https://discuss.elastic.co/t/translate-from-dsl-to-sql/368999)
**Author:** [@metalshanked](https://discuss.elastic.co/u/metalshanked)\ **Replies:** 1\ **Last updated:** [October 17, 2024, 2:48pm UTC](https://discuss.elastic.co/t/translate-from-dsl-to-sql/368999 "2024-10-17T14:48:23Z")
Hi, the sql translate feature converts from SQL --\> DSL. Is there a feature to do the reverse? i.e. convert from DSL to Elastic SQL ? Thanks [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=149) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=151)