# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=124 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 125 --- ## [Filebeats creating duplicates on SMB logfile sources](https://discuss.elastic.co/t/filebeats-creating-duplicates-on-smb-logfile-sources/370800)
**Author:** [@j.koopmann](https://discuss.elastic.co/u/j.koopmann)\ **Replies:** 12\ **Last updated:** [December 11, 2024, 4:19pm UTC](https://discuss.elastic.co/t/filebeats-creating-duplicates-on-smb-logfile-sources/370800 "2024-12-11T16:19:26Z")
Hi, I am faced with this challenge. The logfiles I want to watch with filebeats and then send to graylog are accessible via a SMB mount only. I already mounted with cache=none,actimeo=0 What I am seeing is that when t… --- ## [Automated Email notification once new user created in Kibana](https://discuss.elastic.co/t/automated-email-notification-once-new-user-created-in-kibana/370674)
**Author:** [@Manoilayans](https://discuss.elastic.co/u/Manoilayans)\ **Replies:** 6\ **Last updated:** [December 11, 2024, 3:11pm UTC](https://discuss.elastic.co/t/automated-email-notification-once-new-user-created-in-kibana/370674 "2024-12-11T15:11:48Z")
I wish to enable Email Notification when we create a new user in Kibana and user should click link from the Email to navigate into login page in Kibana Console. Pls help !! --- ## [Azure Load balancer not working with elasticsearch 8.16.1](https://discuss.elastic.co/t/azure-load-balancer-not-working-with-elasticsearch-8-16-1/371361)
**Author:** [@Wajahat\_Iqbal](https://discuss.elastic.co/u/Wajahat_Iqbal)\ **Replies:** 4\ **Last updated:** [December 11, 2024, 3:02pm UTC](https://discuss.elastic.co/t/azure-load-balancer-not-working-with-elasticsearch-8-16-1/371361 "2024-12-11T15:02:41Z")
I built Elasticsearch in my testing environment with the same configuration with a load balancer with Elasticsearch 7.10.0 and it was working fine. now I am using 8.16.1 I am having trouble connecting to it when I check… --- ## [What is the fastest storage type suitable for elasticsaerch than the HDD?](https://discuss.elastic.co/t/what-is-the-fastest-storage-type-suitable-for-elasticsaerch-than-the-hdd/371161)
**Author:** [@dsagent](https://discuss.elastic.co/u/dsagent)\ **Replies:** 36\ **Last updated:** [December 11, 2024, 3:01pm UTC](https://discuss.elastic.co/t/what-is-the-fastest-storage-type-suitable-for-elasticsaerch-than-the-hdd/371161 "2024-12-11T15:01:24Z")
Hello can you help In order to store big data, what is the best type of HDD storage that is fast For example Qnap NAS is there a faster type than it? --- ## [When you copy and paste from KIBANA, column values do not go to the clipboard](https://discuss.elastic.co/t/when-you-copy-and-paste-from-kibana-column-values-do-not-go-to-the-clipboard/371849)
**Author:** [@dkrismile](https://discuss.elastic.co/u/dkrismile)\ **Replies:** 0\ **Last updated:** [December 11, 2024, 2:57pm UTC](https://discuss.elastic.co/t/when-you-copy-and-paste-from-kibana-column-values-do-not-go-to-the-clipboard/371849 "2024-12-11T14:57:29Z")
My version of kibana is 8.15.2 The function I marked in the figure is not effective, please help me to clarify, thank you！！ --- ## [√Fleet managed Elastic Agent listens on port 6791 by default with not activating http endpoint monitoring](https://discuss.elastic.co/t/fleet-managed-elastic-agent-listens-on-port-6791-by-default-with-not-activating-http-endpoint-monitoring/371843)
**Author:** [@Markus\_Muhr](https://discuss.elastic.co/u/Markus_Muhr)\ **Replies:** 1\ **Last updated:** [December 11, 2024, 2:22pm UTC](https://discuss.elastic.co/t/fleet-managed-elastic-agent-listens-on-port-6791-by-default-with-not-activating-http-endpoint-monitoring/371843 "2024-12-11T14:22:31Z")
Hi there, we have experienced an odd behaviour with http endpoint monitoring which defaults to port 6791. We manage our agents via fleet and we haven't activated the http endpoint monitoring. Nevertheless, the agent is… --- ## [Elastic agent - identification integration in the index](https://discuss.elastic.co/t/elastic-agent-identification-integration-in-the-index/371736)
**Author:** [@hofrichterovak](https://discuss.elastic.co/u/hofrichterovak)\ **Replies:** 2\ **Last updated:** [December 11, 2024, 12:35pm UTC](https://discuss.elastic.co/t/elastic-agent-identification-integration-in-the-index/371736 "2024-12-11T12:35:44Z")
Hello, I would like to ask how I can identify a specific integration in a data stream created by Elastic Agent. I would like to have a system in the data. In which field in the data stream index is the information stor… --- ## [\[BUG\] ECK 2.14/Eck-es 8.14.3: ILM Policy Rollover Settings (max\_docs, max\_primary\_shard\_docs) Incorrectly Merged with Cluster Defaults](https://discuss.elastic.co/t/bug-eck-2-14-eck-es-8-14-3-ilm-policy-rollover-settings-max-docs-max-primary-shard-docs-incorrectly-merged-with-cluster-defaults/371775)
**Author:** [@Hadj\_Hassine\_Younes](https://discuss.elastic.co/u/Hadj_Hassine_Younes)\ **Replies:** 0\ **Last updated:** [December 10, 2024, 4:06pm UTC](https://discuss.elastic.co/t/bug-eck-2-14-eck-es-8-14-3-ilm-policy-rollover-settings-max-docs-max-primary-shard-docs-incorrectly-merged-with-cluster-defaults/371775 "2024-12-10T16:06:34Z")
Current Behavior Description We are experiencing unexpected behavior with ILM policy rollover settings in ECK 2.14 with Elasticsearch 8.14.3. Our custom ILM policy settings are being merged with cluster default rollover … --- ## [Showing values in a graphic bar](https://discuss.elastic.co/t/showing-values-in-a-graphic-bar/361025)
**Author:** [@juandres117](https://discuss.elastic.co/u/juandres117)\ **Replies:** 25\ **Last updated:** [December 11, 2024, 11:46am UTC](https://discuss.elastic.co/t/showing-values-in-a-graphic-bar/361025 "2024-12-11T11:46:04Z")
Hi! I'm really new to Kibana and Elasticsearch, but I'm trying to visualize data in a specific way that might be difficult. I'm trying to set up two things: I want to establish a threshold. For example, if any column … --- ## [Hide or Disable specific button in Kibana UI](https://discuss.elastic.co/t/hide-or-disable-specific-button-in-kibana-ui/371830)
**Author:** [@Manoilayans](https://discuss.elastic.co/u/Manoilayans)\ **Replies:** 0\ **Last updated:** [December 11, 2024, 11:33am UTC](https://discuss.elastic.co/t/hide-or-disable-specific-button-in-kibana-ui/371830 "2024-12-11T11:33:48Z")
While creating a new Dashboard in Kibana, we can get below screen. I wish to hide/disable the button i.e, "Controls". --- ## [Hide specific hyperlinks in the Kibana UI Screens](https://discuss.elastic.co/t/hide-specific-hyperlinks-in-the-kibana-ui-screens/371828)
**Author:** [@Manoilayans](https://discuss.elastic.co/u/Manoilayans)\ **Replies:** 0\ **Last updated:** [December 11, 2024, 11:07am UTC](https://discuss.elastic.co/t/hide-specific-hyperlinks-in-the-kibana-ui-screens/371828 "2024-12-11T11:07:08Z")
Recently we have enabled the AI / ML but we planned to provide access the end user.. we found that there are lots of hyperlinks gets enabled which are not relevant to them and it is showing the list of indicies available… --- ## [ElasticSearch taking too much ram](https://discuss.elastic.co/t/elasticsearch-taking-too-much-ram/371808)
**Author:** [@Wajahat\_Iqbal](https://discuss.elastic.co/u/Wajahat_Iqbal)\ **Replies:** 5\ **Last updated:** [December 11, 2024, 10:46am UTC](https://discuss.elastic.co/t/elasticsearch-taking-too-much-ram/371808 "2024-12-11T10:46:30Z")
I have 3 node setup, my CPU usage is very low, I have 4 cpu and 32 gb of ram. why its taking so much ram. --- ## [Frozen tier in self managed cluster](https://discuss.elastic.co/t/frozen-tier-in-self-managed-cluster/371825)
**Author:** [@searchwithme](https://discuss.elastic.co/u/searchwithme)\ **Replies:** 1\ **Last updated:** [December 11, 2024, 10:43am UTC](https://discuss.elastic.co/t/frozen-tier-in-self-managed-cluster/371825 "2024-12-11T10:43:39Z")
I understand elastic cloud enterprise subscription offers hot,warm,cold and frozen. What about a self managed deployment? Could I set up these tiers in my self managed cluster? DO I need enterprise subscription or is it… --- ## [Logstash not able to consume Kafka input](https://discuss.elastic.co/t/logstash-not-able-to-consume-kafka-input/371823)
**Author:** [@1Z10](https://discuss.elastic.co/u/1Z10)\ **Replies:** 0\ **Last updated:** [December 11, 2024, 9:58am UTC](https://discuss.elastic.co/t/logstash-not-able-to-consume-kafka-input/371823 "2024-12-11T09:58:33Z")
I'm playing a bit with the latest versions of Logstash and Kafka but I can't get the Kafka input to work. Here a brief summary of my setup: I'm using Docker Compose with apache/kafka:3.9.0 and logstash:8.16.1 Docker i… --- ## [How to assign new index pattern to new space](https://discuss.elastic.co/t/how-to-assign-new-index-pattern-to-new-space/371815)
**Author:** [@Rakesh\_Bare](https://discuss.elastic.co/u/Rakesh_Bare)\ **Replies:** 0\ **Last updated:** [December 11, 2024, 9:08am UTC](https://discuss.elastic.co/t/how-to-assign-new-index-pattern-to-new-space/371815 "2024-12-11T09:08:41Z")
How can I use Python code to create a new index pattern and space while importing an existing space dashboard and not assigning the pattern to it? --- ## [Query elasticseatrch with pyspark and nested fields](https://discuss.elastic.co/t/query-elasticseatrch-with-pyspark-and-nested-fields/371745)
**Author:** [@xsa\_xsa](https://discuss.elastic.co/u/xsa_xsa)\ **Replies:** 0\ **Last updated:** [December 10, 2024, 9:58am UTC](https://discuss.elastic.co/t/query-elasticseatrch-with-pyspark-and-nested-fields/371745 "2024-12-10T09:58:45Z")
hello, I am trying to query with pyspark an index with documents: { "field1": "field1\_data", "field2": \[ { "field2\_1": "x1", "field2\_2": "x2" }, { "field2\_1": "x3", "field2\_2": "x4" } \] } if i query fr… --- ## [Hybrid search on managed elasticsearch instance](https://discuss.elastic.co/t/hybrid-search-on-managed-elasticsearch-instance/371807)
**Author:** [@aiexplorations](https://discuss.elastic.co/u/aiexplorations)\ **Replies:** 1\ **Last updated:** [December 11, 2024, 6:29am UTC](https://discuss.elastic.co/t/hybrid-search-on-managed-elasticsearch-instance/371807 "2024-12-11T06:29:56Z")
Hi all, I have a specific question on whether we need all the vectors to be persisted in memory on the Elasticsearch ML node (or in the other ES nodes) when running ML search. We're building an application at my end wh… --- ## [Filebeat "failed to perform any bulk index operations"](https://discuss.elastic.co/t/filebeat-failed-to-perform-any-bulk-index-operations/371730)
**Author:** [@Willy\_W](https://discuss.elastic.co/u/Willy_W)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 10:42pm UTC](https://discuss.elastic.co/t/filebeat-failed-to-perform-any-bulk-index-operations/371730 "2024-12-10T22:42:25Z")
Hello, i'm trying to fix my environment (4 Nodes with 32GB of ram and 16 cores each), i solved some performance issues, but now i still have errors, below the error logs retrieved from filebeat: {"log.level":"error","@… --- ## [How to modify the configuration of an already installed and active integration and put it online?](https://discuss.elastic.co/t/how-to-modify-the-configuration-of-an-already-installed-and-active-integration-and-put-it-online/371535)
**Author:** [@Cristina\_Marletta\_Li](https://discuss.elastic.co/u/Cristina_Marletta_Li)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 6:49pm UTC](https://discuss.elastic.co/t/how-to-modify-the-configuration-of-an-already-installed-and-active-integration-and-put-it-online/371535 "2024-12-10T18:49:42Z")
Hi all, After modifying Trend Micro Vision One integration (setting 'preserve\_original\_event') and restarting the agent, what can I do to make the change effective? Thanks a lot! --- ## [Index Pattern and Saved search is moving to default space after Kibana restart](https://discuss.elastic.co/t/index-pattern-and-saved-search-is-moving-to-default-space-after-kibana-restart/353606)
**Author:** [@Sagesh](https://discuss.elastic.co/u/Sagesh)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 3:59pm UTC](https://discuss.elastic.co/t/index-pattern-and-saved-search-is-moving-to-default-space-after-kibana-restart/353606 "2024-12-10T15:59:58Z")
Index Pattern and Saved search is moving to default space after Kibana restart. We have created an index pattern and saved the search with the dashboard file in the "HR" space. After Kibana restarted all the index patte… --- ## [Why Kibana does his own weird formatting of my error.stack\_trace?](https://discuss.elastic.co/t/why-kibana-does-his-own-weird-formatting-of-my-error-stack-trace/371772)
**Author:** [@Tristan107](https://discuss.elastic.co/u/Tristan107)\ **Replies:** 2\ **Last updated:** [December 10, 2024, 3:51pm UTC](https://discuss.elastic.co/t/why-kibana-does-his-own-weird-formatting-of-my-error-stack-trace/371772 "2024-12-10T15:51:54Z")
Hello I'm using Discover in Kibana 8.2.2 When I display a my raw error.stack\_trace in Kibana Discover, I can see this extract : \\n\\tat java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandl… --- ## [Kibana Login with Encrypt Username](https://discuss.elastic.co/t/kibana-login-with-encrypt-username/371756)
**Author:** [@amjad](https://discuss.elastic.co/u/amjad)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 3:12pm UTC](https://discuss.elastic.co/t/kibana-login-with-encrypt-username/371756 "2024-12-10T15:12:29Z")
Hi All, Hope Everyone doing great. Please help me in what are the changes need to be done in both elastic.yml and kibana.yml for the logging of Kibana dashboards with the encrypt username in elastic version 7.16 having… --- ## [Can't run jruby commands on Logstash 8](https://discuss.elastic.co/t/cant-run-jruby-commands-on-logstash-8/371769)
**Author:** [@mcairney](https://discuss.elastic.co/u/mcairney)\ **Replies:** 0\ **Last updated:** [December 10, 2024, 2:26pm UTC](https://discuss.elastic.co/t/cant-run-jruby-commands-on-logstash-8/371769 "2024-12-10T14:26:19Z")
Hi, We're looking to upgrade our ELK stack from 7.17 to 8.16 however I've discovered an issue with the jruby command throwing an error on 8.16 which means we can't build and install logstash plugins. e.g. # /usr/share… --- ## [Logstash riddle fingerprint duplicates](https://discuss.elastic.co/t/logstash-riddle-fingerprint-duplicates/371712)
**Author:** [@grumo35](https://discuss.elastic.co/u/grumo35)\ **Replies:** 5\ **Last updated:** [December 10, 2024, 1:47pm UTC](https://discuss.elastic.co/t/logstash-riddle-fingerprint-duplicates/371712 "2024-12-10T13:47:07Z")
Hi there, Using the logstash fingerprint plugin i came across an issue where it seems i cannot define the \_id as a target from the plugin using the following : fingerprint { source =\> \["\[host\]\[name\]", "\[record\]\[id\]… --- ## [Elastic-Agent Upgradation](https://discuss.elastic.co/t/elastic-agent-upgradation/371749)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 12:39pm UTC](https://discuss.elastic.co/t/elastic-agent-upgradation/371749 "2024-12-10T12:39:22Z")
Hi Team, We are running ELK cluster - 8.13.2 and we have installed elastic-agent -8.13.2 . We need to upgrade the cluster and elastic agent . I have a question that i can upgrade ELK cluster but don’t know how to upgrad… --- ## [ECK performance optimisation on Kubernetes](https://discuss.elastic.co/t/eck-performance-optimisation-on-kubernetes/371694)
**Author:** [@connectgeeks](https://discuss.elastic.co/u/connectgeeks)\ **Replies:** 5\ **Last updated:** [December 10, 2024, 6:42am UTC](https://discuss.elastic.co/t/eck-performance-optimisation-on-kubernetes/371694 "2024-12-10T06:42:28Z")
Can you pass on some recommendation on optimising elasticsearch cluster on Kubernetes. Current Configuration : 3 different node groups hot-warm-cold ES Nodegroup - 4 CPU 8Gib Mem /node Kibana - 2 CPU 4 Gib Mem /node … --- ## [Data Migration from 2.3.3 to 8..9.0](https://discuss.elastic.co/t/data-migration-from-2-3-3-to-8-9-0/368589)
**Author:** [@utkarsh-007](https://discuss.elastic.co/u/utkarsh-007)\ **Replies:** 5\ **Last updated:** [December 10, 2024, 7:02am UTC](https://discuss.elastic.co/t/data-migration-from-2-3-3-to-8-9-0/368589 "2024-12-10T07:02:40Z")
I have an on-premise elastic cluster running on version 2.3.3. (aka old) I have another on-premise elastic cluster running on version 8.9.0 (aka new) I want to migrate data from one index of old cluster to new index o… --- ## [Microsoft Office 365 integration not ingesting logs](https://discuss.elastic.co/t/microsoft-office-365-integration-not-ingesting-logs/371663)
**Author:** [@enyei](https://discuss.elastic.co/u/enyei)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 6:43am UTC](https://discuss.elastic.co/t/microsoft-office-365-integration-not-ingesting-logs/371663 "2024-12-10T06:43:22Z")
Hi, I'm following this guide here to ingest Microsoft Office 365 logs from the Management API I've already created an application and granted these permissions to the application. I've also granted Admin consent to th… --- ## [ELK WITH PROXMOX](https://discuss.elastic.co/t/elk-with-proxmox/371734)
**Author:** [@naresh.s](https://discuss.elastic.co/u/naresh.s)\ **Replies:** 0\ **Last updated:** [December 10, 2024, 4:45am UTC](https://discuss.elastic.co/t/elk-with-proxmox/371734 "2024-12-10T04:45:05Z")
I was planning to configure Proxmox with Elk. I tried using Filebeat for log collection, but I encountered some errors. Will the process work for the configuration? If so, could you suggest ways to make the process succe… --- ## [Having different passowrds for the pkcs12 keystore and the private key in the keystore](https://discuss.elastic.co/t/having-different-passowrds-for-the-pkcs12-keystore-and-the-private-key-in-the-keystore/371597)
**Author:** [@tom110](https://discuss.elastic.co/u/tom110)\ **Replies:** 1\ **Last updated:** [December 10, 2024, 3:39am UTC](https://discuss.elastic.co/t/having-different-passowrds-for-the-pkcs12-keystore-and-the-private-key-in-the-keystore/371597 "2024-12-10T03:39:37Z")
I am confused by how should i handle the passwords for the keystore and the private key inside the keystore. I used the following Openssl command to generate my own certificate using my own CA to secure http layer connec… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=123) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=125)