# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1702 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1703 --- ## [Packetbeat, fail to set up index lifecyle policy](https://discuss.elastic.co/t/packetbeat-fail-to-set-up-index-lifecyle-policy/255139)
**Author:** [@Yanyan\_Liang](https://discuss.elastic.co/u/Yanyan_Liang)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 12:04am UTC](https://discuss.elastic.co/t/packetbeat-fail-to-set-up-index-lifecyle-policy/255139 "2020-11-12T00:04:38Z")
Hi Community, I have tried to set up packetbeat index for 2 days, then rollover to delete phrase for 1 day. I have 1 node, for practice only. This was my configuration in packetbeat.yml where I made changes, others rem… --- ## [Remote clusters authentication](https://discuss.elastic.co/t/remote-clusters-authentication/254988)
**Author:** [@kyle\_che](https://discuss.elastic.co/u/kyle_che)\ **Replies:** 22\ **Last updated:** [November 11, 2020, 11:42pm UTC](https://discuss.elastic.co/t/remote-clusters-authentication/254988 "2020-11-11T23:42:36Z")
I am trying to test out remote clusters and then cross cluster replication. When inputting information about the other cluster under "Remote Clusters", Connection is saying "Not connected". I'm guessing this is due to my… --- ## [Logstash support for composable templates in elasticsearch output](https://discuss.elastic.co/t/logstash-support-for-composable-templates-in-elasticsearch-output/255137)
**Author:** [@phospodka](https://discuss.elastic.co/u/phospodka)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 10:34pm UTC](https://discuss.elastic.co/t/logstash-support-for-composable-templates-in-elasticsearch-output/255137 "2020-11-11T22:34:57Z")
I am trying to upgrade versions of ELK and I have noticed that templates have changed. There is a legacy way and a new composable way. I currently have logstash supply custom templates for different indices. However, … --- ## [Unable to find valid certification path to requested target](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/254829)
**Author:** [@drivera](https://discuss.elastic.co/u/drivera)\ **Replies:** 4\ **Last updated:** [November 11, 2020, 10:12pm UTC](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/254829 "2020-11-11T22:12:47Z")
Hello, I'm trying to authenticate users via AD with no success. Running ES 7.9.2. with TLS encryption in the cluster. Below you can see the excerpt of the yml file where I'm setting up xpack security, and the error I am… --- ## [Timelion gaps in dashboard display data (SNMP interface utilization)](https://discuss.elastic.co/t/timelion-gaps-in-dashboard-display-data-snmp-interface-utilization/254460)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 5\ **Last updated:** [November 11, 2020, 9:48pm UTC](https://discuss.elastic.co/t/timelion-gaps-in-dashboard-display-data-snmp-interface-utilization/254460 "2020-11-11T21:48:44Z")
Hello, Recently I have made my first logstash pipeline that ingests data gathered via SNMP form network devices regarding interfaces statistic. I have made timelion graph to displayed network interface utilization but I… --- ## [How to add heartbet field to alerts index](https://discuss.elastic.co/t/how-to-add-heartbet-field-to-alerts-index/254697)
**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 9:42pm UTC](https://discuss.elastic.co/t/how-to-add-heartbet-field-to-alerts-index/254697 "2020-11-11T21:42:22Z")
Hello, I want to configure alerting for uptime monitors by the general rule that would apply to any monitor. To be able to connect my code to this I need some filed to knew which host general alert says about. Rig… --- ## [VİSUALİZE LABELS NOT SHOWİNG](https://discuss.elastic.co/t/visualize-labels-not-showing/254983)
**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\ **Replies:** 4\ **Last updated:** [November 11, 2020, 9:39pm UTC](https://discuss.elastic.co/t/visualize-labels-not-showing/254983 "2020-11-11T21:39:35Z")
visualize labels do not come all As seen in the graph, 1 of them has no arrow and label. --- ## [HOW İS TABLE DATE SORT DESC?](https://discuss.elastic.co/t/how-is-table-date-sort-desc/254981)
**Author:** [@mr\_searchng](https://discuss.elastic.co/u/mr_searchng)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 9:36pm UTC](https://discuss.elastic.co/t/how-is-table-date-sort-desc/254981 "2020-11-11T21:36:40Z")
By default, the table with date columns comes in asc order. I want the tables with date columns to come as desc order. When I create the table, the dates are exactly the opposite. sort the way as desc, not asc. I wa… --- ## [Receive from Webhook](https://discuss.elastic.co/t/receive-from-webhook/255128)
**Author:** [@GavinBeattie](https://discuss.elastic.co/u/GavinBeattie)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:14pm UTC](https://discuss.elastic.co/t/receive-from-webhook/255128 "2020-11-11T21:14:37Z")
OnePageCRM has the ability to output changes via a webhook. What I would like to know is how can I setup Elasticsearch to receive the post (or more importantly transform it) from the OnePageCRM format to the ES post form… --- ## [Libclntsh.so: cannot open shared object file](https://discuss.elastic.co/t/libclntsh-so-cannot-open-shared-object-file/255126)
**Author:** [@glitz](https://discuss.elastic.co/u/glitz)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:00pm UTC](https://discuss.elastic.co/t/libclntsh-so-cannot-open-shared-object-file/255126 "2020-11-11T21:00:45Z")
Hello, I'm trying to configure Metricbeat with Oracle module but I got this error: module/wrapper.go:266 Error fetching data for metricset oracle.performance: error creating connection to Oracle: error doing ping to da… --- ## [Snapshot Search vs Cold Nodes](https://discuss.elastic.co/t/snapshot-search-vs-cold-nodes/255121)
**Author:** [@rverchere](https://discuss.elastic.co/u/rverchere)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 8:17pm UTC](https://discuss.elastic.co/t/snapshot-search-vs-cold-nodes/255121 "2020-11-11T20:17:28Z")
Hi! I've just seen that Elastic will release snapshot search release for 7.10: https://www.elastic.co/fr/blog/whats-new-elastic-7-10-0-searchable-snapshots-lens-user-experience-monitoring https://www.elastic.co/guide/… --- ## [Elasticsearch Snapshot](https://discuss.elastic.co/t/elasticsearch-snapshot/254907)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 13\ **Last updated:** [November 11, 2020, 6:43pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot/254907 "2020-11-11T18:43:23Z")
Im using Snapshot Lifecycle Mgmt to create nightly snapshots. My questions are I saw this comes under Basic license. But I got confused when I saw XPACK tag in SLM page. Please clarify Since this will be daily snap… --- ## [Cosine-Distance of reduced dense vectors](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114)
**Author:** [@christiana](https://discuss.elastic.co/u/christiana)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:40pm UTC](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114 "2020-11-11T18:40:40Z")
Hi, i have set up a database containing documents which are having dense vectors for the features and for a binary \[1,0\] mask. I would like to use the script query to the database with a feature vector at runtime. For … --- ## [Suggestions for Kibana slowness with tens of millions of records](https://discuss.elastic.co/t/suggestions-for-kibana-slowness-with-tens-of-millions-of-records/254996)
**Author:** [@rgeisman](https://discuss.elastic.co/u/rgeisman)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 6:31pm UTC](https://discuss.elastic.co/t/suggestions-for-kibana-slowness-with-tens-of-millions-of-records/254996 "2020-11-11T18:31:55Z")
Hello Elastic Community. I have created an ELK cluster with 5 boxes, and on box 5 one instance of Kibana is running. All 5 boxes are ingesting with one of the nodes being a master node. We have filebeat, auditbeat and… --- ## [Running out of heap memory Elasticsearch](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848)
**Author:** [@yasir\_khatri](https://discuss.elastic.co/u/yasir_khatri)\ **Replies:** 14\ **Last updated:** [November 11, 2020, 6:28pm UTC](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848 "2020-11-11T18:28:16Z")
We are using single node of elasticsearch with 24 gb of heap memory. The rollover size is 75gb with 2 shards per index therefore single shard size is roughly 37.5 gb. We need to archive 8 Tb of data out of which 2 Tb ha… --- ## [Authentication in us-gov-west-1 with Metricbeat AWS module](https://discuss.elastic.co/t/authentication-in-us-gov-west-1-with-metricbeat-aws-module/254951)
**Author:** [@jstein\_presidio](https://discuss.elastic.co/u/jstein_presidio)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 6:13pm UTC](https://discuss.elastic.co/t/authentication-in-us-gov-west-1-with-metricbeat-aws-module/254951 "2020-11-11T18:13:52Z")
aws.yml is as follows regions: us-gov-west-1 shared\_credential\_file: /mnt/home/metricbeat/.aws\_creds aws\_partition: aws-us-gov #endpoint: us-gov-west-1.amazonaws.com period: 5m metricsets: - ec2 2020-11… --- ## [Exception when highlighting](https://discuss.elastic.co/t/exception-when-highlighting/255108)
**Author:** [@yansplichal](https://discuss.elastic.co/u/yansplichal)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:11pm UTC](https://discuss.elastic.co/t/exception-when-highlighting/255108 "2020-11-11T18:11:24Z")
Hi, In elasticsearch 7.9.2 - when a lot of documents are highlighted by unified highlighter - I am getting an exception. The query used to work in elasticsearch 7.1.0. I try to highlight everything: "highlight": { … --- ## [Setting custom index for two data sources in filebeat 7.x](https://discuss.elastic.co/t/setting-custom-index-for-two-data-sources-in-filebeat-7-x/254400)
**Author:** [@Atul\_Chadha](https://discuss.elastic.co/u/Atul_Chadha)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 5:33pm UTC](https://discuss.elastic.co/t/setting-custom-index-for-two-data-sources-in-filebeat-7-x/254400 "2020-11-11T17:33:57Z")
I am trying to add two index types based on the different log sources in filebeat 7.6.2, i have managed to get custom name running for one of the source however cant seem to find how this can be done for different data s… --- ## [Disabling kibana home](https://discuss.elastic.co/t/disabling-kibana-home/254804)
**Author:** [@teej](https://discuss.elastic.co/u/teej)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 5:18pm UTC](https://discuss.elastic.co/t/disabling-kibana-home/254804 "2020-11-11T17:18:11Z")
Hi, Ive created dedicated spaces for users and so far it seems to contain them fine. However, when they click on the Kibana Home button it takes them out of their restricted area and into an area that allows them to sta… --- ## [Kibana audit logs on search term and filters etc](https://discuss.elastic.co/t/kibana-audit-logs-on-search-term-and-filters-etc/254666)
**Author:** [@xdzhou](https://discuss.elastic.co/u/xdzhou)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 5:04pm UTC](https://discuss.elastic.co/t/kibana-audit-logs-on-search-term-and-filters-etc/254666 "2020-11-11T17:04:46Z")
I am wondering is it possible to track user activity of how they are using kibana, not just the security features like logging and logoff, but more of which dashboard they are accessing and more importantly, the filter a… --- ## [Comparison against business units](https://discuss.elastic.co/t/comparison-against-business-units/254945)
**Author:** [@d-ring](https://discuss.elastic.co/u/d-ring)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 4:47pm UTC](https://discuss.elastic.co/t/comparison-against-business-units/254945 "2020-11-11T16:47:04Z")
Good Morning Kibana Wizards, I am trying to build a dashboard that will compare business units of differing sizes equally. As an example users taking security training. HR has 120 users, 100 of which has completed trai… --- ## [Heatmap respect X or Y axis metric, not both](https://discuss.elastic.co/t/heatmap-respect-x-or-y-axis-metric-not-both/254447)
**Author:** [@nunes](https://discuss.elastic.co/u/nunes)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 4:39pm UTC](https://discuss.elastic.co/t/heatmap-respect-x-or-y-axis-metric-not-both/254447 "2020-11-11T16:39:09Z")
Im trying to make a calendar with heatmap vizualization. Sum of field group by week number and week day. And this works when i use histogram aggregate for week day. But i want to use the week days in text (Mon, Tue, Wed… --- ## [Can not connect to Elasticsearch using Spark and elasticsearch-hadoop](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-using-spark-and-elasticsearch-hadoop/255077)
**Author:** [@swafa](https://discuss.elastic.co/u/swafa)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 2:01pm UTC](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-using-spark-and-elasticsearch-hadoop/255077 "2020-11-11T14:01:04Z")
We are trying to index our Elasticsearch cluster (version: 7.6.1) from Databricks using the elasticsearch-hadoop library (version: 7.9.3). Due to corporate compliance reasons, our Elasticsearch cluster can only be acces… --- ## [ILM policy does not get applied to newly created/rolled over indexes](https://discuss.elastic.co/t/ilm-policy-does-not-get-applied-to-newly-created-rolled-over-indexes/255096)
**Author:** [@Anirbaan\_Chowdhury](https://discuss.elastic.co/u/Anirbaan_Chowdhury)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 3:59pm UTC](https://discuss.elastic.co/t/ilm-policy-does-not-get-applied-to-newly-created-rolled-over-indexes/255096 "2020-11-11T15:59:06Z")
Hi Experts, I am using the default index, index template and ilm policy created by filebeat. Although the ilm policy is assigned to the index template, it does not automatically get assigned to the newly created/rolled… --- ## [Query DSL](https://discuss.elastic.co/t/query-dsl/254615)
**Author:** [@peretz\_shlomi](https://discuss.elastic.co/u/peretz_shlomi)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 3:43pm UTC](https://discuss.elastic.co/t/query-dsl/254615 "2020-11-11T15:43:48Z")
hii I want to make filter on visualization by query dsl a need to make filter to visualization by last value who entered to one field (name : product name) --- ## [Regex on a string field with number](https://discuss.elastic.co/t/regex-on-a-string-field-with-number/254667)
**Author:** [@sudersank](https://discuss.elastic.co/u/sudersank)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 3:41pm UTC](https://discuss.elastic.co/t/regex-on-a-string-field-with-number/254667 "2020-11-11T15:41:32Z")
I have a timestamp field which will have value as below log\_timestamp : 11/8/2020#17:21:25:635 The log\_timestamp is a string field. How do i use regex to filter values from 11/8/2020#17:21:22:635 To 11/8/2020#17:21:25… --- ## [JSON to fields in Logstash](https://discuss.elastic.co/t/json-to-fields-in-logstash/255016)
**Author:** [@Stevek](https://discuss.elastic.co/u/Stevek)\ **Replies:** 6\ **Last updated:** [November 11, 2020, 3:29pm UTC](https://discuss.elastic.co/t/json-to-fields-in-logstash/255016 "2020-11-11T15:29:53Z")
Hello, I am struggling to obtain fields with values from simple JSON file using logstash. Currently putting the output to file so I see if it looks okay, but I always receive errors for each line. JSON : { "cpuLoad":… --- ## [Increase insert and search rate in elastic search](https://discuss.elastic.co/t/increase-insert-and-search-rate-in-elastic-search/254963)
**Author:** [@Sherrie](https://discuss.elastic.co/u/Sherrie)\ **Replies:** 3\ **Last updated:** [November 11, 2020, 3:29pm UTC](https://discuss.elastic.co/t/increase-insert-and-search-rate-in-elastic-search/254963 "2020-11-11T15:29:10Z")
Hi, We are using a JAVA API to insert 100k records from a kafka topic to elastic search endpoints to a particular index. The insert rate for 100k records takes upto 30 minutes. Whereas the same 100k records can be inser… --- ## [Logstash In Windowsn not Pushing logs to kibana](https://discuss.elastic.co/t/logstash-in-windowsn-not-pushing-logs-to-kibana/255091)
**Author:** [@Rahul\_Ravichandran](https://discuss.elastic.co/u/Rahul_Ravichandran)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 3:26pm UTC](https://discuss.elastic.co/t/logstash-in-windowsn-not-pushing-logs-to-kibana/255091 "2020-11-11T15:26:36Z")
Hi guys, I wanted to install logstash in windows 2019 server as my server is in AWS and my ES domain is also in AWS. Im directly using logsatsh to transfer logs to ES end point. This is my logstash.conf file i… --- ## [Intermittent slowness in queries](https://discuss.elastic.co/t/intermittent-slowness-in-queries/255087)
**Author:** [@dcamozzato](https://discuss.elastic.co/u/dcamozzato)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 2:37pm UTC](https://discuss.elastic.co/t/intermittent-slowness-in-queries/255087 "2020-11-11T14:37:25Z")
Hi, I am trying to understand some intermittent slowness in my stack. The symptom is this: I go into Kibana and run a query filtering only by time - "last 24 hours", for example - and I get results in 2 seconds. Ten m… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1701) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1703)