# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1084 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1085 --- ## [With xpack security enabled i can't run a custom plugin - what should change in that plugin?](https://discuss.elastic.co/t/with-xpack-security-enabled-i-cant-run-a-custom-plugin-what-should-change-in-that-plugin/295083)
**Author:** [@LucaL](https://discuss.elastic.co/u/LucaL)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 3:50pm UTC](https://discuss.elastic.co/t/with-xpack-security-enabled-i-cant-run-a-custom-plugin-what-should-change-in-that-plugin/295083 "2022-01-21T15:50:01Z")
Hello, dev sent me a plugin to install on Elasticsearch installed via Elastic Stack Operator on Kubernetes with all security features enabled (authentication, https, etc.). What happens is that plugin, previously worki… --- ## [Kibana plugin development connection issue](https://discuss.elastic.co/t/kibana-plugin-development-connection-issue/295078)
**Author:** [@Richard\_L\_Nichols](https://discuss.elastic.co/u/Richard_L_Nichols)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 3:35pm UTC](https://discuss.elastic.co/t/kibana-plugin-development-connection-issue/295078 "2022-01-21T15:35:32Z")
I have Elastic and Kibana running successfully. Now I’m unsure how to launch the development version. I went to the directory in WSL and used the “yarn start” command. I have updated the kibana.yml file to reflect the v… --- ## [Question on replica shards](https://discuss.elastic.co/t/question-on-replica-shards/295076)
**Author:** [@Pradyumna\_Achar](https://discuss.elastic.co/u/Pradyumna_Achar)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 3:32pm UTC](https://discuss.elastic.co/t/question-on-replica-shards/295076 "2022-01-21T15:32:11Z")
Hello, I have a question regarding replica shards. As I understand, a write to the primary gets propagated to replicas on other nodes via requests that use the same write pool and the same write queue as user-initiated … --- ## [Fields don't show up when events are published](https://discuss.elastic.co/t/fields-dont-show-up-when-events-are-published/294722)
**Author:** [@a11](https://discuss.elastic.co/u/a11)\ **Replies:** 4\ **Last updated:** [January 21, 2022, 3:24pm UTC](https://discuss.elastic.co/t/fields-dont-show-up-when-events-are-published/294722 "2022-01-21T15:24:37Z")
Hi all, I'm struggling with a windows event to publish. Event xml below, strongs fields aren't publish by Winlogbeat. - \ - \ \ **Author:** [@blumre](https://discuss.elastic.co/u/blumre)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 2:49pm UTC](https://discuss.elastic.co/t/absolute-instead-of-relative-url-field/295068 "2022-01-21T14:49:00Z") Hi, I have one field in an index that contains list of URLs. I changed the index pattern to be URL but the problem is that most of the URLS opened as relative paths although I want it to be absolute , for example if the … --- ## [Error Connecting kafka with logsash](https://discuss.elastic.co/t/error-connecting-kafka-with-logsash/295067)
**Author:** [@Avnish\_Singh](https://discuss.elastic.co/u/Avnish_Singh)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 2:42pm UTC](https://discuss.elastic.co/t/error-connecting-kafka-with-logsash/295067 "2022-01-21T14:42:57Z")
OS: Rocky Linux 8.5 Logstash: logstash-7.16.2 Hi, I'm trying to start logstash with kafka as input, here is the config: input { kafka{ bootstrap\_servers =\> "xx.xx.xxx.xx:9092" topics =\> \["ext\_device… --- ## [Missing index setting in the new Java Client](https://discuss.elastic.co/t/missing-index-setting-in-the-new-java-client/294739)
**Author:** [@jdrossl](https://discuss.elastic.co/u/jdrossl)\ **Replies:** 6\ **Last updated:** [January 21, 2022, 2:19pm UTC](https://discuss.elastic.co/t/missing-index-setting-in-the-new-java-client/294739 "2022-01-21T14:19:06Z")
Hi everyone! I'm working on a migration from the RHLC to the new Java Client and most of it went fine but it seems like there is a whole section missing for Index Settings (index.mapping.\*) is this intentional or someth… --- ## [Indexing flattened field with unique keys is very slow](https://discuss.elastic.co/t/indexing-flattened-field-with-unique-keys-is-very-slow/294833)
**Author:** [@caseydm](https://discuss.elastic.co/u/caseydm)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 1:38pm UTC](https://discuss.elastic.co/t/indexing-flattened-field-with-unique-keys-is-very-slow/294833 "2022-01-21T13:38:20Z")
I have a logstash ingest process that ingests records at 4k events per second. Recently we added field that is an object consisting of unique keys. I save it as a flattened data type. But ingest processing time starts at… --- ## [Know Kibana & elasticsearch metrics](https://discuss.elastic.co/t/know-kibana-elasticsearch-metrics/295050)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 1:32pm UTC](https://discuss.elastic.co/t/know-kibana-elasticsearch-metrics/295050 "2022-01-21T13:32:06Z")
Hi, i want to know my Elasticsearch metrics like RAM, heap size, CPU , memory etc. How do I know these ..Is there a Elasticsearch command for this? --- ## [Vega script](https://discuss.elastic.co/t/vega-script/295049)
**Author:** [@paigekim](https://discuss.elastic.co/u/paigekim)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 1:30pm UTC](https://discuss.elastic.co/t/vega-script/295049 "2022-01-21T13:30:33Z")
Hello, I am currently using Custom visualization using vega and would like to put a filter on the field option. { $schema: https://vega.github.io/schema/vega-lite/v4.json title: vega test data: { url: { … --- ## [Logstash - Json Parse Failure and Encoding Problem](https://discuss.elastic.co/t/logstash-json-parse-failure-and-encoding-problem/293447)
**Author:** [@nevincansel](https://discuss.elastic.co/u/nevincansel)\ **Replies:** 7\ **Last updated:** [January 21, 2022, 1:26pm UTC](https://discuss.elastic.co/t/logstash-json-parse-failure-and-encoding-problem/293447 "2022-01-21T13:26:32Z")
Hello, I have a pipeline with tcp input in logstash and pipeline is working without a problem but logs are broken. These are error logs in logstash. 13:34:43.868 \[nioEventLoopGroup-2-2\] WARN logstash.codecs.jsonlines … --- ## [Logstash Indices Rollover to Warm](https://discuss.elastic.co/t/logstash-indices-rollover-to-warm/295058)
**Author:** [@teamomni](https://discuss.elastic.co/u/teamomni)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 1:22pm UTC](https://discuss.elastic.co/t/logstash-indices-rollover-to-warm/295058 "2022-01-21T13:22:36Z")
We have been having issues getting our Logstash data to rollover from hot to warm after 30 days on our Elastic Cloud server. Before we change any settings, we would like to make sure we understand what we are doing. Cur… --- ## [Visual Builder issue - The request for this panel failed](https://discuss.elastic.co/t/visual-builder-issue-the-request-for-this-panel-failed/295056)
**Author:** [@omshankarkumar161](https://discuss.elastic.co/u/omshankarkumar161)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 12:43pm UTC](https://discuss.elastic.co/t/visual-builder-issue-the-request-for-this-panel-failed/295056 "2022-01-21T12:43:07Z")
While creating Time Series visualization using Visual builder, i am facing below issue. --- ## [Support-diagnostics](https://discuss.elastic.co/t/support-diagnostics/294925)
**Author:** [@jadhav.datta](https://discuss.elastic.co/u/jadhav.datta)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 12:05pm UTC](https://discuss.elastic.co/t/support-diagnostics/294925 "2022-01-21T12:05:58Z")
Getting below error while run diagnostics my windows workstation , please help . JAVA\_HOME found, using C:\\Program Files\\Java\\jdk-17.0.2 2022-01-20 10:38:47,017 main ERROR Unable to locate appender "diag" for logger c… --- ## [Filebeat not parsing multiline](https://discuss.elastic.co/t/filebeat-not-parsing-multiline/294969)
**Author:** [@ConorTier](https://discuss.elastic.co/u/ConorTier)\ **Replies:** 2\ **Last updated:** [January 21, 2022, 11:56am UTC](https://discuss.elastic.co/t/filebeat-not-parsing-multiline/294969 "2022-01-21T11:56:54Z")
Here is my scenario - Logstash running on an hosted internal windows server Filebeat running on a linux (Ubuntu) - internally hosted (both can communicate with other internally ok) docker containers running on Linux b… --- ## [Retreive all documents of specific index from ES with snapshot](https://discuss.elastic.co/t/retreive-all-documents-of-specific-index-from-es-with-snapshot/295034)
**Author:** [@Hyeongjun\_Kim](https://discuss.elastic.co/u/Hyeongjun_Kim)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 11:45am UTC](https://discuss.elastic.co/t/retreive-all-documents-of-specific-index-from-es-with-snapshot/295034 "2022-01-21T11:45:13Z")
Hello, I want to extract all documents from ES index. More than 6M documents are stored in target index. In order to get all documents with scroll or search\_after API, I have to send lots of search requests. Many sear… --- ## [Vector tiles search not returning hits on geo\_shape fields](https://discuss.elastic.co/t/vector-tiles-search-not-returning-hits-on-geo-shape-fields/294926)
**Author:** [@henri.normak](https://discuss.elastic.co/u/henri.normak)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 11:33am UTC](https://discuss.elastic.co/t/vector-tiles-search-not-returning-hits-on-geo-shape-fields/294926 "2022-01-21T11:33:28Z")
The index mapping being used is equivalent to this one (simplified): PUT locations { "mappings": { "properties": { "geoshape": { "type": "geo\_shape" } } } } There is a specific document … --- ## [Automate Deletion of Docs from an Index that are older than 10 days](https://discuss.elastic.co/t/automate-deletion-of-docs-from-an-index-that-are-older-than-10-days/293826)
**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 11:20am UTC](https://discuss.elastic.co/t/automate-deletion-of-docs-from-an-index-that-are-older-than-10-days/293826 "2022-01-21T11:20:33Z")
Hi, Currently, I am deleting docs using DSL queries that are older than 10 days. I am having a 1P shard on a single node with No replicas or nodes for this env. DSL query- POST index\_name/\_delete\_by\_query { "query": … --- ## [Combining documents in two indices correlated by their ID, but the fieldname is different](https://discuss.elastic.co/t/combining-documents-in-two-indices-correlated-by-their-id-but-the-fieldname-is-different/294933)
**Author:** [@Spookies123](https://discuss.elastic.co/u/Spookies123)\ **Replies:** 7\ **Last updated:** [January 21, 2022, 10:41am UTC](https://discuss.elastic.co/t/combining-documents-in-two-indices-correlated-by-their-id-but-the-fieldname-is-different/294933 "2022-01-21T10:41:52Z")
Hi! I am fairly new to the elastic stack, and i was wondering if something like the title suggests is possible. Say i have two types of documents, one for cars, and one for drivers. I want to combine the two documents in… --- ## [Customize Date range not appearing in visualization gear icon](https://discuss.elastic.co/t/customize-date-range-not-appearing-in-visualization-gear-icon/294980)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 10:16am UTC](https://discuss.elastic.co/t/customize-date-range-not-appearing-in-visualization-gear-icon/294980 "2022-01-21T10:16:51Z")
Hi, I want to customize Date range not appearing in visualization gear icon. I want to show chart for past 7 days for only this visualization. But this option cannot be seen. I can only see Edit this tile. Any idea w… --- ## [Change the default precision\_threshold from 3000 to 40000](https://discuss.elastic.co/t/change-the-default-precision-threshold-from-3000-to-40000/295038)
**Author:** [@zevodku](https://discuss.elastic.co/u/zevodku)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 9:03am UTC](https://discuss.elastic.co/t/change-the-default-precision-threshold-from-3000-to-40000/295038 "2022-01-21T09:03:59Z")
Hello folks, Is there any way to change the default precision\_threshold from "3000" to "40000" as a global thing? Like in the configuration files (Elasticsearch.yml or kibana.yml)? I'm using cardinality extensively and… --- ## [Kibana not loading due to "Cannot read properties of undefined"](https://discuss.elastic.co/t/kibana-not-loading-due-to-cannot-read-properties-of-undefined/295036)
**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 8:55am UTC](https://discuss.elastic.co/t/kibana-not-loading-due-to-cannot-read-properties-of-undefined/295036 "2022-01-21T08:55:55Z")
I am trying to spin up a kibana / Elasticsearch stack using ECK operator. This is something I have done multiple times. In just one of the attempts however, kibana is not loading on my browser with the following error … --- ## [Multi field custom elasticsearch analyzer](https://discuss.elastic.co/t/multi-field-custom-elasticsearch-analyzer/294613)
**Author:** [@dishant.sharma](https://discuss.elastic.co/u/dishant.sharma)\ **Replies:** 2\ **Last updated:** [January 21, 2022, 8:54am UTC](https://discuss.elastic.co/t/multi-field-custom-elasticsearch-analyzer/294613 "2022-01-21T08:54:40Z")
I am creating an Elasticsearch plugin. I want to analyze a url in two different ways using the same analyzer that is pattern analyzer but with different regular expressions for getting different tokens. I have started c… --- ## [Enrichment - is it the best way?](https://discuss.elastic.co/t/enrichment-is-it-the-best-way/294802)
**Author:** [@jkulcsar](https://discuss.elastic.co/u/jkulcsar)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 8:44am UTC](https://discuss.elastic.co/t/enrichment-is-it-the-best-way/294802 "2022-01-21T08:44:27Z")
Hello all, We've been using Elastic in capturing and consolidating IoT data however - my experience with Elastic is however limited to about 6 months. Consider the scenario: large number of IoT devices with known s… --- ## [Lower case problem in field names](https://discuss.elastic.co/t/lower-case-problem-in-field-names/295026)
**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 8:42am UTC](https://discuss.elastic.co/t/lower-case-problem-in-field-names/295026 "2022-01-21T08:42:41Z")
Hello dear friends, I have a problem, if you can help me I would be very happy. The problem is that; I reindexed from an existing index. While reindexing, there was a capitalization problem in the field names, so I added… --- ## [Pipeline in pipe output Logstash](https://discuss.elastic.co/t/pipeline-in-pipe-output-logstash/295032)
**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 8:41am UTC](https://discuss.elastic.co/t/pipeline-in-pipe-output-logstash/295032 "2022-01-21T08:41:16Z")
hello! I would like to know if, like an Elasticsearch output, we can use pipeline =\> "%{\[@metadata\]\[pipeline\]}" for parsing logs, we could use these predefined pipelines in the pipe type output to parse previously parse… --- ## [How to migrate from version 7.12 to version 7.16.2?](https://discuss.elastic.co/t/how-to-migrate-from-version-7-12-to-version-7-16-2/293964)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 5\ **Last updated:** [January 21, 2022, 7:52am UTC](https://discuss.elastic.co/t/how-to-migrate-from-version-7-12-to-version-7-16-2/293964 "2022-01-21T07:52:31Z")
7.12 cluster 7.16 I made a snapshot on the 7.12 cluster, shared the snapshot using NFS, then created a new 7.16 cluster, mounted the nfs path, and registered the warehouse with the same name on kibana. After … --- ## [Kibana not loading due to unsafe script](https://discuss.elastic.co/t/kibana-not-loading-due-to-unsafe-script/295025)
**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 7:50am UTC](https://discuss.elastic.co/t/kibana-not-loading-due-to-unsafe-script/295025 "2022-01-21T07:50:25Z")
I have upgraded my elastic / kibana stack from 7.12.1 to 7.16.2 Unfortunately and despite the fact that elasticsearch is now healthy, kibana is not loading due to a js error: login:1 Refused to execute script from 'htt… --- ## [Logstash configuration to process 1M events per second](https://discuss.elastic.co/t/logstash-configuration-to-process-1m-events-per-second/288989)
**Author:** [@KunwarAkanksha](https://discuss.elastic.co/u/KunwarAkanksha)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 7:23am UTC](https://discuss.elastic.co/t/logstash-configuration-to-process-1m-events-per-second/288989 "2022-01-21T07:23:56Z")
I have events of around 1M (real time), logstash is proecessing 40K at one instances and one pipeline, if I increase the logstash instance to two it goes around 30K each (60K cummulative) but increasing the logstash inst… --- ## [Logstash to cassandra JDBC Input](https://discuss.elastic.co/t/logstash-to-cassandra-jdbc-input/295019)
**Author:** [@Mandark1990](https://discuss.elastic.co/u/Mandark1990)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 6:46am UTC](https://discuss.elastic.co/t/logstash-to-cassandra-jdbc-input/295019 "2022-01-21T06:46:19Z")
Dear All, Am trying to Connect to SSL enabled Cassandra 3.11 by using the Logstash 7.10.2 builds jdbc input plugin. I tried the Steps and the Cassandra Drivers given in the Below links and also copied the cassandra\_dri… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1083) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1085)