# Latest **URL:** https://discuss.elastic.co/latest.md?page=1297 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1298 --- ## [Indexing flattened field with unique keys is very slow](https://discuss.elastic.co/t/indexing-flattened-field-with-unique-keys-is-very-slow/294833)
**Author:** [@caseydm](https://discuss.elastic.co/u/caseydm)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 1:38pm UTC](https://discuss.elastic.co/t/indexing-flattened-field-with-unique-keys-is-very-slow/294833 "2022-01-21T13:38:20Z")
I have a logstash ingest process that ingests records at 4k events per second. Recently we added field that is an object consisting of unique keys. I save it as a flattened data type. But ingest processing time starts at… --- ## [Know Kibana & elasticsearch metrics](https://discuss.elastic.co/t/know-kibana-elasticsearch-metrics/295050)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 1:32pm UTC](https://discuss.elastic.co/t/know-kibana-elasticsearch-metrics/295050 "2022-01-21T13:32:06Z")
Hi, i want to know my Elasticsearch metrics like RAM, heap size, CPU , memory etc. How do I know these ..Is there a Elasticsearch command for this? --- ## [Vega script](https://discuss.elastic.co/t/vega-script/295049)
**Author:** [@paigekim](https://discuss.elastic.co/u/paigekim)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 1:30pm UTC](https://discuss.elastic.co/t/vega-script/295049 "2022-01-21T13:30:33Z")
Hello, I am currently using Custom visualization using vega and would like to put a filter on the field option. { $schema: https://vega.github.io/schema/vega-lite/v4.json title: vega test data: { url: { … --- ## [Logstash - Json Parse Failure and Encoding Problem](https://discuss.elastic.co/t/logstash-json-parse-failure-and-encoding-problem/293447)
**Author:** [@nevincansel](https://discuss.elastic.co/u/nevincansel)\ **Replies:** 7\ **Last updated:** [January 21, 2022, 1:26pm UTC](https://discuss.elastic.co/t/logstash-json-parse-failure-and-encoding-problem/293447 "2022-01-21T13:26:32Z")
Hello, I have a pipeline with tcp input in logstash and pipeline is working without a problem but logs are broken. These are error logs in logstash. 13:34:43.868 \[nioEventLoopGroup-2-2\] WARN logstash.codecs.jsonlines … --- ## [Logstash Indices Rollover to Warm](https://discuss.elastic.co/t/logstash-indices-rollover-to-warm/295058)
**Author:** [@teamomni](https://discuss.elastic.co/u/teamomni)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 1:22pm UTC](https://discuss.elastic.co/t/logstash-indices-rollover-to-warm/295058 "2022-01-21T13:22:36Z")
We have been having issues getting our Logstash data to rollover from hot to warm after 30 days on our Elastic Cloud server. Before we change any settings, we would like to make sure we understand what we are doing. Cur… --- ## [Visual Builder issue - The request for this panel failed](https://discuss.elastic.co/t/visual-builder-issue-the-request-for-this-panel-failed/295056)
**Author:** [@omshankarkumar161](https://discuss.elastic.co/u/omshankarkumar161)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 12:43pm UTC](https://discuss.elastic.co/t/visual-builder-issue-the-request-for-this-panel-failed/295056 "2022-01-21T12:43:07Z")
While creating Time Series visualization using Visual builder, i am facing below issue. --- ## [Support-diagnostics](https://discuss.elastic.co/t/support-diagnostics/294925)
**Author:** [@jadhav.datta](https://discuss.elastic.co/u/jadhav.datta)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 12:05pm UTC](https://discuss.elastic.co/t/support-diagnostics/294925 "2022-01-21T12:05:58Z")
Getting below error while run diagnostics my windows workstation , please help . JAVA\_HOME found, using C:\\Program Files\\Java\\jdk-17.0.2 2022-01-20 10:38:47,017 main ERROR Unable to locate appender "diag" for logger c… --- ## [Filebeat not parsing multiline](https://discuss.elastic.co/t/filebeat-not-parsing-multiline/294969)
**Author:** [@ConorTier](https://discuss.elastic.co/u/ConorTier)\ **Replies:** 2\ **Last updated:** [January 21, 2022, 11:56am UTC](https://discuss.elastic.co/t/filebeat-not-parsing-multiline/294969 "2022-01-21T11:56:54Z")
Here is my scenario - Logstash running on an hosted internal windows server Filebeat running on a linux (Ubuntu) - internally hosted (both can communicate with other internally ok) docker containers running on Linux b… --- ## [Retreive all documents of specific index from ES with snapshot](https://discuss.elastic.co/t/retreive-all-documents-of-specific-index-from-es-with-snapshot/295034)
**Author:** [@Hyeongjun\_Kim](https://discuss.elastic.co/u/Hyeongjun_Kim)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 11:45am UTC](https://discuss.elastic.co/t/retreive-all-documents-of-specific-index-from-es-with-snapshot/295034 "2022-01-21T11:45:13Z")
Hello, I want to extract all documents from ES index. More than 6M documents are stored in target index. In order to get all documents with scroll or search\_after API, I have to send lots of search requests. Many sear… --- ## [Vector tiles search not returning hits on geo\_shape fields](https://discuss.elastic.co/t/vector-tiles-search-not-returning-hits-on-geo-shape-fields/294926)
**Author:** [@henri.normak](https://discuss.elastic.co/u/henri.normak)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 11:33am UTC](https://discuss.elastic.co/t/vector-tiles-search-not-returning-hits-on-geo-shape-fields/294926 "2022-01-21T11:33:28Z")
The index mapping being used is equivalent to this one (simplified): PUT locations { "mappings": { "properties": { "geoshape": { "type": "geo\_shape" } } } } There is a specific document … --- ## [Help with collecting Custom Windows Event Logs with Elastic Agent](https://discuss.elastic.co/t/help-with-collecting-custom-windows-event-logs-with-elastic-agent/295053)
**Author:** [@Josh\_G](https://discuss.elastic.co/u/Josh_G)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 11:29am UTC](https://discuss.elastic.co/t/help-with-collecting-custom-windows-event-logs-with-elastic-agent/295053 "2022-01-21T11:29:11Z")
Hello everyone! A very rudimentary question I think, but haven't been able to find clarification myself. I am still very much getting to grips with the platform, and logging itself, so apologies if it is a really obviou… --- ## [Automate Deletion of Docs from an Index that are older than 10 days](https://discuss.elastic.co/t/automate-deletion-of-docs-from-an-index-that-are-older-than-10-days/293826)
**Author:** [@Divyank\_Mahalle](https://discuss.elastic.co/u/Divyank_Mahalle)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 11:20am UTC](https://discuss.elastic.co/t/automate-deletion-of-docs-from-an-index-that-are-older-than-10-days/293826 "2022-01-21T11:20:33Z")
Hi, Currently, I am deleting docs using DSL queries that are older than 10 days. I am having a 1P shard on a single node with No replicas or nodes for this env. DSL query- POST index\_name/\_delete\_by\_query { "query": … --- ## [Combining documents in two indices correlated by their ID, but the fieldname is different](https://discuss.elastic.co/t/combining-documents-in-two-indices-correlated-by-their-id-but-the-fieldname-is-different/294933)
**Author:** [@Spookies123](https://discuss.elastic.co/u/Spookies123)\ **Replies:** 7\ **Last updated:** [January 21, 2022, 10:41am UTC](https://discuss.elastic.co/t/combining-documents-in-two-indices-correlated-by-their-id-but-the-fieldname-is-different/294933 "2022-01-21T10:41:52Z")
Hi! I am fairly new to the elastic stack, and i was wondering if something like the title suggests is possible. Say i have two types of documents, one for cars, and one for drivers. I want to combine the two documents in… --- ## [Elastic Endpoint Security Data Sources](https://discuss.elastic.co/t/elastic-endpoint-security-data-sources/295052)
**Author:** [@beijo](https://discuss.elastic.co/u/beijo)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 10:49am UTC](https://discuss.elastic.co/t/elastic-endpoint-security-data-sources/295052 "2022-01-21T10:49:08Z")
Hello, right now I'm testing the Elastic-Agent with the endpoint security integration in a lab environment and I'm very happy with it so far. Via integration settings we can define the events to be collected on windows… --- ## [Security rule exception not working](https://discuss.elastic.co/t/security-rule-exception-not-working/294811)
**Author:** [@masual](https://discuss.elastic.co/u/masual)\ **Replies:** 4\ **Last updated:** [January 21, 2022, 10:20am UTC](https://discuss.elastic.co/t/security-rule-exception-not-working/294811 "2022-01-21T10:20:31Z")
Hi everyone, We are using Elasticsearch and Kibana version 7.16.3. We have defined a security rule and added some exceptions to this rule. Some of the exceptions are working fine, filtering the events that match the e… --- ## [Customize Date range not appearing in visualization gear icon](https://discuss.elastic.co/t/customize-date-range-not-appearing-in-visualization-gear-icon/294980)
**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 10:16am UTC](https://discuss.elastic.co/t/customize-date-range-not-appearing-in-visualization-gear-icon/294980 "2022-01-21T10:16:51Z")
Hi, I want to customize Date range not appearing in visualization gear icon. I want to show chart for past 7 days for only this visualization. But this option cannot be seen. I can only see Edit this tile. Any idea w… --- ## [Change the default precision\_threshold from 3000 to 40000](https://discuss.elastic.co/t/change-the-default-precision-threshold-from-3000-to-40000/295038)
**Author:** [@zevodku](https://discuss.elastic.co/u/zevodku)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 9:03am UTC](https://discuss.elastic.co/t/change-the-default-precision-threshold-from-3000-to-40000/295038 "2022-01-21T09:03:59Z")
Hello folks, Is there any way to change the default precision\_threshold from "3000" to "40000" as a global thing? Like in the configuration files (Elasticsearch.yml or kibana.yml)? I'm using cardinality extensively and… --- ## [Kibana not loading due to "Cannot read properties of undefined"](https://discuss.elastic.co/t/kibana-not-loading-due-to-cannot-read-properties-of-undefined/295036)
**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 8:55am UTC](https://discuss.elastic.co/t/kibana-not-loading-due-to-cannot-read-properties-of-undefined/295036 "2022-01-21T08:55:55Z")
I am trying to spin up a kibana / Elasticsearch stack using ECK operator. This is something I have done multiple times. In just one of the attempts however, kibana is not loading on my browser with the following error … --- ## [Multi field custom elasticsearch analyzer](https://discuss.elastic.co/t/multi-field-custom-elasticsearch-analyzer/294613)
**Author:** [@dishant.sharma](https://discuss.elastic.co/u/dishant.sharma)\ **Replies:** 2\ **Last updated:** [January 21, 2022, 8:54am UTC](https://discuss.elastic.co/t/multi-field-custom-elasticsearch-analyzer/294613 "2022-01-21T08:54:40Z")
I am creating an Elasticsearch plugin. I want to analyze a url in two different ways using the same analyzer that is pattern analyzer but with different regular expressions for getting different tokens. I have started c… --- ## [Enrichment - is it the best way?](https://discuss.elastic.co/t/enrichment-is-it-the-best-way/294802)
**Author:** [@jkulcsar](https://discuss.elastic.co/u/jkulcsar)\ **Replies:** 3\ **Last updated:** [January 21, 2022, 8:44am UTC](https://discuss.elastic.co/t/enrichment-is-it-the-best-way/294802 "2022-01-21T08:44:27Z")
Hello all, We've been using Elastic in capturing and consolidating IoT data however - my experience with Elastic is however limited to about 6 months. Consider the scenario: large number of IoT devices with known s… --- ## [Lower case problem in field names](https://discuss.elastic.co/t/lower-case-problem-in-field-names/295026)
**Author:** [@Busra\_Duygu](https://discuss.elastic.co/u/Busra_Duygu)\ **Replies:** 1\ **Last updated:** [January 21, 2022, 8:42am UTC](https://discuss.elastic.co/t/lower-case-problem-in-field-names/295026 "2022-01-21T08:42:41Z")
Hello dear friends, I have a problem, if you can help me I would be very happy. The problem is that; I reindexed from an existing index. While reindexing, there was a capitalization problem in the field names, so I added… --- ## [Pipeline in pipe output Logstash](https://discuss.elastic.co/t/pipeline-in-pipe-output-logstash/295032)
**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 8:41am UTC](https://discuss.elastic.co/t/pipeline-in-pipe-output-logstash/295032 "2022-01-21T08:41:16Z")
hello! I would like to know if, like an Elasticsearch output, we can use pipeline =\> "%{\[@metadata\]\[pipeline\]}" for parsing logs, we could use these predefined pipelines in the pipe type output to parse previously parse… --- ## [SIEM News feed on securitySolution:enableNewsFeed(Advance Settings) is not working](https://discuss.elastic.co/t/siem-news-feed-on-securitysolution-enablenewsfeed-advance-settings-is-not-working/295030)
**Author:** [@Ilias\_Kou](https://discuss.elastic.co/u/Ilias_Kou)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 8:34am UTC](https://discuss.elastic.co/t/siem-news-feed-on-securitysolution-enablenewsfeed-advance-settings-is-not-working/295030 "2022-01-21T08:34:34Z")
I am trying to change the default news feed from https://feeds.elastic.co/security-solution to anything on this list for example https://www.reddit.com/r/netsecstudents/comments/5rtmu1/rss\_infosec\_news/ but I find no suc… --- ## [How to migrate from version 7.12 to version 7.16.2?](https://discuss.elastic.co/t/how-to-migrate-from-version-7-12-to-version-7-16-2/293964)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 5\ **Last updated:** [January 21, 2022, 7:52am UTC](https://discuss.elastic.co/t/how-to-migrate-from-version-7-12-to-version-7-16-2/293964 "2022-01-21T07:52:31Z")
7.12 cluster 7.16 I made a snapshot on the 7.12 cluster, shared the snapshot using NFS, then created a new 7.16 cluster, mounted the nfs path, and registered the warehouse with the same name on kibana. After … --- ## [Kibana not loading due to unsafe script](https://discuss.elastic.co/t/kibana-not-loading-due-to-unsafe-script/295025)
**Author:** [@pkaramol](https://discuss.elastic.co/u/pkaramol)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 7:50am UTC](https://discuss.elastic.co/t/kibana-not-loading-due-to-unsafe-script/295025 "2022-01-21T07:50:25Z")
I have upgraded my elastic / kibana stack from 7.12.1 to 7.16.2 Unfortunately and despite the fact that elasticsearch is now healthy, kibana is not loading due to a js error: login:1 Refused to execute script from 'htt… --- ## [Logstash configuration to process 1M events per second](https://discuss.elastic.co/t/logstash-configuration-to-process-1m-events-per-second/288989)
**Author:** [@KunwarAkanksha](https://discuss.elastic.co/u/KunwarAkanksha)\ **Replies:** 11\ **Last updated:** [January 21, 2022, 7:23am UTC](https://discuss.elastic.co/t/logstash-configuration-to-process-1m-events-per-second/288989 "2022-01-21T07:23:56Z")
I have events of around 1M (real time), logstash is proecessing 40K at one instances and one pipeline, if I increase the logstash instance to two it goes around 30K each (60K cummulative) but increasing the logstash inst… --- ## [Logstash to cassandra JDBC Input](https://discuss.elastic.co/t/logstash-to-cassandra-jdbc-input/295019)
**Author:** [@Mandark1990](https://discuss.elastic.co/u/Mandark1990)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 6:46am UTC](https://discuss.elastic.co/t/logstash-to-cassandra-jdbc-input/295019 "2022-01-21T06:46:19Z")
Dear All, Am trying to Connect to SSL enabled Cassandra 3.11 by using the Logstash 7.10.2 builds jdbc input plugin. I tried the Steps and the Cassandra Drivers given in the Below links and also copied the cassandra\_dri… --- ## [User details using auditbeat](https://discuss.elastic.co/t/user-details-using-auditbeat/295018)
**Author:** [@Riya\_patel](https://discuss.elastic.co/u/Riya_patel)\ **Replies:** 0\ **Last updated:** [January 21, 2022, 6:43am UTC](https://discuss.elastic.co/t/user-details-using-auditbeat/295018 "2022-01-21T06:43:05Z")
How to fetch last login user details using Auditbeat? --- ## [APM GO Agent Capture instrumented transaction](https://discuss.elastic.co/t/apm-go-agent-capture-instrumented-transaction/293619)
**Author:** [@tarund](https://discuss.elastic.co/u/tarund)\ **Replies:** 4\ **Last updated:** [January 21, 2022, 5:42am UTC](https://discuss.elastic.co/t/apm-go-agent-capture-instrumented-transaction/293619 "2022-01-21T05:42:12Z")
Elasticsearch version: 7.9.2 APM Server version: 7.15.0 APM Agent language and version: Go 1.x "go.elastic.co/apm" \_ "go.elastic.co/apm/module/apmlambda" Instrumented AWS Lambda function using above go apmlambda age… --- ## [Elasticsearch disk based shard allocation tuning](https://discuss.elastic.co/t/elasticsearch-disk-based-shard-allocation-tuning/293616)
**Author:** [@tarund](https://discuss.elastic.co/u/tarund)\ **Replies:** 4\ **Last updated:** [January 21, 2022, 5:38am UTC](https://discuss.elastic.co/t/elasticsearch-disk-based-shard-allocation-tuning/293616 "2022-01-21T05:38:50Z")
I am running 2 node Elasticsearch cluster v7.9.2 Ingesting data through APM-Server v7.15.0, creates ~50 new indices daily with pattern apm-7.15.0-\-transaction-YYYY.MM.DD Observing that all new primary sh… [Previous page](https://discuss.elastic.co/latest.md?page=1296) [Next page](https://discuss.elastic.co/latest.md?page=1298)