# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1858

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1859

---

## [Configure Delete indices based on size index lifecycle management Policy Elastic search](https://discuss.elastic.co/t/configure-delete-indices-based-on-size-index-lifecycle-management-policy-elastic-search/245348)

<div class="topic-metadata">

**Author:** [@Darshan\_Kamat](https://discuss.elastic.co/u/Darshan_Kamat)\
**Replies:** 8\
**Last updated:** [August 18, 2020, 8:39pm UTC](https://discuss.elastic.co/t/configure-delete-indices-based-on-size-index-lifecycle-management-policy-elastic-search/245348 "2020-08-18T20:39:52Z")

</div>

Version : ES 7.6.0 I have elastic search set up with filebeat for pulling up logs and rollover configured with index policy(ILM) . I have 2 phases configured : HOT and DELETE. In the delete phase for index policy there i…

---

## [System.process.cmdline is blank in Kibana table visualization](https://discuss.elastic.co/t/system-process-cmdline-is-blank-in-kibana-table-visualization/245089)

<div class="topic-metadata">

**Author:** [@igorid70](https://discuss.elastic.co/u/igorid70)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 8:36pm UTC](https://discuss.elastic.co/t/system-process-cmdline-is-blank-in-kibana-table-visualization/245089 "2020-08-18T20:36:37Z")

</div>

Hi I am using Elastic stack 7.8.1 and trying to create a table summarizing Linux processes info based on metricbeat (all uses default configuration). The system metric are collected each 60 seconds and the summary tab…

---

## [Logstash shut down](https://discuss.elastic.co/t/logstash-shut-down/245261)

<div class="topic-metadata">

**Author:** [@sukumar.koganti](https://discuss.elastic.co/u/sukumar.koganti)\
**Replies:** 10\
**Last updated:** [August 18, 2020, 8:01pm UTC](https://discuss.elastic.co/t/logstash-shut-down/245261 "2020-08-18T20:01:37Z")

</div>

Hi I have successfully installed/configured the elasticsearh and kibana both along with the logstash. i am trying to process the simple .csv file through logstash.conf file but i am facing the below error. C:\\elastic\_…

---

## [About Key In Elastic Search](https://discuss.elastic.co/t/about-key-in-elastic-search/245292)

<div class="topic-metadata">

**Author:** [@laritza](https://discuss.elastic.co/u/laritza)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 7:43pm UTC](https://discuss.elastic.co/t/about-key-in-elastic-search/245292 "2020-08-18T19:43:26Z")

</div>

Good morning I have read some articles about Installing Elastic Search because I am new with this tool and when I am installing this software because I am doing step by step for example i am trying putting the url for pu…

---

## [Filebeat multiline with hints enabled](https://discuss.elastic.co/t/filebeat-multiline-with-hints-enabled/245472)

<div class="topic-metadata">

**Author:** [@clarkritchie](https://discuss.elastic.co/u/clarkritchie)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 5:24pm UTC](https://discuss.elastic.co/t/filebeat-multiline-with-hints-enabled/245472 "2020-08-18T17:24:09Z")

</div>

I've read the multiline documentation so many times now, I am seeing triple. Our logs are in JSON format and stack traces appear like the example below. When using hints based autodiscovery, is this the correct syntax …

---

## [Execution order of multiple indexes during \_reindex call](https://discuss.elastic.co/t/execution-order-of-multiple-indexes-during-reindex-call/244682)

<div class="topic-metadata">

**Author:** [@anitabee](https://discuss.elastic.co/u/anitabee)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 7:32pm UTC](https://discuss.elastic.co/t/execution-order-of-multiple-indexes-during-reindex-call/244682 "2020-08-18T19:32:13Z")

</div>

Hi all :wave:, During \_reindex call, if I specify remote source from multiple indexes, In which order are those indexes going to be processed? I saw in documentation that there was sort option in reindex but it is depr…

---

## [Increasing Throughput Until My Servers Catch Fire](https://discuss.elastic.co/t/increasing-throughput-until-my-servers-catch-fire/244900)

<div class="topic-metadata">

**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\
**Replies:** 19\
**Last updated:** [August 14, 2020, 4:19pm UTC](https://discuss.elastic.co/t/increasing-throughput-until-my-servers-catch-fire/244900 "2020-08-14T16:19:08Z")

</div>

I'm curious about settings that will increase my index rate, at the risk of losing data in the event of hardware corruption or similar. My datanodes are heavily CPU-constrained, so anything I can do to reduce the CPU loa…

---

## [Elastic Search query on multiple fields in terms lookup](https://discuss.elastic.co/t/elastic-search-query-on-multiple-fields-in-terms-lookup/245342)

<div class="topic-metadata">

**Author:** [@santoshk](https://discuss.elastic.co/u/santoshk)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 7:07pm UTC](https://discuss.elastic.co/t/elastic-search-query-on-multiple-fields-in-terms-lookup/245342 "2020-08-18T19:07:52Z")

</div>

Hello experts and fellow elastic enthusiasts, Am a beginner to elastic search and working on writing a search query which filters data from one index by using data from another index (am using terms lookup to achieve it…

---

## [Custom beat not working flag redefined: strict.perms](https://discuss.elastic.co/t/custom-beat-not-working-flag-redefined-strict-perms/245478)

<div class="topic-metadata">

**Author:** [@dowdyph0](https://discuss.elastic.co/u/dowdyph0)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 6:26pm UTC](https://discuss.elastic.co/t/custom-beat-not-working-flag-redefined-strict-perms/245478 "2020-08-18T18:26:27Z")

</div>

Hi, I've created a custom protocol beat using the python script scripts/create\_tcp\_protocol.py. I've tweaked some things that we're not ok in the code like (\*common.IPPortTuple) entries in trans.go So, i've managed to…

---

## [Visualizations not updating for some hosts](https://discuss.elastic.co/t/visualizations-not-updating-for-some-hosts/245054)

<div class="topic-metadata">

**Author:** [@mike\_w](https://discuss.elastic.co/u/mike_w)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 5:53pm UTC](https://discuss.elastic.co/t/visualizations-not-updating-for-some-hosts/245054 "2020-08-18T17:53:54Z")

</div>

Hi, I'm working on setting up some metricbeat visualizations and I am seeing some unexpected behavior. If I view the metrics inventory page I can see the metrics updating for each host as they should, however when I try…

---

## [How to get most recent reading from two different documents in an index/machine](https://discuss.elastic.co/t/how-to-get-most-recent-reading-from-two-different-documents-in-an-index-machine/243247)

<div class="topic-metadata">

**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 5:37pm UTC](https://discuss.elastic.co/t/how-to-get-most-recent-reading-from-two-different-documents-in-an-index-machine/243247 "2020-08-18T17:37:51Z")

</div>

I have a machine that sends me temperature metrics that I'm pulling from two different files on that machine with filebeat. I'm trying to get some sort of current status of all the metrics of the machine in a query, and …

---

## [SNMP Polling Very slow boot up time](https://discuss.elastic.co/t/snmp-polling-very-slow-boot-up-time/245046)

<div class="topic-metadata">

**Author:** [@csgeek](https://discuss.elastic.co/u/csgeek)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 4:41pm UTC](https://discuss.elastic.co/t/snmp-polling-very-slow-boot-up-time/245046 "2020-08-18T16:41:39Z")

</div>

I'm looking at using Logstash to poll several hosts for SNMP data migrating from an old python script in favor of ELK. The pipeline is really incredibly simple. read data, convert to message format (ruby), send to goo…

---

## [Logstash errors retrying failed action with response code 500](https://discuss.elastic.co/t/logstash-errors-retrying-failed-action-with-response-code-500/245466)

<div class="topic-metadata">

**Author:** [@srk1](https://discuss.elastic.co/u/srk1)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 4:29pm UTC](https://discuss.elastic.co/t/logstash-errors-retrying-failed-action-with-response-code-500/245466 "2020-08-18T16:29:40Z")

</div>

Hello ES experts, My logstash logs are completely being filled with below errors which is blocking me to see the information regarding other pipelines. I tried looking for this particular problem but it doesn't look lik…

---

## [Kibana 7.7 Customization](https://discuss.elastic.co/t/kibana-7-7-customization/245421)

<div class="topic-metadata">

**Author:** [@duvida\_elastic](https://discuss.elastic.co/u/duvida_elastic)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 4:18pm UTC](https://discuss.elastic.co/t/kibana-7-7-customization/245421 "2020-08-18T16:18:47Z")

</div>

Good Morning, I'm trying to customize the Kibana 7.7 login screen, but I'm not able to make any changes, someone could help me, informing me which files should I change, to be able to change the background image, the we…

---

## [Percentage Calculation in kibana](https://discuss.elastic.co/t/percentage-calculation-in-kibana/245090)

<div class="topic-metadata">

**Author:** [@Ramadevi](https://discuss.elastic.co/u/Ramadevi)\
**Replies:** 7\
**Last updated:** [August 18, 2020, 3:52pm UTC](https://discuss.elastic.co/t/percentage-calculation-in-kibana/245090 "2020-08-18T15:52:31Z")

</div>

Hi Team, Our goal is to build table in the below format Marketing Operating Count Total AF FL Total(%) AF(%) FL(%) UA UA 9415 24 17 7 0.25 0.18 0.07 UA LH 47 6 6 0 12.77 12.77 0 We are able to create below…

---

## [Error when rendering visualization plugin](https://discuss.elastic.co/t/error-when-rendering-visualization-plugin/245322)

<div class="topic-metadata">

**Author:** [@ylasri](https://discuss.elastic.co/u/ylasri)\
**Replies:** 3\
**Last updated:** [August 18, 2020, 3:49pm UTC](https://discuss.elastic.co/t/error-when-rendering-visualization-plugin/245322 "2020-08-18T15:49:30Z")

</div>

I am using Kibana master branch to develop a new visualization I am using Base Visualization Type like visualizations.createBaseVisualization(getExampleVisDefinition()); I am getting this error when trying to render m…

---

## [Filebeat autodiscover not working with hints & namespace](https://discuss.elastic.co/t/filebeat-autodiscover-not-working-with-hints-namespace/243876)

<div class="topic-metadata">

**Author:** [@mirii1994](https://discuss.elastic.co/u/mirii1994)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 3:25pm UTC](https://discuss.elastic.co/t/filebeat-autodiscover-not-working-with-hints-namespace/243876 "2020-08-18T15:25:11Z")

</div>

I'd like to configure filebeat to use autodiscover with hints enabled. Problem is, when I set a config for a certain namespace, it cancels the annotations in the pods under that namespace (meaning I get the multiline lo…

---

## [How to manage Security Certificates on native cloud environment?](https://discuss.elastic.co/t/how-to-manage-security-certificates-on-native-cloud-environment/245411)

<div class="topic-metadata">

**Author:** [@Wasantha\_Herath](https://discuss.elastic.co/u/Wasantha_Herath)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 3:21pm UTC](https://discuss.elastic.co/t/how-to-manage-security-certificates-on-native-cloud-environment/245411 "2020-08-18T15:21:21Z")

</div>

Does native elastic cloud - https://www.elastic.co/cloud/ provides facilities to manage certificates files manually as it does on Elastic Cloud Enterprise ? I have launched an elastic cloud using this https://www.elast…

---

## [Getting 404 shard\_not\_found\_exception frequently](https://discuss.elastic.co/t/getting-404-shard-not-found-exception-frequently/245033)

<div class="topic-metadata">

**Author:** [@ravib](https://discuss.elastic.co/u/ravib)\
**Replies:** 3\
**Last updated:** [August 18, 2020, 3:06pm UTC](https://discuss.elastic.co/t/getting-404-shard-not-found-exception-frequently/245033 "2020-08-18T15:06:28Z")

</div>

I have an index with 2 replicas and 1 shard on a 3 node elastic search server (7.6.1). On bulk requests (index) I keep getting shard\_not\_found\_exception, any thoughts?

---

## [Logstash OSS features](https://discuss.elastic.co/t/logstash-oss-features/245347)

<div class="topic-metadata">

**Author:** [@sera](https://discuss.elastic.co/u/sera)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 2:59pm UTC](https://discuss.elastic.co/t/logstash-oss-features/245347 "2020-08-18T14:59:35Z")

</div>

What Logstash features are missing from Logstash OSS (latest versions)? Why is there no documentation describing the OSS vs Basic features? Thanks, Sera

---

## [How to define Filebeat writer role?](https://discuss.elastic.co/t/how-to-define-filebeat-writer-role/245450)

<div class="topic-metadata">

**Author:** [@illopssec](https://discuss.elastic.co/u/illopssec)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 2:48pm UTC](https://discuss.elastic.co/t/how-to-define-filebeat-writer-role/245450 "2020-08-18T14:48:13Z")

</div>

Good morning, We are using the hosted elasticsearch service version 7.8 as well as Filebeat 7.8.0. I'm trying to set up the writer role for filebeat instances that will only publish data. In the docs,(https://www.elasti…

---

## [How to parse and index xml in ES7](https://discuss.elastic.co/t/how-to-parse-and-index-xml-in-es7/245269)

<div class="topic-metadata">

**Author:** [@azer\_gorai](https://discuss.elastic.co/u/azer_gorai)\
**Replies:** 8\
**Last updated:** [August 18, 2020, 2:38pm UTC](https://discuss.elastic.co/t/how-to-parse-and-index-xml-in-es7/245269 "2020-08-18T14:38:50Z")

</div>

I need to index and parse xml in elasticsearsh. I need one field to store the xml as raw data and another field that will contain a fvalue retrieved from xpath in the same xml

---

## [Filebeat dissect processed logs not appearing in Kibana](https://discuss.elastic.co/t/filebeat-dissect-processed-logs-not-appearing-in-kibana/245065)

<div class="topic-metadata">

**Author:** [@MANI\_M](https://discuss.elastic.co/u/MANI_M)\
**Replies:** 4\
**Last updated:** [August 18, 2020, 2:34pm UTC](https://discuss.elastic.co/t/filebeat-dissect-processed-logs-not-appearing-in-kibana/245065 "2020-08-18T14:34:54Z")

</div>

Hi , I've used dissect in order to process the log outputs of our application. And then I've renamed the message by dropping it and renaming other field. The log seems to be processing fine and I've verified it using o…

---

## [Replacing timestamp field null value with constant date value through ingest pipeline](https://discuss.elastic.co/t/replacing-timestamp-field-null-value-with-constant-date-value-through-ingest-pipeline/245409)

<div class="topic-metadata">

**Author:** [@InfiniteDreamer](https://discuss.elastic.co/u/InfiniteDreamer)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 2:17pm UTC](https://discuss.elastic.co/t/replacing-timestamp-field-null-value-with-constant-date-value-through-ingest-pipeline/245409 "2020-08-18T14:17:00Z")

</div>

We want to know the possibilities of replaing a null valued field with connstant value suplied in ingest pipeline. We are pushing data to elasticsearch where we have field salesdate in all docs and it may be null in fe…

---

## [Watermark floodstage not stopping usage of diskspace](https://discuss.elastic.co/t/watermark-floodstage-not-stopping-usage-of-diskspace/245415)

<div class="topic-metadata">

**Author:** [@Darshan\_Kamat](https://discuss.elastic.co/u/Darshan_Kamat)\
**Replies:** 6\
**Last updated:** [August 18, 2020, 1:56pm UTC](https://discuss.elastic.co/t/watermark-floodstage-not-stopping-usage-of-diskspace/245415 "2020-08-18T13:56:14Z")

</div>

I have 1 node cluster where flood stage watermark is breached but it seems ES is still occupying data .Is this correct ? PFB my logs : \[2020-05-30T06:18:44,774\]\[WARN \]\[o.e.c.r.a.DiskThresholdMonitor\] \[elastic\_226\] flo…

---

## [Best method for exact matches only](https://discuss.elastic.co/t/best-method-for-exact-matches-only/245300)

<div class="topic-metadata">

**Author:** [@blewis1337](https://discuss.elastic.co/u/blewis1337)\
**Replies:** 2\
**Last updated:** [August 18, 2020, 1:54pm UTC](https://discuss.elastic.co/t/best-method-for-exact-matches-only/245300 "2020-08-18T13:54:27Z")

</div>

We currently use elastic search for our magento storefront. We are a B2B style company and our customers search for very specific terms and skus when using our site. We have set all our items up with a number of meta\_key…

---

## [Plugin Installation Aborted](https://discuss.elastic.co/t/plugin-installation-aborted/245437)

<div class="topic-metadata">

**Author:** [@sonnenteich](https://discuss.elastic.co/u/sonnenteich)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 1:50pm UTC](https://discuss.elastic.co/t/plugin-installation-aborted/245437 "2020-08-18T13:50:58Z")

</div>

I've written myself a simple filter plugin in java. I developed and tested it on an Ubuntu 20.04 with java 11.0.8, everything works just fine. Then I copied it to a Debian Baster (version 10.4), also with java version 1…

---

## [Okta Filebeat Stops Pulling Logs](https://discuss.elastic.co/t/okta-filebeat-stops-pulling-logs/245434)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 1:48pm UTC](https://discuss.elastic.co/t/okta-filebeat-stops-pulling-logs/245434 "2020-08-18T13:48:39Z")

</div>

Has anyone else noticed Filebeat Okta module stops pulling in logs after sometime (I don't have an exact duration). I've been running two Filebeats running the Okta module that pulls from 2 different Okta environments. …

---

## [Simple watcher syntax help](https://discuss.elastic.co/t/simple-watcher-syntax-help/245426)

<div class="topic-metadata">

**Author:** [@Fredrik\_Cronholm](https://discuss.elastic.co/u/Fredrik_Cronholm)\
**Replies:** 1\
**Last updated:** [August 18, 2020, 1:48pm UTC](https://discuss.elastic.co/t/simple-watcher-syntax-help/245426 "2020-08-18T13:48:07Z")

</div>

Hi! I trying my first watcher, and being a newbie I have trouble with the basics. I'd like to filter out the events for the last 10 minutes, but somewhere I have made (I suppose) a simple syntax error. Anyone can point…

---

## [Metricbeat: Filtering processes based on Command Line parameters](https://discuss.elastic.co/t/metricbeat-filtering-processes-based-on-command-line-parameters/245433)

<div class="topic-metadata">

**Author:** [@musician](https://discuss.elastic.co/u/musician)\
**Replies:** 0\
**Last updated:** [August 18, 2020, 1:47pm UTC](https://discuss.elastic.co/t/metricbeat-filtering-processes-based-on-command-line-parameters/245433 "2020-08-18T13:47:02Z")

</div>

Hello, I have two questions: We have multiple java processes that we would like to connect metrics for. Each of these processes has a custom name as a part of the command line. Since the process name for each of them …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1857)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1859)
