# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1984

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1985

---

## [Netflow codec. Wrong data](https://discuss.elastic.co/t/netflow-codec-wrong-data/238029)

<div class="topic-metadata">

**Author:** [@swb](https://discuss.elastic.co/u/swb)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 7:52am UTC](https://discuss.elastic.co/t/netflow-codec-wrong-data/238029 "2020-06-22T07:52:21Z")

</div>

Hello friends, We want to replace our old system for viewing Netflow (Nfsen) information with ELK. For this, we used the netflow module for Logstash. But we see fewer packets and bytes than it actually is. For example: …

---

## [Kibana sorts big numbers wrong](https://discuss.elastic.co/t/kibana-sorts-big-numbers-wrong/237326)

<div class="topic-metadata">

**Author:** [@jbeyer](https://discuss.elastic.co/u/jbeyer)\
**Replies:** 7\
**Last updated:** [June 22, 2020, 8:07am UTC](https://discuss.elastic.co/t/kibana-sorts-big-numbers-wrong/237326 "2020-06-22T08:07:24Z")

</div>

For a test, I inserted 1000 docs into elasticsearch index. One column has a consecutive number (3. column in the screen shot). This column is sorted ascending in Kibana. After the 253. row Kibana breaks the order and sho…

---

## [Logstash output to redis](https://discuss.elastic.co/t/logstash-output-to-redis/237892)

<div class="topic-metadata">

**Author:** [@kase](https://discuss.elastic.co/u/kase)\
**Replies:** 2\
**Last updated:** [June 22, 2020, 8:03am UTC](https://discuss.elastic.co/t/logstash-output-to-redis/237892 "2020-06-22T08:03:09Z")

</div>

Hi there, my logstash will get lots of data from other's API, after filter these data, logstash will output to redis. I want to ask some questions: redis is a key-value database, how to let logstash know which is key…

---

## [Get output of executing process](https://discuss.elastic.co/t/get-output-of-executing-process/238030)

<div class="topic-metadata">

**Author:** [@Matt\_Rollo](https://discuss.elastic.co/u/Matt_Rollo)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 7:52am UTC](https://discuss.elastic.co/t/get-output-of-executing-process/238030 "2020-06-22T07:52:26Z")

</div>

Hi Guys, Is there option to grab and log stdout of executing process/application ? Cheers Matt

---

## [Winlogbeat index pattern not showing up on kibana](https://discuss.elastic.co/t/winlogbeat-index-pattern-not-showing-up-on-kibana/237608)

<div class="topic-metadata">

**Author:** [@norup](https://discuss.elastic.co/u/norup)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 7:51am UTC](https://discuss.elastic.co/t/winlogbeat-index-pattern-not-showing-up-on-kibana/237608 "2020-06-22T07:51:26Z")

</div>

I can see the index has been made here, but it looks like theres 0 documents in it. But for some reason its not showing up here I have run the command .\\winlogbeat.exe setup --index-management -E output.logstash.en…

---

## [Elasticsearch Log Files](https://discuss.elastic.co/t/elasticsearch-log-files/238015)

<div class="topic-metadata">

**Author:** [@DawitCh](https://discuss.elastic.co/u/DawitCh)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 6:54am UTC](https://discuss.elastic.co/t/elasticsearch-log-files/238015 "2020-06-22T06:54:33Z")

</div>

I have a custom path to store Elasticsearch log files (around 5 GB). It already full and I don't know how to clear it automatically. For the data, I already set ILM so it never reaches 60%. I don't know is it has log ret…

---

## [How to customize time range for a particular visualization in a dasboard in kibana version 7.7 OSS license](https://discuss.elastic.co/t/how-to-customize-time-range-for-a-particular-visualization-in-a-dasboard-in-kibana-version-7-7-oss-license/238008)

<div class="topic-metadata">

**Author:** [@Mayank\_Damani](https://discuss.elastic.co/u/Mayank_Damani)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 6:16am UTC](https://discuss.elastic.co/t/how-to-customize-time-range-for-a-particular-visualization-in-a-dasboard-in-kibana-version-7-7-oss-license/238008 "2020-06-22T06:16:51Z")

</div>

Hello, According to my requirement i need to customize the time range of some visualizations in my dashboard apart from dashboard time range. This feature exist in Kibana version 7.6 but as upgraded to 7.7 OSS license v…

---

## [Very high CPU usage on one Elasticsearch Java.exe](https://discuss.elastic.co/t/very-high-cpu-usage-on-one-elasticsearch-java-exe/237072)

<div class="topic-metadata">

**Author:** [@Manikandan\_Selvaraj](https://discuss.elastic.co/u/Manikandan_Selvaraj)\
**Replies:** 21\
**Last updated:** [June 22, 2020, 6:16am UTC](https://discuss.elastic.co/t/very-high-cpu-usage-on-one-elasticsearch-java-exe/237072 "2020-06-22T06:16:20Z")

</div>

Hi Team, I have very limited data in Elastic search. I have hosted my elastic search in VM. Most of the time Java usage more CPU usage. So My site getting slow due to this. My elastic search version - 2.3.2 Why it hap…

---

## [Logstash doesn't start due to Charset issue](https://discuss.elastic.co/t/logstash-doesnt-start-due-to-charset-issue/237291)

<div class="topic-metadata">

**Author:** [@sahere37](https://discuss.elastic.co/u/sahere37)\
**Replies:** 5\
**Last updated:** [June 22, 2020, 6:15am UTC](https://discuss.elastic.co/t/logstash-doesnt-start-due-to-charset-issue/237291 "2020-06-22T06:15:00Z")

</div>

hi all I installed logstash v. 6.6 on windows. my config file is as following: input { beats { port =\> 5044 } } output { elasticsearch { hosts =\> \["localhost:9200"\] index =\> "my\_log" …

---

## [Filebeat when started as homebrew service is not harvesting logs](https://discuss.elastic.co/t/filebeat-when-started-as-homebrew-service-is-not-harvesting-logs/238004)

<div class="topic-metadata">

**Author:** [@Venkat\_Ram\_Movva](https://discuss.elastic.co/u/Venkat_Ram_Movva)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 5:42am UTC](https://discuss.elastic.co/t/filebeat-when-started-as-homebrew-service-is-not-harvesting-logs/238004 "2020-06-22T05:42:40Z")

</div>

Hi, I installed filebeat-full using the brew command from the documentation. I changed the config file(present at /usr/local/etc/filebeat/filebeat.yml). I started the service using brew services start filebeat-full. But…

---

## [Kibana API endpoint for AWS](https://discuss.elastic.co/t/kibana-api-endpoint-for-aws/237051)

<div class="topic-metadata">

**Author:** [@Lamppost](https://discuss.elastic.co/u/Lamppost)\
**Replies:** 6\
**Last updated:** [June 22, 2020, 5:35am UTC](https://discuss.elastic.co/t/kibana-api-endpoint-for-aws/237051 "2020-06-22T05:35:30Z")

</div>

Hi, I have created an elastic search cluster on aws and am using kibana to visualize the data. I can't seem to figure out how to use the Kibana API for saved objects with my AWS endpoint. The Kibana URL given to me by A…

---

## [Logstash multiple ruby filter](https://discuss.elastic.co/t/logstash-multiple-ruby-filter/237758)

<div class="topic-metadata">

**Author:** [@ohoroyoi](https://discuss.elastic.co/u/ohoroyoi)\
**Replies:** 4\
**Last updated:** [June 22, 2020, 5:15am UTC](https://discuss.elastic.co/t/logstash-multiple-ruby-filter/237758 "2020-06-22T05:15:17Z")

</div>

I'm bringing table A and B from postgres. I want to apply the ruby filter in different forms. How should I set it up? input { jdbc { tags =\> table A } jdbc { tags =\> table B } } filter { ruby { code=\>…

---

## [Logstash Netflow Codec support for Multiple Definition files](https://discuss.elastic.co/t/logstash-netflow-codec-support-for-multiple-definition-files/237998)

<div class="topic-metadata">

**Author:** [@bniranjanbhat](https://discuss.elastic.co/u/bniranjanbhat)\
**Replies:** 0\
**Last updated:** [June 22, 2020, 4:41am UTC](https://discuss.elastic.co/t/logstash-netflow-codec-support-for-multiple-definition-files/237998 "2020-06-22T04:41:09Z")

</div>

Hi All, I am trying to get the netflow codec work with multiple definition files. I understand that "netflow\_definitions" configuration option is a valid file system path. However, when I try to configure this path as…

---

## [When index rollover by ilm, the date can't be update](https://discuss.elastic.co/t/when-index-rollover-by-ilm-the-date-cant-be-update/236133)

<div class="topic-metadata">

**Author:** [@111258](https://discuss.elastic.co/u/111258)\
**Replies:** 2\
**Last updated:** [June 22, 2020, 3:40am UTC](https://discuss.elastic.co/t/when-index-rollover-by-ilm-the-date-cant-be-update/236133 "2020-06-22T03:40:24Z")

</div>

I can use ilm to rollover index by date on none prod env, like this: POST rehearsal-k8s-logs/\_rollover?dry\_run { "conditions" : { "max\_age": "1d", "max\_size": "20gb" } } --- { "acknowledged" : false, "…

---

## [Kibana 7.8 New Feature (Drilldown)..How about going back UP?](https://discuss.elastic.co/t/kibana-7-8-new-feature-drilldown-how-about-going-back-up/237966)

<div class="topic-metadata">

**Author:** [@tenet\_testuser1](https://discuss.elastic.co/u/tenet_testuser1)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 1:45am UTC](https://discuss.elastic.co/t/kibana-7-8-new-feature-drilldown-how-about-going-back-up/237966 "2020-06-22T01:45:36Z")

</div>

Hello, This feature, much awaited (personally), was great news to see in 7.8. https://www.elastic.co/guide/en/kibana/7.8/drilldowns.html#drilldowns-example However, Once I drilldown, there seems to be no-option to dri…

---

## [Dropdown Chain Filter](https://discuss.elastic.co/t/dropdown-chain-filter/237715)

<div class="topic-metadata">

**Author:** [@rwr](https://discuss.elastic.co/u/rwr)\
**Replies:** 1\
**Last updated:** [June 22, 2020, 1:07am UTC](https://discuss.elastic.co/t/dropdown-chain-filter/237715 "2020-06-22T01:07:53Z")

</div>

Can kibana canvas implementation a dropdown chain filter like in kibana dashboard ?

---

## [Logs from Firewall CheckPoint](https://discuss.elastic.co/t/logs-from-firewall-checkpoint/237835)

<div class="topic-metadata">

**Author:** [@julianksanchez](https://discuss.elastic.co/u/julianksanchez)\
**Replies:** 8\
**Last updated:** [June 21, 2020, 3:37pm UTC](https://discuss.elastic.co/t/logs-from-firewall-checkpoint/237835 "2020-06-21T15:37:23Z")

</div>

Hello, I am new in Elastic, and I want to send the logs of our firewalls CheckPoint to logstash. I configurate the log exporter in CheckPoint, however we dont know how received and configurate this information in logsta…

---

## [Finding a public IP for geotagging](https://discuss.elastic.co/t/finding-a-public-ip-for-geotagging/237979)

<div class="topic-metadata">

**Author:** [@DPattee](https://discuss.elastic.co/u/DPattee)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 10:38pm UTC](https://discuss.elastic.co/t/finding-a-public-ip-for-geotagging/237979 "2020-06-21T22:38:59Z")

</div>

The scenario is enhancing my metricbeat data to help track a dozen laptops. I thought adding geo data to their low frequency uptime response would be a cheap way to do this. A custom pipeline that all metricbeats data go…

---

## [Error during reindexing via Elasticsearch input plugin](https://discuss.elastic.co/t/error-during-reindexing-via-elasticsearch-input-plugin/237940)

<div class="topic-metadata">

**Author:** [@magnalite](https://discuss.elastic.co/u/magnalite)\
**Replies:** 0\
**Last updated:** [June 20, 2020, 10:02pm UTC](https://discuss.elastic.co/t/error-during-reindexing-via-elasticsearch-input-plugin/237940 "2020-06-20T22:02:41Z")

</div>

I'm currently using the Elasticsearch input plugin to reindex an index via a Logstash (7.8.0) pipeline however I keep getting a random error which will stop the Logstash instance (and then get restarted, starting from th…

---

## [Index text as keyword array leveraging tokenizers and filters](https://discuss.elastic.co/t/index-text-as-keyword-array-leveraging-tokenizers-and-filters/237976)

<div class="topic-metadata">

**Author:** [@rsinger86](https://discuss.elastic.co/u/rsinger86)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 7:47pm UTC](https://discuss.elastic.co/t/index-text-as-keyword-array-leveraging-tokenizers-and-filters/237976 "2020-06-21T19:47:30Z")

</div>

Say I am indexing emails as documents into Elasticsearch, and I'd like to index the email body as an array of keywords, in addition to indexing it as an analyzed text field. My purpose is that I'd like to do term aggreg…

---

## [Date of the last snapshot?](https://discuss.elastic.co/t/date-of-the-last-snapshot/237969)

<div class="topic-metadata">

**Author:** [@granier](https://discuss.elastic.co/u/granier)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 4:11pm UTC](https://discuss.elastic.co/t/date-of-the-last-snapshot/237969 "2020-06-21T16:11:06Z")

</div>

Hi, I am using Elasticsearch 6.8.3 and try to create a script which displays the date of the last successfull snapshot of a repository. I found how to get the date of one snapshot, the list of all snapshots, but how to…

---

## [Winlogbeat queuing when Logstash offline](https://discuss.elastic.co/t/winlogbeat-queuing-when-logstash-offline/237968)

<div class="topic-metadata">

**Author:** [@sera](https://discuss.elastic.co/u/sera)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 4:00pm UTC](https://discuss.elastic.co/t/winlogbeat-queuing-when-logstash-offline/237968 "2020-06-21T16:00:55Z")

</div>

Apologies if this has been asked before, but I have hunted around and can't find anything specific. I'm sending domain controller logs to Logstash with Winlogbeat. Windows Performance Monitor shows Winlogbeat process usi…

---

## [Agent less deployment](https://discuss.elastic.co/t/agent-less-deployment/237589)

<div class="topic-metadata">

**Author:** [@Adriann](https://discuss.elastic.co/u/Adriann)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 2:27pm UTC](https://discuss.elastic.co/t/agent-less-deployment/237589 "2020-06-21T14:27:21Z")

</div>

Hello, I need to deploy agent less deployment version of ELK stack on a basic license. Basically we want to use IT as a log collector and availability monitoring for Windows/Centos/RedHat servers as well as gather info…

---

## [Count of Log messages on logstash](https://discuss.elastic.co/t/count-of-log-messages-on-logstash/237827)

<div class="topic-metadata">

**Author:** [@Dublin\_2020](https://discuss.elastic.co/u/Dublin_2020)\
**Replies:** 3\
**Last updated:** [June 21, 2020, 2:20pm UTC](https://discuss.elastic.co/t/count-of-log-messages-on-logstash/237827 "2020-06-21T14:20:41Z")

</div>

Hi Guys i am new to elastic search , need an insight on how can we get the count of Log messages received in Logstash from rsyslog server. Any idea , this is to check the differnce in logs forwarded from rsyslog and r…

---

## [FileBeat for parsing](https://discuss.elastic.co/t/filebeat-for-parsing/237964)

<div class="topic-metadata">

**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\
**Replies:** 0\
**Last updated:** [June 21, 2020, 2:12pm UTC](https://discuss.elastic.co/t/filebeat-for-parsing/237964 "2020-06-21T14:12:05Z")

</div>

I know that FileBeat was not built for parsing data, rather for filtering and shipping specific data! However, looking at the current landing page of processors, I realized that if the data is not too complicated, we co…

---

## [Extract Post Data From Request](https://discuss.elastic.co/t/extract-post-data-from-request/237962)

<div class="topic-metadata">

**Author:** [@aaron-nimocks](https://discuss.elastic.co/u/aaron-nimocks)\
**Replies:** 1\
**Last updated:** [June 21, 2020, 1:41pm UTC](https://discuss.elastic.co/t/extract-post-data-from-request/237962 "2020-06-21T13:41:57Z")

</div>

At a loss here on why my post data is not being captured in the request. My Post React.useEffect(() =\> { if (readyToSave) { axios.post('/wxc/api/custom\_css\_server/saveObjectCss', { …

---

## [Coordinating nodes in a cluster](https://discuss.elastic.co/t/coordinating-nodes-in-a-cluster/237001)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 9\
**Last updated:** [June 21, 2020, 12:19pm UTC](https://discuss.elastic.co/t/coordinating-nodes-in-a-cluster/237001 "2020-06-21T12:19:34Z")

</div>

We don’t currently use a balancing node / coordinating nodes, and I have seen that sometimes if a particular node is under load, it slows down the entire server. This is very mysterious to me, as the indices that need to…

---

## [Upgrading plugin 7.6.2 to 7.7.0 : vis.updateState() does not trigger requestHandler anymore](https://discuss.elastic.co/t/upgrading-plugin-7-6-2-to-7-7-0-vis-updatestate-does-not-trigger-requesthandler-anymore/236031)

<div class="topic-metadata">

**Author:** [@guitoo](https://discuss.elastic.co/u/guitoo)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 11:32am UTC](https://discuss.elastic.co/t/upgrading-plugin-7-6-2-to-7-7-0-vis-updatestate-does-not-trigger-requesthandler-anymore/236031 "2020-06-21T11:32:50Z")

</div>

Hello I have developed a working simple visualization plugin in v7.6, based on the legacy plugin development framework. On version v7.6, a component UI change props.vis.updateState() does trigger requestHandler function…

---

## [Elasticseach unable to start after "elasticsearch.yml file " configuration](https://discuss.elastic.co/t/elasticseach-unable-to-start-after-elasticsearch-yml-file-configuration/237950)

<div class="topic-metadata">

**Author:** [@georgeokey](https://discuss.elastic.co/u/georgeokey)\
**Replies:** 2\
**Last updated:** [June 21, 2020, 10:21am UTC](https://discuss.elastic.co/t/elasticseach-unable-to-start-after-elasticsearch-yml-file-configuration/237950 "2020-06-21T10:21:53Z")

</div>

I am have below error after configuring "elasticsearch.yml" file. Version 7.7.1 I have deleted the node file from data directory yet still encountering same error this is below logs.kindly advice \[elastic@elk1 elastic…

---

## [With the removal of doc types, must I reindex all the indices that use a named type?](https://discuss.elastic.co/t/with-the-removal-of-doc-types-must-i-reindex-all-the-indices-that-use-a-named-type/237947)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 4\
**Last updated:** [June 21, 2020, 10:07am UTC](https://discuss.elastic.co/t/with-the-removal-of-doc-types-must-i-reindex-all-the-indices-that-use-a-named-type/237947 "2020-06-21T10:07:23Z")

</div>

I am getting conflicting instructions regarding the removal of doc types. If my indices only having one doc type (but not named \_doc), do I have to reindex all the indices before I upgrade, or will it upgrade and simply …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1983)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1985)
