# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1834

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1835

---

## [Visualize Prometheus Metrics From Metricbeats](https://discuss.elastic.co/t/visualize-prometheus-metrics-from-metricbeats/246893)

<div class="topic-metadata">

**Author:** [@Karl\_Falconer](https://discuss.elastic.co/u/Karl_Falconer)\
**Replies:** 3\
**Last updated:** [August 31, 2020, 1:16pm UTC](https://discuss.elastic.co/t/visualize-prometheus-metrics-from-metricbeats/246893 "2020-08-31T13:16:29Z")

</div>

Hi, We are evaluating migrating from Grafana to Kibana, we have metricbeats sending prometheus data to be Elastic to be indexed. I am having trouble creating a visualization on a pre-aggregated count field. Below is a d…

---

## [Filebeat not dropping the entire events/log](https://discuss.elastic.co/t/filebeat-not-dropping-the-entire-events-log/246875)

<div class="topic-metadata">

**Author:** [@Kumar\_Shubham](https://discuss.elastic.co/u/Kumar_Shubham)\
**Replies:** 1\
**Last updated:** [August 31, 2020, 12:42pm UTC](https://discuss.elastic.co/t/filebeat-not-dropping-the-entire-events-log/246875 "2020-08-31T12:42:24Z")

</div>

I don't want to collect logs from all containers, so I want to discard a few container logs. In the below case, I don't want to capture logs from logstash and elastic. Actual: In the logs, I see only the "container" f…

---

## [Cannot setup Filebeat, when enable Imperva module - 7.9](https://discuss.elastic.co/t/cannot-setup-filebeat-when-enable-imperva-module-7-9/245719)

<div class="topic-metadata">

**Author:** [@denis.atanasov](https://discuss.elastic.co/u/denis.atanasov)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 12:37pm UTC](https://discuss.elastic.co/t/cannot-setup-filebeat-when-enable-imperva-module-7-9/245719 "2020-08-31T12:37:47Z")

</div>

Hello guys, Yesterday on my ELK stack I upgraded the Filebeat version from 7.8 to 7.9. The reason is because of new modules included, especialy the Imperva module for receiving Syslog messages. I am successfully enabli…

---

## [Metricbeat HTTP module digest authentication configuration](https://discuss.elastic.co/t/metricbeat-http-module-digest-authentication-configuration/246939)

<div class="topic-metadata">

**Author:** [@Olga\_Pilipets](https://discuss.elastic.co/u/Olga_Pilipets)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 12:35pm UTC](https://discuss.elastic.co/t/metricbeat-http-module-digest-authentication-configuration/246939 "2020-08-31T12:35:50Z")

</div>

Is it possible to call arbitrary HTTP endpoint with digest authentication using metricbeat HTTP module? If yes, how digest authentication type should be configured?

---

## [Reduce number of results according to max result per field](https://discuss.elastic.co/t/reduce-number-of-results-according-to-max-result-per-field/246946)

<div class="topic-metadata">

**Author:** [@emr](https://discuss.elastic.co/u/emr)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 12:14pm UTC](https://discuss.elastic.co/t/reduce-number-of-results-according-to-max-result-per-field/246946 "2020-08-31T12:14:45Z")

</div>

We have an index that has over 100 million data. it has a structure like this: { // ... "first\_name": "John", "last\_name": "Doe", "company": "X Company", // ... } We want to return results let's say 3 items per co…

---

## [Best way to delete large number of documents](https://discuss.elastic.co/t/best-way-to-delete-large-number-of-documents/246402)

<div class="topic-metadata">

**Author:** [@landport](https://discuss.elastic.co/u/landport)\
**Replies:** 3\
**Last updated:** [August 31, 2020, 11:40am UTC](https://discuss.elastic.co/t/best-way-to-delete-large-number-of-documents/246402 "2020-08-31T11:40:40Z")

</div>

About 10 months ago we investigated adding Elasticsearch logging to a range of consumer electronics products to track which features were being used. I used a simplistic approach with a single index and wrote to it via t…

---

## [Http\_poller input plugin digest authentication configuration](https://discuss.elastic.co/t/http-poller-input-plugin-digest-authentication-configuration/246943)

<div class="topic-metadata">

**Author:** [@Olga\_Pilipets](https://discuss.elastic.co/u/Olga_Pilipets)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 11:28am UTC](https://discuss.elastic.co/t/http-poller-input-plugin-digest-authentication-configuration/246943 "2020-08-31T11:28:58Z")

</div>

Is it possible to call arbitrary HTTP endpoint with digest authentication using Http poller input plugin? If yes, how digest authentication type should be configured?

---

## [How do I add a custom Vega transformation?](https://discuss.elastic.co/t/how-do-i-add-a-custom-vega-transformation/246546)

<div class="topic-metadata">

**Author:** [@moxenb](https://discuss.elastic.co/u/moxenb)\
**Replies:** 1\
**Last updated:** [August 31, 2020, 11:13am UTC](https://discuss.elastic.co/t/how-do-i-add-a-custom-vega-transformation/246546 "2020-08-31T11:13:09Z")

</div>

I would like to create a custom Vega transformation, specifically to put time ranges into arbitrary buckets such that they never overlap in a given bucket (basically to show the duration and disposition of a set of tasks…

---

## [Elastic search fail to start](https://discuss.elastic.co/t/elastic-search-fail-to-start/246876)

<div class="topic-metadata">

**Author:** [@steve2020](https://discuss.elastic.co/u/steve2020)\
**Replies:** 23\
**Last updated:** [August 31, 2020, 11:04am UTC](https://discuss.elastic.co/t/elastic-search-fail-to-start/246876 "2020-08-31T11:04:04Z")

</div>

Hi everyone, I have this issue with elasticsearch after installing successfully on fresh ubuntu 20.04 server, sudo /bin/systemctl daemon-reload sudo /bin/systemctl enable elasticsearch.service sudo systemctl start ela…

---

## [Map dashboard](https://discuss.elastic.co/t/map-dashboard/246573)

<div class="topic-metadata">

**Author:** [@suresh123](https://discuss.elastic.co/u/suresh123)\
**Replies:** 1\
**Last updated:** [August 31, 2020, 11:02am UTC](https://discuss.elastic.co/t/map-dashboard/246573 "2020-08-31T11:02:08Z")

</div>

Hi Experts, How to create the map metric dashboard with out having geo ip. Also after adding below to logstash filter, \*geoip.location\* is not adding geoip { source =\> "clientip" } Regards, Suresh

---

## [Elastic Stack memory pressure increase over time](https://discuss.elastic.co/t/elastic-stack-memory-pressure-increase-over-time/246936)

<div class="topic-metadata">

**Author:** [@sfenman](https://discuss.elastic.co/u/sfenman)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 10:52am UTC](https://discuss.elastic.co/t/elastic-stack-memory-pressure-increase-over-time/246936 "2020-08-31T10:52:04Z")

</div>

Hello, Last month I have upgraded my elastic stack from 8GB Ram to 16GB since I had high memory pressure. It all worked out until last week when memory and CPU started to increase day after day without any change or inc…

---

## [Logstash is overwriting output elasticsearch](https://discuss.elastic.co/t/logstash-is-overwriting-output-elasticsearch/246937)

<div class="topic-metadata">

**Author:** [@Turotakun98](https://discuss.elastic.co/u/Turotakun98)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 10:44am UTC](https://discuss.elastic.co/t/logstash-is-overwriting-output-elasticsearch/246937 "2020-08-31T10:44:35Z")

</div>

Hi, Is it possible to add a field in elasticsearch output only if the document in the index does not contain that field? I'm trying to fetch data from a API (using the input http\_poller) and storing the data in a elast…

---

## [TCP Plugin - Error: event executor terminated](https://discuss.elastic.co/t/tcp-plugin-error-event-executor-terminated/246934)

<div class="topic-metadata">

**Author:** [@anon56147639](https://discuss.elastic.co/u/anon56147639)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 10:27am UTC](https://discuss.elastic.co/t/tcp-plugin-error-event-executor-terminated/246934 "2020-08-31T10:27:31Z")

</div>

Hello, I'm facing an issue with the TCP input plugin in Logstash: \[2020-08-31T11:57:15,669\]\[ERROR\]\[logstash.javapipeline \]\[main\]\[ebfb52d241eb37911098921f56a3a2be4b082eb7a6e749166438a3e26fe28ccb\] A plugin had an unrec…

---

## [Want to configure email in kibana](https://discuss.elastic.co/t/want-to-configure-email-in-kibana/246675)

<div class="topic-metadata">

**Author:** [@AKumar123](https://discuss.elastic.co/u/AKumar123)\
**Replies:** 12\
**Last updated:** [August 31, 2020, 10:23am UTC](https://discuss.elastic.co/t/want-to-configure-email-in-kibana/246675 "2020-08-31T10:23:49Z")

</div>

want to configure email in kibana so i can take the screen shot of Particular panel and able to send it to someone from kibana page.

---

## [Logstash stopping and restatŕting every 5 seconds and is using more than 600% of cpu](https://discuss.elastic.co/t/logstash-stopping-and-restatrting-every-5-seconds-and-is-using-more-than-600-of-cpu/243202)

<div class="topic-metadata">

**Author:** [@hemant\_472](https://discuss.elastic.co/u/hemant_472)\
**Replies:** 17\
**Last updated:** [August 31, 2020, 9:54am UTC](https://discuss.elastic.co/t/logstash-stopping-and-restatrting-every-5-seconds-and-is-using-more-than-600-of-cpu/243202 "2020-08-31T09:54:54Z")

</div>

Logstash is using ore than 600% cpu and is starting and stopping again, actually it is working fine for the filters but still the cpu issue is critical and i am getting below error in the logstash logs - \[2020-07-30T10…

---

## [Timelion chaining cusum() and derivative() on distinct time intervals](https://discuss.elastic.co/t/timelion-chaining-cusum-and-derivative-on-distinct-time-intervals/241600)

<div class="topic-metadata">

**Author:** [@Henk21](https://discuss.elastic.co/u/Henk21)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 9:01am UTC](https://discuss.elastic.co/t/timelion-chaining-cusum-and-derivative-on-distinct-time-intervals/241600 "2020-08-31T09:01:30Z")

</div>

I am using timelion to plot the number of connection sessions in our VPN infrastructure. To do so, I have a cumulative sum of the difference between connection and disconnection events. The time interval is set to 1h. …

---

## [Can't get a two-node cluster to work](https://discuss.elastic.co/t/cant-get-a-two-node-cluster-to-work/246140)

<div class="topic-metadata">

**Author:** [@Arp](https://discuss.elastic.co/u/Arp)\
**Replies:** 8\
**Last updated:** [August 31, 2020, 8:58am UTC](https://discuss.elastic.co/t/cant-get-a-two-node-cluster-to-work/246140 "2020-08-31T08:58:37Z")

</div>

Hi, So, I installed oss-7.9 on two VMs with RH8. All I want is a cluster with two nodes, of which one acts as a replica. I have the same config on both VMs, though of course with different IPs and node names, differen…

---

## [Multi Document Search in the Same Index](https://discuss.elastic.co/t/multi-document-search-in-the-same-index/246888)

<div class="topic-metadata">

**Author:** [@ShashikanthKomandoor](https://discuss.elastic.co/u/ShashikanthKomandoor)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 8:48am UTC](https://discuss.elastic.co/t/multi-document-search-in-the-same-index/246888 "2020-08-31T08:48:33Z")

</div>

Hi Team, I am pushing the /var/log/maillog to ELK Stack version 6.X I was able to use the postfix grok filters available in github and create the indices, documents, fields and so and also I am able to see in Kibana to…

---

## [Ingest rename processor ignore empty](https://discuss.elastic.co/t/ingest-rename-processor-ignore-empty/246755)

<div class="topic-metadata">

**Author:** [@bernhard.fluehmann](https://discuss.elastic.co/u/bernhard.fluehmann)\
**Replies:** 1\
**Last updated:** [August 31, 2020, 8:17am UTC](https://discuss.elastic.co/t/ingest-rename-processor-ignore-empty/246755 "2020-08-31T08:17:38Z")

</div>

The ingest rename processor has an option ignore\_missing which does not rename a field if the field is missing. In some cases it would be helpful if the field would not be renamed if empty. E.g. with a new option ignore…

---

## [Does ElasticSearch support GRPC or will support in near future?](https://discuss.elastic.co/t/does-elasticsearch-support-grpc-or-will-support-in-near-future/246916)

<div class="topic-metadata">

**Author:** [@isuhendro](https://discuss.elastic.co/u/isuhendro)\
**Replies:** 1\
**Last updated:** [August 31, 2020, 7:40am UTC](https://discuss.elastic.co/t/does-elasticsearch-support-grpc-or-will-support-in-near-future/246916 "2020-08-31T07:40:17Z")

</div>

https://medium.com/@EmperorRXF/evaluating-performance-of-rest-vs-grpc-1b8bdf0b22da#:~:text=gRPC%20is%20roughly%207%20times,of%20HTTP%2F2%20by%20gRPC. The article above mentioned: gRPC is roughly 7 times faster than REST…

---

## [An error into installing template](https://discuss.elastic.co/t/an-error-into-installing-template/246899)

<div class="topic-metadata">

**Author:** [@AayushPatel](https://discuss.elastic.co/u/AayushPatel)\
**Replies:** 3\
**Last updated:** [August 31, 2020, 7:09am UTC](https://discuss.elastic.co/t/an-error-into-installing-template/246899 "2020-08-31T07:09:22Z")

</div>

Hi I am using elastic stacks 7.8.1 and trying to write data in elastic cluster from logstash. this is my simple test pipeline input{ stdin{} } output{ elasticsearch{ hosts =\> "l…

---

## [Cannot run tests for new module](https://discuss.elastic.co/t/cannot-run-tests-for-new-module/246911)

<div class="topic-metadata">

**Author:** [@hazcod](https://discuss.elastic.co/u/hazcod)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 7:06am UTC](https://discuss.elastic.co/t/cannot-run-tests-for-new-module/246911 "2020-08-31T07:06:31Z")

</div>

Hi, I am having issues running tests for a new filebeat module I'm developing. I followed the public docs on developing a new module, can you see something out of the ordinary? Module is located here: https://github.co…

---

## [Logstash JDBC Plugin](https://discuss.elastic.co/t/logstash-jdbc-plugin/246910)

<div class="topic-metadata">

**Author:** [@Rahul12](https://discuss.elastic.co/u/Rahul12)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 6:34am UTC](https://discuss.elastic.co/t/logstash-jdbc-plugin/246910 "2020-08-31T06:34:41Z")

</div>

Hi, I am querying MS SQL database to fetch some monitoring parameter. I am using JDBC plugin and firing below query which giving me error. Resultset doesn't return any result. I doubt that we can't use Create table que…

---

## [Unable to delete the document in the elasticserach using logstash action](https://discuss.elastic.co/t/unable-to-delete-the-document-in-the-elasticserach-using-logstash-action/246744)

<div class="topic-metadata">

**Author:** [@Shashikala\_G](https://discuss.elastic.co/u/Shashikala_G)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 6:25am UTC](https://discuss.elastic.co/t/unable-to-delete-the-document-in-the-elasticserach-using-logstash-action/246744 "2020-08-31T06:25:11Z")

</div>

Hello there, I am using elasticsearch 7.6.2 version on a single node windows machine. i am trying to delete documents from elastic search using logstash. delete.csv: 272586 logstash configuration file: input{ stdin …

---

## [Не ищет слова меньше 4 символов](https://discuss.elastic.co/t/topic/246909)

<div class="topic-metadata">

**Author:** [@gvozdb](https://discuss.elastic.co/u/gvozdb)\
**Replies:** 0\
**Last updated:** [August 31, 2020, 6:14am UTC](https://discuss.elastic.co/t/topic/246909 "2020-08-31T06:14:23Z")

</div>

Привет! Почему-то Elasticsearch отказывается производить поиск по словам менее 4 символов. То есть, ищет от 4 символов включительно, 3 символа уже не ищет. Должен найти вот такой документ: \[pagetitle\] =\> Лувр в первый …

---

## [GPU accelerated Machine learning](https://discuss.elastic.co/t/gpu-accelerated-machine-learning/246716)

<div class="topic-metadata">

**Author:** [@nsrushi](https://discuss.elastic.co/u/nsrushi)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 5:58am UTC](https://discuss.elastic.co/t/gpu-accelerated-machine-learning/246716 "2020-08-31T05:58:14Z")

</div>

hi would like to know if GPU accelerated machine learning is supported on Xpack along with SIEM (threat hunting platform) ?

---

## [Job for elasticsearch.service failed because the control process exited with error code](https://discuss.elastic.co/t/job-for-elasticsearch-service-failed-because-the-control-process-exited-with-error-code/246853)

<div class="topic-metadata">

**Author:** [@hamzakarim](https://discuss.elastic.co/u/hamzakarim)\
**Replies:** 2\
**Last updated:** [August 31, 2020, 5:03am UTC](https://discuss.elastic.co/t/job-for-elasticsearch-service-failed-because-the-control-process-exited-with-error-code/246853 "2020-08-31T05:03:52Z")

</div>

I have newly installed the Elasticsearch-7.4.2-x86\_64.rpm with rmp from the link But when i start the service it gives the below error . sudo systemctl start elasticsearch.service Job for elasticsearch.service faile…

---

## [Use specific NIC for output](https://discuss.elastic.co/t/use-specific-nic-for-output/246906)

<div class="topic-metadata">

**Author:** [@gunlomboy](https://discuss.elastic.co/u/gunlomboy)\
**Replies:** 4\
**Last updated:** [August 31, 2020, 4:58am UTC](https://discuss.elastic.co/t/use-specific-nic-for-output/246906 "2020-08-31T04:58:18Z")

</div>

Hi, I'm a complete Logstash newbie, so hopefully this isn't a difficult question to answer. I have 3 NICs on my Logstash servers. I will use one to receive inputs, one for management and one for outputs. I am unable …

---

## [Is it mutitenecy supported by ELK?](https://discuss.elastic.co/t/is-it-mutitenecy-supported-by-elk/246611)

<div class="topic-metadata">

**Author:** [@japarka2](https://discuss.elastic.co/u/japarka2)\
**Replies:** 4\
**Last updated:** [August 31, 2020, 4:56am UTC](https://discuss.elastic.co/t/is-it-mutitenecy-supported-by-elk/246611 "2020-08-31T04:56:14Z")

</div>

He Tam, We need to monitor multiple accounts servers from centralize location. what data collection method is used by Beat ? weather pull by ElasticSearch or push by Beat to Elastic ? if any failure in network in betw…

---

## [How to index large text string data?](https://discuss.elastic.co/t/how-to-index-large-text-string-data/246848)

<div class="topic-metadata">

**Author:** [@sandeep\_rana](https://discuss.elastic.co/u/sandeep_rana)\
**Replies:** 3\
**Last updated:** [August 31, 2020, 4:47am UTC](https://discuss.elastic.co/t/how-to-index-large-text-string-data/246848 "2020-08-31T04:47:58Z")

</div>

Why max\_bytes\_length\_exceeded\_exception while insert a doc with some large text field data.. ?

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1833)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1835)
