# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1947

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1948

---

## [Plugin install error:"This plugin is using \`link:\` dependencies for non-Kibana packages"](https://discuss.elastic.co/t/plugin-install-error-this-plugin-is-using-link-dependencies-for-non-kibana-packages/240074)

<div class="topic-metadata">

**Author:** [@Fent](https://discuss.elastic.co/u/Fent)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 3:43pm UTC](https://discuss.elastic.co/t/plugin-install-error-this-plugin-is-using-link-dependencies-for-non-kibana-packages/240074 "2020-07-07T15:43:50Z")

</div>

HI ,I create my plugin,and run "yarn build" to package this plugin to a zip file, and install to kibana ,it show error info like this my demo plugin create like this , and i don't modify any file ,it work well in w…

---

## [elasticsearch.requestTimeout value is not reflecting in kibana UI](https://discuss.elastic.co/t/elasticsearch-requesttimeout-value-is-not-reflecting-in-kibana-ui/240079)

<div class="topic-metadata">

**Author:** [@GopiV](https://discuss.elastic.co/u/GopiV)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 3:40pm UTC](https://discuss.elastic.co/t/elasticsearch-requesttimeout-value-is-not-reflecting-in-kibana-ui/240079 "2020-07-07T15:40:38Z")

</div>

Kabana: v 7.2.1 I've change the value of elasticsearch.requestTimeout from 30secs (30000) to 60secs (60000) in /etc/kibana/kibana.yml and restart Kibana due to the timeout I'm getting for few searches in UI after 30secs…

---

## [Error to Push CQV files from Logstash to Elastic](https://discuss.elastic.co/t/error-to-push-cqv-files-from-logstash-to-elastic/239887)

<div class="topic-metadata">

**Author:** [@zizou90](https://discuss.elastic.co/u/zizou90)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 10:36am UTC](https://discuss.elastic.co/t/error-to-push-cqv-files-from-logstash-to-elastic/239887 "2020-07-07T10:36:39Z")

</div>

Helllo, I have 5 CSV files (separator : , ) with the same structures but the last one haven't the same order of columns : example : the columns of the Files number 1 2 3 4 like this : Price |Date | Quantity | The f…

---

## [Unable to grok ingest pipeline for Caddy log (even after running in grok debugger)](https://discuss.elastic.co/t/unable-to-grok-ingest-pipeline-for-caddy-log-even-after-running-in-grok-debugger/240168)

<div class="topic-metadata">

**Author:** [@OliPicard](https://discuss.elastic.co/u/OliPicard)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 3:22pm UTC](https://discuss.elastic.co/t/unable-to-grok-ingest-pipeline-for-caddy-log-even-after-running-in-grok-debugger/240168 "2020-07-07T15:22:06Z")

</div>

Dear Elastic, I am having problems processing this grok into the ingest pipeline. PUT \_ingest/pipeline/parse\_caddy { "description": "parsing fields from Caddy", "processors": \[ { "grok" : { "field…

---

## [Bar and Lines Visualization](https://discuss.elastic.co/t/bar-and-lines-visualization/240184)

<div class="topic-metadata">

**Author:** [@BrunoSdeMenezes](https://discuss.elastic.co/u/BrunoSdeMenezes)\
**Replies:** 0\
**Last updated:** [July 7, 2020, 3:19pm UTC](https://discuss.elastic.co/t/bar-and-lines-visualization/240184 "2020-07-07T15:19:24Z")

</div>

Hello There, I'm trying to build a chart with a bar and a line. The bar must show the actual year and the line must show last year. The x-axis must be the months. Something like that: I've built a chart with two coun…

---

## [Rollup vs Continuous Transform for historical data](https://discuss.elastic.co/t/rollup-vs-continuous-transform-for-historical-data/240178)

<div class="topic-metadata">

**Author:** [@Vlad\_K](https://discuss.elastic.co/u/Vlad_K)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 3:09pm UTC](https://discuss.elastic.co/t/rollup-vs-continuous-transform-for-historical-data/240178 "2020-07-07T15:09:48Z")

</div>

Are there any reasons to pick one over another to store historical data? As far as i can see rollups have limited ability for searching and aggregations (no filtered aggregations, etc.) while transformed index doesn't h…

---

## [Fail to elect a master following a failover due to GC](https://discuss.elastic.co/t/fail-to-elect-a-master-following-a-failover-due-to-gc/240181)

<div class="topic-metadata">

**Author:** [@Alex\_Davidovich](https://discuss.elastic.co/u/Alex_Davidovich)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 3:05pm UTC](https://discuss.elastic.co/t/fail-to-elect-a-master-following-a-failover-due-to-gc/240181 "2020-07-07T15:05:27Z")

</div>

We are using elastic 7.2.1 We have a 3 nodes cluster with all nodes being master eligible. Our configuration is: transport.connect\_timeout: 1s cluster.publish.timeout: 15s cluster.fault\_detection.leader\_check.timeout:…

---

## [Kibana graph now showing on a selected Index](https://discuss.elastic.co/t/kibana-graph-now-showing-on-a-selected-index/240155)

<div class="topic-metadata">

**Author:** [@Kevin\_f](https://discuss.elastic.co/u/Kevin_f)\
**Replies:** 12\
**Last updated:** [July 7, 2020, 2:49pm UTC](https://discuss.elastic.co/t/kibana-graph-now-showing-on-a-selected-index/240155 "2020-07-07T14:49:37Z")

</div>

Hi All, I have got an issue where a particular index is not showing the graph like other indexes do within discovery. This index I am referring to is for the ingestion of Cloudtrail logs not showing the bar graph as it …

---

## [Minimum interval on "Date Histogram" aggregation](https://discuss.elastic.co/t/minimum-interval-on-date-histogram-aggregation/238973)

<div class="topic-metadata">

**Author:** [@laurentml](https://discuss.elastic.co/u/laurentml)\
**Replies:** 14\
**Last updated:** [July 7, 2020, 2:40pm UTC](https://discuss.elastic.co/t/minimum-interval-on-date-histogram-aggregation/238973 "2020-07-07T14:40:25Z")

</div>

Hi folks, I'm using ELK stack (v7.8.0, same on v7.7.1) for an application used by historians, where each entry is an archive which can be like from year 1687 for example. Rendering options of Kibana are generally very …

---

## [Shard reallocation and disk space](https://discuss.elastic.co/t/shard-reallocation-and-disk-space/240174)

<div class="topic-metadata">

**Author:** [@kernelpanic](https://discuss.elastic.co/u/kernelpanic)\
**Replies:** 4\
**Last updated:** [July 7, 2020, 2:25pm UTC](https://discuss.elastic.co/t/shard-reallocation-and-disk-space/240174 "2020-07-07T14:25:19Z")

</div>

Hello, I'm using ElasticStack 7.6.1 on CentOS 8. I recently upgraded the kernels on all three of our nodes so I then rebooted them all; after they were rebooted the cluster decided to reallocate some shards but for some…

---

## [./filebeat generate fields with pipeline.yml](https://discuss.elastic.co/t/filebeat-generate-fields-with-pipeline-yml/239790)

<div class="topic-metadata">

**Author:** [@bernhard.fluehmann](https://discuss.elastic.co/u/bernhard.fluehmann)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 2:14pm UTC](https://discuss.elastic.co/t/filebeat-generate-fields-with-pipeline-yml/239790 "2020-07-07T14:14:43Z")

</div>

I am developing a new filebeat module for sophos firewall logs. Now I got stuck on the ./filebeat generate fields command. It returns with the following error: cannot read pipeline: open module/sophos/secureweb/ingest…

---

## [Memory Utilization in ELK](https://discuss.elastic.co/t/memory-utilization-in-elk/240169)

<div class="topic-metadata">

**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 2:09pm UTC](https://discuss.elastic.co/t/memory-utilization-in-elk/240169 "2020-07-07T14:09:36Z")

</div>

Hi All, Memory utilization on my all the data\_nodes is reaching around 70-80 percent. Can someone suggest, how to reduce it. As we are afraid that after adding all the instances it might reach even 100%. Thanks for you…

---

## [BulkProcessor.awaitClose() is returning false and documents are getting indexed](https://discuss.elastic.co/t/bulkprocessor-awaitclose-is-returning-false-and-documents-are-getting-indexed/240176)

<div class="topic-metadata">

**Author:** [@Sanyukta\_Sinha](https://discuss.elastic.co/u/Sanyukta_Sinha)\
**Replies:** 0\
**Last updated:** [July 7, 2020, 2:00pm UTC](https://discuss.elastic.co/t/bulkprocessor-awaitclose-is-returning-false-and-documents-are-getting-indexed/240176 "2020-07-07T14:00:48Z")

</div>

I am using bulkProcessor to index multiple UpdateRequests. The awaitClose() is returning false and hence the logs of the listener are not printing. The documents are still getting indexed but in the absence of the BulkRe…

---

## [IP2Proxy - Pipeline](https://discuss.elastic.co/t/ip2proxy-pipeline/239901)

<div class="topic-metadata">

**Author:** [@pablo1816](https://discuss.elastic.co/u/pablo1816)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 1:56pm UTC](https://discuss.elastic.co/t/ip2proxy-pipeline/239901 "2020-07-07T13:56:16Z")

</div>

I am using Elasticsearch and Kibana, entering data with filebeats direct to Elastic parsing the information with apache2 pipeline and they work perfectly but for the analysis that I should do I would like to change or ad…

---

## [Prometheus data in ElasticSearch via Metricbeats](https://discuss.elastic.co/t/prometheus-data-in-elasticsearch-via-metricbeats/239768)

<div class="topic-metadata">

**Author:** [@Jalpesh1](https://discuss.elastic.co/u/Jalpesh1)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 1:44pm UTC](https://discuss.elastic.co/t/prometheus-data-in-elasticsearch-via-metricbeats/239768 "2020-07-07T13:44:55Z")

</div>

Hi Team, We are scaling Prometheus data in Elastic via Metricbeats . But there are lot of metrics exposed in Prometheus . We want only few metrics in Elastic , is there any filtering possible to restrict metrics? Cur…

---

## [Divide Should query into two parts and combine them with and logic](https://discuss.elastic.co/t/divide-should-query-into-two-parts-and-combine-them-with-and-logic/240120)

<div class="topic-metadata">

**Author:** [@buka\_bidzina](https://discuss.elastic.co/u/buka_bidzina)\
**Replies:** 12\
**Last updated:** [July 7, 2020, 1:03pm UTC](https://discuss.elastic.co/t/divide-should-query-into-two-parts-and-combine-them-with-and-logic/240120 "2020-07-07T13:03:44Z")

</div>

GET INDEX/\_search { "query": { "bool": { "must": \[ { "nested": { "path": "categories", "query": { "terms": { "categories.id": \[ …

---

## [The correct use of logstash](https://discuss.elastic.co/t/the-correct-use-of-logstash/239823)

<div class="topic-metadata">

**Author:** [@Katia](https://discuss.elastic.co/u/Katia)\
**Replies:** 5\
**Last updated:** [July 7, 2020, 12:59pm UTC](https://discuss.elastic.co/t/the-correct-use-of-logstash/239823 "2020-07-07T12:59:03Z")

</div>

I have four types of log files. Every day I get the 4 types from several machines and, I have for each machine : t1-20200703, t2-20200703, t3-20200703 and t4-20200703. After a few days I will have hundreds of files and…

---

## [Monitoring beats hosts who send data to logstash?](https://discuss.elastic.co/t/monitoring-beats-hosts-who-send-data-to-logstash/240135)

<div class="topic-metadata">

**Author:** [@Andrew\_Foxis](https://discuss.elastic.co/u/Andrew_Foxis)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 12:53pm UTC](https://discuss.elastic.co/t/monitoring-beats-hosts-who-send-data-to-logstash/240135 "2020-07-07T12:53:24Z")

</div>

Hi all! Is it possible to monitoring beats hosts who send data to logstash? I want monitoring hostname and last time data. Thank you advanced

---

## [Query range problem](https://discuss.elastic.co/t/query-range-problem/240150)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 12:51pm UTC](https://discuss.elastic.co/t/query-range-problem/240150 "2020-07-07T12:51:39Z")

</div>

Dears, How to modify such query to add additional condition to first range "0nn"? I need to find only such documents which meet such conditions: ci.a": { "gte": 0,"lte": 99} and ci.b like "(??1?) or (??3?) or (??5?) o…

---

## [URL ingest processor](https://discuss.elastic.co/t/url-ingest-processor/239616)

<div class="topic-metadata">

**Author:** [@bernhard.fluehmann](https://discuss.elastic.co/u/bernhard.fluehmann)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 12:25pm UTC](https://discuss.elastic.co/t/url-ingest-processor/239616 "2020-07-07T12:25:06Z")

</div>

It would be helpful to have an ingest pipeline processor which parses a url to the corresponding ecs fields. It can be done with GROK, but would be much more convenient and error save to have it as an official processor. …

---

## [How to make elastic search ignore delimiter](https://discuss.elastic.co/t/how-to-make-elastic-search-ignore-delimiter/240037)

<div class="topic-metadata">

**Author:** [@ermagherd](https://discuss.elastic.co/u/ermagherd)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 12:19pm UTC](https://discuss.elastic.co/t/how-to-make-elastic-search-ignore-delimiter/240037 "2020-07-07T12:19:33Z")

</div>

Hi all, ES Noob posting his first question here. I've ingested some text documents into ES using FS Crawler. When I try to run a match query in elastic search for a piece of text like "aaa-bbb", I notice that elastic se…

---

## [Unable to connect to Elasticsearch server 6.2.2 from spring application](https://discuss.elastic.co/t/unable-to-connect-to-elasticsearch-server-6-2-2-from-spring-application/240055)

<div class="topic-metadata">

**Author:** [@alexc1](https://discuss.elastic.co/u/alexc1)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 12:07pm UTC](https://discuss.elastic.co/t/unable-to-connect-to-elasticsearch-server-6-2-2-from-spring-application/240055 "2020-07-07T12:07:12Z")

</div>

Hello everyone, I am struggling to connect my webapp based on Spring Framework 4.3.13 (not a springboot app) to an Elasticsearch server 6.2.2. I've googling al lot but with no result unfortunally. Here the code I'm ex…

---

## [How to add the value count of 2 search results in Logstash](https://discuss.elastic.co/t/how-to-add-the-value-count-of-2-search-results-in-logstash/240153)

<div class="topic-metadata">

**Author:** [@Matish\_Bhuyan](https://discuss.elastic.co/u/Matish_Bhuyan)\
**Replies:** 1\
**Last updated:** [July 7, 2020, 11:51am UTC](https://discuss.elastic.co/t/how-to-add-the-value-count-of-2-search-results-in-logstash/240153 "2020-07-07T11:51:35Z")

</div>

Hi All, I have written a scripted filed to add the count of these 2 values Identity Accepted and Identity Rejected. These values are searched under result keyword this is my scripted field if (doc\['result'\].value ==…

---

## [Elastic search errors after OutOfMemoryError](https://discuss.elastic.co/t/elastic-search-errors-after-outofmemoryerror/240142)

<div class="topic-metadata">

**Author:** [@cm-vdp](https://discuss.elastic.co/u/cm-vdp)\
**Replies:** 3\
**Last updated:** [July 7, 2020, 11:48am UTC](https://discuss.elastic.co/t/elastic-search-errors-after-outofmemoryerror/240142 "2020-07-07T11:48:17Z")

</div>

I restarted the elasticsearch service after I saw OutOfMemoryError - errors. But in the logging I see these errors: \[2020-07-07T09:43:52,654\]\[ERROR\]\[o.e.x.m.c.i.IndexStatsCollector\] \[mPGPZUq\] collector \[index-stats\] fa…

---

## [JMS Input Plugin for Logstash - Tibco JMS Provider](https://discuss.elastic.co/t/jms-input-plugin-for-logstash-tibco-jms-provider/240151)

<div class="topic-metadata">

**Author:** [@rohitdgp](https://discuss.elastic.co/u/rohitdgp)\
**Replies:** 0\
**Last updated:** [July 7, 2020, 11:42am UTC](https://discuss.elastic.co/t/jms-input-plugin-for-logstash-tibco-jms-provider/240151 "2020-07-07T11:42:47Z")

</div>

I was reading through JMS as input plugin for Logstash. Post reading the documentation i was trying to setup a Logstash EMS listener for Tibco JMS provider with JNDI configuration. Although the official elastic-matrix …

---

## [How to create map with 0 length](https://discuss.elastic.co/t/how-to-create-map-with-0-length/240093)

<div class="topic-metadata">

**Author:** [@Deepak\_Dandotiya](https://discuss.elastic.co/u/Deepak_Dandotiya)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 11:42am UTC](https://discuss.elastic.co/t/how-to-create-map-with-0-length/240093 "2020-07-07T11:42:29Z")

</div>

Hi All, I need one help. how to create map with 0 length if data is null for that map fields. I am giving one example where student\_key is PK and for a student creating SUBJECT as map so if all column data is null then…

---

## [Pipeline is being aborted due to logstash\_jdbc\_last\_run File Not Found](https://discuss.elastic.co/t/pipeline-is-being-aborted-due-to-logstash-jdbc-last-run-file-not-found/240029)

<div class="topic-metadata">

**Author:** [@anurag397](https://discuss.elastic.co/u/anurag397)\
**Replies:** 2\
**Last updated:** [July 7, 2020, 11:27am UTC](https://discuss.elastic.co/t/pipeline-is-being-aborted-due-to-logstash-jdbc-last-run-file-not-found/240029 "2020-07-07T11:27:52Z")

</div>

I have two pipelines which sync data from different tables in a postgresql database. - pipeline.id: logstash\_test\_user\_table path.config: "/usr/share/logstash/pipeline/logstash.conf" pipeline.workers: 1 - pipeline.i…

---

## [Rsyslog + Beats together](https://discuss.elastic.co/t/rsyslog-beats-together/239994)

<div class="topic-metadata">

**Author:** [@akam](https://discuss.elastic.co/u/akam)\
**Replies:** 3\
**Last updated:** [July 7, 2020, 10:55am UTC](https://discuss.elastic.co/t/rsyslog-beats-together/239994 "2020-07-07T10:55:56Z")

</div>

Hello, I am trying to collect logs from rsyslog and filebeats. I have rsyslog configuration files: 01-json-template.conf template(name="json-template" type="list") { constant(value="{") constant(va…

---

## [Performance tuning for aggregators](https://discuss.elastic.co/t/performance-tuning-for-aggregators/240050)

<div class="topic-metadata">

**Author:** [@pratikgcet](https://discuss.elastic.co/u/pratikgcet)\
**Replies:** 0\
**Last updated:** [July 6, 2020, 6:21pm UTC](https://discuss.elastic.co/t/performance-tuning-for-aggregators/240050 "2020-07-06T18:21:37Z")

</div>

Hello, I have a below query which is doing mulitple aggregations and then returning the data. I am doing a filter on date greater than 7am this morning. The elasticsearch has got millions of rows and I expected the belo…

---

## [Logstash studdown seconds after starting on its own](https://discuss.elastic.co/t/logstash-studdown-seconds-after-starting-on-its-own/240138)

<div class="topic-metadata">

**Author:** [@Jayesh\_Rathi](https://discuss.elastic.co/u/Jayesh_Rathi)\
**Replies:** 7\
**Last updated:** [July 7, 2020, 10:42am UTC](https://discuss.elastic.co/t/logstash-studdown-seconds-after-starting-on-its-own/240138 "2020-07-07T10:42:50Z")

</div>

hello, i was trying to start my logstash but it started and shutted down in a few seconds. Does anyone have any idea to resolve this issue? \[2020-07-07T15:17:11,564\]\[INFO \]\[logstash.runner \] Logstash shut down…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1946)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1948)
