# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1932

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1933

---

## [Automating watcher creation?](https://discuss.elastic.co/t/automating-watcher-creation/240813)

<div class="topic-metadata">

**Author:** [@John\_Ham](https://discuss.elastic.co/u/John_Ham)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 7:52pm UTC](https://discuss.elastic.co/t/automating-watcher-creation/240813 "2020-07-13T19:52:22Z")

</div>

Hi! Question about creation of watchers in Kibana. I use 7.5.1 and have set up a number of watchers using Kibana's UI. Can watchers be created in an automated way?

---

## [Imphash behavior changes between 7.7.1 and 7.8.0](https://discuss.elastic.co/t/imphash-behavior-changes-between-7-7-1-and-7-8-0/241034)

<div class="topic-metadata">

**Author:** [@j91321](https://discuss.elastic.co/u/j91321)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 7:49pm UTC](https://discuss.elastic.co/t/imphash-behavior-changes-between-7-7-1-and-7-8-0/241034 "2020-07-13T19:49:54Z")

</div>

Hello, I have noticed a change in behavior of hash.imphash field between versions 7.7.1 and 7.8.0. In 7.7.1 when Event log has value IMPHASH=00000000000000000000000000000000 this is used then as a field value. Let's say…

---

## [Kibana API: How to specify fields to be fetched in a GET call from saved\_objects?](https://discuss.elastic.co/t/kibana-api-how-to-specify-fields-to-be-fetched-in-a-get-call-from-saved-objects/240790)

<div class="topic-metadata">

**Author:** [@kelk](https://discuss.elastic.co/u/kelk)\
**Replies:** 4\
**Last updated:** [July 13, 2020, 7:47pm UTC](https://discuss.elastic.co/t/kibana-api-how-to-specify-fields-to-be-fetched-in-a-get-call-from-saved-objects/240790 "2020-07-13T19:47:06Z")

</div>

I'm trying to get list of Dashboards via API http://localhost:5601/api/saved\_objects/\_find?type=dashboard&fields=id&fields=title But this gives quite other fields (like references & type of visualizations etc), though …

---

## [Ruby help with array of json objects](https://discuss.elastic.co/t/ruby-help-with-array-of-json-objects/241022)

<div class="topic-metadata">

**Author:** [@rajsolanki](https://discuss.elastic.co/u/rajsolanki)\
**Replies:** 14\
**Last updated:** [July 13, 2020, 7:42pm UTC](https://discuss.elastic.co/t/ruby-help-with-array-of-json-objects/241022 "2020-07-13T19:42:52Z")

</div>

hi sorry if its repeat question. In my document there are few fields which are array of json objects. I want to extract one of json array object's value and assign it to my new field. So for that i m using ruby code t…

---

## [Ingest Pipeline for Transformations](https://discuss.elastic.co/t/ingest-pipeline-for-transformations/240736)

<div class="topic-metadata">

**Author:** [@AV25242](https://discuss.elastic.co/u/AV25242)\
**Replies:** 6\
**Last updated:** [July 13, 2020, 7:11pm UTC](https://discuss.elastic.co/t/ingest-pipeline-for-transformations/240736 "2020-07-13T19:11:27Z")

</div>

I am very new to elastic search, I have downloaded Elastic search on MacOs and have also installed Kibana for visualization. I am working with a connector which allows me to provide a pipeline name. However I dont know h…

---

## [Logstash - Trying to assign an existing key to a new key's value](https://discuss.elastic.co/t/logstash-trying-to-assign-an-existing-key-to-a-new-keys-value/241017)

<div class="topic-metadata">

**Author:** [@Acomra](https://discuss.elastic.co/u/Acomra)\
**Replies:** 3\
**Last updated:** [July 13, 2020, 6:05pm UTC](https://discuss.elastic.co/t/logstash-trying-to-assign-an-existing-key-to-a-new-keys-value/241017 "2020-07-13T18:05:58Z")

</div>

Hello, I’m pulling aggregated events from Opentsdb and I have a key/value where the key is the epoch event time and value is the agg count. Example: "dps" =\> { "1594657920" =\> 12.0 }, I’m trying to find a way to …

---

## [Get single figure shows in Timelion using simple visualization](https://discuss.elastic.co/t/get-single-figure-shows-in-timelion-using-simple-visualization/240370)

<div class="topic-metadata">

**Author:** [@isharamadhawa](https://discuss.elastic.co/u/isharamadhawa)\
**Replies:** 5\
**Last updated:** [July 13, 2020, 4:17pm UTC](https://discuss.elastic.co/t/get-single-figure-shows-in-timelion-using-simple-visualization/240370 "2020-07-13T16:17:40Z")

</div>

I have created a visualization to obtain average TPS for my application using Timelion. Here you can see some straight lines that indicates average TPS for given time period. Timelion expression is as follows: .es(i…

---

## [Geo-query: Filter Geo-shapes/polygons using Geo-Points](https://discuss.elastic.co/t/geo-query-filter-geo-shapes-polygons-using-geo-points/240908)

<div class="topic-metadata">

**Author:** [@edbautista](https://discuss.elastic.co/u/edbautista)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 4:06pm UTC](https://discuss.elastic.co/t/geo-query-filter-geo-shapes-polygons-using-geo-points/240908 "2020-07-13T16:06:15Z")

</div>

Hi! Kibana: 7.6.2 Is it possible to filter pre indexed geoshapes using a geopoint? Specifically, we want to know if we can use the geopoints produced from our device to get the geoshapes it went to. Thanks.

---

## [Create graph showing duration between log lines](https://discuss.elastic.co/t/create-graph-showing-duration-between-log-lines/240987)

<div class="topic-metadata">

**Author:** [@scuba\_fly](https://discuss.elastic.co/u/scuba_fly)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 4:02pm UTC](https://discuss.elastic.co/t/create-graph-showing-duration-between-log-lines/240987 "2020-07-13T16:02:23Z")

</div>

Having log lines like: id: 123 message: start processing @timestamp: Jul 7, 2020 @ 02:10:02.866 id: 123 message: finished processing @timestamp: Jul 7, 2020 @ 02:12:02.866 So I want to make a graph where I display the…

---

## [Date Format - Elastic index mapping - Please help](https://discuss.elastic.co/t/date-format-elastic-index-mapping-please-help/241008)

<div class="topic-metadata">

**Author:** [@Bhavani\_Prasad](https://discuss.elastic.co/u/Bhavani_Prasad)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 4:01pm UTC](https://discuss.elastic.co/t/date-format-elastic-index-mapping-please-help/241008 "2020-07-13T16:01:27Z")

</div>

Hi, In my log, i have date value for a date field as : "dateOfTravel":"2020-07-14 11:49" What should be the date format for the "dateofTravel" DataType when I set the mappings in the index. I have used below "dateOfTra…

---

## [Stack monitoring shows a subset of all configured beats](https://discuss.elastic.co/t/stack-monitoring-shows-a-subset-of-all-configured-beats/240804)

<div class="topic-metadata">

**Author:** [@tterranigma](https://discuss.elastic.co/u/tterranigma)\
**Replies:** 4\
**Last updated:** [July 13, 2020, 3:52pm UTC](https://discuss.elastic.co/t/stack-monitoring-shows-a-subset-of-all-configured-beats/240804 "2020-07-13T15:52:19Z")

</div>

I am running version 7.8 of everything. I have a cluster of 3 instances, each running logstash and elasticsearch. On a 4th instance I run kibana with metricbeat and with a separate monitoring cluster. These are located i…

---

## [ES 5.x - delete by query](https://discuss.elastic.co/t/es-5-x-delete-by-query/241006)

<div class="topic-metadata">

**Author:** [@natasha\_adewar](https://discuss.elastic.co/u/natasha_adewar)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 3:48pm UTC](https://discuss.elastic.co/t/es-5-x-delete-by-query/241006 "2020-07-13T15:48:23Z")

</div>

Is anyone running delete by-query cron on large live indexes where insert and update of documents is happening at the same time for ES 5.x? How to optimize the performance of this cron ? How often should we run these c…

---

## [Vega Integration in Kibana Dashboard](https://discuss.elastic.co/t/vega-integration-in-kibana-dashboard/240906)

<div class="topic-metadata">

**Author:** [@PRACHI\_GUPTA](https://discuss.elastic.co/u/PRACHI_GUPTA)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 3:08pm UTC](https://discuss.elastic.co/t/vega-integration-in-kibana-dashboard/240906 "2020-07-13T15:08:49Z")

</div>

hi, My requirement was to create a bar graph like But as this post suggests this is possible using Vega only. I created my bar graph using Vega but i have other visuals in my dashboard as well. Now I am not getting ho…

---

## [Upper limits on replication and recovery heap usage](https://discuss.elastic.co/t/upper-limits-on-replication-and-recovery-heap-usage/240985)

<div class="topic-metadata">

**Author:** [@Pradyumna\_Achar](https://discuss.elastic.co/u/Pradyumna_Achar)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 3:06pm UTC](https://discuss.elastic.co/t/upper-limits-on-replication-and-recovery-heap-usage/240985 "2020-07-13T15:06:34Z")

</div>

Hello, I'm running into a strange situation with elasticsearch. I would like to estimate the Xmx needed for running elasticsearch data nodes while accounting for the heap needed during recovery. All my documents are sm…

---

## [Timelion is not showing any data in Kibana](https://discuss.elastic.co/t/timelion-is-not-showing-any-data-in-kibana/240888)

<div class="topic-metadata">

**Author:** [@prakash\_kumar](https://discuss.elastic.co/u/prakash_kumar)\
**Replies:** 3\
**Last updated:** [July 13, 2020, 2:56pm UTC](https://discuss.elastic.co/t/timelion-is-not-showing-any-data-in-kibana/240888 "2020-07-13T14:56:15Z")

</div>

Timelion is not showing any data in the Kibana dashboard. Please find the error snapshot.

---

## [Kibana import visualization fails - 7.8 to 7.7](https://discuss.elastic.co/t/kibana-import-visualization-fails-7-8-to-7-7/240806)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 6\
**Last updated:** [July 13, 2020, 2:55pm UTC](https://discuss.elastic.co/t/kibana-import-visualization-fails-7-8-to-7-7/240806 "2020-07-13T14:55:33Z")

</div>

is there a bug. I am trying to export import via UI from kibana output is from 7.8 and import is gone a happen to 7.7. it fails with error the "file could not be processed" and when I try same exact ndjson file impo…

---

## [Playlist option in kibana](https://discuss.elastic.co/t/playlist-option-in-kibana/240524)

<div class="topic-metadata">

**Author:** [@muthucse](https://discuss.elastic.co/u/muthucse)\
**Replies:** 5\
**Last updated:** [July 13, 2020, 2:52pm UTC](https://discuss.elastic.co/t/playlist-option-in-kibana/240524 "2020-07-13T14:52:10Z")

</div>

I am looking for a playlist option in Kibana where i can select multiple dashboards to be viewed in big screen with a specified time interval. Is it possible in Kibana ?

---

## [Filebeat system module: multiline events not merged?](https://discuss.elastic.co/t/filebeat-system-module-multiline-events-not-merged/240998)

<div class="topic-metadata">

**Author:** [@pauleccm](https://discuss.elastic.co/u/pauleccm)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 2:30pm UTC](https://discuss.elastic.co/t/filebeat-system-module-multiline-events-not-merged/240998 "2020-07-13T14:30:49Z")

</div>

I have enabled the system module and loaded the ingest pipeline using the filebeat setup command. The resulting events se\]eem a bit odd to me and I wonder if this is current normal behaviour of the module, or abnormal b…

---

## [Kibana showing a missing index pattern (for an index that exists), Index Pattern fails at looking up field mappings](https://discuss.elastic.co/t/kibana-showing-a-missing-index-pattern-for-an-index-that-exists-index-pattern-fails-at-looking-up-field-mappings/240748)

<div class="topic-metadata">

**Author:** [@Mercwri](https://discuss.elastic.co/u/Mercwri)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 2:23pm UTC](https://discuss.elastic.co/t/kibana-showing-a-missing-index-pattern-for-an-index-that-exists-index-pattern-fails-at-looking-up-field-mappings/240748 "2020-07-13T14:23:40Z")

</div>

Running Kibana 7.8.0 on Elasticsearch Service, I have/had an existing filebeat index pattern, today when loading a dashboard that references it I got the following error. Error fetching fields for index pattern filebeat…

---

## [Security.Permissions Exceptions in Elastic.Net.ConnectionConfiguration in wcf dot net applications](https://discuss.elastic.co/t/security-permissions-exceptions-in-elastic-net-connectionconfiguration-in-wcf-dot-net-applications/240990)

<div class="topic-metadata">

**Author:** [@ajvenkatesh4228](https://discuss.elastic.co/u/ajvenkatesh4228)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 2:08pm UTC](https://discuss.elastic.co/t/security-permissions-exceptions-in-elastic-net-connectionconfiguration-in-wcf-dot-net-applications/240990 "2020-07-13T14:08:14Z")

</div>

Hi Folks, Hope, anyone helps on this to get an answer for this : I am working in a wcf dot net applications - I am logging in elastic search, it works in my local windows 10 machine, when hosting the wcf application in …

---

## [Configure logstash with Cloud ID](https://discuss.elastic.co/t/configure-logstash-with-cloud-id/240989)

<div class="topic-metadata">

**Author:** [@Samson\_Nelson](https://discuss.elastic.co/u/Samson_Nelson)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 2:07pm UTC](https://discuss.elastic.co/t/configure-logstash-with-cloud-id/240989 "2020-07-13T14:07:44Z")

</div>

Goal: Using Filebeat and Logstash, filter / ship kubernetes pod logs to our hosted elasticsearch instance. Problem: According to the documentation there are two ways to configure Logstash ,with Cloud ID and without Clou…

---

## [Full text search all Indexes but filter out blog posts that aren't published](https://discuss.elastic.co/t/full-text-search-all-indexes-but-filter-out-blog-posts-that-arent-published/240557)

<div class="topic-metadata">

**Author:** [@Revekius](https://discuss.elastic.co/u/Revekius)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 1:53pm UTC](https://discuss.elastic.co/t/full-text-search-all-indexes-but-filter-out-blog-posts-that-arent-published/240557 "2020-07-13T13:53:14Z")

</div>

Hi, I would like to do the following in Elasticsearch 7.8. Do a full text search with fuzzy searching enabled on all indexes Do a secondary search for a specific term on all indexes Filter out on the publishedDate for…

---

## [Create a data table from a TSVB](https://discuss.elastic.co/t/create-a-data-table-from-a-tsvb/240981)

<div class="topic-metadata">

**Author:** [@Alexandros888](https://discuss.elastic.co/u/Alexandros888)\
**Replies:** 0\
**Last updated:** [July 13, 2020, 1:49pm UTC](https://discuss.elastic.co/t/create-a-data-table-from-a-tsvb/240981 "2020-07-13T13:49:11Z")

</div>

Hello, I have succesfully created a TSVB visualization that shows the ratio of orders/searches per customer number as my image and detailed info show below. denominator = event\_type.keyword : "fulltextsearch" and "fa…

---

## [Logs in discovery update very rarely](https://discuss.elastic.co/t/logs-in-discovery-update-very-rarely/240843)

<div class="topic-metadata">

**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 1:46pm UTC](https://discuss.elastic.co/t/logs-in-discovery-update-very-rarely/240843 "2020-07-13T13:46:33Z")

</div>

Hello, First of all I should say that I'm very new to elasticsearch/kibana and I'm still really struggling to wrap my head around the whole thing. I've got a weird issue with elasticsearch not updating the information …

---

## [Frequent cluster\_block\_exception Kibana logstash](https://discuss.elastic.co/t/frequent-cluster-block-exception-kibana-logstash/240945)

<div class="topic-metadata">

**Author:** [@Sai\_Avinash\_Duddupud](https://discuss.elastic.co/u/Sai_Avinash_Duddupud)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 1:44pm UTC](https://discuss.elastic.co/t/frequent-cluster-block-exception-kibana-logstash/240945 "2020-07-13T13:44:38Z")

</div>

Hi all, I am getting the following errors in my logstash logs. \[INFO \] 2020-07-13 07:29:08.401 \[\[main\]\>worker0\] elasticsearch - retrying failed action with response code: 429 ({"type"=\>"cluster\_block\_exception", "reaso…

---

## [Kibana throws error while creating index pattern](https://discuss.elastic.co/t/kibana-throws-error-while-creating-index-pattern/240932)

<div class="topic-metadata">

**Author:** [@Sai\_Avinash\_Duddupud](https://discuss.elastic.co/u/Sai_Avinash_Duddupud)\
**Replies:** 6\
**Last updated:** [July 13, 2020, 1:44pm UTC](https://discuss.elastic.co/t/kibana-throws-error-while-creating-index-pattern/240932 "2020-07-13T13:44:02Z")

</div>

I have setup logstash on server1 which is sending data to elastic-search(server2) so that I visualise the same in Kibana but when I am creating index patter it throws Internal Server Error as show in the following image. …

---

## [Using Logstash, not able to filter Error Level while indexing to elastic search](https://discuss.elastic.co/t/using-logstash-not-able-to-filter-error-level-while-indexing-to-elastic-search/240916)

<div class="topic-metadata">

**Author:** [@Rakesh\_Katakam](https://discuss.elastic.co/u/Rakesh_Katakam)\
**Replies:** 1\
**Last updated:** [July 13, 2020, 1:38pm UTC](https://discuss.elastic.co/t/using-logstash-not-able-to-filter-error-level-while-indexing-to-elastic-search/240916 "2020-07-13T13:38:21Z")

</div>

Hi, I recently started using ELK stack and we came across a scenario where to filter Error level logs in application log files and want to push Elastic search to do more visualization on logs using Kibana. Here below i…

---

## [\[Filebeat\] Setup of pipelines is not working correctly](https://discuss.elastic.co/t/filebeat-setup-of-pipelines-is-not-working-correctly/240477)

<div class="topic-metadata">

**Author:** [@miande](https://discuss.elastic.co/u/miande)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 1:19pm UTC](https://discuss.elastic.co/t/filebeat-setup-of-pipelines-is-not-working-correctly/240477 "2020-07-13T13:19:48Z")

</div>

IPs are masked. When I run the following command: filebeat setup --pipelines logstash,kibana,elasticsearch -E output.logstash.enabled=false -E 'output.elasticsearch.hosts=\["X.X.X.X:9200"\]' I do not see the pipelines i…

---

## [Kibana Alerts and Actions don't send e-mail](https://discuss.elastic.co/t/kibana-alerts-and-actions-dont-send-e-mail/237936)

<div class="topic-metadata">

**Author:** [@leogoldim](https://discuss.elastic.co/u/leogoldim)\
**Replies:** 2\
**Last updated:** [July 13, 2020, 1:16pm UTC](https://discuss.elastic.co/t/kibana-alerts-and-actions-dont-send-e-mail/237936 "2020-07-13T13:16:32Z")

</div>

Hi all, I'm using Elastic Cloud and the Heartbeat to monitor some applications. My monitoring works fine, but the alerts don't work. I've created an Connector to use Gmail to send e-mail, but I realized that the userna…

---

## [Which is the main master in 3 dedicated master node?](https://discuss.elastic.co/t/which-is-the-main-master-in-3-dedicated-master-node/240264)

<div class="topic-metadata">

**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\
**Replies:** 13\
**Last updated:** [July 13, 2020, 12:50pm UTC](https://discuss.elastic.co/t/which-is-the-main-master-in-3-dedicated-master-node/240264 "2020-07-13T12:50:36Z")

</div>

Suppose I have a 3 dedicated master node and 4 data nodes. At a moment are all 3 acting as a master or is there a supreme master between them so that when it goes down another is elected as Supreme Master ? Are 3 master…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1931)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1933)
