# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1874

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1875

---

## [Sort by date in kibana in the visualize option](https://discuss.elastic.co/t/sort-by-date-in-kibana-in-the-visualize-option/244589)

<div class="topic-metadata">

**Author:** [@bruno\_aleixo](https://discuss.elastic.co/u/bruno_aleixo)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 7:33pm UTC](https://discuss.elastic.co/t/sort-by-date-in-kibana-in-the-visualize-option/244589 "2020-08-11T19:33:44Z")

</div>

Hello I am trying to create a visualize where it is sorted by date, I used the filter in the date logstash, but I cannot sort the crescent in the kibana visualize Logstash input { beats { port =\> "5064" …

---

## [Kibana: visualization for recurring jobs, advice needed](https://discuss.elastic.co/t/kibana-visualization-for-recurring-jobs-advice-needed/241474)

<div class="topic-metadata">

**Author:** [@insane](https://discuss.elastic.co/u/insane)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 7:33pm UTC](https://discuss.elastic.co/t/kibana-visualization-for-recurring-jobs-advice-needed/241474 "2020-08-11T19:33:27Z")

</div>

I've started using ELK to store metrics and event history, and for one of our systems I came to this question. There are several jobs running in the system at least once per day (maybe more). For every job a report is s…

---

## [Is there some tools to visualize / debug the "explain" part of a DSL query result?](https://discuss.elastic.co/t/is-there-some-tools-to-visualize-debug-the-explain-part-of-a-dsl-query-result/244624)

<div class="topic-metadata">

**Author:** [@ClubberLang](https://discuss.elastic.co/u/ClubberLang)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 7:29pm UTC](https://discuss.elastic.co/t/is-there-some-tools-to-visualize-debug-the-explain-part-of-a-dsl-query-result/244624 "2020-08-11T19:29:28Z")

</div>

Hi, I have several DSL queries, I try to optimize/profile the scores... for now I use the "explain" option. The problem is that the JSON is so long that it is unreadable and very difficult to understand. Ideally, a ki…

---

## [How to use parent/sibiling pipeline aggregation in TVSB](https://discuss.elastic.co/t/how-to-use-parent-sibiling-pipeline-aggregation-in-tvsb/244184)

<div class="topic-metadata">

**Author:** [@Redcxx](https://discuss.elastic.co/u/Redcxx)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 7:16pm UTC](https://discuss.elastic.co/t/how-to-use-parent-sibiling-pipeline-aggregation-in-tvsb/244184 "2020-08-11T19:16:31Z")

</div>

As title said, may I know how to use parent/sibiling pipeline aggregation? They appear gray in the interface: Let say I have two fields called itemCount1 and itemCount2, is there a way to find the ratio of itemCount1 …

---

## [Kibana metric vizualization](https://discuss.elastic.co/t/kibana-metric-vizualization/241440)

<div class="topic-metadata">

**Author:** [@haythem](https://discuss.elastic.co/u/haythem)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 7:06pm UTC](https://discuss.elastic.co/t/kibana-metric-vizualization/241440 "2020-08-11T19:06:50Z")

</div>

Hi guys , lately I've been working on a project using ELK , so my index has 5 fields(MAT,NAME,DATE,PRESENCE,ABSENCE) it contains the data of the presence and absence of employees everyday , so my goal is to show in a met…

---

## [Vega timelines Visualization -issue in query-elasticsearch](https://discuss.elastic.co/t/vega-timelines-visualization-issue-in-query-elasticsearch/241347)

<div class="topic-metadata">

**Author:** [@alessandro\_calvo](https://discuss.elastic.co/u/alessandro_calvo)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 6:58pm UTC](https://discuss.elastic.co/t/vega-timelines-visualization-issue-in-query-elasticsearch/241347 "2020-08-11T18:58:22Z")

</div>

Based on https://vega.github.io/vega/examples/timelines/ example , I would like to create visualization with: just a static horizontal line and 1 vertical line startin @timestamp of elasticsearch query match on a stri…

---

## [Metribeat dashboard not showing data but visualization is](https://discuss.elastic.co/t/metribeat-dashboard-not-showing-data-but-visualization-is/241475)

<div class="topic-metadata">

**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 6:45pm UTC](https://discuss.elastic.co/t/metribeat-dashboard-not-showing-data-but-visualization-is/241475 "2020-08-11T18:45:46Z")

</div>

I have the default metricbeat System Host Overview ECS dashboard brought up and most visualizations do show data however a few do not. If I go into that specific visualization and it shows data. I've tried changing the t…

---

## [Return specific fields in \_source when searching in multiple indicies](https://discuss.elastic.co/t/return-specific-fields-in-source-when-searching-in-multiple-indicies/244619)

<div class="topic-metadata">

**Author:** [@claudiug](https://discuss.elastic.co/u/claudiug)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 6:37pm UTC](https://discuss.elastic.co/t/return-specific-fields-in-source-when-searching-in-multiple-indicies/244619 "2020-08-11T18:37:55Z")

</div>

Hello all, I have 2 indicies, xxx , and yyy xxx has documents with: {id, content, name} yyy has document with {id, content, name, starred } i would like that my query should return only: name,content, and st…

---

## [How to Show Month names in Control Visualaization by Sorting](https://discuss.elastic.co/t/how-to-show-month-names-in-control-visualaization-by-sorting/241454)

<div class="topic-metadata">

**Author:** [@jeeva](https://discuss.elastic.co/u/jeeva)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 6:33pm UTC](https://discuss.elastic.co/t/how-to-show-month-names-in-control-visualaization-by-sorting/241454 "2020-08-11T18:33:17Z")

</div>

Hi Team, We have index with "Month" Field and it has all 12 Months value. We are using Control Visualization to show all 12 months in Drop Down list but how to Sort all month values (like Jan,Feb,Mar,Apr..Dec). Curre…

---

## [Query metrics of VMS through API call via HTTP Poller](https://discuss.elastic.co/t/query-metrics-of-vms-through-api-call-via-http-poller/244569)

<div class="topic-metadata">

**Author:** [@Ayesha](https://discuss.elastic.co/u/Ayesha)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 6:32pm UTC](https://discuss.elastic.co/t/query-metrics-of-vms-through-api-call-via-http-poller/244569 "2020-08-11T18:32:48Z")

</div>

Hi I want to grab specific metrics of VMs by API calls Currently I am using ///suite-api/api/resources?resourceKind=VirtualMachine to call all VMs and their resource IDs in postman Next I am using below to get metri…

---

## [Cant see my chart plugins after i added them on elastic cloud](https://discuss.elastic.co/t/cant-see-my-chart-plugins-after-i-added-them-on-elastic-cloud/244573)

<div class="topic-metadata">

**Author:** [@Venkatesh\_Guruprasad](https://discuss.elastic.co/u/Venkatesh_Guruprasad)\
**Replies:** 4\
**Last updated:** [August 11, 2020, 6:29pm UTC](https://discuss.elastic.co/t/cant-see-my-chart-plugins-after-i-added-them-on-elastic-cloud/244573 "2020-08-11T18:29:09Z")

</div>

I added a plugin on the EC deployment hosted with elastic cloud. i restarted all the services. I still dont see them in my visualizations.

---

## [Create temp metadata field using regex in message field and parse json](https://discuss.elastic.co/t/create-temp-metadata-field-using-regex-in-message-field-and-parse-json/244594)

<div class="topic-metadata">

**Author:** [@srbhklkrn](https://discuss.elastic.co/u/srbhklkrn)\
**Replies:** 6\
**Last updated:** [August 11, 2020, 6:15pm UTC](https://discuss.elastic.co/t/create-temp-metadata-field-using-regex-in-message-field-and-parse-json/244594 "2020-08-11T18:15:12Z")

</div>

I need to extract the JSON object from the message field filter { grok { match =\> { "message" =\> "(?\<\[@metadata\]\[tempjson\]\>{.+})" } } json { source =\> "\[@metadata\]\[tempjson\]" } } Above…

---

## [Kibana TSVB No data to display once I add another series](https://discuss.elastic.co/t/kibana-tsvb-no-data-to-display-once-i-add-another-series/244541)

<div class="topic-metadata">

**Author:** [@nada.nasser](https://discuss.elastic.co/u/nada.nasser)\
**Replies:** 2\
**Last updated:** [August 11, 2020, 6:00pm UTC](https://discuss.elastic.co/t/kibana-tsvb-no-data-to-display-once-i-add-another-series/244541 "2020-08-11T18:00:58Z")

</div>

I am using Elastic v 7.7.0 once I add a new series No data displays unless I disable one of them

---

## [Beats log capture limitation using filebeat, matricbeat and winlogbeat](https://discuss.elastic.co/t/beats-log-capture-limitation-using-filebeat-matricbeat-and-winlogbeat/244542)

<div class="topic-metadata">

**Author:** [@japarka2](https://discuss.elastic.co/u/japarka2)\
**Replies:** 2\
**Last updated:** [August 11, 2020, 5:59pm UTC](https://discuss.elastic.co/t/beats-log-capture-limitation-using-filebeat-matricbeat-and-winlogbeat/244542 "2020-08-11T17:59:35Z")

</div>

Hi Team, Since I am new to Beats and ElasticSearch, I have few query before perfromaing POC on Beats and Elasticsearch for windows and Linux monitoring. Is possible to capature the log on endpoint and send the capture…

---

## [Kibana and Elasticsearch Node configuration not working after moving data directory](https://discuss.elastic.co/t/kibana-and-elasticsearch-node-configuration-not-working-after-moving-data-directory/244467)

<div class="topic-metadata">

**Author:** [@userR](https://discuss.elastic.co/u/userR)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 5:58pm UTC](https://discuss.elastic.co/t/kibana-and-elasticsearch-node-configuration-not-working-after-moving-data-directory/244467 "2020-08-11T17:58:49Z")

</div>

I have two elasticsearch nodes and for one of them, I moved the the /var/lib/elasticsearch folder to a mount with more storage. I chown'd an elasticsearch user and changed the path.data in the elasticsearch.yml file and …

---

## [Monitoring Cluster - monitoring using metricbeat or xpack self default monitoring?](https://discuss.elastic.co/t/monitoring-cluster-monitoring-using-metricbeat-or-xpack-self-default-monitoring/244011)

<div class="topic-metadata">

**Author:** [@Divit\_Sharma](https://discuss.elastic.co/u/Divit_Sharma)\
**Replies:** 3\
**Last updated:** [August 11, 2020, 5:31pm UTC](https://discuss.elastic.co/t/monitoring-cluster-monitoring-using-metricbeat-or-xpack-self-default-monitoring/244011 "2020-08-11T17:31:32Z")

</div>

What are the pro and cons of monitoring using metricbeat vs default elasticseaech http export? I have a separate monitoring cluster? Why switch to metricbeat if default self xpack monitoring can also do the same job?

---

## [Kibana Dynamically Time Filter](https://discuss.elastic.co/t/kibana-dynamically-time-filter/242940)

<div class="topic-metadata">

**Author:** [@alparslan](https://discuss.elastic.co/u/alparslan)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 5:31pm UTC](https://discuss.elastic.co/t/kibana-dynamically-time-filter/242940 "2020-08-11T17:31:03Z")

</div>

I need to show daily/weekly/monthly average of duration of my job with Gauge in Kibana. We can call this graph as daily/weekly/monthly load percente of machine. I have duration-time-in-day field in index. want to sum …

---

## [Choosing the apropriate beats to import MySQL-DB](https://discuss.elastic.co/t/choosing-the-apropriate-beats-to-import-mysql-db/244602)

<div class="topic-metadata">

**Author:** [@S.Schlaak](https://discuss.elastic.co/u/S.Schlaak)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 5:24pm UTC](https://discuss.elastic.co/t/choosing-the-apropriate-beats-to-import-mysql-db/244602 "2020-08-11T17:24:51Z")

</div>

Hi, i am new to working with the elastic solutions and currently tasked to import a variety of data from MySQL Databases into Kibana / elastic. So i found some solutions promising that metricbeats and filebeat can impo…

---

## [Update by query adds "ctx" in source of all the matching document](https://discuss.elastic.co/t/update-by-query-adds-ctx-in-source-of-all-the-matching-document/244570)

<div class="topic-metadata">

**Author:** [@ahmadimt07](https://discuss.elastic.co/u/ahmadimt07)\
**Replies:** 7\
**Last updated:** [August 11, 2020, 5:13pm UTC](https://discuss.elastic.co/t/update-by-query-adds-ctx-in-source-of-all-the-matching-document/244570 "2020-08-11T17:13:14Z")

</div>

We are using update\_by\_query to add/modify some of the fields in our documents. The update is working fine. However, it is adding an additional field "ctx" in each of the document: Here is the query I am using : POST …

---

## [Report disk failures](https://discuss.elastic.co/t/report-disk-failures/243605)

<div class="topic-metadata">

**Author:** [@jmcclelland](https://discuss.elastic.co/u/jmcclelland)\
**Replies:** 2\
**Last updated:** [August 11, 2020, 4:21pm UTC](https://discuss.elastic.co/t/report-disk-failures/243605 "2020-08-11T16:21:14Z")

</div>

The journald log is reporting: Jul 22 09:39:26 zora kernel: sd 3:0:0:0: \[sdd\] tag#14 FAILED Result: hostbyte=DID\_OK driverbyte=DRIVER\_SENSE Jul 22 09:39:26 zora kernel: sd 3:0:0:0: \[sdd\] tag#14 Sense Key : Medium Error …

---

## [Query to divide aggregation result by a parent value](https://discuss.elastic.co/t/query-to-divide-aggregation-result-by-a-parent-value/244552)

<div class="topic-metadata">

**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 4:14pm UTC](https://discuss.elastic.co/t/query-to-divide-aggregation-result-by-a-parent-value/244552 "2020-08-11T16:14:20Z")

</div>

Say I have a series of documents with an event type and a user\_id. Is there an Elasticsearch pipeline aggregation that allows me to divide the count of events by the unique total users (not total users per event)? I kn…

---

## [An exception caught while applying mutate filter - Could not set field 'log' on object '' to value '...'](https://discuss.elastic.co/t/an-exception-caught-while-applying-mutate-filter-could-not-set-field-log-on-object-to-value/244583)

<div class="topic-metadata">

**Author:** [@Yuval\_Khalifa](https://discuss.elastic.co/u/Yuval_Khalifa)\
**Replies:** 5\
**Last updated:** [August 11, 2020, 4:02pm UTC](https://discuss.elastic.co/t/an-exception-caught-while-applying-mutate-filter-could-not-set-field-log-on-object-to-value/244583 "2020-08-11T16:02:03Z")

</div>

Hi, I'm getting the following error message in Logstash logs: \[2020-08-11T15:07:11,248\]\[WARN \]\[logstash.filters.mutate \]\[main\]\[51aae80b265c32978f64e0aace0ece634a29ae2a08ef228095111afd72bfdd0b\] Exception caught while a…

---

## [Beats can not connect to Logstash](https://discuss.elastic.co/t/beats-can-not-connect-to-logstash/244584)

<div class="topic-metadata">

**Author:** [@Ben\_said](https://discuss.elastic.co/u/Ben_said)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 3:52pm UTC](https://discuss.elastic.co/t/beats-can-not-connect-to-logstash/244584 "2020-08-11T15:52:33Z")

</div>

\[2020-08-12T12:53:29,146\]\[INFO \]\[org.logstash.beats.BeatsHandler\]\[main\]\[2ab0e765b84268c7156e67dc3b10bd35b876b27ad91871edfa9d3b1669f4fea7\] \[local: 10.100.80.40:5044, remote: 10.100.80.40:39494\] Handling exception: org.log…

---

## [Rollover Fails of max\_size condition](https://discuss.elastic.co/t/rollover-fails-of-max-size-condition/244125)

<div class="topic-metadata">

**Author:** [@sai\_kiran1](https://discuss.elastic.co/u/sai_kiran1)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 2:56pm UTC](https://discuss.elastic.co/t/rollover-fails-of-max-size-condition/244125 "2020-08-11T14:56:48Z")

</div>

Greetings I Am trying to create a ilm policy that rolls over my index on size condition My ilm policy looks like : { "testing\_ilm\_dataloss" : { "version" : 7, "modified\_date" : "2020-08-06T14:25:09.434Z", "policy" : {…

---

## [JDBC Driver to be used to crawl the data from IBM db2 database](https://discuss.elastic.co/t/jdbc-driver-to-be-used-to-crawl-the-data-from-ibm-db2-database/243338)

<div class="topic-metadata">

**Author:** [@Mohan\_vel](https://discuss.elastic.co/u/Mohan_vel)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 2:45pm UTC](https://discuss.elastic.co/t/jdbc-driver-to-be-used-to-crawl-the-data-from-ibm-db2-database/243338 "2020-08-11T14:45:26Z")

</div>

Hi All, I have created a logstash configuration file to crawl the data from IBM Db2. I am getting an issue that JDBC driver libirary is not loaded. Here i am using logstash version 7.7.1. Configuration file in…

---

## [Elastic Query](https://discuss.elastic.co/t/elastic-query/244572)

<div class="topic-metadata">

**Author:** [@thejaswani](https://discuss.elastic.co/u/thejaswani)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 2:39pm UTC](https://discuss.elastic.co/t/elastic-query/244572 "2020-08-11T14:39:39Z")

</div>

we are using elastic 5.6.2. In this version, how we do the term aggregation for nested objetcs with limit and offset? Please advice.. We have tried this query { "index": "sample\_mastercollection", "type": "collectio…

---

## [Reduced precision on date fields when used in field\_value\_factor score](https://discuss.elastic.co/t/reduced-precision-on-date-fields-when-used-in-field-value-factor-score/244497)

<div class="topic-metadata">

**Author:** [@zoellner](https://discuss.elastic.co/u/zoellner)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 6:51am UTC](https://discuss.elastic.co/t/reduced-precision-on-date-fields-when-used-in-field-value-factor-score/244497 "2020-08-11T06:51:03Z")

</div>

I am trying to do a custom scoring using a date field. I need the score to take the date into account with millisecond precision. However, when I run the code below, I get a result where the score for both 2020-01-01T00:…

---

## [Filebeat sending only few log entries to Logstash](https://discuss.elastic.co/t/filebeat-sending-only-few-log-entries-to-logstash/244180)

<div class="topic-metadata">

**Author:** [@eth](https://discuss.elastic.co/u/eth)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 2:25pm UTC](https://discuss.elastic.co/t/filebeat-sending-only-few-log-entries-to-logstash/244180 "2020-08-11T14:25:44Z")

</div>

I am trying to send kubernetes pod log of 100 MB to logstash via filebeat. pod log - filebeat- logstash -syslog I observed that filebeat stopped reading after sending some MB data. I could see the file getting created …

---

## [Received ban for the parent , reason: \[by user request\]](https://discuss.elastic.co/t/received-ban-for-the-parent-reason-by-user-request/244566)

<div class="topic-metadata">

**Author:** [@Anis](https://discuss.elastic.co/u/Anis)\
**Replies:** 0\
**Last updated:** [August 11, 2020, 1:50pm UTC](https://discuss.elastic.co/t/received-ban-for-the-parent-reason-by-user-request/244566 "2020-08-11T13:50:01Z")

</div>

I am experiencing the follwoig BUG/WARN when sporadically our searches appear to not be returning when these messages are seen. They all seem to begin with the "Received ban for the parent" message. Other times the same…

---

## [Kibana UI Customization](https://discuss.elastic.co/t/kibana-ui-customization/244360)

<div class="topic-metadata">

**Author:** [@sima](https://discuss.elastic.co/u/sima)\
**Replies:** 1\
**Last updated:** [August 11, 2020, 1:02pm UTC](https://discuss.elastic.co/t/kibana-ui-customization/244360 "2020-08-11T13:02:38Z")

</div>

Hi!! I want to slightly change the UI of kibana without installing any other themes. I just want to change some colors fonts using the original source code file. However i couldnt find the index page or the exact locatio…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1873)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1875)
