# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1217

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1218

---

## [Can both allocate this shard and improve the cluster balance](https://discuss.elastic.co/t/can-both-allocate-this-shard-and-improve-the-cluster-balance/285579)

<div class="topic-metadata">

**Author:** [@Mike\_Williams](https://discuss.elastic.co/u/Mike_Williams)\
**Replies:** 5\
**Last updated:** [October 1, 2021, 10:20am UTC](https://discuss.elastic.co/t/can-both-allocate-this-shard-and-improve-the-cluster-balance/285579 "2021-10-01T10:20:35Z")

</div>

Hi everyone, I've recently been setting up a new ELK stack, and am naturally trying to use all the cool tools and features possible. In times past we've used regular indices and curator to move their shards about based…

---

## [Few logs present in elasticsearch but not visible in Kibana](https://discuss.elastic.co/t/few-logs-present-in-elasticsearch-but-not-visible-in-kibana/285596)

<div class="topic-metadata">

**Author:** [@Sandeep\_Gupta](https://discuss.elastic.co/u/Sandeep_Gupta)\
**Replies:** 2\
**Last updated:** [October 1, 2021, 10:10am UTC](https://discuss.elastic.co/t/few-logs-present-in-elasticsearch-but-not-visible-in-kibana/285596 "2021-10-01T10:10:29Z")

</div>

I am using Elastic 7.11. I am logging each request to my website in Elasticsearch through Logstash and using Kibana to view the request data. Somehow, I am not able to see (in Kibana) each request sent to Elasticsearch.…

---

## [Can't figure out how to create time based visualisation with sub-aggregation](https://discuss.elastic.co/t/cant-figure-out-how-to-create-time-based-visualisation-with-sub-aggregation/285563)

<div class="topic-metadata">

**Author:** [@Sergey\_Ganchuk](https://discuss.elastic.co/u/Sergey_Ganchuk)\
**Replies:** 4\
**Last updated:** [October 1, 2021, 9:42am UTC](https://discuss.elastic.co/t/cant-figure-out-how-to-create-time-based-visualisation-with-sub-aggregation/285563 "2021-10-01T09:42:40Z")

</div>

Hello. I'm collecting accounting data from our cloud platform (vmname, memory, cpu, owner, etc...) Script is running every hour and posting document for every vm. I would like to visualize usage of resources by every …

---

## [VSphere Performance Metrics - Metricbeat](https://discuss.elastic.co/t/vsphere-performance-metrics-metricbeat/285665)

<div class="topic-metadata">

**Author:** [@bm.brit](https://discuss.elastic.co/u/bm.brit)\
**Replies:** 0\
**Last updated:** [October 1, 2021, 9:41am UTC](https://discuss.elastic.co/t/vsphere-performance-metrics-metricbeat/285665 "2021-10-01T09:41:24Z")

</div>

Hi, I would like to see IOPS and Total Latency for the Datastore metricset, Throughput and Network like Current Send/Receive KBps, Interface Name of Disk's of the Virtual Host and the same for the Host. I tried the 7.15…

---

## [Kibana - Metricbeat Gadget Top Hosts](https://discuss.elastic.co/t/kibana-metricbeat-gadget-top-hosts/285273)

<div class="topic-metadata">

**Author:** [@Joel.Andrews](https://discuss.elastic.co/u/Joel.Andrews)\
**Replies:** 1\
**Last updated:** [October 1, 2021, 9:35am UTC](https://discuss.elastic.co/t/kibana-metricbeat-gadget-top-hosts/285273 "2021-10-01T09:35:48Z")

</div>

Hi There, After upgrading to 7.15.0, I've noticed a couple of the Metricbeat gadgets are not reporting correctly anymore. It shows the stats for a couple of hosts, and the rest are just solid bars. Is there a configur…

---

## [Using a force transform with "x", "y" forces](https://discuss.elastic.co/t/using-a-force-transform-with-x-y-forces/283838)

<div class="topic-metadata">

**Author:** [@elad\_sheinfeld](https://discuss.elastic.co/u/elad_sheinfeld)\
**Replies:** 1\
**Last updated:** [October 1, 2021, 9:26am UTC](https://discuss.elastic.co/t/using-a-force-transform-with-x-y-forces/283838 "2021-10-01T09:26:52Z")

</div>

Hey all, I'm using the VEGA visualization in ELK version 7.13.3 I'm trying to draw nodes connected to networks. I want the x, y coordinates represent the "node\_id" and "net\_level" respectively, using the force transfo…

---

## [Kibana Upgrade from 7.12 to 7.13.3 using migrations.enableV2: false](https://discuss.elastic.co/t/kibana-upgrade-from-7-12-to-7-13-3-using-migrations-enablev2-false/284808)

<div class="topic-metadata">

**Author:** [@qiratnahraf](https://discuss.elastic.co/u/qiratnahraf)\
**Replies:** 8\
**Last updated:** [October 1, 2021, 8:52am UTC](https://discuss.elastic.co/t/kibana-upgrade-from-7-12-to-7-13-3-using-migrations-enablev2-false/284808 "2021-10-01T08:52:37Z")

</div>

Hi, We upgraded our kibana from 7.12 to 7.13.3 with migrations.enableV2: false set in configuration. The kibana instance upgraded successfully but Now we are getting following error when trying to save searches or rul…

---

## [MySQL metricbeat module error](https://discuss.elastic.co/t/mysql-metricbeat-module-error/285662)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 0\
**Last updated:** [October 1, 2021, 8:43am UTC](https://discuss.elastic.co/t/mysql-metricbeat-module-error/285662 "2021-10-01T08:43:22Z")

</div>

hello ! im trying to use de mysql module of metricbeat but it only works without performance and query. some visualizations work fine but others don't, I guess this occurs because I can't activate performance and qu…

---

## [Fetch data from a middle of a big stack using searchAfter( jump to a specific page)](https://discuss.elastic.co/t/fetch-data-from-a-middle-of-a-big-stack-using-searchafter-jump-to-a-specific-page/285256)

<div class="topic-metadata">

**Author:** [@Fat](https://discuss.elastic.co/u/Fat)\
**Replies:** 4\
**Last updated:** [October 1, 2021, 8:18am UTC](https://discuss.elastic.co/t/fetch-data-from-a-middle-of-a-big-stack-using-searchafter-jump-to-a-specific-page/285256 "2021-10-01T08:18:13Z")

</div>

Hi All I have a large data set around 25million records I am using searchAfter with PointInTime to walk through the data My question is there a way where I can skip records over the limit of 10000 index.max\_result\_w…

---

## [How to set maximum 100% for TopN visuals?](https://discuss.elastic.co/t/how-to-set-maximum-100-for-topn-visuals/283515)

<div class="topic-metadata">

**Author:** [@Disha\_Bodade](https://discuss.elastic.co/u/Disha_Bodade)\
**Replies:** 1\
**Last updated:** [October 1, 2021, 7:55am UTC](https://discuss.elastic.co/t/how-to-set-maximum-100-for-topn-visuals/283515 "2021-10-01T07:55:14Z")

</div>

I have created a TOPN visual for percentage CPU usage, I created a visual in TSVB - \> Time series, done all settings for axis min and max values. once its shows 100% max on the x-axis, I change the visual to TOPN. but it…

---

## [Database stored procedure reading output](https://discuss.elastic.co/t/database-stored-procedure-reading-output/285467)

<div class="topic-metadata">

**Author:** [@tractor\_boy](https://discuss.elastic.co/u/tractor_boy)\
**Replies:** 6\
**Last updated:** [October 1, 2021, 7:53am UTC](https://discuss.elastic.co/t/database-stored-procedure-reading-output/285467 "2021-10-01T07:53:39Z")

</div>

I have searched and found some articles that describe how to set up data capture from a stored procedure, but I do not understand the conversations, so cannot convert into a concise description of what is required to mak…

---

## [Kibana Watcher Current Date in e-mail subject](https://discuss.elastic.co/t/kibana-watcher-current-date-in-e-mail-subject/284155)

<div class="topic-metadata">

**Author:** [@piotr.krupinski](https://discuss.elastic.co/u/piotr.krupinski)\
**Replies:** 1\
**Last updated:** [October 1, 2021, 7:42am UTC](https://discuss.elastic.co/t/kibana-watcher-current-date-in-e-mail-subject/284155 "2021-10-01T07:42:26Z")

</div>

Hello, I need to have current date in subject in e-mail sent by Elastic Watcher at the moment I have code like below: "subject": " {{ctx.trigger.scheduled\_time}}Exposure Report is available" and the Result is which …

---

## [Terms aggregation on multiple indexes, ignore text fields](https://discuss.elastic.co/t/terms-aggregation-on-multiple-indexes-ignore-text-fields/285654)

<div class="topic-metadata">

**Author:** [@Emil](https://discuss.elastic.co/u/Emil)\
**Replies:** 1\
**Last updated:** [October 1, 2021, 7:41am UTC](https://discuss.elastic.co/t/terms-aggregation-on-multiple-indexes-ignore-text-fields/285654 "2021-10-01T07:41:27Z")

</div>

I have multiple indexes, that I'd like to query at the same time, and find out which values are present in some field, with a terms aggregation. The problem is, this field is sometimes mapped as a keyword, and sometimes…

---

## [How does Packetbeat match DNS Queries with Answers?](https://discuss.elastic.co/t/how-does-packetbeat-match-dns-queries-with-answers/285657)

<div class="topic-metadata">

**Author:** [@tomx1](https://discuss.elastic.co/u/tomx1)\
**Replies:** 0\
**Last updated:** [October 1, 2021, 7:39am UTC](https://discuss.elastic.co/t/how-does-packetbeat-match-dns-queries-with-answers/285657 "2021-10-01T07:39:00Z")

</div>

We are maintaining some authoritative DNS resolvers and consider to use Packetbeat / Elasticsearch for statistic generation, alerting and so on. Its very nice that Packetbeat is capable of matching queries with responses…

---

## [Upgrade data node to data + master node in production](https://discuss.elastic.co/t/upgrade-data-node-to-data-master-node-in-production/285633)

<div class="topic-metadata">

**Author:** [@bhargava\_kovi](https://discuss.elastic.co/u/bhargava_kovi)\
**Replies:** 2\
**Last updated:** [October 1, 2021, 7:24am UTC](https://discuss.elastic.co/t/upgrade-data-node-to-data-master-node-in-production/285633 "2021-10-01T07:24:48Z")

</div>

I am running a production cluster with below configuration No of nodes:6 memory size of each node=64GB No of documents=1Billion No of shards=5 No of replicas=1 All the 6 nodes are master + data nodes and there is n…

---

## [Bootstrapped index is set as the write index but logs are getting written to old index](https://discuss.elastic.co/t/bootstrapped-index-is-set-as-the-write-index-but-logs-are-getting-written-to-old-index/285589)

<div class="topic-metadata">

**Author:** [@mitesh.gangaramani](https://discuss.elastic.co/u/mitesh.gangaramani)\
**Replies:** 4\
**Last updated:** [October 1, 2021, 5:50am UTC](https://discuss.elastic.co/t/bootstrapped-index-is-set-as-the-write-index-but-logs-are-getting-written-to-old-index/285589 "2021-10-01T05:50:14Z")

</div>

Hello Experts, We are running Elastic + Fluentbit + Kibana stack on kubernetes for container logs and it was working correctly with daily rollover based on date(new-YYYY-MM-DD) but on high volume it caused over shard s…

---

## [I could not see the real Time data on Kibana](https://discuss.elastic.co/t/i-could-not-see-the-real-time-data-on-kibana/285590)

<div class="topic-metadata">

**Author:** [@Mamta\_Yadav](https://discuss.elastic.co/u/Mamta_Yadav)\
**Replies:** 2\
**Last updated:** [October 1, 2021, 5:40am UTC](https://discuss.elastic.co/t/i-could-not-see-the-real-time-data-on-kibana/285590 "2021-10-01T05:40:54Z")

</div>

I am very new to this ELK , I have few questions , 1) I am trying to visualize below log line kibana for that I used 4 components filebeat which is reading the log file from server and send data to logstash logstash filt…

---

## [Filebeat setup error at kibana](https://discuss.elastic.co/t/filebeat-setup-error-at-kibana/285626)

<div class="topic-metadata">

**Author:** [@vnikh15](https://discuss.elastic.co/u/vnikh15)\
**Replies:** 2\
**Last updated:** [October 1, 2021, 5:28am UTC](https://discuss.elastic.co/t/filebeat-setup-error-at-kibana/285626 "2021-10-01T05:28:28Z")

</div>

Hi Everyone , I am trying to display filebeat\* indices at kibana but the file beat setup is giving below error:- error connecting to kibana: fail to get the kibana version: http get request to h "http://localhost:5601/…

---

## [TSVB table results greater than 12 hours results in an error](https://discuss.elastic.co/t/tsvb-table-results-greater-than-12-hours-results-in-an-error/284253)

<div class="topic-metadata">

**Author:** [@fidsamurai](https://discuss.elastic.co/u/fidsamurai)\
**Replies:** 5\
**Last updated:** [October 1, 2021, 4:05am UTC](https://discuss.elastic.co/t/tsvb-table-results-greater-than-12-hours-results-in-an-error/284253 "2021-10-01T04:05:52Z")

</div>

Hi All, I have a bit of a strange issue - I have created a TSVB table with 8 columns. 3 are normal count columns. The remaining 5 are filter ratios. The weird scenario is that if we keep the time to "Last 12 hours",…

---

## [ES 7.14 does create index from template but ignore mappings and replicas](https://discuss.elastic.co/t/es-7-14-does-create-index-from-template-but-ignore-mappings-and-replicas/283352)

<div class="topic-metadata">

**Author:** [@luigius](https://discuss.elastic.co/u/luigius)\
**Replies:** 2\
**Last updated:** [October 1, 2021, 3:46am UTC](https://discuss.elastic.co/t/es-7-14-does-create-index-from-template-but-ignore-mappings-and-replicas/283352 "2021-10-01T03:46:57Z")

</div>

Hi, I create a template: PUT \_template/logstash { "index\_patterns" : \[ "logstash-\*" \], "settings" : { "index" : { "lifecycle" : { "name" : "filebeat", "rollover\_alia…

---

## [How to aggregate consecutive "same" logs in Elasticsearch/Kibana?](https://discuss.elastic.co/t/how-to-aggregate-consecutive-same-logs-in-elasticsearch-kibana/285181)

<div class="topic-metadata">

**Author:** [@piglovesyou1](https://discuss.elastic.co/u/piglovesyou1)\
**Replies:** 4\
**Last updated:** [October 1, 2021, 2:40am UTC](https://discuss.elastic.co/t/how-to-aggregate-consecutive-same-logs-in-elasticsearch-kibana/285181 "2021-10-01T02:40:59Z")

</div>

Hi. I currently have data looking like these. // Input { user: "A", status: "away", timestamp: 1 } { user: "A", status: "away", timestamp: 2 } { user: "B", status: "active", timestamp: 3 } { user: "A", status: "away", t…

---

## [Trouble Building Metricbeat Cont](https://discuss.elastic.co/t/trouble-building-metricbeat-cont/285638)

<div class="topic-metadata">

**Author:** [@ss\_22](https://discuss.elastic.co/u/ss_22)\
**Replies:** 1\
**Last updated:** [September 30, 2021, 11:42pm UTC](https://discuss.elastic.co/t/trouble-building-metricbeat-cont/285638 "2021-09-30T23:42:15Z")

</div>

Hello, I am trying to build the current master branch metricbeat image from source code on my mac (macOS Catalina V10.15.7). I have been following the developer guides. Everything installed and it goes great when I run…

---

## [Filter field by percentage](https://discuss.elastic.co/t/filter-field-by-percentage/285628)

<div class="topic-metadata">

**Author:** [@Felipe\_Fuller](https://discuss.elastic.co/u/Felipe_Fuller)\
**Replies:** 1\
**Last updated:** [September 30, 2021, 11:35pm UTC](https://discuss.elastic.co/t/filter-field-by-percentage/285628 "2021-09-30T23:35:28Z")

</div>

Hello Community! I am having a problem formulating a query in Elasticseach. In this query, I have to group the IPs by the field called ip\_address defined as IP type, and return the ones that have an occurrence greater t…

---

## [Kibana-keystore password view option in Elastic 7.13.1](https://discuss.elastic.co/t/kibana-keystore-password-view-option-in-elastic-7-13-1/285539)

<div class="topic-metadata">

**Author:** [@tsahoo43](https://discuss.elastic.co/u/tsahoo43)\
**Replies:** 2\
**Last updated:** [September 30, 2021, 10:56pm UTC](https://discuss.elastic.co/t/kibana-keystore-password-view-option-in-elastic-7-13-1/285539 "2021-09-30T22:56:30Z")

</div>

Hi Team, I have created the "kibana-keystore" file and stored the Elasticsearch username and Elasticsearch password in it . Could anyone please explain the process to view the stored password from the keystore . Thank…

---

## [Kibana and UiPath Orchestrator ( Cloud)](https://discuss.elastic.co/t/kibana-and-uipath-orchestrator-cloud/285548)

<div class="topic-metadata">

**Author:** [@Varun\_Dharni](https://discuss.elastic.co/u/Varun_Dharni)\
**Replies:** 1\
**Last updated:** [September 30, 2021, 10:49pm UTC](https://discuss.elastic.co/t/kibana-and-uipath-orchestrator-cloud/285548 "2021-09-30T22:49:00Z")

</div>

How can I connect Kibana with UiPath Orchestrator . I want to visualize logs created in UiPath Orchestrator in Kibana. I am using Uipath Orchestrator CE edition which is on cloud and have installed kibana on my local m…

---

## [Is it possible to hide some fields in filters for particular user?](https://discuss.elastic.co/t/is-it-possible-to-hide-some-fields-in-filters-for-particular-user/285572)

<div class="topic-metadata">

**Author:** [@WhatsIsKibana](https://discuss.elastic.co/u/WhatsIsKibana)\
**Replies:** 1\
**Last updated:** [September 30, 2021, 10:47pm UTC](https://discuss.elastic.co/t/is-it-possible-to-hide-some-fields-in-filters-for-particular-user/285572 "2021-09-30T22:47:51Z")

</div>

Hello, I want to hide some fields in filter bar of dashboard or visualization. For example, if user is "admin" I want to show all available fields, but for non-admin user I'd like to hide some of fields. Is it possible…

---

## [Grafana colored logs and elasticsearch lucene query](https://discuss.elastic.co/t/grafana-colored-logs-and-elasticsearch-lucene-query/285541)

<div class="topic-metadata">

**Author:** [@AlexG](https://discuss.elastic.co/u/AlexG)\
**Replies:** 1\
**Last updated:** [September 30, 2021, 9:49pm UTC](https://discuss.elastic.co/t/grafana-colored-logs-and-elasticsearch-lucene-query/285541 "2021-09-30T21:49:16Z")

</div>

I have colored logs (Ansible logs) in Elasticsearch. Logs are displayed normally (colored) in Grafana. If I execute a lucence query using a Number field, the logs will be displayed in color: But if I execute lucen…

---

## [One or multiple metricbeat indices?](https://discuss.elastic.co/t/one-or-multiple-metricbeat-indices/285216)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 3\
**Last updated:** [September 30, 2021, 9:45pm UTC](https://discuss.elastic.co/t/one-or-multiple-metricbeat-indices/285216 "2021-09-30T21:45:51Z")

</div>

Hi there. I am installing machines with metricbeat to measure metrics. At the time of implementing it, I have the doubt if it is better to have a single index ({Agent} - {version}) or multiple indexes ({Agent} -{versio…

---

## [Winlogbeat - Sysmon Module and Even.Code: 1 Missing](https://discuss.elastic.co/t/winlogbeat-sysmon-module-and-even-code-1-missing/285620)

<div class="topic-metadata">

**Author:** [@elasticband](https://discuss.elastic.co/u/elasticband)\
**Replies:** 0\
**Last updated:** [September 30, 2021, 5:40pm UTC](https://discuss.elastic.co/t/winlogbeat-sysmon-module-and-even-code-1-missing/285620 "2021-09-30T17:40:53Z")

</div>

I am having a problem with Winlogbeats not sending or not properly parsing all the Sysmon event.code fields. I have been testing beign able to event code: 1 for process creations like "whoami.exe", but when I started to …

---

## [How to use Analyze index disk usage API?](https://discuss.elastic.co/t/how-to-use-analyze-index-disk-usage-api/285119)

<div class="topic-metadata">

**Author:** [@Rakesh\_B](https://discuss.elastic.co/u/Rakesh_B)\
**Replies:** 7\
**Last updated:** [September 30, 2021, 5:22pm UTC](https://discuss.elastic.co/t/how-to-use-analyze-index-disk-usage-api/285119 "2021-09-30T17:22:32Z")

</div>

Hi, We'd like to know how to use \_disk\_usage api. We are trying to figure out how much disk is used by individual fields in an index. The example mentioned in the doc is a POST request but it has no example data…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1216)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1218)
