# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1262

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1263

---

## [Metricbeat Azure Modules metricset for VirtualNetworkGateway](https://discuss.elastic.co/t/metricbeat-azure-modules-metricset-for-virtualnetworkgateway/282732)

<div class="topic-metadata">

**Author:** [@adhiraj-g](https://discuss.elastic.co/u/adhiraj-g)\
**Replies:** 0\
**Last updated:** [August 28, 2021, 8:23pm UTC](https://discuss.elastic.co/t/metricbeat-azure-modules-metricset-for-virtualnetworkgateway/282732 "2021-08-28T20:23:23Z")

</div>

Hi, Is it possible to get Data from azure Virtual Network Gateway shown on Kibana? I have added the namespace to azure module yaml file. Connection is there but not sure on how to display its metrics on Kibana. I trie…

---

## [Revert from new Kibana v7.13 JSON format](https://discuss.elastic.co/t/revert-from-new-kibana-v7-13-json-format/280542)

<div class="topic-metadata">

**Author:** [@Roy\_Levy](https://discuss.elastic.co/u/Roy_Levy)\
**Replies:** 5\
**Last updated:** [August 29, 2021, 3:51pm UTC](https://discuss.elastic.co/t/revert-from-new-kibana-v7-13-json-format/280542 "2021-08-29T15:51:12Z")

</div>

Hey, After upgrading to Kibana v7.13 the JSON format in the Discover tab in Kibana was altered and now has no hierarchy in it. I was wondering if there is any way to revert this change to get a formatted JSON when…

---

## [Matching receipts with fulfilled orders](https://discuss.elastic.co/t/matching-receipts-with-fulfilled-orders/282123)

<div class="topic-metadata">

**Author:** [@JoeGilkey](https://discuss.elastic.co/u/JoeGilkey)\
**Replies:** 3\
**Last updated:** [August 29, 2021, 3:43pm UTC](https://discuss.elastic.co/t/matching-receipts-with-fulfilled-orders/282123 "2021-08-29T15:43:17Z")

</div>

Hello, I have a data stream that I am posting grocery receipts to on an hourly basis. The receipt includes the individual items purchased, as well as a keyword array with the unique product UPC codes. I’m trying to matc…

---

## [Kibana startup failure in Windows](https://discuss.elastic.co/t/kibana-startup-failure-in-windows/279407)

<div class="topic-metadata">

**Author:** [@Srinivas\_Kris](https://discuss.elastic.co/u/Srinivas_Kris)\
**Replies:** 4\
**Last updated:** [August 29, 2021, 3:34pm UTC](https://discuss.elastic.co/t/kibana-startup-failure-in-windows/279407 "2021-08-29T15:34:41Z")

</div>

Hi All I downloaded Kibana 7.13.4 zip file and extracted in windows. I started kibarna.bat in command prompt. I am getting the following error. Any help is appreciated. log \[11:02:36.548\] \[fatal\]\[root\] Error: Cannot …

---

## [Kafka Output - idempotent producer?](https://discuss.elastic.co/t/kafka-output-idempotent-producer/282754)

<div class="topic-metadata">

**Author:** [@GitSpree23](https://discuss.elastic.co/u/GitSpree23)\
**Replies:** 1\
**Last updated:** [August 29, 2021, 2:43pm UTC](https://discuss.elastic.co/t/kafka-output-idempotent-producer/282754 "2021-08-29T14:43:00Z")

</div>

I can see from Logstash logs that enable.idempotence=false by default. How do I set the value to true?

---

## [Docker elasticsearch - changing directory permission is not working](https://discuss.elastic.co/t/docker-elasticsearch-changing-directory-permission-is-not-working/282746)

<div class="topic-metadata">

**Author:** [@lilyyy](https://discuss.elastic.co/u/lilyyy)\
**Replies:** 0\
**Last updated:** [August 29, 2021, 7:19am UTC](https://discuss.elastic.co/t/docker-elasticsearch-changing-directory-permission-is-not-working/282746 "2021-08-29T07:19:50Z")

</div>

Hi all elasticsearch.yml --- ## Default Elasticsearch configuration from Elasticsearch base image. ## https://github.com/elastic/elasticsearch/blob/master/distribution/docker/src/docker/config/elasticsearch.yml # clust…

---

## [\-system.hostfs doesn't seem to work](https://discuss.elastic.co/t/system-hostfs-doesnt-seem-to-work/282745)

<div class="topic-metadata">

**Author:** [@MikSFG](https://discuss.elastic.co/u/MikSFG)\
**Replies:** 0\
**Last updated:** [August 29, 2021, 7:15am UTC](https://discuss.elastic.co/t/system-hostfs-doesnt-seem-to-work/282745 "2021-08-29T07:15:53Z")

</div>

Hi, I'm currently trying to audit my host from my container, but when I mount my var,sys,proc to the container's /hostfs it doesn't affect anything, audit doesn't do anything with them. For example, I can check my host…

---

## [How do I apply the Precision from the Ranking Evaluation API to all ids?](https://discuss.elastic.co/t/how-do-i-apply-the-precision-from-the-ranking-evaluation-api-to-all-ids/282742)

<div class="topic-metadata">

**Author:** [@Talents](https://discuss.elastic.co/u/Talents)\
**Replies:** 0\
**Last updated:** [August 29, 2021, 3:36am UTC](https://discuss.elastic.co/t/how-do-i-apply-the-precision-from-the-ranking-evaluation-api-to-all-ids/282742 "2021-08-29T03:36:10Z")

</div>

I'm using this page as a reference (Ranking evaluation API | Elasticsearch Guide \[7.14\] | Elastic) and I was just wondering how I'd apply the Precision part to all the ids in my index instead of having to do it 1 by 1? T…

---

## [Logstash Plugins](https://discuss.elastic.co/t/logstash-plugins/282713)

<div class="topic-metadata">

**Author:** [@Markelastic](https://discuss.elastic.co/u/Markelastic)\
**Replies:** 4\
**Last updated:** [August 28, 2021, 10:53pm UTC](https://discuss.elastic.co/t/logstash-plugins/282713 "2021-08-28T22:53:52Z")

</div>

I am trying to parse a single line of unstructured data and I believe I am over complicating the matter. I am a log time SIEM engineer and content developer. That said, I am both in awe and just a tad overwhelmed in ligh…

---

## [Anomalies and bucket span](https://discuss.elastic.co/t/anomalies-and-bucket-span/282601)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 1\
**Last updated:** [August 28, 2021, 1:17pm UTC](https://discuss.elastic.co/t/anomalies-and-bucket-span/282601 "2021-08-28T13:17:38Z")

</div>

Hi, I have a ML job with a bucket span of 5 minutes. when an anomaly is detected and displayed in a graph, the red dot is the beggining of that bucket span? or the end of the bucket span? in other words the red dot indi…

---

## [Unble to view single document permission denied](https://discuss.elastic.co/t/unble-to-view-single-document-permission-denied/282724)

<div class="topic-metadata">

**Author:** [@selin](https://discuss.elastic.co/u/selin)\
**Replies:** 1\
**Last updated:** [August 28, 2021, 1:00pm UTC](https://discuss.elastic.co/t/unble-to-view-single-document-permission-denied/282724 "2021-08-28T13:00:49Z")

</div>

Hi friend can i know what permission need to be provided so user can view \[View surrounding documents\] \[View single document\]

---

## [The perfect Elasticsearch data node](https://discuss.elastic.co/t/the-perfect-elasticsearch-data-node/280841)

<div class="topic-metadata">

**Author:** [@Jason\_Baumgartner](https://discuss.elastic.co/u/Jason_Baumgartner)\
**Replies:** 4\
**Last updated:** [August 28, 2021, 12:01pm UTC](https://discuss.elastic.co/t/the-perfect-elasticsearch-data-node/280841 "2021-08-28T12:01:20Z")

</div>

I'm currently upgrading our Elasticsearch cluster to a multi-petabyte cluster (~2.5 petabytes). I have some questions about scaling out Elasticsearch, etc. First, I've found that cheap nucs with 12+ cores and 64GB of RA…

---

## [HTTP error 401 on /api/licensing/info](https://discuss.elastic.co/t/http-error-401-on-api-licensing-info/281542)

<div class="topic-metadata">

**Author:** [@rilcy](https://discuss.elastic.co/u/rilcy)\
**Replies:** 3\
**Last updated:** [August 28, 2021, 4:04am UTC](https://discuss.elastic.co/t/http-error-401-on-api-licensing-info/281542 "2021-08-28T04:04:42Z")

</div>

Hi everyone, When browsing in Kibana interface i often get disconnected with the message "SESSION\_EXPIRED" and got redirected to the login page Checking in the Kibana logs i see that right before getting disconnected t…

---

## [Unable to start elasticsearch on CentOs](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-centos/282687)

<div class="topic-metadata">

**Author:** [@mirza\_muhriz](https://discuss.elastic.co/u/mirza_muhriz)\
**Replies:** 11\
**Last updated:** [August 28, 2021, 3:06am UTC](https://discuss.elastic.co/t/unable-to-start-elasticsearch-on-centos/282687 "2021-08-28T03:06:56Z")

</div>

/bin/systemctl status elasticsearch.service ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendo …

---

## [Kibana Error connecting to package registry: request to https://xxx.xxx/xxx failed, reason: self signed certificate in certificate chain](https://discuss.elastic.co/t/kibana-error-connecting-to-package-registry-request-to-https-xxx-xxx-xxx-failed-reason-self-signed-certificate-in-certificate-chain/282710)

<div class="topic-metadata">

**Author:** [@jonkop](https://discuss.elastic.co/u/jonkop)\
**Replies:** 1\
**Last updated:** [August 28, 2021, 12:37am UTC](https://discuss.elastic.co/t/kibana-error-connecting-to-package-registry-request-to-https-xxx-xxx-xxx-failed-reason-self-signed-certificate-in-certificate-chain/282710 "2021-08-28T00:37:21Z")

</div>

Hello, In our company we have a checkpoint firewall with a reverse proxy everything works fine except for 1 error message that appears every time you try to access external content from kibana. log \[23: 58: 26.917\] …

---

## [Beginner: Trouble getting started](https://discuss.elastic.co/t/beginner-trouble-getting-started/282617)

<div class="topic-metadata">

**Author:** [@jmsbooth](https://discuss.elastic.co/u/jmsbooth)\
**Replies:** 7\
**Last updated:** [August 27, 2021, 11:33pm UTC](https://discuss.elastic.co/t/beginner-trouble-getting-started/282617 "2021-08-27T23:33:21Z")

</div>

Deployed elasticsearch to an Ubuntu VM within Azure cloud. Edited the elasticsearch.yaml for the port, cluster.initial\_master\_nodes, and the network host: \[network.host\](https://network.host/): "localhost" http.port: 92…

---

## [Kibana server not ready yet](https://discuss.elastic.co/t/kibana-server-not-ready-yet/282694)

<div class="topic-metadata">

**Author:** [@Techy\_Vince](https://discuss.elastic.co/u/Techy_Vince)\
**Replies:** 4\
**Last updated:** [August 27, 2021, 7:33pm UTC](https://discuss.elastic.co/t/kibana-server-not-ready-yet/282694 "2021-08-27T19:33:51Z")

</div>

Hey everyone! Please I need fixing this error. Currently ruining from a docker container {"type":"log","@timestamp":"2021-08-27T16:29:22+00:00","tags":\["warning","plugins","actions","actions"\],"pid":1215,"message":"APIs…

---

## [HTTP\_Poller and Elasticsearch](https://discuss.elastic.co/t/http-poller-and-elasticsearch/282704)

<div class="topic-metadata">

**Author:** [@tofubeats](https://discuss.elastic.co/u/tofubeats)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 8:03pm UTC](https://discuss.elastic.co/t/http-poller-and-elasticsearch/282704 "2021-08-27T20:03:40Z")

</div>

Hi, I am trying to query elasticsearch API with http\_poller input but keep getting the beloved PKIX building path failed error. I've set the elasticsearch.yml on the node being queried to contain the following: xpack.s…

---

## [Upgraded Kibana from 7.12 to 7.14 and now it's broken](https://discuss.elastic.co/t/upgraded-kibana-from-7-12-to-7-14-and-now-its-broken/282515)

<div class="topic-metadata">

**Author:** [@RLPowellJr](https://discuss.elastic.co/u/RLPowellJr)\
**Replies:** 8\
**Last updated:** [August 27, 2021, 5:38pm UTC](https://discuss.elastic.co/t/upgraded-kibana-from-7-12-to-7-14-and-now-its-broken/282515 "2021-08-27T17:38:57Z")

</div>

Bottom line up front: I’ve broken my Kibana by attempting an upgrade from 7.12 to 7.14. Details: We have an Elastic Stack installation in a development sandbox environment. The first version of the Stack components ins…

---

## [Other deployment options for functionbeat](https://discuss.elastic.co/t/other-deployment-options-for-functionbeat/282696)

<div class="topic-metadata">

**Author:** [@mohsen0](https://discuss.elastic.co/u/mohsen0)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 5:16pm UTC](https://discuss.elastic.co/t/other-deployment-options-for-functionbeat/282696 "2021-08-27T17:16:28Z")

</div>

Hi The current deployment method of functionbeat, doesn't support adding AWS resource tags for different deployments. I saw Pass AWS tags to resources created by Functionbeat which went unanswered. Currently, deploym…

---

## [What's the characteristics and criterion of choosing master and search (kibana) nodes](https://discuss.elastic.co/t/whats-the-characteristics-and-criterion-of-choosing-master-and-search-kibana-nodes/282695)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 5:15pm UTC](https://discuss.elastic.co/t/whats-the-characteristics-and-criterion-of-choosing-master-and-search-kibana-nodes/282695 "2021-08-27T17:15:55Z")

</div>

Hey I am trying to design a cluster in a real use case, it's well-known that when we have more then 5 data nodes, the number of master nodes should be 3 (at least if I am wrong), but I can't decide the characteritics of …

---

## [Logs not show on Kibana](https://discuss.elastic.co/t/logs-not-show-on-kibana/282689)

<div class="topic-metadata">

**Author:** [@fcoulibaly](https://discuss.elastic.co/u/fcoulibaly)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 4:22pm UTC](https://discuss.elastic.co/t/logs-not-show-on-kibana/282689 "2021-08-27T16:22:23Z")

</div>

can someone help me to write correct grok filter for the pattern: 2021.08.27-17:15:02 INFO\[172\] - start running on dev2 i used this code below but this not show any logs on Kibana else if \[fields\]\[hostgroup\] == "sols\_…

---

## [Logstash Grok pattern match issue](https://discuss.elastic.co/t/logstash-grok-pattern-match-issue/282584)

<div class="topic-metadata">

**Author:** [@ericilavia](https://discuss.elastic.co/u/ericilavia)\
**Replies:** 3\
**Last updated:** [August 27, 2021, 3:44pm UTC](https://discuss.elastic.co/t/logstash-grok-pattern-match-issue/282584 "2021-08-27T15:44:28Z")

</div>

Hello, I am facing an issue with parsing data using Logstash using Grok filter, below is the use-case There are two types of logs I am trying to parse, //Grok patterns Type1: 04-16 07:16:35,359\[ INFO\]:Except:Process…

---

## [Joining multiple document within same index with joining the key](https://discuss.elastic.co/t/joining-multiple-document-within-same-index-with-joining-the-key/282680)

<div class="topic-metadata">

**Author:** [@Cap\_Ho](https://discuss.elastic.co/u/Cap_Ho)\
**Replies:** 4\
**Last updated:** [August 27, 2021, 3:40pm UTC](https://discuss.elastic.co/t/joining-multiple-document-within-same-index-with-joining-the-key/282680 "2021-08-27T15:40:17Z")

</div>

Just have an question on query to join multiple document together. For example , i have the following 6 document into same index: { "\_id" : 1, "studentId" : "a11", "class" : "1A", "classNumber" : 11 }, { "\_id" :…

---

## [Is there any way to set number of shards for an Index's replica?(default is 1)](https://discuss.elastic.co/t/is-there-any-way-to-set-number-of-shards-for-an-indexs-replica-default-is-1/282606)

<div class="topic-metadata">

**Author:** [@iti](https://discuss.elastic.co/u/iti)\
**Replies:** 10\
**Last updated:** [August 27, 2021, 3:24pm UTC](https://discuss.elastic.co/t/is-there-any-way-to-set-number-of-shards-for-an-indexs-replica-default-is-1/282606 "2021-08-27T15:24:26Z")

</div>

I am setting the index's shard to something other than 1. (Say 5). I was expecting to have 5 primary shards and 5 replica shards. But what I got is 5 primary shards and 1 replica shard. Is there anyway to set the shard …

---

## [Error watcher with multiple terms and a metric](https://discuss.elastic.co/t/error-watcher-with-multiple-terms-and-a-metric/282604)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 10\
**Last updated:** [August 27, 2021, 3:03pm UTC](https://discuss.elastic.co/t/error-watcher-with-multiple-terms-and-a-metric/282604 "2021-08-27T15:03:19Z")

</div>

Hello, good people. I have a problem with an alert, I get the following error: { "watch\_id": "\_inlined\_", "node": "ELuSGxpSRICZb2ZHJp4paA", "state": "failed", "user": "elastic", "status": { "state": { …

---

## [Filebeat fingerprint doesn't understand columns from csv files](https://discuss.elastic.co/t/filebeat-fingerprint-doesnt-understand-columns-from-csv-files/282427)

<div class="topic-metadata">

**Author:** [@Baygon](https://discuss.elastic.co/u/Baygon)\
**Replies:** 4\
**Last updated:** [August 27, 2021, 2:44pm UTC](https://discuss.elastic.co/t/filebeat-fingerprint-doesnt-understand-columns-from-csv-files/282427 "2021-08-27T14:44:35Z")

</div>

Hi, I have a filebeat instance that sends event from CSV files to an ES cluster. The ingest pipeline has the relevant mappings and everything works fine. I'm trying to improve the pipeline for deduplication of event b…

---

## [How to run beats/machinebeat as a service](https://discuss.elastic.co/t/how-to-run-beats-machinebeat-as-a-service/282678)

<div class="topic-metadata">

**Author:** [@Valdos116](https://discuss.elastic.co/u/Valdos116)\
**Replies:** 0\
**Last updated:** [August 27, 2021, 2:30pm UTC](https://discuss.elastic.co/t/how-to-run-beats-machinebeat-as-a-service/282678 "2021-08-27T14:30:14Z")

</div>

I've machinebeat set up and running and I'm looking for a way to run it as a service. Any helps will be appreciated. Thanks,

---

## [Python parallel\_bulk, info says no errors, but nothing in index](https://discuss.elastic.co/t/python-parallel-bulk-info-says-no-errors-but-nothing-in-index/282611)

<div class="topic-metadata">

**Author:** [@dreic](https://discuss.elastic.co/u/dreic)\
**Replies:** 1\
**Last updated:** [August 27, 2021, 2:27pm UTC](https://discuss.elastic.co/t/python-parallel-bulk-info-says-no-errors-but-nothing-in-index/282611 "2021-08-27T14:27:11Z")

</div>

Here is the part of my python code. Took me a while to get this working without any errors as I didn't know what was the input structure function was accepting... Anyway here it is: docs = \[ { "Cr…

---

## [Filebeat unable to output logs to kafka](https://discuss.elastic.co/t/filebeat-unable-to-output-logs-to-kafka/278359)

<div class="topic-metadata">

**Author:** [@itsec](https://discuss.elastic.co/u/itsec)\
**Replies:** 5\
**Last updated:** [August 27, 2021, 2:00pm UTC](https://discuss.elastic.co/t/filebeat-unable-to-output-logs-to-kafka/278359 "2021-08-27T14:00:24Z")

</div>

I had setup a 3 node clusters and my kafka / zookeeper are running i can create a topic and insert msg to the topic and read its output filebeat version 7.12.0 (amd64), libbeat 7.12.0 kafka 2.13-2.7.0 zookeeper 3.5.8 …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1261)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1263)
