# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1551

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1552

---

## [Adding multi tenant encryption at rest](https://discuss.elastic.co/t/adding-multi-tenant-encryption-at-rest/264423)

<div class="topic-metadata">

**Author:** [@oriagranat9](https://discuss.elastic.co/u/oriagranat9)\
**Replies:** 5\
**Last updated:** [February 17, 2021, 2:28pm UTC](https://discuss.elastic.co/t/adding-multi-tenant-encryption-at-rest/264423 "2021-02-17T14:28:53Z")

</div>

hey everyone, at my job we want to add encryption at rest with multi tenant keys, like this plugin called elasticrypt did a long time ago. since this plugin is deprecated i wanted to know if it is still possible to do s…

---

## [How to not log extra metadata from Logstash to Elasticsearch](https://discuss.elastic.co/t/how-to-not-log-extra-metadata-from-logstash-to-elasticsearch/264524)

<div class="topic-metadata">

**Author:** [@arclinear](https://discuss.elastic.co/u/arclinear)\
**Replies:** 1\
**Last updated:** [February 17, 2021, 1:40pm UTC](https://discuss.elastic.co/t/how-to-not-log-extra-metadata-from-logstash-to-elasticsearch/264524 "2021-02-17T13:40:22Z")

</div>

Hello, currently I have a working example of an ELK stack, however, in my indices I do not want to log the following fields : Ideally, in Elasticsearch, I only want to see "message" and "@timestamp", the other 4 is se…

---

## [Data table click event](https://discuss.elastic.co/t/data-table-click-event/264443)

<div class="topic-metadata">

**Author:** [@deeksha39](https://discuss.elastic.co/u/deeksha39)\
**Replies:** 1\
**Last updated:** [February 17, 2021, 1:33pm UTC](https://discuss.elastic.co/t/data-table-click-event/264443 "2021-02-17T13:33:19Z")

</div>

Hi Everyone, I want to create a data table from kibana that shows aggregate result based on some categorical columns for e.g. aggregation based on zone, country, the city then show aggregation of numerical data for e.…

---

## [Parse json in string in json (nested json)](https://discuss.elastic.co/t/parse-json-in-string-in-json-nested-json/264569)

<div class="topic-metadata">

**Author:** [@Romanian\_Coder](https://discuss.elastic.co/u/Romanian_Coder)\
**Replies:** 3\
**Last updated:** [February 17, 2021, 1:03pm UTC](https://discuss.elastic.co/t/parse-json-in-string-in-json-nested-json/264569 "2021-02-17T13:03:42Z")

</div>

I have next json in input { "partitionId": 3, "value": { "name": "updatedPaymentInfo", "value": "{\\"reference\\":\\"Z091702210000015\\",\\"transactionId\\":\\"CC11702210000020\\",\\"amountDTO\\":{\\"value\\":10000,\\"c…

---

## [org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed](https://discuss.elastic.co/t/org-apache-lucene-store-alreadyclosedexception-this-indexwriter-is-closed/264551)

<div class="topic-metadata">

**Author:** [@Farzad\_Ebrahimi](https://discuss.elastic.co/u/Farzad_Ebrahimi)\
**Replies:** 1\
**Last updated:** [February 17, 2021, 12:45pm UTC](https://discuss.elastic.co/t/org-apache-lucene-store-alreadyclosedexception-this-indexwriter-is-closed/264551 "2021-02-17T12:45:34Z")

</div>

Hi, we are doing single large index creation via java program on single elasticsearch node. after few millions of documents, we faced to this error: org.apache.lucene.store.AlreadyClosedException: this IndexWriter…

---

## [Multinode Cluster](https://discuss.elastic.co/t/multinode-cluster/264557)

<div class="topic-metadata">

**Author:** [@gafoc](https://discuss.elastic.co/u/gafoc)\
**Replies:** 1\
**Last updated:** [February 17, 2021, 12:30pm UTC](https://discuss.elastic.co/t/multinode-cluster/264557 "2021-02-17T12:30:22Z")

</div>

Hey can anyone help me setting up multi node cluster on 3 ubuntu machine making 1 as master node and the other two as slave node and injecting the data.

---

## [Lucene Total usage \< Fixed Bitsets usage?](https://discuss.elastic.co/t/lucene-total-usage-fixed-bitsets-usage/264564)

<div class="topic-metadata">

**Author:** [@val](https://discuss.elastic.co/u/val)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 12:08pm UTC](https://discuss.elastic.co/t/lucene-total-usage-fixed-bitsets-usage/264564 "2021-02-17T12:08:10Z")

</div>

When looking at the index memory statistics in Kibana, I currently see this: My question is pretty simple: How come the "Fixed Bitsets" memory usage is bigger than the "Lucene Total" memory usage, even though the for…

---

## [HEAP Memory usage over 90%](https://discuss.elastic.co/t/heap-memory-usage-over-90/264400)

<div class="topic-metadata">

**Author:** [@HammerZEIT](https://discuss.elastic.co/u/HammerZEIT)\
**Replies:** 4\
**Last updated:** [February 17, 2021, 11:46am UTC](https://discuss.elastic.co/t/heap-memory-usage-over-90/264400 "2021-02-17T11:46:04Z")

</div>

Hi everyone, I'm facing an issue with the memory usage of ES. We have a 5 nodes cluster to store our logs sent from graylog. I've searching and reading around for a week now I made some change on my configuration but …

---

## [Romanization keyword sorting (specifically Pinyin)](https://discuss.elastic.co/t/romanization-keyword-sorting-specifically-pinyin/264558)

<div class="topic-metadata">

**Author:** [@UserName3](https://discuss.elastic.co/u/UserName3)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 11:23am UTC](https://discuss.elastic.co/t/romanization-keyword-sorting-specifically-pinyin/264558 "2021-02-17T11:23:47Z")

</div>

Hi, Is sorting by Romanization, specifically Pinyin supported currently? It should be sorted along other languages with Roman alphabet, so the sorting results should be in an order like this: a, b, C, // ignore case j…

---

## [FileBeats -\> MSK : SSL handshake failed when TLS is enabled](https://discuss.elastic.co/t/filebeats-msk-ssl-handshake-failed-when-tls-is-enabled/264424)

<div class="topic-metadata">

**Author:** [@Ravi342883](https://discuss.elastic.co/u/Ravi342883)\
**Replies:** 2\
**Last updated:** [February 17, 2021, 11:16am UTC](https://discuss.elastic.co/t/filebeats-msk-ssl-handshake-failed-when-tls-is-enabled/264424 "2021-02-17T11:16:49Z")

</div>

Hi All.. I have created a MSK cluster with 3 brokers and enabled encryption at rest and in transit but disabled TLS authentication. I'm trying to send data from Filebeat (7.10.0) --\> AWS MSK over TLS endpoint (9094). …

---

## [\[SOLVED\] Whole cluster down after sorting on \_id](https://discuss.elastic.co/t/solved-whole-cluster-down-after-sorting-on-id/264445)

<div class="topic-metadata">

**Author:** [@voharunado](https://discuss.elastic.co/u/voharunado)\
**Replies:** 4\
**Last updated:** [February 17, 2021, 10:28am UTC](https://discuss.elastic.co/t/solved-whole-cluster-down-after-sorting-on-id/264445 "2021-02-17T10:28:31Z")

</div>

Hi, I just had a massive issue with my ES prod cluster. I use an ES plugin for IntelliJ IDE that allows to see search result as a table, which can be ordered by clicking on the columns: it then add a sort parameter corr…

---

## [Don't get doc count after setting ilm](https://discuss.elastic.co/t/dont-get-doc-count-after-setting-ilm/264117)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 5\
**Last updated:** [February 17, 2021, 10:25am UTC](https://discuss.elastic.co/t/dont-get-doc-count-after-setting-ilm/264117 "2021-02-17T10:25:06Z")

</div>

I am using two indices each index is pointed to ilm. below is the index setting for two indices "index": { "lifecycle": { "name": "packetbeat\_flow", "rollover\_alias": "log-pb-flow" }, "number\_o…

---

## [Persistent queue Issue on logstash](https://discuss.elastic.co/t/persistent-queue-issue-on-logstash/264546)

<div class="topic-metadata">

**Author:** [@iammanmale](https://discuss.elastic.co/u/iammanmale)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 10:10am UTC](https://discuss.elastic.co/t/persistent-queue-issue-on-logstash/264546 "2021-02-17T10:10:12Z")

</div>

We have three logstash nodes to collect log in parallel. All three logstash have 6 output pipelines and 1 intake pipeline. After i try to enable persistent queue on one of the logstash, no matter how little the queue\_max…

---

## [Multiple Elapsed](https://discuss.elastic.co/t/multiple-elapsed/264459)

<div class="topic-metadata">

**Author:** [@artobstrel](https://discuss.elastic.co/u/artobstrel)\
**Replies:** 2\
**Last updated:** [February 17, 2021, 10:05am UTC](https://discuss.elastic.co/t/multiple-elapsed/264459 "2021-02-17T10:05:11Z")

</div>

I want to measure the duration of several events within a single transaction. I use a elapsed filter for this. My data and logstash config file is below: data file2021-02-16 16:00:00 016cbeb4 Input 2021-02-16 1…

---

## [Ingress Could not find the endpoints](https://discuss.elastic.co/t/ingress-could-not-find-the-endpoints/264238)

<div class="topic-metadata">

**Author:** [@Ahmed\_Abdulaleem](https://discuss.elastic.co/u/Ahmed_Abdulaleem)\
**Replies:** 2\
**Last updated:** [February 16, 2021, 1:32pm UTC](https://discuss.elastic.co/t/ingress-could-not-find-the-endpoints/264238 "2021-02-16T13:32:17Z")

</div>

I installed Elasticsearch with helm and nginx-ingress as nginx controller I added the ingress like that but when I check the ingress found this error why ingress resource could not find the endpoints

---

## [NEST Client - Mapping, aggregations, search for dynamic properties/attributes of a model](https://discuss.elastic.co/t/nest-client-mapping-aggregations-search-for-dynamic-properties-attributes-of-a-model/264544)

<div class="topic-metadata">

**Author:** [@krishnapss](https://discuss.elastic.co/u/krishnapss)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 9:44am UTC](https://discuss.elastic.co/t/nest-client-mapping-aggregations-search-for-dynamic-properties-attributes-of-a-model/264544 "2021-02-17T09:44:34Z")

</div>

Hi, Could someone please help me to solve this problem. We are trying to integrate elasticsearch in our project using NEST Client. For our project we will have different schema per customer or product. e.g. cars, boo…

---

## [Kibana run very slow in mozilla firefox](https://discuss.elastic.co/t/kibana-run-very-slow-in-mozilla-firefox/264521)

<div class="topic-metadata">

**Author:** [@radragar](https://discuss.elastic.co/u/radragar)\
**Replies:** 2\
**Last updated:** [February 17, 2021, 8:43am UTC](https://discuss.elastic.co/t/kibana-run-very-slow-in-mozilla-firefox/264521 "2021-02-17T08:43:22Z")

</div>

Hello, Im try install kibana in production environment, with 3 node elasticsearch. 1 master and 2 datanode. but when im running kibana in mozilla firefox, its running very slow. how kibana running very slow in mozilla…

---

## [Java API ping operation hangs the application on Elasticsearch 7.11.0](https://discuss.elastic.co/t/java-api-ping-operation-hangs-the-application-on-elasticsearch-7-11-0/264351)

<div class="topic-metadata">

**Author:** [@marcgise](https://discuss.elastic.co/u/marcgise)\
**Replies:** 20\
**Last updated:** [February 17, 2021, 8:23am UTC](https://discuss.elastic.co/t/java-api-ping-operation-hangs-the-application-on-elasticsearch-7-11-0/264351 "2021-02-17T08:23:12Z")

</div>

I have 3 Java applications (using RestHighLevelClient 7.11.0 client API) connected to the same ElasticSearch server version 7.11.0, and periodically I check the connection to ElasticSearch with ping operation, using clie…

---

## [Get the filtered response in Elasticsearch cat APIs](https://discuss.elastic.co/t/get-the-filtered-response-in-elasticsearch-cat-apis/264522)

<div class="topic-metadata">

**Author:** [@bhavya](https://discuss.elastic.co/u/bhavya)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 7:36am UTC](https://discuss.elastic.co/t/get-the-filtered-response-in-elasticsearch-cat-apis/264522 "2021-02-17T07:36:05Z")

</div>

I am planning to get the information of all the primary shards in my ES cluster using \_cat/shards API, but I don't see any option to get only the primary shards in the API response, I tried using prirep:p in the h=index,…

---

## [Logstash can´t index event to Elasticsearch](https://discuss.elastic.co/t/logstash-can-t-index-event-to-elasticsearch/264398)

<div class="topic-metadata">

**Author:** [@Martin\_perez](https://discuss.elastic.co/u/Martin_perez)\
**Replies:** 6\
**Last updated:** [February 17, 2021, 7:28am UTC](https://discuss.elastic.co/t/logstash-can-t-index-event-to-elasticsearch/264398 "2021-02-17T07:28:17Z")

</div>

Hello everyone, First of all, I want to introduce you to my problem, what I want to do, and how I have it installed. I have ELK Stack installed this docker, and this docker, at the same time, on a virtualized ubuntu wi…

---

## [Metricbeat zookeeper module](https://discuss.elastic.co/t/metricbeat-zookeeper-module/264453)

<div class="topic-metadata">

**Author:** [@VictorG](https://discuss.elastic.co/u/VictorG)\
**Replies:** 2\
**Last updated:** [February 17, 2021, 7:26am UTC](https://discuss.elastic.co/t/metricbeat-zookeeper-module/264453 "2021-02-17T07:26:38Z")

</div>

Hello, I have two questions regarding the zookeeper module from metricbeat. Does metricbeat reads from a file or connects directly to zookeeper to query for mntr events? Does the zookeeper dashboard comes with panels …

---

## [Elasticsearch multi-tenancy encryption](https://discuss.elastic.co/t/elasticsearch-multi-tenancy-encryption/264518)

<div class="topic-metadata">

**Author:** [@orenwin](https://discuss.elastic.co/u/orenwin)\
**Replies:** 1\
**Last updated:** [February 17, 2021, 7:25am UTC](https://discuss.elastic.co/t/elasticsearch-multi-tenancy-encryption/264518 "2021-02-17T07:25:19Z")

</div>

Hi, I am trying to figure out a way to encrypt Elasticsearch data files per tenant. I came across this plugin: elasticsearch/IndexStorePlugin.java at 985ae9a1ae9abbe110a1fb7333da013b25413edf · elastic/elasticsearch · …

---

## [Transform and get previous row value](https://discuss.elastic.co/t/transform-and-get-previous-row-value/262881)

<div class="topic-metadata">

**Author:** [@wicka](https://discuss.elastic.co/u/wicka)\
**Replies:** 3\
**Last updated:** [February 17, 2021, 7:23am UTC](https://discuss.elastic.co/t/transform-and-get-previous-row-value/262881 "2021-02-17T07:23:21Z")

</div>

I've got elasticsearch setup to collect log from Jenkins. I want to visualize the duration on each build stage. However Jenkins logs is really unstructured, I find many difference way in elasticsearch and still not able …

---

## [Dissect Parsing Error with Sonicwall Module \[Filebeat 7.9.2\]](https://discuss.elastic.co/t/dissect-parsing-error-with-sonicwall-module-filebeat-7-9-2/264011)

<div class="topic-metadata">

**Author:** [@RdrgPorto](https://discuss.elastic.co/u/RdrgPorto)\
**Replies:** 2\
**Last updated:** [February 17, 2021, 6:54am UTC](https://discuss.elastic.co/t/dissect-parsing-error-with-sonicwall-module-filebeat-7-9-2/264011 "2021-02-17T06:54:58Z")

</div>

Hi, everyone I have found some dissect parsing errors by using Sonicwall module module of Filebeat 7.9.2. Here you are some examples: Feb 11 07:31:35 \_gateway id=firewall sn=\<serial-number\> time="2021-02-11 06:31:35 …

---

## [Filebeat invalid CRI log format error](https://discuss.elastic.co/t/filebeat-invalid-cri-log-format-error/263324)

<div class="topic-metadata">

**Author:** [@user2416](https://discuss.elastic.co/u/user2416)\
**Replies:** 4\
**Last updated:** [February 17, 2021, 6:45am UTC](https://discuss.elastic.co/t/filebeat-invalid-cri-log-format-error/263324 "2021-02-17T06:45:27Z")

</div>

Hi, I am frequently seeing invalid CRI log format ERROR with filebeat. We are running filebeat as deamonset on kubernetes nodes to collect container logs. This Error is causing filebeat to stop sending logs to logstash …

---

## [Incorrect type of field in index from Logstash, why?](https://discuss.elastic.co/t/incorrect-type-of-field-in-index-from-logstash-why/264335)

<div class="topic-metadata">

**Author:** [@d.silwon](https://discuss.elastic.co/u/d.silwon)\
**Replies:** 8\
**Last updated:** [February 17, 2021, 6:10am UTC](https://discuss.elastic.co/t/incorrect-type-of-field-in-index-from-logstash-why/264335 "2021-02-17T06:10:37Z")

</div>

Dears, I loading tomcat logs to Elastic. My logstash config include such grok pattern: if "tomcat" in \[tags\] { grok { match =\> \["message", "%{IPV4} (?:-|%{USER:ident}) (?:-|%{USER:auth}) \\\[%{HTTPDATE:timesta…

---

## [X-pack for Logstash](https://discuss.elastic.co/t/x-pack-for-logstash/264466)

<div class="topic-metadata">

**Author:** [@testsemd\_email](https://discuss.elastic.co/u/testsemd_email)\
**Replies:** 3\
**Last updated:** [February 17, 2021, 5:50am UTC](https://discuss.elastic.co/t/x-pack-for-logstash/264466 "2021-02-17T05:50:19Z")

</div>

I have enabled the x-pack in my cluster. Now I want to install Logstash on ingest node. Enabling x-pack for Logstash is optional or compulsory?

---

## [Add a node to an existing cluster](https://discuss.elastic.co/t/add-a-node-to-an-existing-cluster/264432)

<div class="topic-metadata">

**Author:** [@rojin](https://discuss.elastic.co/u/rojin)\
**Replies:** 3\
**Last updated:** [February 17, 2021, 5:07am UTC](https://discuss.elastic.co/t/add-a-node-to-an-existing-cluster/264432 "2021-02-17T05:07:33Z")

</div>

Hello! Can someone please help me with adding a new node to an existing cluster? I get the "Master\_not\_discovered\_exception" and I have tried different solutions such as removing path.data (on node 2) , setting up discov…

---

## [Logstash self restart without error](https://discuss.elastic.co/t/logstash-self-restart-without-error/264501)

<div class="topic-metadata">

**Author:** [@cling1988](https://discuss.elastic.co/u/cling1988)\
**Replies:** 0\
**Last updated:** [February 17, 2021, 4:42am UTC](https://discuss.elastic.co/t/logstash-self-restart-without-error/264501 "2021-02-17T04:42:52Z")

</div>

After a few days I upgrade the Logstash from 7.4 to Logstash 7.10.1, the Logstash kill itself and restart. I only can found the log in journalctl -u logstash.service Feb 16 03:44:23 xxx systemd\[1\]: logstash.service: ma…

---

## [Can Elastic work with Windows certificates?](https://discuss.elastic.co/t/can-elastic-work-with-windows-certificates/263964)

<div class="topic-metadata">

**Author:** [@lachezar.uzunov](https://discuss.elastic.co/u/lachezar.uzunov)\
**Replies:** 4\
**Last updated:** [February 17, 2021, 2:32am UTC](https://discuss.elastic.co/t/can-elastic-work-with-windows-certificates/263964 "2021-02-17T02:32:22Z")

</div>

Hello everyone. I created elastic stack of 3 nodes and it was working pretty fine until I have to replace the elastic generated certificate with one from windows server CA. I do not seem to find information of rather it…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1550)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1552)
