# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=902

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 903

---

## [Displaying number](https://discuss.elastic.co/t/displaying-number/307091)

<div class="topic-metadata">

**Author:** [@behappy\_alwayz0401](https://discuss.elastic.co/u/behappy_alwayz0401)\
**Replies:** 4\
**Last updated:** [June 15, 2022, 3:29pm UTC](https://discuss.elastic.co/t/displaying-number/307091 "2022-06-15T15:29:16Z")

</div>

Hi, is there a way to store a number as 0,0a format but for report download purposes it still shows as the full number? The reason being, when you download the 0,0a format to a CSV it doesnt show up as a number for furt…

---

## [Cluster is not in a defined clean state while using the Elasticsearch setup by Rally](https://discuss.elastic.co/t/cluster-is-not-in-a-defined-clean-state-while-using-the-elasticsearch-setup-by-rally/307003)

<div class="topic-metadata">

**Author:** [@Gsqsf](https://discuss.elastic.co/u/Gsqsf)\
**Replies:** 4\
**Last updated:** [June 15, 2022, 2:25pm UTC](https://discuss.elastic.co/t/cluster-is-not-in-a-defined-clean-state-while-using-the-elasticsearch-setup-by-rally/307003 "2022-06-15T14:25:29Z")

</div>

I got that message \[WARNING\] indexing\_total\_time is 3941 ms indicating that the cluster is not in a defined clean state. Recorded index time metrics may be misleading. While running esrally race --distribution-version…

---

## [Add new calculated field when processing file in logstash](https://discuss.elastic.co/t/add-new-calculated-field-when-processing-file-in-logstash/307014)

<div class="topic-metadata">

**Author:** [@eduhernandezm](https://discuss.elastic.co/u/eduhernandezm)\
**Replies:** 4\
**Last updated:** [June 15, 2022, 1:54pm UTC](https://discuss.elastic.co/t/add-new-calculated-field-when-processing-file-in-logstash/307014 "2022-06-15T13:54:46Z")

</div>

Hello, I have the following configuration in Logstash to read data from a CSV file that I pass every day. I have it working correctly. My doubt is that I need to add a new field based on a mathematical function against …

---

## [Logstash configuration not working on read csv file](https://discuss.elastic.co/t/logstash-configuration-not-working-on-read-csv-file/306515)

<div class="topic-metadata">

**Author:** [@selflabs](https://discuss.elastic.co/u/selflabs)\
**Replies:** 11\
**Last updated:** [June 15, 2022, 12:24pm UTC](https://discuss.elastic.co/t/logstash-configuration-not-working-on-read-csv-file/306515 "2022-06-15T12:24:49Z")

</div>

Hello Everyone, Logstash not reading csv file, i have tried all possible case but unable to pick data from the csv file. my ultimate goal is read data from REST API and mapping with CSV file. Please suggest, Configuratio…

---

## [Logstash pipeline issues with flowfile attributes](https://discuss.elastic.co/t/logstash-pipeline-issues-with-flowfile-attributes/307260)

<div class="topic-metadata">

**Author:** [@Mary2022](https://discuss.elastic.co/u/Mary2022)\
**Replies:** 1\
**Last updated:** [June 15, 2022, 12:07pm UTC](https://discuss.elastic.co/t/logstash-pipeline-issues-with-flowfile-attributes/307260 "2022-06-15T12:07:34Z")

</div>

We get json files from a Nifi and when I checked in Kibana They have a \_jsonparsefailure. When I looked at the logs I see inside "message" "flowfile.attributes0000644 0000 000 000 000 and other garbage about ECDS and at …

---

## [Unable to read Cluster Stats index](https://discuss.elastic.co/t/unable-to-read-cluster-stats-index/306936)

<div class="topic-metadata">

**Author:** [@Abhi\_Abhishek](https://discuss.elastic.co/u/Abhi_Abhishek)\
**Replies:** 1\
**Last updated:** [June 15, 2022, 12:04pm UTC](https://discuss.elastic.co/t/unable-to-read-cluster-stats-index/306936 "2022-06-15T12:04:30Z")

</div>

I am unable to read or fetch data from cluster Stats field. GET /\_cluster/stats I need data in this index to be used in the kibana dashboard visualization to fetch the details like disk usage, cpu & jvm usage just like…

---

## [Cannot access through http://ipaddress:5601 but localhost:5601](https://discuss.elastic.co/t/cannot-access-through-http-ipaddress-5601-but-localhost-5601/307247)

<div class="topic-metadata">

**Author:** [@ghostmomo](https://discuss.elastic.co/u/ghostmomo)\
**Replies:** 2\
**Last updated:** [June 15, 2022, 11:14am UTC](https://discuss.elastic.co/t/cannot-access-through-http-ipaddress-5601-but-localhost-5601/307247 "2022-06-15T11:14:52Z")

</div>

Elasticsarch and Kibana version: 8.2.2 OS: Windows server 2019 Hello, been struggling below problems while I setup the Elasticsearch and kibana on windows platform. unable to get into http://ipaddress:5601 but it's f…

---

## [Filter the metrics column](https://discuss.elastic.co/t/filter-the-metrics-column/307230)

<div class="topic-metadata">

**Author:** [@GinkoLucas](https://discuss.elastic.co/u/GinkoLucas)\
**Replies:** 6\
**Last updated:** [June 15, 2022, 11:04am UTC](https://discuss.elastic.co/t/filter-the-metrics-column/307230 "2022-06-15T11:04:46Z")

</div>

Hello, I created with TSVB a table with two columns. The table displays the date of the last document of each server (Top hit..). server 2 | 2022-06-15 server 2 | 2022-06-15 server 3 | 2022-06-12 I would like to f…

---

## [Working with multiple Nest version - JsonNetSerializer doesn't exist in Nest6](https://discuss.elastic.co/t/working-with-multiple-nest-version-jsonnetserializer-doesnt-exist-in-nest6/307255)

<div class="topic-metadata">

**Author:** [@Aharon\_Ya](https://discuss.elastic.co/u/Aharon_Ya)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 10:53am UTC](https://discuss.elastic.co/t/working-with-multiple-nest-version-jsonnetserializer-doesnt-exist-in-nest6/307255 "2022-06-15T10:53:52Z")

</div>

Hello Team, We are working on upgrading our Elastic from 5.x to the latest. Currently, we are working against them both (as a rollout process). I'm trying to use multiple Nest versions as guided here: https://www.elast…

---

## [Are there no msi installers for new Elasticsearch versions](https://discuss.elastic.co/t/are-there-no-msi-installers-for-new-elasticsearch-versions/306012)

<div class="topic-metadata">

**Author:** [@runegronkjaer](https://discuss.elastic.co/u/runegronkjaer)\
**Replies:** 4\
**Last updated:** [June 15, 2022, 10:36am UTC](https://discuss.elastic.co/t/are-there-no-msi-installers-for-new-elasticsearch-versions/306012 "2022-06-15T10:36:21Z")

</div>

Hi, I installed Elasticsearch 7 with an msi installer last year and now that I need to install it again there's no msi installer on the newer versions. Will there not be msi installers from now on? And if that is the…

---

## [Kibana Alerts: is this feature stable?](https://discuss.elastic.co/t/kibana-alerts-is-this-feature-stable/307048)

<div class="topic-metadata">

**Author:** [@oandreiev](https://discuss.elastic.co/u/oandreiev)\
**Replies:** 3\
**Last updated:** [June 15, 2022, 10:32am UTC](https://discuss.elastic.co/t/kibana-alerts-is-this-feature-stable/307048 "2022-06-15T10:32:24Z")

</div>

Hello, Just want to know if the Kibana Alerts feature is stable enough to use it in a production. Is there a chance it will be removed? I saw couple alerting view with technical preview label in 8.2.2 and I do not know…

---

## [Log4j management of access files created by Elasticsearch](https://discuss.elastic.co/t/log4j-management-of-access-files-created-by-elasticsearch/307249)

<div class="topic-metadata">

**Author:** [@intrepid1](https://discuss.elastic.co/u/intrepid1)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 10:00am UTC](https://discuss.elastic.co/t/log4j-management-of-access-files-created-by-elasticsearch/307249 "2022-06-15T10:00:09Z")

</div>

Hi there, I am running Elasticsearch 7.16.1 and also have auditing configured. I am using a default log4j properties files which I had to extend to gzip the audit files. This is not included in the 7.16.1 log4j2 propert…

---

## [Downgrade beat version from v8 to v7](https://discuss.elastic.co/t/downgrade-beat-version-from-v8-to-v7/307045)

<div class="topic-metadata">

**Author:** [@navin1093](https://discuss.elastic.co/u/navin1093)\
**Replies:** 4\
**Last updated:** [June 15, 2022, 9:53am UTC](https://discuss.elastic.co/t/downgrade-beat-version-from-v8-to-v7/307045 "2022-06-15T09:53:23Z")

</div>

Hi, can I know is it possible to downgrade from version 8 to v 7.14. Earlier what I did was just backup existing filebeat at /etc/filebeat and install new filebeat v8 via rpm. After installing noticed something cause my …

---

## [Filebeats not picking .log files from directories](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790)

<div class="topic-metadata">

**Author:** [@Dhilipkumar](https://discuss.elastic.co/u/Dhilipkumar)\
**Replies:** 2\
**Last updated:** [June 15, 2022, 9:50am UTC](https://discuss.elastic.co/t/filebeats-not-picking-log-files-from-directories/306790 "2022-06-15T09:50:40Z")

</div>

Hello All, Im using 8.1.3 version of Elasticsearch and 8.1.0 version of filebeat for log Analysis puropse in Linux environment as a group user. We have log files of various types (e.g .txt, .log, .html, .sql, .csv) in …

---

## [Kibana: Failed to decrypt "apiKey" attribute: Unsupported state or unable to authenticate data](https://discuss.elastic.co/t/kibana-failed-to-decrypt-apikey-attribute-unsupported-state-or-unable-to-authenticate-data/251236)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 3\
**Last updated:** [June 15, 2022, 9:49am UTC](https://discuss.elastic.co/t/kibana-failed-to-decrypt-apikey-attribute-unsupported-state-or-unable-to-authenticate-data/251236 "2022-06-15T09:49:58Z")

</div>

Hello everybody, I am facing the error: Kibana: Failed to decrypt "apiKey" attribute: Unsupported state or unable to authenticate data After that I added the line below to Kibana configuration file: xpack.encryptedSa…

---

## [Elastic cloud and azure ad logs](https://discuss.elastic.co/t/elastic-cloud-and-azure-ad-logs/307239)

<div class="topic-metadata">

**Author:** [@Serhii\_Chebonenko](https://discuss.elastic.co/u/Serhii_Chebonenko)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 8:54am UTC](https://discuss.elastic.co/t/elastic-cloud-and-azure-ad-logs/307239 "2022-06-15T08:54:20Z")

</div>

I'm trying to ingest azure ad logs using diagnostic setting -\> partner solution, elastic cloud deployment is visible. Configure -\> save, no new data in elastic. Only documentation I found on azure ad integration is using…

---

## [Elasticsearch 8.1.0 errors](https://discuss.elastic.co/t/elasticsearch-8-1-0-errors/307151)

<div class="topic-metadata">

**Author:** [@Sravan1](https://discuss.elastic.co/u/Sravan1)\
**Replies:** 3\
**Last updated:** [June 15, 2022, 8:46am UTC](https://discuss.elastic.co/t/elasticsearch-8-1-0-errors/307151 "2022-06-15T08:46:32Z")

</div>

unknown setting \[node.ml\] please check that any required plugins are installed, or check the breaking changes documentation for removed settings roles: master: "true" ingest: "true" data: "true" remote\_cluster\_clien…

---

## [Google Workspace module using wrong field to avoid duplicates](https://discuss.elastic.co/t/google-workspace-module-using-wrong-field-to-avoid-duplicates/306816)

<div class="topic-metadata">

**Author:** [@serhii.okhrimenko](https://discuss.elastic.co/u/serhii.okhrimenko)\
**Replies:** 3\
**Last updated:** [June 15, 2022, 8:33am UTC](https://discuss.elastic.co/t/google-workspace-module-using-wrong-field-to-avoid-duplicates/306816 "2022-06-15T08:33:12Z")

</div>

Hi, I have recently noticed that Google Workspace module uses @metadata.id instead of @metadata.\_id. It leads to duplicate appearance in logs. Changing this: var addID = new processor.Fingerprint({ fields: \[ …

---

## [Problem with dns in kibana - lb](https://discuss.elastic.co/t/problem-with-dns-in-kibana-lb/307235)

<div class="topic-metadata">

**Author:** [@Frida](https://discuss.elastic.co/u/Frida)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 8:05am UTC](https://discuss.elastic.co/t/problem-with-dns-in-kibana-lb/307235 "2022-06-15T08:05:28Z")

</div>

Hi, this is my kibana yml file: apiVersion: kibana.k8s.elastic.co/v1 kind: Kibana metadata: name: quickstart spec: version: 7.6.2 count: 1 elasticsearchRef: name: cdbridgerpayelasticsearch http: servi…

---

## [How to compare two column fields under same index table and create graph based on the output](https://discuss.elastic.co/t/how-to-compare-two-column-fields-under-same-index-table-and-create-graph-based-on-the-output/307152)

<div class="topic-metadata">

**Author:** [@Mohit.Sharma](https://discuss.elastic.co/u/Mohit.Sharma)\
**Replies:** 1\
**Last updated:** [June 15, 2022, 8:04am UTC](https://discuss.elastic.co/t/how-to-compare-two-column-fields-under-same-index-table-and-create-graph-based-on-the-output/307152 "2022-06-15T08:04:37Z")

</div>

Hello Team, We have a scenario where we want to check percentage of transactions breached SLA time. If we are logging field 'Duration' and 'Expected SLA' under same index, then how to compare both these fields on Kiban…

---

## [Run Http GET from Ansible to remote server by connecting via localhost](https://discuss.elastic.co/t/run-http-get-from-ansible-to-remote-server-by-connecting-via-localhost/307233)

<div class="topic-metadata">

**Author:** [@charlot\_Attard](https://discuss.elastic.co/u/charlot_Attard)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 7:55am UTC](https://discuss.elastic.co/t/run-http-get-from-ansible-to-remote-server-by-connecting-via-localhost/307233 "2022-06-15T07:55:03Z")

</div>

Hello, I am creating an ansible-playbook which is doing HTTP GET to a remote elastic server. The problem is that this ES server doesn't accept any other connection apart from localhost. Is there a way how to connect to …

---

## [Using the same index for a year](https://discuss.elastic.co/t/using-the-same-index-for-a-year/307132)

<div class="topic-metadata">

**Author:** [@mertkaant](https://discuss.elastic.co/u/mertkaant)\
**Replies:** 2\
**Last updated:** [June 15, 2022, 7:31am UTC](https://discuss.elastic.co/t/using-the-same-index-for-a-year/307132 "2022-06-15T07:31:13Z")

</div>

Hello, elastic community, I have a new index and I'm writing small data daily to this index. I want to achieve lifecycle management for this index and about that, I thought since this is a really small index can I confi…

---

## [Does ELK support indexing emails from Microsoft Exchange?](https://discuss.elastic.co/t/does-elk-support-indexing-emails-from-microsoft-exchange/307223)

<div class="topic-metadata">

**Author:** [@Wang\_Yin](https://discuss.elastic.co/u/Wang_Yin)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 6:32am UTC](https://discuss.elastic.co/t/does-elk-support-indexing-emails-from-microsoft-exchange/307223 "2022-06-15T06:32:39Z")

</div>

Hi, I did some research and found that logstash does support indexing emails from IMAP https://qbox.io/blog/indexing-emails-to-elasticsearch-logstash-imap/ But I'm not sure if there's any similar plugin available in L…

---

## [Can not install elastic on Ubuntu](https://discuss.elastic.co/t/can-not-install-elastic-on-ubuntu/306975)

<div class="topic-metadata">

**Author:** [@MaralErdene\_Tumursuh](https://discuss.elastic.co/u/MaralErdene_Tumursuh)\
**Replies:** 2\
**Last updated:** [June 15, 2022, 6:09am UTC](https://discuss.elastic.co/t/can-not-install-elastic-on-ubuntu/306975 "2022-06-15T06:09:05Z")

</div>

Hello, when i execute sudo apt update that error occurred. Temporary failure resolving 'artifacts.elastic.co'. Is there any blocking? I'm from Mongolia. My ip is 103.17.108.48. What should i do? Please, answer asa…

---

## [Parsing mixed: plain-text and json log files in logstash](https://discuss.elastic.co/t/parsing-mixed-plain-text-and-json-log-files-in-logstash/307024)

<div class="topic-metadata">

**Author:** [@xyz3](https://discuss.elastic.co/u/xyz3)\
**Replies:** 14\
**Last updated:** [June 15, 2022, 5:46am UTC](https://discuss.elastic.co/t/parsing-mixed-plain-text-and-json-log-files-in-logstash/307024 "2022-06-15T05:46:31Z")

</div>

Hello I have log lines containing of two parts - plain-text and json. Example line below: Jun 13 07:58:00 c4e-gen1 c4edlog\[555007\]: {"level":"info","commit":"436F6D6D697449447B5B3135362031303720362036362032353120323331…

---

## [Permission error when applying apm (pinpoint) to elasticsearch](https://discuss.elastic.co/t/permission-error-when-applying-apm-pinpoint-to-elasticsearch/307209)

<div class="topic-metadata">

**Author:** [@Aaron2](https://discuss.elastic.co/u/Aaron2)\
**Replies:** 0\
**Last updated:** [June 15, 2022, 2:41am UTC](https://discuss.elastic.co/t/permission-error-when-applying-apm-pinpoint-to-elasticsearch/307209 "2022-06-15T02:41:05Z")

</div>

hi I am trying to monitor using apm (pinpoint) in elasticsearch. To do this, I created custom-policy.policy and specified it when running elasticsearch because it was necessary to grant permission. (It is not confirme…

---

## [Remove empty data buckets with @timestan](https://discuss.elastic.co/t/remove-empty-data-buckets-with-timestan/305452)

<div class="topic-metadata">

**Author:** [@Rashmi\_Prabha](https://discuss.elastic.co/u/Rashmi_Prabha)\
**Replies:** 6\
**Last updated:** [June 15, 2022, 3:59am UTC](https://discuss.elastic.co/t/remove-empty-data-buckets-with-timestan/305452 "2022-06-15T03:59:04Z")

</div>

How to remove empty data buckets { "min\_doc\_count":1} didn't work.

---

## [\[ERROR\] Total Ingest Pipeline Count/Time/Failed Metrics are all returning 0](https://discuss.elastic.co/t/error-total-ingest-pipeline-count-time-failed-metrics-are-all-returning-0/307069)

<div class="topic-metadata">

**Author:** [@raphaelli1](https://discuss.elastic.co/u/raphaelli1)\
**Replies:** 3\
**Last updated:** [June 15, 2022, 2:53am UTC](https://discuss.elastic.co/t/error-total-ingest-pipeline-count-time-failed-metrics-are-all-returning-0/307069 "2022-06-15T02:53:43Z")

</div>

Hi, it seems that whenever we get the final score for ingest pipeline count/time/failed metrics all return 0 when we run esrally race. The command we are running is: esrally race --track=http\_logs --target-hosts=http:/…

---

## [How to get all results with search API](https://discuss.elastic.co/t/how-to-get-all-results-with-search-api/307127)

<div class="topic-metadata">

**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\
**Replies:** 5\
**Last updated:** [June 15, 2022, 2:35am UTC](https://discuss.elastic.co/t/how-to-get-all-results-with-search-api/307127 "2022-06-15T02:35:25Z")

</div>

I am trying to use the REST API to get the contents of the index. I found that this API only retrieves up to 10 results by default. I also found that by using the size option, I can retrieve the specified number of re…

---

## [Kibana 8.2.2 startup issue](https://discuss.elastic.co/t/kibana-8-2-2-startup-issue/307087)

<div class="topic-metadata">

**Author:** [@Ram-Ind](https://discuss.elastic.co/u/Ram-Ind)\
**Replies:** 5\
**Last updated:** [June 15, 2022, 2:02am UTC](https://discuss.elastic.co/t/kibana-8-2-2-startup-issue/307087 "2022-06-15T02:02:15Z")

</div>

Kibana 8.2.2 startup failing with below error and couldn't able to start the service on s390x architecture. \[DEBUG\]\[root\] shutting root down \[2022-06-13T21:39:55.940-04:00\]\[FATAL\]\[root\] Error: /var/newheights-logs/ELK/…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=901)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=903)
