# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1773

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1774

---

## [Quickstart: tolerations issues](https://discuss.elastic.co/t/quickstart-tolerations-issues/266984)

<div class="topic-metadata">

**Author:** [@maxclac1](https://discuss.elastic.co/u/maxclac1)\
**Replies:** 5\
**Last updated:** [March 22, 2021, 9:07am UTC](https://discuss.elastic.co/t/quickstart-tolerations-issues/266984 "2021-03-22T09:07:25Z")

</div>

Hi! I have a 3-node Kubernetes cluster running with OpenStack VM (Ubuntu 20). I wanted to create an ElasticSearch Cluster but I have to say that I am a bit confused with the instructions, especially about setting up the…

---

## [Export option missing from Kibana Vizualizations](https://discuss.elastic.co/t/export-option-missing-from-kibana-vizualizations/267458)

<div class="topic-metadata">

**Author:** [@gyterpena](https://discuss.elastic.co/u/gyterpena)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 8:36am UTC](https://discuss.elastic.co/t/export-option-missing-from-kibana-vizualizations/267458 "2021-03-22T08:36:12Z")

</div>

Hello We upgraded our stack to 7.11.2 from 7.10.2 and export option on kibana visualizations is missing for new data table visualizations. I can still export from visualizations created on older versions. Is this expec…

---

## [How to add custom index descriptor mapping to added fields (Nest .net)](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958)

<div class="topic-metadata">

**Author:** [@Nicolas\_Rey](https://discuss.elastic.co/u/Nicolas_Rey)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 8:24am UTC](https://discuss.elastic.co/t/how-to-add-custom-index-descriptor-mapping-to-added-fields-nest-net/267958 "2021-03-22T08:24:20Z")

</div>

Hi, I use a repository to deal with Elasticsearch CRUD operations. It works but I face a problem : when I add fields to an existing index I don't know how to apply custom Index Descriptor. It works with an AutoMap but …

---

## [Change StorageClass of an already running cluster](https://discuss.elastic.co/t/change-storageclass-of-an-already-running-cluster/267573)

<div class="topic-metadata">

**Author:** [@dtapia](https://discuss.elastic.co/u/dtapia)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 8:05am UTC](https://discuss.elastic.co/t/change-storageclass-of-an-already-running-cluster/267573 "2021-03-22T08:05:40Z")

</div>

I've created a cluster with a specific storageClass, but now I need to change the disks to something cheaper, but I get this error when trying to update the ElasticSearch CRD. Error: UPGRADE FAILED: cannot patch "elasti…

---

## [Logstash jdbc stuck at \[Api Webserver\] agent - Successfully started Logstash API endpoint {:port=\>9600}](https://discuss.elastic.co/t/logstash-jdbc-stuck-at-api-webserver-agent-successfully-started-logstash-api-endpoint-port-9600/267954)

<div class="topic-metadata">

**Author:** [@Burhanudin](https://discuss.elastic.co/u/Burhanudin)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 8:05am UTC](https://discuss.elastic.co/t/logstash-jdbc-stuck-at-api-webserver-agent-successfully-started-logstash-api-endpoint-port-9600/267954 "2021-03-22T08:05:06Z")

</div>

hi all, i got stuck at \[Api Webserver\] agent - Successfully started Logstash API endpoint {:port=\>9600} and nothing happen after this. could anyone help what's wrong with this? and actually before it's running normaly. …

---

## [When will translog file be deleted from disk?](https://discuss.elastic.co/t/when-will-translog-file-be-deleted-from-disk/267944)

<div class="topic-metadata">

**Author:** [@CHU\_XU](https://discuss.elastic.co/u/CHU_XU)\
**Replies:** 3\
**Last updated:** [March 22, 2021, 8:02am UTC](https://discuss.elastic.co/t/when-will-translog-file-be-deleted-from-disk/267944 "2021-03-22T08:02:27Z")

</div>

Hi there, I found in the data directory, there many translog files like \*.tlog or \*.ckp have been existing for few days. According to the document, there's a retention setting with default 12 hours. But I'm using 7.5 v…

---

## [Elastic cloud email reporting](https://discuss.elastic.co/t/elastic-cloud-email-reporting/267685)

<div class="topic-metadata">

**Author:** [@accateo](https://discuss.elastic.co/u/accateo)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 8:01am UTC](https://discuss.elastic.co/t/elastic-cloud-email-reporting/267685 "2021-03-22T08:01:46Z")

</div>

Hello, I am using Elastic Cloud and I was trying to set up a Watcher to send a pdf (generated from a dashboard) via email. I have some questions: can I create a watcher who, every 7 days, automatically sends this repo…

---

## [Filebeat netflow module do not start after update to 7.11](https://discuss.elastic.co/t/filebeat-netflow-module-do-not-start-after-update-to-7-11/264037)

<div class="topic-metadata">

**Author:** [@UweW](https://discuss.elastic.co/u/UweW)\
**Replies:** 7\
**Last updated:** [March 22, 2021, 7:53am UTC](https://discuss.elastic.co/t/filebeat-netflow-module-do-not-start-after-update-to-7-11/264037 "2021-03-22T07:53:53Z")

</div>

Hi, after updating the stack from 7.10.2 to 7.11 the netflow module will not start anymore. The only message we see every 10 seconds in journal is filebeat\[1976620\]: 2021-02-11T17:40:01.242+0100 ERROR \[r…

---

## [ECK on AKS - Error after upgrading k8s from V1.18 to V1.19](https://discuss.elastic.co/t/eck-on-aks-error-after-upgrading-k8s-from-v1-18-to-v1-19/267948)

<div class="topic-metadata">

**Author:** [@HadarPeeran](https://discuss.elastic.co/u/HadarPeeran)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 7:00am UTC](https://discuss.elastic.co/t/eck-on-aks-error-after-upgrading-k8s-from-v1-18-to-v1-19/267948 "2021-03-22T07:00:52Z")

</div>

I have installed the operator by helm: helm install elastic-operator elastic/eck-operator -n elastic-system --create-namespace --version 1.4.0 And Elastic node by: apiVersion: elasticsearch.k8s.elastic.co/v1 kind: El…

---

## [How to deploy alert on incoming events](https://discuss.elastic.co/t/how-to-deploy-alert-on-incoming-events/267920)

<div class="topic-metadata">

**Author:** [@\_omar](https://discuss.elastic.co/u/_omar)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 5:44am UTC](https://discuss.elastic.co/t/how-to-deploy-alert-on-incoming-events/267920 "2021-03-22T05:44:20Z")

</div>

Hi I'm a new user of 'elastic', and need to deploy an alert that notify each event with 'geoip.country\_name' tag value distinct than 'peru'. The alert have to be in real time, like the mostly siem solutions do, so far i…

---

## [Is there any way to score nested documents as if they're native fields of the main document?](https://discuss.elastic.co/t/is-there-any-way-to-score-nested-documents-as-if-theyre-native-fields-of-the-main-document/267934)

<div class="topic-metadata">

**Author:** [@Yaron\_Golan](https://discuss.elastic.co/u/Yaron_Golan)\
**Replies:** 0\
**Last updated:** [March 22, 2021, 3:20am UTC](https://discuss.elastic.co/t/is-there-any-way-to-score-nested-documents-as-if-theyre-native-fields-of-the-main-document/267934 "2021-03-22T03:20:09Z")

</div>

Is it possible to get similar scoring methodologies for nested document fields normal fields? See searches for "awful" (nested) and "amazing" (direct) below. DELETE /testindex PUT /testindex { "mappings": { "pro…

---

## [How to create pipeline definition from command line?](https://discuss.elastic.co/t/how-to-create-pipeline-definition-from-command-line/267139)

<div class="topic-metadata">

**Author:** [@YuWatanabe](https://discuss.elastic.co/u/YuWatanabe)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 3:44am UTC](https://discuss.elastic.co/t/how-to-create-pipeline-definition-from-command-line/267139 "2021-03-22T03:44:30Z")

</div>

I want to automate the process for preparing below pipeline. i.e by command line , api , etc This is because I want to send logs from filebeat to logstash instead of sending directly to elasticsearch . GET \_ingest/p…

---

## [Empty Values in DateTimeStamp - Ignore Empty Values & Perform Calculation](https://discuss.elastic.co/t/empty-values-in-datetimestamp-ignore-empty-values-perform-calculation/267721)

<div class="topic-metadata">

**Author:** [@prohit](https://discuss.elastic.co/u/prohit)\
**Replies:** 3\
**Last updated:** [March 22, 2021, 3:12am UTC](https://discuss.elastic.co/t/empty-values-in-datetimestamp-ignore-empty-values-perform-calculation/267721 "2021-03-22T03:12:52Z")

</div>

Hi All, Ver: 7.11 (Painless script) I have datetimestamp fields in number type, to convert into date format i have used doc\['actualdatetimestamp'\].value with the default format in painless script it worked Need Help …

---

## [Data validation error from traefik(go agent) to elastic apm server](https://discuss.elastic.co/t/data-validation-error-from-traefik-go-agent-to-elastic-apm-server/267614)

<div class="topic-metadata">

**Author:** [@jinner](https://discuss.elastic.co/u/jinner)\
**Replies:** 3\
**Last updated:** [March 22, 2021, 3:09am UTC](https://discuss.elastic.co/t/data-validation-error-from-traefik-go-agent-to-elastic-apm-server/267614 "2021-03-22T03:09:44Z")

</div>

Kibana version: 7.6.1 Elasticsearch version: 7.6.1 APM Server version: 7.6.1 APM Agent language and version: traefik(go agent), 2.4.7 Browser version: N/A Original install method (e.g. download page, yum, deb, …

---

## [100% cpu system time used on hdd data node](https://discuss.elastic.co/t/100-cpu-system-time-used-on-hdd-data-node/267532)

<div class="topic-metadata">

**Author:** [@wangxr1985](https://discuss.elastic.co/u/wangxr1985)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 2:44am UTC](https://discuss.elastic.co/t/100-cpu-system-time-used-on-hdd-data-node/267532 "2021-03-22T02:44:38Z")

</div>

The ES version is 7.11.1 We use 16C64G vm which has 4 physical hdd disks(striped lvm volume) as warm data node. The issue is that the cpu system time of a random vm offen suddenly rises up to 100%, and then the vm keep…

---

## [Other language problems in official document page translation](https://discuss.elastic.co/t/other-language-problems-in-official-document-page-translation/266794)

<div class="topic-metadata">

**Author:** [@jevic](https://discuss.elastic.co/u/jevic)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 2:30am UTC](https://discuss.elastic.co/t/other-language-problems-in-official-document-page-translation/266794 "2021-03-22T02:30:19Z")

</div>

In the official document, the sample code part is also translated when using google translation. For this point, can you refer to the google kubernetes document, the sample code part is not translated?

---

## [STIG - The DBMS must isolate security functions from non-security functions](https://discuss.elastic.co/t/stig-the-dbms-must-isolate-security-functions-from-non-security-functions/267744)

<div class="topic-metadata">

**Author:** [@Dan\_Bitter](https://discuss.elastic.co/u/Dan_Bitter)\
**Replies:** 3\
**Last updated:** [March 22, 2021, 2:28am UTC](https://discuss.elastic.co/t/stig-the-dbms-must-isolate-security-functions-from-non-security-functions/267744 "2021-03-22T02:28:01Z")

</div>

I have a list of STIGs to implement for Elasticsearch, and I'm not sure how to verify the needs of this one. I read about the keystore, which I think helps, but I don't think it covers all the points. I found setup p…

---

## [Logstash config file without input section](https://discuss.elastic.co/t/logstash-config-file-without-input-section/267931)

<div class="topic-metadata">

**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 2:24am UTC](https://discuss.elastic.co/t/logstash-config-file-without-input-section/267931 "2021-03-22T02:24:55Z")

</div>

Hi All, I am wondering, shall we use a logstash config file without the input section? Apparently, it works without complain. I tried that using settings like below: input { stdin{} } filter { ruby { # here i …

---

## [Packetbeat: Trying to find utilization across network](https://discuss.elastic.co/t/packetbeat-trying-to-find-utilization-across-network/267368)

<div class="topic-metadata">

**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 2:03am UTC](https://discuss.elastic.co/t/packetbeat-trying-to-find-utilization-across-network/267368 "2021-03-22T02:03:58Z")

</div>

Hi all, I'm trying to find Network devices in network with over 70% utilization. I'm unable to find the data in my packetbeat index. Any way to go about to do visualization. Thanks in Advance.

---

## [Packetbeat : Detecting Top applications usage on Network](https://discuss.elastic.co/t/packetbeat-detecting-top-applications-usage-on-network/267366)

<div class="topic-metadata">

**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 2:03am UTC](https://discuss.elastic.co/t/packetbeat-detecting-top-applications-usage-on-network/267366 "2021-03-22T02:03:40Z")

</div>

Hi all, I'm using packetbeat and building visualizations based on network data. I'm trying to see top applications usage across network. I'm not getting any data regarding this. Any solution for this. Thanks in adva…

---

## [How to stop logstash when ruby filter encountered error](https://discuss.elastic.co/t/how-to-stop-logstash-when-ruby-filter-encountered-error/267899)

<div class="topic-metadata">

**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\
**Replies:** 4\
**Last updated:** [March 22, 2021, 2:02am UTC](https://discuss.elastic.co/t/how-to-stop-logstash-when-ruby-filter-encountered-error/267899 "2021-03-22T02:02:57Z")

</div>

Hi, May i know how to stop logstash from indexing when error found inside ruby filter? i have following config file which will call external python script to process data and insert the records into elasticsearch. It …

---

## [Indices name Can't use IP?](https://discuss.elastic.co/t/indices-name-cant-use-ip/267439)

<div class="topic-metadata">

**Author:** [@jun\_li](https://discuss.elastic.co/u/jun_li)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 2:02am UTC](https://discuss.elastic.co/t/indices-name-cant-use-ip/267439 "2021-03-22T02:02:22Z")

</div>

I did a test to create index: Add Index PUT /access.log.2020.04.07/\_doc/1 { "domain":"www.amazon.com", "status":200 } #There is no problem when I query this index, GET \_cat/indices yellow open access.log.2020.04.0…

---

## [How the real data is stored in data disk?](https://discuss.elastic.co/t/how-the-real-data-is-stored-in-data-disk/267476)

<div class="topic-metadata">

**Author:** [@Jax\_dev](https://discuss.elastic.co/u/Jax_dev)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 1:58am UTC](https://discuss.elastic.co/t/how-the-real-data-is-stored-in-data-disk/267476 "2021-03-22T01:58:46Z")

</div>

I have executed below api GET "/\_cat/shards?v" it has shown all the indices in which one of the indices has taken 302 GB. When I have checked the mounted disk ( mentioned in path.data ) which elastic is being used, it s…

---

## [How much disk storage required to take backup of index which is having 300GB?](https://discuss.elastic.co/t/how-much-disk-storage-required-to-take-backup-of-index-which-is-having-300gb/267424)

<div class="topic-metadata">

**Author:** [@Jax\_dev](https://discuss.elastic.co/u/Jax_dev)\
**Replies:** 12\
**Last updated:** [March 22, 2021, 1:55am UTC](https://discuss.elastic.co/t/how-much-disk-storage-required-to-take-backup-of-index-which-is-having-300gb/267424 "2021-03-22T01:55:57Z")

</div>

If we want to take a back of one of the indices which is having 300GB, enabling compression - true. How much space snapshot will occupy? How do we take snapshot to azure blob storage? Elastic server cluster is on azure…

---

## [How to fix Unassigned state for my indexes?](https://discuss.elastic.co/t/how-to-fix-unassigned-state-for-my-indexes/267560)

<div class="topic-metadata">

**Author:** [@andy1122](https://discuss.elastic.co/u/andy1122)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 1:54am UTC](https://discuss.elastic.co/t/how-to-fix-unassigned-state-for-my-indexes/267560 "2021-03-22T01:54:08Z")

</div>

I have ElasticSearch configured in Docker and loading data from Magento into ES via indexer. When quering ES indexes I can see all the data is there but when I try to access it from my localhost:8080 where my connection …

---

## [Help With Validating This Heartbeat Config](https://discuss.elastic.co/t/help-with-validating-this-heartbeat-config/267874)

<div class="topic-metadata">

**Author:** [@LongBeachHXC](https://discuss.elastic.co/u/LongBeachHXC)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 1:53am UTC](https://discuss.elastic.co/t/help-with-validating-this-heartbeat-config/267874 "2021-03-22T01:53:14Z")

</div>

I am having a tough time starting a heartbeat container. I am bind mounting the config file into the path /usr/share/heartbeat/heartbeat.yml. My config file is below. I'm sure this is something simple but I haven't been …

---

## [How to create a document using the .NET library?](https://discuss.elastic.co/t/how-to-create-a-document-using-the-net-library/267584)

<div class="topic-metadata">

**Author:** [@jay2021](https://discuss.elastic.co/u/jay2021)\
**Replies:** 0\
**Last updated:** [March 17, 2021, 11:20pm UTC](https://discuss.elastic.co/t/how-to-create-a-document-using-the-net-library/267584 "2021-03-17T23:20:33Z")

</div>

Hello, I am trying to create a document using the .NET library. Here is the code that I attempted var newLogResponse = await elasticClient.CreateAsync(new ElasticJobLog() { Create…

---

## [Indices don't have primary shards while taking snapshot](https://discuss.elastic.co/t/indices-dont-have-primary-shards-while-taking-snapshot/267619)

<div class="topic-metadata">

**Author:** [@Venkatesh\_Kumar](https://discuss.elastic.co/u/Venkatesh_Kumar)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 1:44am UTC](https://discuss.elastic.co/t/indices-dont-have-primary-shards-while-taking-snapshot/267619 "2021-03-22T01:44:22Z")

</div>

Hi , I am trying to take snapshot using curl -X PUT "http://localhost:9200/\_snapshot/repo1/snap1?wait\_for\_completion=true&pretty" -H 'Content-Type: application/json' -d" { \\"indices\\": \[ \\"apm-7.10.1-transaction-00…

---

## [Filebeat misp module](https://discuss.elastic.co/t/filebeat-misp-module/267843)

<div class="topic-metadata">

**Author:** [@Charles100](https://discuss.elastic.co/u/Charles100)\
**Replies:** 2\
**Last updated:** [March 22, 2021, 1:09am UTC](https://discuss.elastic.co/t/filebeat-misp-module/267843 "2021-03-22T01:09:16Z")

</div>

Hi, I'm playing the filebeat MISP module and getting this error when starting filebeat : : ERROR fileset/factory.go:97 Error creating input: (assert) value of type 'string' not convertible into unsupported go type '…

---

## [Elastic and kibana 7.12 (or higher) compatibility with logstash , beats etc older 7.x](https://discuss.elastic.co/t/elastic-and-kibana-7-12-or-higher-compatibility-with-logstash-beats-etc-older-7-x/267850)

<div class="topic-metadata">

**Author:** [@xyz2](https://discuss.elastic.co/u/xyz2)\
**Replies:** 1\
**Last updated:** [March 22, 2021, 12:47am UTC](https://discuss.elastic.co/t/elastic-and-kibana-7-12-or-higher-compatibility-with-logstash-beats-etc-older-7-x/267850 "2021-03-22T00:47:26Z")

</div>

HI, Is elasticsearch and kibana 7.12 or 7.13 compatible with logstash, metricbeat, filebeat, heartbeat 7.x older version ? I see the that it is compatible until 7.11 though.

[Previous page](https://discuss.elastic.co/latest.md?page=1772)

[Next page](https://discuss.elastic.co/latest.md?page=1774)
