# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1182

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1183

---

## [Elasticsearch node with Metricbeat not registering in Kibana](https://discuss.elastic.co/t/elasticsearch-node-with-metricbeat-not-registering-in-kibana/301548)

<div class="topic-metadata">

**Author:** [@Chris\_Stone](https://discuss.elastic.co/u/Chris_Stone)\
**Replies:** 4\
**Last updated:** [April 6, 2022, 4:38pm UTC](https://discuss.elastic.co/t/elasticsearch-node-with-metricbeat-not-registering-in-kibana/301548 "2022-04-06T16:38:52Z")

</div>

I've added a 4th identical ES node to my cluster, and for some reason Metricbeat is not reporting correctly to Kibana. The only error from the Metricbeat logs is: Apr 4 17:58:35 elk-5 metricbeat\[8781\]: 2022-04-04T10:5…

---

## [Increase Virtual Memory for Elasticsearch on GKE with cloud build](https://discuss.elastic.co/t/increase-virtual-memory-for-elasticsearch-on-gke-with-cloud-build/301775)

<div class="topic-metadata">

**Author:** [@danskiyq](https://discuss.elastic.co/u/danskiyq)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 4:17pm UTC](https://discuss.elastic.co/t/increase-virtual-memory-for-elasticsearch-on-gke-with-cloud-build/301775 "2022-04-06T16:17:38Z")

</div>

I have created multi-node cluster on GKE and I was using this shell script for fixing the virtual memory on nodes Set vm.max\_map\_count=262144 on the nodes of a GKE cluster #k8s · GitHub. I want it to be executed in my cl…

---

## [Elastic Endpoint 8.1.1 - Memory usage crashing services](https://discuss.elastic.co/t/elastic-endpoint-8-1-1-memory-usage-crashing-services/301274)

<div class="topic-metadata">

**Author:** [@PublicName](https://discuss.elastic.co/u/PublicName)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 3:41pm UTC](https://discuss.elastic.co/t/elastic-endpoint-8-1-1-memory-usage-crashing-services/301274 "2022-04-06T15:41:28Z")

</div>

Well the locking issue is gone but the memory usage has started to climb from the generally 512Mb usage. At one point it took 100% memory and crashed services on several servers causing downtime and lost revenue. 7.17 …

---

## [Modify Kibana Embeds to improve UX](https://discuss.elastic.co/t/modify-kibana-embeds-to-improve-ux/301054)

<div class="topic-metadata">

**Author:** [@msanz-acclaro](https://discuss.elastic.co/u/msanz-acclaro)\
**Replies:** 5\
**Last updated:** [April 6, 2022, 3:32pm UTC](https://discuss.elastic.co/t/modify-kibana-embeds-to-improve-ux/301054 "2022-04-06T15:32:38Z")

</div>

Hi there, We have some dashboards from Kibana that we are injecting in our app through iframes. We do not want to allow filters to display because we still have to do some cleanup in our indexes and also name the fields…

---

## [ElasticEndpoint service registration in Windows stuck after uninstall](https://discuss.elastic.co/t/elasticendpoint-service-registration-in-windows-stuck-after-uninstall/301773)

<div class="topic-metadata">

**Author:** [@MichelV](https://discuss.elastic.co/u/MichelV)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 3:17pm UTC](https://discuss.elastic.co/t/elasticendpoint-service-registration-in-windows-stuck-after-uninstall/301773 "2022-04-06T15:17:57Z")

</div>

Hi, after removing the Elastic Agent with Endpoint Security the service registration of ElasticEndpoint is stuck in Windows. In services I can see Elastic Endpoint, with "Failed to read description. Error code 2". Also …

---

## [Group Watcher results per host](https://discuss.elastic.co/t/group-watcher-results-per-host/301079)

<div class="topic-metadata">

**Author:** [@700grm](https://discuss.elastic.co/u/700grm)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 3:09pm UTC](https://discuss.elastic.co/t/group-watcher-results-per-host/301079 "2022-04-06T15:09:52Z")

</div>

Hi, I'm trying to create a watcher that can monitor service sshd.service status on multiple hosts and create aggregated log entry per host every five minutes. instead of creating log entry every time it detects "syst…

---

## [Node Role Specific Disk Watermarks](https://discuss.elastic.co/t/node-role-specific-disk-watermarks/301684)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 3:05pm UTC](https://discuss.elastic.co/t/node-role-specific-disk-watermarks/301684 "2022-04-06T15:05:19Z")

</div>

Hi All, I was wondering if there was a way to set high disk watermark based on the node role? Looking at the docs. I see the normal settings cluster.routing.allocation.disk.watermark.low, cluster.routing.allocation.di…

---

## [Sorting multiple indices with different fields](https://discuss.elastic.co/t/sorting-multiple-indices-with-different-fields/301315)

<div class="topic-metadata">

**Author:** [@marten1](https://discuss.elastic.co/u/marten1)\
**Replies:** 5\
**Last updated:** [April 6, 2022, 2:27pm UTC](https://discuss.elastic.co/t/sorting-multiple-indices-with-different-fields/301315 "2022-04-06T14:27:34Z")

</div>

Hi there, I'm having a sorting issue. I have 2 indexes which I search. I want to sort on a date field, but they have different names in each index: index01 has a datefield: publishedDate index02 has a datefield: pos…

---

## [Suggest index design for my data](https://discuss.elastic.co/t/suggest-index-design-for-my-data/301702)

<div class="topic-metadata">

**Author:** [@Martynas\_Juravicius](https://discuss.elastic.co/u/Martynas_Juravicius)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 2:20pm UTC](https://discuss.elastic.co/t/suggest-index-design-for-my-data/301702 "2022-04-06T14:20:52Z")

</div>

Hey, everyone, We are currently building some search engine for our internal data and we are using Elasticsearch for that. Our data looks like this: Object A: {attribute\_a\_1, attribute\_a\_2} - 100M of object A; Object …

---

## [Registry filebeat with file overwritten daily](https://discuss.elastic.co/t/registry-filebeat-with-file-overwritten-daily/301771)

<div class="topic-metadata">

**Author:** [@S-elk](https://discuss.elastic.co/u/S-elk)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 2:05pm UTC](https://discuss.elastic.co/t/registry-filebeat-with-file-overwritten-daily/301771 "2022-04-06T14:05:57Z")

</div>

hello! I have a filebeat reading a document and sending the logs to kafka. My client has a single file that is overwritten every day. I understand how the filebeat registry works when new records are added to the docu…

---

## [Logstash fail while running with opensearch](https://discuss.elastic.co/t/logstash-fail-while-running-with-opensearch/301768)

<div class="topic-metadata">

**Author:** [@abhaypersistent](https://discuss.elastic.co/u/abhaypersistent)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 2:05pm UTC](https://discuss.elastic.co/t/logstash-fail-while-running-with-opensearch/301768 "2022-04-06T14:05:29Z")

</div>

I am getting this error. "Using bundled JDK: C:\\Users\\abhay\_pandey\\Documents\\GitHub\\logsdash\\logstash-8.1.2-windows-x86\_64\\logstash-8.1.2\\jdk\\bin\\java.exe" OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC wa…

---

## [How to set data change history in a separate index?](https://discuss.elastic.co/t/how-to-set-data-change-history-in-a-separate-index/301762)

<div class="topic-metadata">

**Author:** [@a.number27](https://discuss.elastic.co/u/a.number27)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 1:39pm UTC](https://discuss.elastic.co/t/how-to-set-data-change-history-in-a-separate-index/301762 "2022-04-06T13:39:45Z")

</div>

To set the historicity I need : "You should store the history in a separate index. And insert into the history index on every update to the original document index." Can you please tell me how to set it up step by step?…

---

## [Hi, I am trying to join Kibana and Nagios](https://discuss.elastic.co/t/hi-i-am-trying-to-join-kibana-and-nagios/301426)

<div class="topic-metadata">

**Author:** [@nour41\_nour41](https://discuss.elastic.co/u/nour41_nour41)\
**Replies:** 7\
**Last updated:** [April 6, 2022, 1:35pm UTC](https://discuss.elastic.co/t/hi-i-am-trying-to-join-kibana-and-nagios/301426 "2022-04-06T13:35:07Z")

</div>

Hi, I am trying to join Kibana and Nagios, following this link: https://www.elastic.co/es/blog/integrating-nagios-checks-with-logstash But I get some errors which I cant resolve it, any ideas? Thanks. root@nagios:/ho…

---

## [Logstash output is not generating file with current date when timestamp field not available](https://discuss.elastic.co/t/logstash-output-is-not-generating-file-with-current-date-when-timestamp-field-not-available/301752)

<div class="topic-metadata">

**Author:** [@sagarpatel](https://discuss.elastic.co/u/sagarpatel)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 1:03pm UTC](https://discuss.elastic.co/t/logstash-output-is-not-generating-file-with-current-date-when-timestamp-field-not-available/301752 "2022-04-06T13:03:04Z")

</div>

Hi, I am trying to create output file using logstash file output plugin but when @timestamp field is not available then it is not genearting file with current date. Below is working example where i have added date fil…

---

## [Filebeat stops harvesting logs after a point of time](https://discuss.elastic.co/t/filebeat-stops-harvesting-logs-after-a-point-of-time/301746)

<div class="topic-metadata">

**Author:** [@Chirag\_Baid](https://discuss.elastic.co/u/Chirag_Baid)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 11:26am UTC](https://discuss.elastic.co/t/filebeat-stops-harvesting-logs-after-a-point-of-time/301746 "2022-04-06T11:26:46Z")

</div>

After a point of time Filebeats fails to show logs in Kibana cloud but I can see all my logs in the filebeat docker container which means filebeat not streaming logs to Elasticsearch

---

## [Max CSV export elastic cloud 50MB, how to increase it](https://discuss.elastic.co/t/max-csv-export-elastic-cloud-50mb-how-to-increase-it/301016)

<div class="topic-metadata">

**Author:** [@Gustavo\_Llermaly](https://discuss.elastic.co/u/Gustavo_Llermaly)\
**Replies:** 8\
**Last updated:** [April 6, 2022, 11:14am UTC](https://discuss.elastic.co/t/max-csv-export-elastic-cloud-50mb-how-to-increase-it/301016 "2022-04-06T11:14:48Z")

</div>

Hello, I need to generate large CSV reports so I must set 'xpack.reporting.csv.maxSizeBytes' to a high value but I'm being capped at 50MB, how can I go beyond that? The error when trying to save the changes is: Kibana…

---

## [The day of date is always one in kibana and different that elastic search](https://discuss.elastic.co/t/the-day-of-date-is-always-one-in-kibana-and-different-that-elastic-search/300478)

<div class="topic-metadata">

**Author:** [@tarek0811](https://discuss.elastic.co/u/tarek0811)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 9:52am UTC](https://discuss.elastic.co/t/the-day-of-date-is-always-one-in-kibana-and-different-that-elastic-search/300478 "2022-04-06T09:52:10Z")

</div>

Hi, the day of date in kibana is showing always 1 , regardless of the date in my log or in Elasticsearch. i am using elk docker-compose with the latest version. my logstash config: grok { match =\> { "message" =\> \[ …

---

## [How to generate new file per metricbeat event](https://discuss.elastic.co/t/how-to-generate-new-file-per-metricbeat-event/301732)

<div class="topic-metadata">

**Author:** [@AMBUJ\_DUBEY](https://discuss.elastic.co/u/AMBUJ_DUBEY)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:44am UTC](https://discuss.elastic.co/t/how-to-generate-new-file-per-metricbeat-event/301732 "2022-04-06T09:44:12Z")

</div>

How can I generate a new file for every new metricbeat event? Below config creates a file named metricbeat and keeps appending data into it. output.file: enabled: true path: "/tmp/metricbeat"

---

## [Logstash Read and Write from 2 Different Kafka](https://discuss.elastic.co/t/logstash-read-and-write-from-2-different-kafka/301731)

<div class="topic-metadata">

**Author:** [@osy](https://discuss.elastic.co/u/osy)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:43am UTC](https://discuss.elastic.co/t/logstash-read-and-write-from-2-different-kafka/301731 "2022-04-06T09:43:36Z")

</div>

Can logstash read from 2 different kafka which has same topic&tag name? Can logstash write these 2 kafka logs to same Elasticsearch? Example: input { kafka { codec =\> “json” bootstrap\_servers =\> “172.16.1.15:9092” to…

---

## [How to index the csv file data into elasticsearch?](https://discuss.elastic.co/t/how-to-index-the-csv-file-data-into-elasticsearch/301395)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 4\
**Last updated:** [April 6, 2022, 9:30am UTC](https://discuss.elastic.co/t/how-to-index-the-csv-file-data-into-elasticsearch/301395 "2022-04-06T09:30:12Z")

</div>

How to index the data from a CSV file into Elasticsearch without using logstash? Looking to get it done through curl command and providing the csv file as input.

---

## [Grok pattern construction](https://discuss.elastic.co/t/grok-pattern-construction/301610)

<div class="topic-metadata">

**Author:** [@anushka1203](https://discuss.elastic.co/u/anushka1203)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 9:16am UTC](https://discuss.elastic.co/t/grok-pattern-construction/301610 "2022-04-06T09:16:47Z")

</div>

Hi, I need help constructing the grok pattern for the following log messages Fri Mar 18 17:43:27 2022 : Info: Debugger not attached Fri Mar 18 17:43:27 2022 : Info: Loaded virtual server inner-tunnel Fri Mar 18 17:43:27…

---

## [Is it possible to update kibana plugins without a pause?](https://discuss.elastic.co/t/is-it-possible-to-update-kibana-plugins-without-a-pause/301687)

<div class="topic-metadata">

**Author:** [@kyh119](https://discuss.elastic.co/u/kyh119)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 9:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-update-kibana-plugins-without-a-pause/301687 "2022-04-06T09:06:14Z")

</div>

Hi. Let's assume that there's a plugin and it's version is 1.0.0. Soon, the newer version 1.1.0 is released with minor fixes, and I want to upgrade my old plugin. If I removed old plugin and then installed new plugin,…

---

## [Send metrics from specific namespaces in kubernetes using metricbeat](https://discuss.elastic.co/t/send-metrics-from-specific-namespaces-in-kubernetes-using-metricbeat/301726)

<div class="topic-metadata">

**Author:** [@Sherlock06](https://discuss.elastic.co/u/Sherlock06)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:01am UTC](https://discuss.elastic.co/t/send-metrics-from-specific-namespaces-in-kubernetes-using-metricbeat/301726 "2022-04-06T09:01:25Z")

</div>

is there a way for us to configure the metric beat config file to be able to fetch cpu/memory metrics only from specific namespaces in kubernetes. We are running a metric beat pod as daemon set on open-shift. Using metri…

---

## [Как переименовать политику в кибане ? How to rename policy in kibana?](https://discuss.elastic.co/t/how-to-rename-policy-in-kibana/301723)

<div class="topic-metadata">

**Author:** [@tmakaev](https://discuss.elastic.co/u/tmakaev)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 8:41am UTC](https://discuss.elastic.co/t/how-to-rename-policy-in-kibana/301723 "2022-04-06T08:41:41Z")

</div>

Всем привет кто может подсказать как переименовать политику в кибане ? Очень тривиальная задача на которой вышел затуп ...

---

## [Can anyone answer a few questions about apm UI?](https://discuss.elastic.co/t/can-anyone-answer-a-few-questions-about-apm-ui/301721)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 8:37am UTC](https://discuss.elastic.co/t/can-anyone-answer-a-few-questions-about-apm-ui/301721 "2022-04-06T08:37:40Z")

</div>

First I found a request, its status is http200, but it also contains an error message, I wonder why http200 also returns an error? And where can I find the details of this error? I can understand that occurrences…

---

## [Problem starting nagioscheckbeat on nagios server](https://discuss.elastic.co/t/problem-starting-nagioscheckbeat-on-nagios-server/301720)

<div class="topic-metadata">

**Author:** [@nour41\_nour41](https://discuss.elastic.co/u/nour41_nour41)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 8:21am UTC](https://discuss.elastic.co/t/problem-starting-nagioscheckbeat-on-nagios-server/301720 "2022-04-06T08:21:37Z")

</div>

nagioscheckbeat.service - One sentence description of the Beat. Loaded: loaded (/usr/lib/systemd/system/nagioscheckbeat.service; enabled; vendor preset: disabled) Active: failed (Result: start-limit) since mer. 2022-04…

---

## [Indexing/search algorithm stability between versions](https://discuss.elastic.co/t/indexing-search-algorithm-stability-between-versions/301718)

<div class="topic-metadata">

**Author:** [@Alvaro\_Denis\_Acosta](https://discuss.elastic.co/u/Alvaro_Denis_Acosta)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 8:14am UTC](https://discuss.elastic.co/t/indexing-search-algorithm-stability-between-versions/301718 "2022-04-06T08:14:22Z")

</div>

Hello @all, I'm migrating from Elasticsearch 1.5 to 7.10 there are multiple required changes, the most relevant one is the removal of the document type concept in version 6, to deal with it I introduced a new field "doc…

---

## [Doc\['message.keyword'\] shows 0 value for given index but actually value is present in message field. What could be the reason?](https://discuss.elastic.co/t/doc-message-keyword-shows-0-value-for-given-index-but-actually-value-is-present-in-message-field-what-could-be-the-reason/301299)

<div class="topic-metadata">

**Author:** [@vishdubey](https://discuss.elastic.co/u/vishdubey)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 8:14am UTC](https://discuss.elastic.co/t/doc-message-keyword-shows-0-value-for-given-index-but-actually-value-is-present-in-message-field-what-could-be-the-reason/301299 "2022-04-06T08:14:12Z")

</div>

below is the script field GET log-2022.03.30/\_search { "script\_fields": { "message": { "script": { "lang" : "painless", "source": "doc\['message.keyword'\].value" } } } } and here …

---

## [Multiple pipelines with Fileabeat and Logstash](https://discuss.elastic.co/t/multiple-pipelines-with-fileabeat-and-logstash/301652)

<div class="topic-metadata">

**Author:** [@bianca6](https://discuss.elastic.co/u/bianca6)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 7:38am UTC](https://discuss.elastic.co/t/multiple-pipelines-with-fileabeat-and-logstash/301652 "2022-04-06T07:38:38Z")

</div>

Hi, I know this is a known topic, I read different discussions but.. I'm still stuck, if someone could help me I will be grateful. What I'm trying to achieve is this: https://www.elastic.co/guide/en/logstash/current/p…

---

## [AWS VPC Flow Log integration](https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712)

<div class="topic-metadata">

**Author:** [@ame123](https://discuss.elastic.co/u/ame123)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 7:20am UTC](https://discuss.elastic.co/t/aws-vpc-flow-log-integration/301712 "2022-04-06T07:20:44Z")

</div>

Hi all, We have been trying since a month to stabilize the integration of vpc flow logs using elastic agent. There is always a lag of 2-3 days in the ingestion, the messages in the sqs queue never seems to do down beca…

[Previous page](https://discuss.elastic.co/latest.md?page=1181)

[Next page](https://discuss.elastic.co/latest.md?page=1183)
