# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=983

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 984

---

## [Self-signed cert unable to import data to stream using fleet](https://discuss.elastic.co/t/self-signed-cert-unable-to-import-data-to-stream-using-fleet/301798)

<div class="topic-metadata">

**Author:** [@nfarmer](https://discuss.elastic.co/u/nfarmer)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 8:07pm UTC](https://discuss.elastic.co/t/self-signed-cert-unable-to-import-data-to-stream-using-fleet/301798 "2022-04-06T20:07:56Z")

</div>

Hello, I'm trying to deploy elastic agents using fleet with the certificate authorities enable in the advanced output settings, but when I go to install the agent, it still says unknown authority. So I enrolled the agen…

---

## [How to delete elasticsearch logs?](https://discuss.elastic.co/t/how-to-delete-elasticsearch-logs/301666)

<div class="topic-metadata">

**Author:** [@danielbsilva2](https://discuss.elastic.co/u/danielbsilva2)\
**Replies:** 16\
**Last updated:** [April 6, 2022, 8:02pm UTC](https://discuss.elastic.co/t/how-to-delete-elasticsearch-logs/301666 "2022-04-06T20:02:29Z")

</div>

good afternoon folks how do i delete my indexes in Elasticsearch? I need to delete the logs generated in Elasticsearch from an application I have here and leave the logs from the last 3 days, I've looked here on the fo…

---

## [Control Range Slider does not match Is Between Operator Filter](https://discuss.elastic.co/t/control-range-slider-does-not-match-is-between-operator-filter/301796)

<div class="topic-metadata">

**Author:** [@bsmith](https://discuss.elastic.co/u/bsmith)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 7:39pm UTC](https://discuss.elastic.co/t/control-range-slider-does-not-match-is-between-operator-filter/301796 "2022-04-06T19:39:35Z")

</div>

Using ELK 7.10 When adding a filter via the Range Slider in Controls it uses gte/lte. You can also see a visual bug where the second value does not show in the filter. { "script": { "script": { "lang": "pai…

---

## [How do I put another related field below the columns?](https://discuss.elastic.co/t/how-do-i-put-another-related-field-below-the-columns/301564)

<div class="topic-metadata">

**Author:** [@Alejandra\_Mata1](https://discuss.elastic.co/u/Alejandra_Mata1)\
**Replies:** 7\
**Last updated:** [April 6, 2022, 7:30pm UTC](https://discuss.elastic.co/t/how-do-i-put-another-related-field-below-the-columns/301564 "2022-04-06T19:30:07Z")

</div>

I have an array of fields that I have already put in the form of columns, but my concern is that the count() appears as a metric at the bottom, but I need the date to appear, instead of count() but what I need, to ou…

---

## [How to get logstash to read/process multiple log files at the same time?](https://discuss.elastic.co/t/how-to-get-logstash-to-read-process-multiple-log-files-at-the-same-time/301710)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 7:34pm UTC](https://discuss.elastic.co/t/how-to-get-logstash-to-read-process-multiple-log-files-at-the-same-time/301710 "2022-04-06T19:34:33Z")

</div>

It seems that logstash doesnt read multiple files in the directory at the same time , what am i missing ? how do i get logstash to read all three files here ? root@dev-elk-app02:/app/input# lsof \* COMMAND PID USER FD…

---

## [Where User/Roles, Index and Saved objects are stored?](https://discuss.elastic.co/t/where-user-roles-index-and-saved-objects-are-stored/301686)

<div class="topic-metadata">

**Author:** [@Gabriel\_Mendez](https://discuss.elastic.co/u/Gabriel_Mendez)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 6:30pm UTC](https://discuss.elastic.co/t/where-user-roles-index-and-saved-objects-are-stored/301686 "2022-04-06T18:30:47Z")

</div>

Hello!, I am using a docker version for Elasticsearch and Kibana, and I have deployed an AWS instance to have my App working, Now on every documentation for Elastic and Kibana with docker it says that to backup the data…

---

## [ElasticSearch 8.1 - Multinode Cluster Setup](https://discuss.elastic.co/t/elasticsearch-8-1-multinode-cluster-setup/301677)

<div class="topic-metadata">

**Author:** [@Aldo2](https://discuss.elastic.co/u/Aldo2)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 5:40pm UTC](https://discuss.elastic.co/t/elasticsearch-8-1-multinode-cluster-setup/301677 "2022-04-06T17:40:21Z")

</div>

Hi Elastic Community, I have a question about the multi node version 8.1.1 cluster setup. When I need to add the 2nd node to the cluster according to the elastic support I must add: cluster.name: aiops node.name: elas…

---

## [Elasticsearch node with Metricbeat not registering in Kibana](https://discuss.elastic.co/t/elasticsearch-node-with-metricbeat-not-registering-in-kibana/301548)

<div class="topic-metadata">

**Author:** [@Chris\_Stone](https://discuss.elastic.co/u/Chris_Stone)\
**Replies:** 4\
**Last updated:** [April 6, 2022, 4:38pm UTC](https://discuss.elastic.co/t/elasticsearch-node-with-metricbeat-not-registering-in-kibana/301548 "2022-04-06T16:38:52Z")

</div>

I've added a 4th identical ES node to my cluster, and for some reason Metricbeat is not reporting correctly to Kibana. The only error from the Metricbeat logs is: Apr 4 17:58:35 elk-5 metricbeat\[8781\]: 2022-04-04T10:5…

---

## [Modify Kibana Embeds to improve UX](https://discuss.elastic.co/t/modify-kibana-embeds-to-improve-ux/301054)

<div class="topic-metadata">

**Author:** [@msanz-acclaro](https://discuss.elastic.co/u/msanz-acclaro)\
**Replies:** 5\
**Last updated:** [April 6, 2022, 3:32pm UTC](https://discuss.elastic.co/t/modify-kibana-embeds-to-improve-ux/301054 "2022-04-06T15:32:38Z")

</div>

Hi there, We have some dashboards from Kibana that we are injecting in our app through iframes. We do not want to allow filters to display because we still have to do some cleanup in our indexes and also name the fields…

---

## [Node Role Specific Disk Watermarks](https://discuss.elastic.co/t/node-role-specific-disk-watermarks/301684)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 3:05pm UTC](https://discuss.elastic.co/t/node-role-specific-disk-watermarks/301684 "2022-04-06T15:05:19Z")

</div>

Hi All, I was wondering if there was a way to set high disk watermark based on the node role? Looking at the docs. I see the normal settings cluster.routing.allocation.disk.watermark.low, cluster.routing.allocation.di…

---

## [Sorting multiple indices with different fields](https://discuss.elastic.co/t/sorting-multiple-indices-with-different-fields/301315)

<div class="topic-metadata">

**Author:** [@marten1](https://discuss.elastic.co/u/marten1)\
**Replies:** 5\
**Last updated:** [April 6, 2022, 2:27pm UTC](https://discuss.elastic.co/t/sorting-multiple-indices-with-different-fields/301315 "2022-04-06T14:27:34Z")

</div>

Hi there, I'm having a sorting issue. I have 2 indexes which I search. I want to sort on a date field, but they have different names in each index: index01 has a datefield: publishedDate index02 has a datefield: pos…

---

## [Suggest index design for my data](https://discuss.elastic.co/t/suggest-index-design-for-my-data/301702)

<div class="topic-metadata">

**Author:** [@Martynas\_Juravicius](https://discuss.elastic.co/u/Martynas_Juravicius)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 2:20pm UTC](https://discuss.elastic.co/t/suggest-index-design-for-my-data/301702 "2022-04-06T14:20:52Z")

</div>

Hey, everyone, We are currently building some search engine for our internal data and we are using Elasticsearch for that. Our data looks like this: Object A: {attribute\_a\_1, attribute\_a\_2} - 100M of object A; Object …

---

## [Registry filebeat with file overwritten daily](https://discuss.elastic.co/t/registry-filebeat-with-file-overwritten-daily/301771)

<div class="topic-metadata">

**Author:** [@S-elk](https://discuss.elastic.co/u/S-elk)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 2:05pm UTC](https://discuss.elastic.co/t/registry-filebeat-with-file-overwritten-daily/301771 "2022-04-06T14:05:57Z")

</div>

hello! I have a filebeat reading a document and sending the logs to kafka. My client has a single file that is overwritten every day. I understand how the filebeat registry works when new records are added to the docu…

---

## [Logstash fail while running with opensearch](https://discuss.elastic.co/t/logstash-fail-while-running-with-opensearch/301768)

<div class="topic-metadata">

**Author:** [@abhaypersistent](https://discuss.elastic.co/u/abhaypersistent)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 2:05pm UTC](https://discuss.elastic.co/t/logstash-fail-while-running-with-opensearch/301768 "2022-04-06T14:05:29Z")

</div>

I am getting this error. "Using bundled JDK: C:\\Users\\abhay\_pandey\\Documents\\GitHub\\logsdash\\logstash-8.1.2-windows-x86\_64\\logstash-8.1.2\\jdk\\bin\\java.exe" OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC wa…

---

## [How to set data change history in a separate index?](https://discuss.elastic.co/t/how-to-set-data-change-history-in-a-separate-index/301762)

<div class="topic-metadata">

**Author:** [@a.number27](https://discuss.elastic.co/u/a.number27)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 1:39pm UTC](https://discuss.elastic.co/t/how-to-set-data-change-history-in-a-separate-index/301762 "2022-04-06T13:39:45Z")

</div>

To set the historicity I need : "You should store the history in a separate index. And insert into the history index on every update to the original document index." Can you please tell me how to set it up step by step?…

---

## [Hi, I am trying to join Kibana and Nagios](https://discuss.elastic.co/t/hi-i-am-trying-to-join-kibana-and-nagios/301426)

<div class="topic-metadata">

**Author:** [@nour41\_nour41](https://discuss.elastic.co/u/nour41_nour41)\
**Replies:** 7\
**Last updated:** [April 6, 2022, 1:35pm UTC](https://discuss.elastic.co/t/hi-i-am-trying-to-join-kibana-and-nagios/301426 "2022-04-06T13:35:07Z")

</div>

Hi, I am trying to join Kibana and Nagios, following this link: https://www.elastic.co/es/blog/integrating-nagios-checks-with-logstash But I get some errors which I cant resolve it, any ideas? Thanks. root@nagios:/ho…

---

## [Logstash output is not generating file with current date when timestamp field not available](https://discuss.elastic.co/t/logstash-output-is-not-generating-file-with-current-date-when-timestamp-field-not-available/301752)

<div class="topic-metadata">

**Author:** [@sagarpatel](https://discuss.elastic.co/u/sagarpatel)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 1:03pm UTC](https://discuss.elastic.co/t/logstash-output-is-not-generating-file-with-current-date-when-timestamp-field-not-available/301752 "2022-04-06T13:03:04Z")

</div>

Hi, I am trying to create output file using logstash file output plugin but when @timestamp field is not available then it is not genearting file with current date. Below is working example where i have added date fil…

---

## [Filebeat stops harvesting logs after a point of time](https://discuss.elastic.co/t/filebeat-stops-harvesting-logs-after-a-point-of-time/301746)

<div class="topic-metadata">

**Author:** [@Chirag\_Baid](https://discuss.elastic.co/u/Chirag_Baid)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 11:26am UTC](https://discuss.elastic.co/t/filebeat-stops-harvesting-logs-after-a-point-of-time/301746 "2022-04-06T11:26:46Z")

</div>

After a point of time Filebeats fails to show logs in Kibana cloud but I can see all my logs in the filebeat docker container which means filebeat not streaming logs to Elasticsearch

---

## [Max CSV export elastic cloud 50MB, how to increase it](https://discuss.elastic.co/t/max-csv-export-elastic-cloud-50mb-how-to-increase-it/301016)

<div class="topic-metadata">

**Author:** [@Gustavo\_Llermaly](https://discuss.elastic.co/u/Gustavo_Llermaly)\
**Replies:** 8\
**Last updated:** [April 6, 2022, 11:14am UTC](https://discuss.elastic.co/t/max-csv-export-elastic-cloud-50mb-how-to-increase-it/301016 "2022-04-06T11:14:48Z")

</div>

Hello, I need to generate large CSV reports so I must set 'xpack.reporting.csv.maxSizeBytes' to a high value but I'm being capped at 50MB, how can I go beyond that? The error when trying to save the changes is: Kibana…

---

## [The day of date is always one in kibana and different that elastic search](https://discuss.elastic.co/t/the-day-of-date-is-always-one-in-kibana-and-different-that-elastic-search/300478)

<div class="topic-metadata">

**Author:** [@tarek0811](https://discuss.elastic.co/u/tarek0811)\
**Replies:** 3\
**Last updated:** [April 6, 2022, 9:52am UTC](https://discuss.elastic.co/t/the-day-of-date-is-always-one-in-kibana-and-different-that-elastic-search/300478 "2022-04-06T09:52:10Z")

</div>

Hi, the day of date in kibana is showing always 1 , regardless of the date in my log or in Elasticsearch. i am using elk docker-compose with the latest version. my logstash config: grok { match =\> { "message" =\> \[ …

---

## [How to generate new file per metricbeat event](https://discuss.elastic.co/t/how-to-generate-new-file-per-metricbeat-event/301732)

<div class="topic-metadata">

**Author:** [@AMBUJ\_DUBEY](https://discuss.elastic.co/u/AMBUJ_DUBEY)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:44am UTC](https://discuss.elastic.co/t/how-to-generate-new-file-per-metricbeat-event/301732 "2022-04-06T09:44:12Z")

</div>

How can I generate a new file for every new metricbeat event? Below config creates a file named metricbeat and keeps appending data into it. output.file: enabled: true path: "/tmp/metricbeat"

---

## [Logstash Read and Write from 2 Different Kafka](https://discuss.elastic.co/t/logstash-read-and-write-from-2-different-kafka/301731)

<div class="topic-metadata">

**Author:** [@osy](https://discuss.elastic.co/u/osy)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:43am UTC](https://discuss.elastic.co/t/logstash-read-and-write-from-2-different-kafka/301731 "2022-04-06T09:43:36Z")

</div>

Can logstash read from 2 different kafka which has same topic&tag name? Can logstash write these 2 kafka logs to same Elasticsearch? Example: input { kafka { codec =\> “json” bootstrap\_servers =\> “172.16.1.15:9092” to…

---

## [How to index the csv file data into elasticsearch?](https://discuss.elastic.co/t/how-to-index-the-csv-file-data-into-elasticsearch/301395)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 4\
**Last updated:** [April 6, 2022, 9:30am UTC](https://discuss.elastic.co/t/how-to-index-the-csv-file-data-into-elasticsearch/301395 "2022-04-06T09:30:12Z")

</div>

How to index the data from a CSV file into Elasticsearch without using logstash? Looking to get it done through curl command and providing the csv file as input.

---

## [Grok pattern construction](https://discuss.elastic.co/t/grok-pattern-construction/301610)

<div class="topic-metadata">

**Author:** [@anushka1203](https://discuss.elastic.co/u/anushka1203)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 9:16am UTC](https://discuss.elastic.co/t/grok-pattern-construction/301610 "2022-04-06T09:16:47Z")

</div>

Hi, I need help constructing the grok pattern for the following log messages Fri Mar 18 17:43:27 2022 : Info: Debugger not attached Fri Mar 18 17:43:27 2022 : Info: Loaded virtual server inner-tunnel Fri Mar 18 17:43:27…

---

## [Is it possible to update kibana plugins without a pause?](https://discuss.elastic.co/t/is-it-possible-to-update-kibana-plugins-without-a-pause/301687)

<div class="topic-metadata">

**Author:** [@kyh119](https://discuss.elastic.co/u/kyh119)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 9:06am UTC](https://discuss.elastic.co/t/is-it-possible-to-update-kibana-plugins-without-a-pause/301687 "2022-04-06T09:06:14Z")

</div>

Hi. Let's assume that there's a plugin and it's version is 1.0.0. Soon, the newer version 1.1.0 is released with minor fixes, and I want to upgrade my old plugin. If I removed old plugin and then installed new plugin,…

---

## [Send metrics from specific namespaces in kubernetes using metricbeat](https://discuss.elastic.co/t/send-metrics-from-specific-namespaces-in-kubernetes-using-metricbeat/301726)

<div class="topic-metadata">

**Author:** [@Sherlock06](https://discuss.elastic.co/u/Sherlock06)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 9:01am UTC](https://discuss.elastic.co/t/send-metrics-from-specific-namespaces-in-kubernetes-using-metricbeat/301726 "2022-04-06T09:01:25Z")

</div>

is there a way for us to configure the metric beat config file to be able to fetch cpu/memory metrics only from specific namespaces in kubernetes. We are running a metric beat pod as daemon set on open-shift. Using metri…

---

## [Problem starting nagioscheckbeat on nagios server](https://discuss.elastic.co/t/problem-starting-nagioscheckbeat-on-nagios-server/301720)

<div class="topic-metadata">

**Author:** [@nour41\_nour41](https://discuss.elastic.co/u/nour41_nour41)\
**Replies:** 0\
**Last updated:** [April 6, 2022, 8:21am UTC](https://discuss.elastic.co/t/problem-starting-nagioscheckbeat-on-nagios-server/301720 "2022-04-06T08:21:37Z")

</div>

nagioscheckbeat.service - One sentence description of the Beat. Loaded: loaded (/usr/lib/systemd/system/nagioscheckbeat.service; enabled; vendor preset: disabled) Active: failed (Result: start-limit) since mer. 2022-04…

---

## [Indexing/search algorithm stability between versions](https://discuss.elastic.co/t/indexing-search-algorithm-stability-between-versions/301718)

<div class="topic-metadata">

**Author:** [@Alvaro\_Denis\_Acosta](https://discuss.elastic.co/u/Alvaro_Denis_Acosta)\
**Replies:** 1\
**Last updated:** [April 6, 2022, 8:14am UTC](https://discuss.elastic.co/t/indexing-search-algorithm-stability-between-versions/301718 "2022-04-06T08:14:22Z")

</div>

Hello @all, I'm migrating from Elasticsearch 1.5 to 7.10 there are multiple required changes, the most relevant one is the removal of the document type concept in version 6, to deal with it I introduced a new field "doc…

---

## [Doc\['message.keyword'\] shows 0 value for given index but actually value is present in message field. What could be the reason?](https://discuss.elastic.co/t/doc-message-keyword-shows-0-value-for-given-index-but-actually-value-is-present-in-message-field-what-could-be-the-reason/301299)

<div class="topic-metadata">

**Author:** [@vishdubey](https://discuss.elastic.co/u/vishdubey)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 8:14am UTC](https://discuss.elastic.co/t/doc-message-keyword-shows-0-value-for-given-index-but-actually-value-is-present-in-message-field-what-could-be-the-reason/301299 "2022-04-06T08:14:12Z")

</div>

below is the script field GET log-2022.03.30/\_search { "script\_fields": { "message": { "script": { "lang" : "painless", "source": "doc\['message.keyword'\].value" } } } } and here …

---

## [Multiple pipelines with Fileabeat and Logstash](https://discuss.elastic.co/t/multiple-pipelines-with-fileabeat-and-logstash/301652)

<div class="topic-metadata">

**Author:** [@bianca6](https://discuss.elastic.co/u/bianca6)\
**Replies:** 2\
**Last updated:** [April 6, 2022, 7:38am UTC](https://discuss.elastic.co/t/multiple-pipelines-with-fileabeat-and-logstash/301652 "2022-04-06T07:38:38Z")

</div>

Hi, I know this is a known topic, I read different discussions but.. I'm still stuck, if someone could help me I will be grateful. What I'm trying to achieve is this: https://www.elastic.co/guide/en/logstash/current/p…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=982)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=984)
