# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1419

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1420

---

## [Doubt about Elasticsearch module of Filebeat on container \[7.9.2\]](https://discuss.elastic.co/t/doubt-about-elasticsearch-module-of-filebeat-on-container-7-9-2/272189)

<div class="topic-metadata">

**Author:** [@RdrgPorto](https://discuss.elastic.co/u/RdrgPorto)\
**Replies:** 11\
**Last updated:** [May 12, 2021, 8:53am UTC](https://discuss.elastic.co/t/doubt-about-elasticsearch-module-of-filebeat-on-container-7-9-2/272189 "2021-05-12T08:53:09Z")

</div>

Hi, everyone I have been testing with Elasticsearch module of Filebeat in order to have information about Elasticsearch. I work with Kubernetes and I have created a deployment with Filebeat. Here are you are my Filebea…

---

## [Unnable to list snapshots in Elasticsearch repository](https://discuss.elastic.co/t/unnable-to-list-snapshots-in-elasticsearch-repository/271425)

<div class="topic-metadata">

**Author:** [@KA3AXCTAH](https://discuss.elastic.co/u/KA3AXCTAH)\
**Replies:** 38\
**Last updated:** [May 12, 2021, 8:35am UTC](https://discuss.elastic.co/t/unnable-to-list-snapshots-in-elasticsearch-repository/271425 "2021-05-12T08:35:15Z")

</div>

I have an Elasticsearch snapshot repository configured to folder on NFS share, and i'm unable to do list snapshots because of strange errors curl -X GET "10.0.1.159:9200/\_cat/snapshots/temp\_elastic\_backup?v&s=id&pretty"…

---

## [Access Logsatsh via HTTPS](https://discuss.elastic.co/t/access-logsatsh-via-https/272780)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 0\
**Last updated:** [May 12, 2021, 8:18am UTC](https://discuss.elastic.co/t/access-logsatsh-via-https/272780 "2021-05-12T08:18:27Z")

</div>

Hello, I would like to monitor Logstash with Metricbeat, and TLS is activated in all my cluster (beats, kibana, Elasticsearch) that's why why I run metricbeat, I get an error: error making http request: Get "https://10…

---

## [Config File doesn't work](https://discuss.elastic.co/t/config-file-doesnt-work/272712)

<div class="topic-metadata">

**Author:** [@qttv](https://discuss.elastic.co/u/qttv)\
**Replies:** 3\
**Last updated:** [May 12, 2021, 7:32am UTC](https://discuss.elastic.co/t/config-file-doesnt-work/272712 "2021-05-12T07:32:26Z")

</div>

Good evening. I'm trying to run Logstash for the first time. I already downloaded and runned with success ElasticSearch and Kibana. I created the config file named "logstash-simple.conf" following the istructions on th…

---

## [Node not joining Elasticsearch cluster](https://discuss.elastic.co/t/node-not-joining-elasticsearch-cluster/272667)

<div class="topic-metadata">

**Author:** [@ravi-shanker](https://discuss.elastic.co/u/ravi-shanker)\
**Replies:** 8\
**Last updated:** [May 12, 2021, 7:33am UTC](https://discuss.elastic.co/t/node-not-joining-elasticsearch-cluster/272667 "2021-05-12T07:33:04Z")

</div>

I have made an Elasticsearch cluster of 3 nodes but one of the node is not joining the cluster. Below are my elasticsearch.yml file for all 3 nodes. NODE1 cluster.name: ES-Cluster node.name: node-1 node.master: true …

---

## [Access policy issue](https://discuss.elastic.co/t/access-policy-issue/272761)

<div class="topic-metadata">

**Author:** [@ANSON\_SHAJI](https://discuss.elastic.co/u/ANSON_SHAJI)\
**Replies:** 2\
**Last updated:** [May 12, 2021, 7:04am UTC](https://discuss.elastic.co/t/access-policy-issue/272761 "2021-05-12T07:04:53Z")

</div>

Hi, I created an elastic search domain using amplify framework using the @searchable method. It creates a domain in elastic search. But I can't able to modify the access policy to allow open access to the domain. There …

---

## [Import Canvas to dashboard](https://discuss.elastic.co/t/import-canvas-to-dashboard/272684)

<div class="topic-metadata">

**Author:** [@Mik\_a](https://discuss.elastic.co/u/Mik_a)\
**Replies:** 3\
**Last updated:** [May 12, 2021, 6:56am UTC](https://discuss.elastic.co/t/import-canvas-to-dashboard/272684 "2021-05-12T06:56:31Z")

</div>

I need images and custom icons in the dashboard. In the canvas editor I can do that. However, is it possible to import the canvas to a dashboard?

---

## [Elastic Index Allocation](https://discuss.elastic.co/t/elastic-index-allocation/272222)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 7\
**Last updated:** [May 7, 2021, 5:41am UTC](https://discuss.elastic.co/t/elastic-index-allocation/272222 "2021-05-07T05:41:54Z")

</div>

We have typical deployment of 5000 users per server. We are planning to use Elasticsearch for indexing new data onwards. Our earlier indexing engine was having provision to map one index with one user. It was easier to r…

---

## [Doubt in query](https://discuss.elastic.co/t/doubt-in-query/272759)

<div class="topic-metadata">

**Author:** [@ANSON\_SHAJI](https://discuss.elastic.co/u/ANSON_SHAJI)\
**Replies:** 1\
**Last updated:** [May 12, 2021, 5:56am UTC](https://discuss.elastic.co/t/doubt-in-query/272759 "2021-05-12T05:56:27Z")

</div>

Hi, I have an index named product in elastic search. Each document contains an attribute field. This is shown below. { "category": "xyx", "name": "product-1", "attribute": \[ { "unit": "mm", "name": "Length", "va…

---

## [Exclude weekends(Saturdays and Sundays) from my dashboard view](https://discuss.elastic.co/t/exclude-weekends-saturdays-and-sundays-from-my-dashboard-view/272757)

<div class="topic-metadata">

**Author:** [@mohanss08](https://discuss.elastic.co/u/mohanss08)\
**Replies:** 10\
**Last updated:** [May 12, 2021, 4:31am UTC](https://discuss.elastic.co/t/exclude-weekends-saturdays-and-sundays-from-my-dashboard-view/272757 "2021-05-12T04:31:26Z")

</div>

I am using ELK – 7.12.1 version and currently I am looking for a way to filter-out the weekends(Saturdays and Sundays) from my dashboard view. On my Dashboard I have (Vertical Bar, Line, Data table, Pie & Gauge) chart v…

---

## [Can not connect to Elasticsearch from AngularJS](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-from-angularjs/271865)

<div class="topic-metadata">

**Author:** [@ANSON\_SHAJI](https://discuss.elastic.co/u/ANSON_SHAJI)\
**Replies:** 9\
**Last updated:** [May 12, 2021, 4:04am UTC](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-from-angularjs/271865 "2021-05-12T04:04:43Z")

</div>

Hi, I am using elastic search. I created a domain of elasticsearch. Is there is any way to connect the elastic search from my Angular 11. I used the elasticsearch.js library, but I can't able to connect with it for doi…

---

## [Mapping es.mapping.id](https://discuss.elastic.co/t/mapping-es-mapping-id/272755)

<div class="topic-metadata">

**Author:** [@Gokul6](https://discuss.elastic.co/u/Gokul6)\
**Replies:** 10\
**Last updated:** [May 12, 2021, 3:10am UTC](https://discuss.elastic.co/t/mapping-es-mapping-id/272755 "2021-05-12T03:10:42Z")

</div>

i am reading the data from an elasticsearch index, processing it using spark and finally loading it into a new elasticsearch index. while processing the data i am grouping the data using date(day wise) and driverPkid co…

---

## [How to add a specific key to a field from a JSON format part](https://discuss.elastic.co/t/how-to-add-a-specific-key-to-a-field-from-a-json-format-part/272384)

<div class="topic-metadata">

**Author:** [@its-ogawa](https://discuss.elastic.co/u/its-ogawa)\
**Replies:** 3\
**Last updated:** [May 12, 2021, 3:05am UTC](https://discuss.elastic.co/t/how-to-add-a-specific-key-to-a-field-from-a-json-format-part/272384 "2021-05-12T03:05:04Z")

</div>

I was able to get a JSON part from a message in grok. I want to keep a specific key from the JSON part in a field, how can I do that? target log: ... snip ... { ... snip ..., "api\_code":"40216", ... snip ... } ... sni…

---

## [Conditional with regex failing](https://discuss.elastic.co/t/conditional-with-regex-failing/272743)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 5\
**Last updated:** [May 12, 2021, 2:22am UTC](https://discuss.elastic.co/t/conditional-with-regex-failing/272743 "2021-05-12T02:22:22Z")

</div>

Hi Im trying to replace a value whenever the the characters ":" are present in the category field, but I get an error, I tried to scape the colon, but I get an error too if \[category\] =~ /:\\\\/ { mutate { replace =\> \[ "…

---

## [Logstash not capturing SNMP traps from remote machine](https://discuss.elastic.co/t/logstash-not-capturing-snmp-traps-from-remote-machine/272754)

<div class="topic-metadata">

**Author:** [@ssunkara](https://discuss.elastic.co/u/ssunkara)\
**Replies:** 0\
**Last updated:** [May 12, 2021, 1:33am UTC](https://discuss.elastic.co/t/logstash-not-capturing-snmp-traps-from-remote-machine/272754 "2021-05-12T01:33:22Z")

</div>

Hi, I have logstash configured with snmptrap input plugin on a CentOS7 machine. Below is my .conf file that I have at /etc/logstash/conf.d input { snmptrap { community =\> "public" port =\> 10…

---

## [How to recover cluster state red in K8s](https://discuss.elastic.co/t/how-to-recover-cluster-state-red-in-k8s/272420)

<div class="topic-metadata">

**Author:** [@dandelion](https://discuss.elastic.co/u/dandelion)\
**Replies:** 1\
**Last updated:** [May 12, 2021, 12:45am UTC](https://discuss.elastic.co/t/how-to-recover-cluster-state-red-in-k8s/272420 "2021-05-12T00:45:44Z")

</div>

We are using Elasticsearch along with Graylog. We have three replicas running. On the Graylog side I noticed that the Elasticsearch cluster status is red. Started to investigate, and noticed that we had run out of disk …

---

## [Regarding XPack Metric Collection with Beats](https://discuss.elastic.co/t/regarding-xpack-metric-collection-with-beats/272650)

<div class="topic-metadata">

**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\
**Replies:** 0\
**Last updated:** [May 11, 2021, 8:38am UTC](https://discuss.elastic.co/t/regarding-xpack-metric-collection-with-beats/272650 "2021-05-11T08:38:28Z")

</div>

Hi, I have configured metricbeat on a logstash instance to send xpack metrics to a remote elasticsearch cluster. The metrics are being shipped and indexed and are accessible via the kibana monitoring view. However, they…

---

## [Does snapshot lifecycle management track the deletion](https://discuss.elastic.co/t/does-snapshot-lifecycle-management-track-the-deletion/272651)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 1\
**Last updated:** [May 12, 2021, 12:23am UTC](https://discuss.elastic.co/t/does-snapshot-lifecycle-management-track-the-deletion/272651 "2021-05-12T00:23:52Z")

</div>

Hi, I just wanted to get this confirmed though I strongly feel that snapshot policy takes a backup only of an index. I have configured ILM to delete indices older than a week. Snapshot policy will be taking backups of …

---

## [Convert mapping in the table logstash](https://discuss.elastic.co/t/convert-mapping-in-the-table-logstash/272753)

<div class="topic-metadata">

**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\
**Replies:** 7\
**Last updated:** [May 11, 2021, 11:50pm UTC](https://discuss.elastic.co/t/convert-mapping-in-the-table-logstash/272753 "2021-05-11T23:50:12Z")

</div>

good, I need help with the mapping in logstash, I need to change certain metrics to integer, but the metrics go together in a table so it does not let me change them. I attach the configuration in logstash. input { ht…

---

## [Modsecurity logs to kibana dashboard](https://discuss.elastic.co/t/modsecurity-logs-to-kibana-dashboard/272726)

<div class="topic-metadata">

**Author:** [@Kenny188](https://discuss.elastic.co/u/Kenny188)\
**Replies:** 1\
**Last updated:** [May 11, 2021, 11:08pm UTC](https://discuss.elastic.co/t/modsecurity-logs-to-kibana-dashboard/272726 "2021-05-11T23:08:33Z")

</div>

HI , I'm currently working on WAF (web application firewall) ModSecurity , and I'm trying to forward the logs files of modsec into kibana so it can be visualise from there and be more untestable . My first time worki…

---

## [Unable to access s3 bucket(snapshot and restore)](https://discuss.elastic.co/t/unable-to-access-s3-bucket-snapshot-and-restore/272676)

<div class="topic-metadata">

**Author:** [@Yash\_Shukla](https://discuss.elastic.co/u/Yash_Shukla)\
**Replies:** 1\
**Last updated:** [May 11, 2021, 11:07pm UTC](https://discuss.elastic.co/t/unable-to-access-s3-bucket-snapshot-and-restore/272676 "2021-05-11T23:07:31Z")

</div>

Hello everyone, I am setting up an EFK cluster(elasticsearch-kibana-fluentd) in the AWS eks cluster. currently i am facing a problem with the snapshot and backup option present in the kibana console - followed followin…

---

## [Encrypted Communications reloading certificate](https://discuss.elastic.co/t/encrypted-communications-reloading-certificate/272686)

<div class="topic-metadata">

**Author:** [@ewolfman](https://discuss.elastic.co/u/ewolfman)\
**Replies:** 0\
**Last updated:** [May 11, 2021, 11:23am UTC](https://discuss.elastic.co/t/encrypted-communications-reloading-certificate/272686 "2021-05-11T11:23:33Z")

</div>

Hi, ES client allows loading the certificate for trust as described here. But what happens if the certificate changes? Is there a way to reload the certificate (e.g. recreate the sslContext context?) without having to …

---

## [Cluster node roles changed after rolling upgrade](https://discuss.elastic.co/t/cluster-node-roles-changed-after-rolling-upgrade/272685)

<div class="topic-metadata">

**Author:** [@Pyppe](https://discuss.elastic.co/u/Pyppe)\
**Replies:** 1\
**Last updated:** [May 11, 2021, 11:05pm UTC](https://discuss.elastic.co/t/cluster-node-roles-changed-after-rolling-upgrade/272685 "2021-05-11T23:05:23Z")

</div>

Hi! We did a rolling upgrade from version 7.6.1 to 7.12.1 as documented in Rolling upgrades | Elasticsearch Guide \[7.12\] | Elastic. We have three nodes in our cluster. Before the upgrade each node had roles dilm, but af…

---

## [Unable to find valid certification path to requested target](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/272692)

<div class="topic-metadata">

**Author:** [@osher.l](https://discuss.elastic.co/u/osher.l)\
**Replies:** 0\
**Last updated:** [May 11, 2021, 12:06pm UTC](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/272692 "2021-05-11T12:06:38Z")

</div>

We have ELK stack on Kubernetes(version 7.0.0), Logstash is failing to interact with elasticsearch with the following warning and errors, all other components like filebeat and kibana are well functioning. \[2021-05-11T1…

---

## [Documents not showing Discover, show in queries and document counts](https://discuss.elastic.co/t/documents-not-showing-discover-show-in-queries-and-document-counts/272740)

<div class="topic-metadata">

**Author:** [@LoganS](https://discuss.elastic.co/u/LoganS)\
**Replies:** 2\
**Last updated:** [May 11, 2021, 8:35pm UTC](https://discuss.elastic.co/t/documents-not-showing-discover-show-in-queries-and-document-counts/272740 "2021-05-11T20:35:01Z")

</div>

I have some documents that were created via Elastic's REST API. When logged into Kibana to view these records, I am able to see them in the results using a GET or PUT request in Dev Tools and in the document count for t…

---

## [How the \_source field helps in snapshot](https://discuss.elastic.co/t/how-the-source-field-helps-in-snapshot/272725)

<div class="topic-metadata">

**Author:** [@Abhishek\_Shinde](https://discuss.elastic.co/u/Abhishek_Shinde)\
**Replies:** 3\
**Last updated:** [May 11, 2021, 8:19pm UTC](https://discuss.elastic.co/t/how-the-source-field-helps-in-snapshot/272725 "2021-05-11T20:19:51Z")

</div>

Hey Guys, I would need to know how the \_source field helps in the Snapshot and Restore scenario?

---

## [Automatically visualize data on kibana from input?](https://discuss.elastic.co/t/automatically-visualize-data-on-kibana-from-input/271613)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 14\
**Last updated:** [May 11, 2021, 7:41pm UTC](https://discuss.elastic.co/t/automatically-visualize-data-on-kibana-from-input/271613 "2021-05-11T19:41:03Z")

</div>

I'm wondering if there's a way to automatically visualize data on KIBANA. ? My logstash will receive frequent new inputs, and i need to know if there's way to automatically create dashboards ? may be a way to define in…

---

## [Metricbeat-\* vs metrics-\*](https://discuss.elastic.co/t/metricbeat-vs-metrics/272612)

<div class="topic-metadata">

**Author:** [@muhdiekuh](https://discuss.elastic.co/u/muhdiekuh)\
**Replies:** 3\
**Last updated:** [May 11, 2021, 7:06pm UTC](https://discuss.elastic.co/t/metricbeat-vs-metrics/272612 "2021-05-11T19:06:51Z")

</div>

I noticed that these days there are index patterns & dashboards for both metricbeat-\* and metrics-\*. What's that about? I'm using logstash to ingest the data into elasticsearch, so my data goes into the metricbeat-\* ind…

---

## [Add message\_length field](https://discuss.elastic.co/t/add-message-length-field/272737)

<div class="topic-metadata">

**Author:** [@lag](https://discuss.elastic.co/u/lag)\
**Replies:** 2\
**Last updated:** [May 11, 2021, 6:39pm UTC](https://discuss.elastic.co/t/add-message-length-field/272737 "2021-05-11T18:39:40Z")

</div>

I am trying to add calculated "message\_length" field that would be a representation on character count in "message" field. Info is coming in from winlogbeat/filebeat/syslog if that makes any difference. This is the code…

---

## [ES 7.12 - Different analyzers are getting used for indexing and searching](https://discuss.elastic.co/t/es-7-12-different-analyzers-are-getting-used-for-indexing-and-searching/272186)

<div class="topic-metadata">

**Author:** [@justramesh2000](https://discuss.elastic.co/u/justramesh2000)\
**Replies:** 3\
**Last updated:** [May 11, 2021, 6:23pm UTC](https://discuss.elastic.co/t/es-7-12-different-analyzers-are-getting-used-for-indexing-and-searching/272186 "2021-05-11T18:23:25Z")

</div>

Hello, I have an interesting issue to report for ES 7.12. For one of the dynamically indexed field the analyzer used for indexing is "ngram" but for searching its "standard". I am not sure if this is a bug or an intended…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1418)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1420)
