# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=217 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 218 --- ## [GCS Input not working as expected](https://discuss.elastic.co/t/gcs-input-not-working-as-expected/361713)
**Author:** [@Random\_BB](https://discuss.elastic.co/u/Random_BB)\ **Replies:** 5\ **Last updated:** [June 20, 2024, 7:17am UTC](https://discuss.elastic.co/t/gcs-input-not-working-as-expected/361713 "2024-06-20T07:17:24Z")
I have an AWS Domain to which I am trying to Ingest Json codec files from GCS bucket using Logstash. I can see a log stating that my logstash has connected to domain and a few other logs stating it is trying to fetch log… --- ## [Logstash stopped processing because of an error](https://discuss.elastic.co/t/logstash-stopped-processing-because-of-an-error/361716)
**Author:** [@SIM\_Vik](https://discuss.elastic.co/u/SIM_Vik)\ **Replies:** 4\ **Last updated:** [June 20, 2024, 7:02am UTC](https://discuss.elastic.co/t/logstash-stopped-processing-because-of-an-error/361716 "2024-06-20T07:02:56Z")
I tried many solutions from other topics, but they didn’t help me. I installed logstash, wrote conf and now logstash can’t start, what am I doing wrong. I run logstash via systemctl logstash-plain.log \[2024-06-19T11… --- ## [After enabling xpack security readinessprobe fails](https://discuss.elastic.co/t/after-enabling-xpack-security-readinessprobe-fails/361625)
**Author:** [@laurijssen](https://discuss.elastic.co/u/laurijssen)\ **Replies:** 3\ **Last updated:** [June 20, 2024, 6:14am UTC](https://discuss.elastic.co/t/after-enabling-xpack-security-readinessprobe-fails/361625 "2024-06-20T06:14:30Z")
I've got elk stack running through helm without security but now I was aked to turn it on. So I generated certificates with elastic-certutil and put them in a secret and changed the config into esConfig: elasticsearc… --- ## [How to generate a metric index from a Nginx log(or similar) index?](https://discuss.elastic.co/t/how-to-generate-a-metric-index-from-a-nginx-log-or-similar-index/361769)
**Author:** [@gzOne2Free](https://discuss.elastic.co/u/gzOne2Free)\ **Replies:** 0\ **Last updated:** [June 20, 2024, 5:27am UTC](https://discuss.elastic.co/t/how-to-generate-a-metric-index-from-a-nginx-log-or-similar-index/361769 "2024-06-20T05:27:11Z")
Hi there, I have an index which store Nginx access log. I am able to create a Kibana dashboard to visualize the response time, 4XX, 5XX and other KPIs for a website. A dashboard visualization can do the aggregation like… --- ## [Index Permission blocking ingestion of the whole pipeline](https://discuss.elastic.co/t/index-permission-blocking-ingestion-of-the-whole-pipeline/361189)
**Author:** [@Perry\_Lam](https://discuss.elastic.co/u/Perry_Lam)\ **Replies:** 7\ **Last updated:** [June 19, 2024, 3:30pm UTC](https://discuss.elastic.co/t/index-permission-blocking-ingestion-of-the-whole-pipeline/361189 "2024-06-19T15:30:15Z")
Hi, My Logstash containers stopped their ingestion when one index pattern is not permitted in ESS. Code (simplified): output { opensearch { id =\> "oss\_output\_cluster-unknown" hosts =\> \[… --- ## [Failed to determine the health of the cluster when creating enrollment token](https://discuss.elastic.co/t/failed-to-determine-the-health-of-the-cluster-when-creating-enrollment-token/361679)
**Author:** [@HallMonitor](https://discuss.elastic.co/u/HallMonitor)\ **Replies:** 5\ **Last updated:** [June 19, 2024, 11:48pm UTC](https://discuss.elastic.co/t/failed-to-determine-the-health-of-the-cluster-when-creating-enrollment-token/361679 "2024-06-19T23:48:42Z")
sudo /usr/share/elasticsearch/bin/elasticsearch-create-enrollment-token -s node ERROR: Failed to determine the health of the cluster. , with exit code 69 Only configuration change so far is the setup of ReadOnlyRest. … --- ## [Transport ssl cannot read configured](https://discuss.elastic.co/t/transport-ssl-cannot-read-configured/361705)
**Author:** [@VijayIQA](https://discuss.elastic.co/u/VijayIQA)\ **Replies:** 1\ **Last updated:** [June 19, 2024, 11:42pm UTC](https://discuss.elastic.co/t/transport-ssl-cannot-read-configured/361705 "2024-06-19T23:42:28Z")
Hi Team, Created pk12 certification for http and transport as like below steps: openssl genrsa -out elastic\_private\_key.pem 2048 openssl req -new -key elastic\_private\_key.pem -out elastic\_csr.pem openssl x509 -req -day… --- ## [Index not showing up in Kibana while using Logstash](https://discuss.elastic.co/t/index-not-showing-up-in-kibana-while-using-logstash/361717)
**Author:** [@dou07](https://discuss.elastic.co/u/dou07)\ **Replies:** 6\ **Last updated:** [June 19, 2024, 10:46pm UTC](https://discuss.elastic.co/t/index-not-showing-up-in-kibana-while-using-logstash/361717 "2024-06-19T22:46:07Z")
Hello everyone, I want to load a json file into elasticsearch using Logstash. I am following all the steps but the index is still not showing up in Kibana. For reference, this is my Logstash configuration file : input… --- ## [Kibana data node monitoring stops after five minutes](https://discuss.elastic.co/t/kibana-data-node-monitoring-stops-after-five-minutes/361674)
**Author:** [@mbby](https://discuss.elastic.co/u/mbby)\ **Replies:** 6\ **Last updated:** [June 19, 2024, 7:57pm UTC](https://discuss.elastic.co/t/kibana-data-node-monitoring-stops-after-five-minutes/361674 "2024-06-19T19:57:07Z")
I've a cluster with five nodes, running 8.4.1. One of the nodes had write rejections. We restarted the node and everything went back to a working state. But after five minutes no monitoring data was displayed anymore. … --- ## [Get user.name from user.id in Entity Analytics Azure Entra ID dataset](https://discuss.elastic.co/t/get-user-name-from-user-id-in-entity-analytics-azure-entra-id-dataset/359019)
**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\ **Replies:** 5\ **Last updated:** [June 19, 2024, 7:25pm UTC](https://discuss.elastic.co/t/get-user-name-from-user-id-in-entity-analytics-azure-entra-id-dataset/359019 "2024-06-19T19:25:20Z")
Hello, So now we have the entity analytics, is it on Elastic's to do to enrich certain datasets with the real user.name from the user.id ? For example in the Azure Graph API logs only a user.id field is known. The user… --- ## [Get a list of all available language analyzers?](https://discuss.elastic.co/t/get-a-list-of-all-available-language-analyzers/361752)
**Author:** [@mrodent](https://discuss.elastic.co/u/mrodent)\ **Replies:** 1\ **Last updated:** [June 19, 2024, 5:30pm UTC](https://discuss.elastic.co/t/get-a-list-of-all-available-language-analyzers/361752 "2024-06-19T17:30:06Z")
Asked 10 years ago. The "command" or "index" or whatever it was, "sgen", either appears no longer to exist, or no longer to work that way. I'm doing a project where users should be able to stipulate "set of such and suc… --- ## [Component template](https://discuss.elastic.co/t/component-template/361677)
**Author:** [@Kishore\_Pothireddy1](https://discuss.elastic.co/u/Kishore_Pothireddy1)\ **Replies:** 2\ **Last updated:** [June 19, 2024, 1:41pm UTC](https://discuss.elastic.co/t/component-template/361677 "2024-06-19T13:41:10Z")
How to reference the custom analyzer present in settings component template in mappings component template? I have created a component template for settings as shown below but creating a mappings component template that… --- ## [Deploy Elasticsearch free for PoC Testing/Development](https://discuss.elastic.co/t/deploy-elasticsearch-free-for-poc-testing-development/361727)
**Author:** [@b-m-s-west](https://discuss.elastic.co/u/b-m-s-west)\ **Replies:** 6\ **Last updated:** [June 19, 2024, 3:24pm UTC](https://discuss.elastic.co/t/deploy-elasticsearch-free-for-poc-testing-development/361727 "2024-06-19T15:24:55Z")
Using Elasticsearch for development of a PoC between three people. Are there any ways or suggestions to be able to deploy it for free beyond the free trail? Currently have tried the free VM on Azure and AWS, but the comp… --- ## [Issue with creating backup to s3](https://discuss.elastic.co/t/issue-with-creating-backup-to-s3/361701)
**Author:** [@Vakh](https://discuss.elastic.co/u/Vakh)\ **Replies:** 10\ **Last updated:** [June 19, 2024, 3:03pm UTC](https://discuss.elastic.co/t/issue-with-creating-backup-to-s3/361701 "2024-06-19T15:03:55Z")
Hello there! I will start by providing as many details as possible. First of all, I want to state that it is my first time working with Elastic and I do not know a lot. Now, in a company we have 3 EC2 instances, on wh… --- ## [Readiness probe failed when I apply SSL and saml on the data notes on the ECK cluster in AWS EKS cluster](https://discuss.elastic.co/t/readiness-probe-failed-when-i-apply-ssl-and-saml-on-the-data-notes-on-the-eck-cluster-in-aws-eks-cluster/360643)
**Author:** [@sunilyadav0201](https://discuss.elastic.co/u/sunilyadav0201)\ **Replies:** 0\ **Last updated:** [May 31, 2024, 5:56pm UTC](https://discuss.elastic.co/t/readiness-probe-failed-when-i-apply-ssl-and-saml-on-the-data-notes-on-the-eck-cluster-in-aws-eks-cluster/360643 "2024-05-31T17:56:44Z")
Hi, I am trying to apply the SSL and SAML configuration on my elastic cluster which is in aws EKS and created using ECK. I am running the cluster and have applied the SSL and SAML working but sometimes I am facing failu… --- ## [What's the recomendation when dealing with a index widely used?](https://discuss.elastic.co/t/whats-the-recomendation-when-dealing-with-a-index-widely-used/361741)
**Author:** [@SamuelSMendes](https://discuss.elastic.co/u/SamuelSMendes)\ **Replies:** 0\ **Last updated:** [June 19, 2024, 2:17pm UTC](https://discuss.elastic.co/t/whats-the-recomendation-when-dealing-with-a-index-widely-used/361741 "2024-06-19T14:17:26Z")
I have plans to centralize the indexes I use for a few reports. The plan is to have an index with little more than 2million documents; Short in size but still growing and is also highly searched within multiple Kibana sp… --- ## [Broken documentation link](https://discuss.elastic.co/t/broken-documentation-link/361735)
**Author:** [@Chenko](https://discuss.elastic.co/u/Chenko)\ **Replies:** 4\ **Last updated:** [June 19, 2024, 2:02pm UTC](https://discuss.elastic.co/t/broken-documentation-link/361735 "2024-06-19T14:02:54Z")
Hello, I have found a broken link in the documentation, here. Tested on Chrome & Firefox, both showed a broken page. Kr, Chenko --- ## [Rollover ELK](https://discuss.elastic.co/t/rollover-elk/360616)
**Author:** [@v.popov](https://discuss.elastic.co/u/v.popov)\ **Replies:** 7\ **Last updated:** [June 19, 2024, 1:59pm UTC](https://discuss.elastic.co/t/rollover-elk/360616 "2024-06-19T13:59:15Z")
Hello. Indexes from docker containers are coming to me from the server. Here is my filebeat.yml logging.to\_files: false logging.to\_syslog: false logging.to\_stderr: true #logging.level: debug setup.template: enabled: … --- ## [Parse date from @timestamp](https://discuss.elastic.co/t/parse-date-from-timestamp/361721)
**Author:** [@TasK](https://discuss.elastic.co/u/TasK)\ **Replies:** 3\ **Last updated:** [June 19, 2024, 11:27am UTC](https://discuss.elastic.co/t/parse-date-from-timestamp/361721 "2024-06-19T11:27:07Z")
Hello, I'm trying to replace the date in kibana with the date from the logfile, which gets pre-parsed with the json parser from filebeat and looks like this: { "@timestamp": "2024-06-19T10:00:00.469Z", "log.lev… --- ## [Getting 401 errors after accessing Kibana with OIDC](https://discuss.elastic.co/t/getting-401-errors-after-accessing-kibana-with-oidc/360474)
**Author:** [@juangar](https://discuss.elastic.co/u/juangar)\ **Replies:** 3\ **Last updated:** [June 19, 2024, 11:22am UTC](https://discuss.elastic.co/t/getting-401-errors-after-accessing-kibana-with-oidc/360474 "2024-06-19T11:22:07Z")
Hi team! We are running Elastic Search on GKE, and we're working in integrating with our organization's own IDaaS. We are using Anthos Service Mesh, and asm-user-auth to communicate with our internal OIDC provider. Afte… --- ## [Pipeline error - special characters are not allowed in reader](https://discuss.elastic.co/t/pipeline-error-special-characters-are-not-allowed-in-reader/360926)
**Author:** [@Bela\_Kovacs](https://discuss.elastic.co/u/Bela_Kovacs)\ **Replies:** 2\ **Last updated:** [June 7, 2024, 11:57am UTC](https://discuss.elastic.co/t/pipeline-error-special-characters-are-not-allowed-in-reader/360926 "2024-06-07T11:57:46Z")
Hello Logstash 7.11.1 starting with errors and not creating indices. It writes pipeline error - special characters are not allowed in reader, but I don't know which file and it's worked from 2021 but now it's stopped wi… --- ## [Logstash XML Filter Plugin - XML Parsing General Question](https://discuss.elastic.co/t/logstash-xml-filter-plugin-xml-parsing-general-question/360954)
**Author:** [@domino](https://discuss.elastic.co/u/domino)\ **Replies:** 6\ **Last updated:** [June 19, 2024, 11:04am UTC](https://discuss.elastic.co/t/logstash-xml-filter-plugin-xml-parsing-general-question/360954 "2024-06-19T11:04:02Z")
Hi all I need to parse all xml-elements on all hierarchies in millions of xml-files with logstash as pasted below and store them in separate json fields in Elasticsearch. One xml file shall end up in one json document i… --- ## [Trouble with errors when creating a snapshot](https://discuss.elastic.co/t/trouble-with-errors-when-creating-a-snapshot/361462)
**Author:** [@YUUTA.INOUE-JPN](https://discuss.elastic.co/u/YUUTA.INOUE-JPN)\ **Replies:** 13\ **Last updated:** [June 19, 2024, 9:40am UTC](https://discuss.elastic.co/t/trouble-with-errors-when-creating-a-snapshot/361462 "2024-06-19T09:40:26Z")
Hello from Japan I have a question for all the dear Elastic engineers I want to use the snapshot function to save a snapshot on one node in a cluster. \*I have configured a cluster of three Elasticsearch machines. I h… --- ## [Bin/elasticsearch-create-enrollment-token --scope kibana](https://discuss.elastic.co/t/bin-elasticsearch-create-enrollment-token-scope-kibana/361715)
**Author:** [@g0nz0](https://discuss.elastic.co/u/g0nz0)\ **Replies:** 0\ **Last updated:** [June 19, 2024, 9:00am UTC](https://discuss.elastic.co/t/bin-elasticsearch-create-enrollment-token-scope-kibana/361715 "2024-06-19T09:00:06Z")
Hello, I'm trying to get something called Elastiflow working. I'm newish to Docker and very new to the ELK setup. I've followed this: This is my docker compose file: When I go to http://192.168.100.100:5601/ I g… --- ## [Filebeat sent duplicate events after the log file renamed - Windows](https://discuss.elastic.co/t/filebeat-sent-duplicate-events-after-the-log-file-renamed-windows/361706)
**Author:** [@petertw6235](https://discuss.elastic.co/u/petertw6235)\ **Replies:** 0\ **Last updated:** [June 19, 2024, 7:25am UTC](https://discuss.elastic.co/t/filebeat-sent-duplicate-events-after-the-log-file-renamed-windows/361706 "2024-06-19T07:25:47Z")
hi, We found some duplicate events in Elasticsearch and those events were from the renamed log file. Filebeat version : 7.17 OS: Windows 2019 server Here is the filebeat log: 2024-05-28T09:02:42.320+0800 INFO \[input… --- ## [Filebeat not sending logs to Eventhub](https://discuss.elastic.co/t/filebeat-not-sending-logs-to-eventhub/361704)
**Author:** [@Pavani\_Reddy](https://discuss.elastic.co/u/Pavani_Reddy)\ **Replies:** 0\ **Last updated:** [June 19, 2024, 7:20am UTC](https://discuss.elastic.co/t/filebeat-not-sending-logs-to-eventhub/361704 "2024-06-19T07:20:24Z")
Hello Team, I have a filebeat configuration on source VM, which is configured to send application logs to eventhub. It was fine for somedays, suddenly the logs are not shipped to eventhub, and we have checked the fileb… --- ## [Changing elasticsearch/kibana IP address](https://discuss.elastic.co/t/changing-elasticsearch-kibana-ip-address/361233)
**Author:** [@maissam\_asgari](https://discuss.elastic.co/u/maissam_asgari)\ **Replies:** 8\ **Last updated:** [June 19, 2024, 7:03am UTC](https://discuss.elastic.co/t/changing-elasticsearch-kibana-ip-address/361233 "2024-06-19T07:03:08Z")
Hello everyone I've been searching and trying every manual on Internet for this issue, but at end, couldn't resolve the problem. I installed elasticsearch/kibana via the manual here from debian packages. guide/en/elas… --- ## [Watcher showing security\_exception error](https://discuss.elastic.co/t/watcher-showing-security-exception-error/361393)
**Author:** [@Sayali](https://discuss.elastic.co/u/Sayali)\ **Replies:** 4\ **Last updated:** [June 19, 2024, 6:47am UTC](https://discuss.elastic.co/t/watcher-showing-security-exception-error/361393 "2024-06-19T06:47:28Z")
Hello, I have been facing an issue with some watchers regarding role privileges due to which the watchers don't trigger and show error. But I have superuser privileges. "result": { "execution\_time": "2024-06-13T07:… --- ## [Which index is exceeding the total\_fields limit?](https://discuss.elastic.co/t/which-index-is-exceeding-the-total-fields-limit/361697)
**Author:** [@Nithesh\_Balaji\_D](https://discuss.elastic.co/u/Nithesh_Balaji_D)\ **Replies:** 2\ **Last updated:** [June 19, 2024, 6:38am UTC](https://discuss.elastic.co/t/which-index-is-exceeding-the-total-fields-limit/361697 "2024-06-19T06:38:27Z")
We're encountering an issue with our Elasticsearch pods: The error message we're seeing is: \[Limit of total fields \[1000\] has been exceeded while adding new fields \[644\]\], which is causing Fluentd to partially upload lo… --- ## [Linux Agent failing to get local metrics with certificate authority error](https://discuss.elastic.co/t/linux-agent-failing-to-get-local-metrics-with-certificate-authority-error/361693)
**Author:** [@Ross\_Wakelin](https://discuss.elastic.co/u/Ross_Wakelin)\ **Replies:** 0\ **Last updated:** [June 19, 2024, 5:25am UTC](https://discuss.elastic.co/t/linux-agent-failing-to-get-local-metrics-with-certificate-authority-error/361693 "2024-06-19T05:25:23Z")
We are rebuilding our cluster using 8.14.1, and decided to change our configuration to match the latest and greatest. We have fleet servers and agents, and all our certificates are generated using our in-house CA - we D… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=216) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=218)