# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1123

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1124

---

## [Enabling Security X-Pack errors](https://discuss.elastic.co/t/enabling-security-x-pack-errors/292216)

<div class="topic-metadata">

**Author:** [@userR](https://discuss.elastic.co/u/userR)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 9:38pm UTC](https://discuss.elastic.co/t/enabling-security-x-pack-errors/292216 "2021-12-16T21:38:57Z")

</div>

\# ---------------------------------- Cluster ----------------------------------- # # Use a descriptive name for your cluster: # cluster.name: test-application # # ------------------------------------ Node ---------------…

---

## [Sending data to TCP socket server on connect using logstash](https://discuss.elastic.co/t/sending-data-to-tcp-socket-server-on-connect-using-logstash/292221)

<div class="topic-metadata">

**Author:** [@Bobby\_Maine](https://discuss.elastic.co/u/Bobby_Maine)\
**Replies:** 0\
**Last updated:** [December 16, 2021, 8:40pm UTC](https://discuss.elastic.co/t/sending-data-to-tcp-socket-server-on-connect-using-logstash/292221 "2021-12-16T20:40:05Z")

</div>

Hi - I have a question that are two parts I am trying to configure logstash as a tcp socket client and have to send a message to the socket server each time the the socket client connects All messages sent and rece…

---

## [Libbeat or Official Beat Delivery Guarantees with Logstash Ingest?](https://discuss.elastic.co/t/libbeat-or-official-beat-delivery-guarantees-with-logstash-ingest/292220)

<div class="topic-metadata">

**Author:** [@benatsb](https://discuss.elastic.co/u/benatsb)\
**Replies:** 0\
**Last updated:** [December 16, 2021, 8:35pm UTC](https://discuss.elastic.co/t/libbeat-or-official-beat-delivery-guarantees-with-logstash-ingest/292220 "2021-12-16T20:35:42Z")

</div>

Hello, I'm looking for an overview and in-depth details on elastic beat delivery guarantees including queuing with Logstash, but information is hard to find... I have only been able to find information regarding Filebe…

---

## [Problem witch characters "ãˆ°ãˆ±â´±ãˆ­ã„¶ã„¶ã„°" in field Message](https://discuss.elastic.co/t/problem-witch-characters-a-a-a-a-a-a-a-in-field-message/292214)

<div class="topic-metadata">

**Author:** [@Adixon\_Diaz](https://discuss.elastic.co/u/Adixon_Diaz)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 8:17pm UTC](https://discuss.elastic.co/t/problem-witch-characters-a-a-a-a-a-a-a-in-field-message/292214 "2021-12-16T20:17:45Z")

</div>

Hi Elastic team, I have problem with some insertion in my logstash. I recieve a lot of row by second and some event give me "\_dateparsefailure" i could see in debug mode that this issue es when the field message come th…

---

## [Elastic cloud - Cluster failing to restart - log4j JVM security issue](https://discuss.elastic.co/t/elastic-cloud-cluster-failing-to-restart-log4j-jvm-security-issue/292058)

<div class="topic-metadata">

**Author:** [@Ralph\_v](https://discuss.elastic.co/u/Ralph_v)\
**Replies:** 5\
**Last updated:** [December 16, 2021, 7:50pm UTC](https://discuss.elastic.co/t/elastic-cloud-cluster-failing-to-restart-log4j-jvm-security-issue/292058 "2021-12-16T19:50:06Z")

</div>

Hello there, Is anyone else experiencing problems restarting their older version \<7.2 elastic cloud cluster? I am following the recommendation for the Log4j vulnerability, which is for cloud users to restart their clus…

---

## ["GET \_cat/indices" does not output all the indices](https://discuss.elastic.co/t/get-cat-indices-does-not-output-all-the-indices/292096)

<div class="topic-metadata">

**Author:** [@raulk89](https://discuss.elastic.co/u/raulk89)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 7:24pm UTC](https://discuss.elastic.co/t/get-cat-indices-does-not-output-all-the-indices/292096 "2021-12-16T19:24:18Z")

</div>

Hi Elastic, kibana 7.15.1 This gives me 31 rows (30 indices in total and first row for heading) GET \_cat/indices/\*?v&s=index:desc health status index uuid pri rep docs.coun…

---

## [Delete log4j-api-2.11.1.jar - CVE-2021-44228 - ESA-2021-31](https://discuss.elastic.co/t/delete-log4j-api-2-11-1-jar-cve-2021-44228-esa-2021-31/291711)

<div class="topic-metadata">

**Author:** [@Rnx](https://discuss.elastic.co/u/Rnx)\
**Replies:** 3\
**Last updated:** [December 16, 2021, 6:18pm UTC](https://discuss.elastic.co/t/delete-log4j-api-2-11-1-jar-cve-2021-44228-esa-2021-31/291711 "2021-12-16T18:18:16Z")

</div>

Hi, yes, the vulnurability... Shell I delete file "log4j-api-2.11.1.jar" from Elasticsearch folder in Linux installation after the package was updated to 7.16.1? The reason to ask is, the server will get several securi…

---

## [Elastic Agent/Fleet Limit how many agents get a policy update at once](https://discuss.elastic.co/t/elastic-agent-fleet-limit-how-many-agents-get-a-policy-update-at-once/292175)

<div class="topic-metadata">

**Author:** [@BenB196](https://discuss.elastic.co/u/BenB196)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 6:14pm UTC](https://discuss.elastic.co/t/elastic-agent-fleet-limit-how-many-agents-get-a-policy-update-at-once/292175 "2021-12-16T18:14:12Z")

</div>

Hi All, I was wondering if there is a way to limit the number of agents that can pull an updated policy at once? The reason for this, is I have noticed that in large deployments where I perform a policy update (i.e.: a…

---

## [Only title/first row get inserted in in elasticsearch](https://discuss.elastic.co/t/only-title-first-row-get-inserted-in-in-elasticsearch/292119)

<div class="topic-metadata">

**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 6:10pm UTC](https://discuss.elastic.co/t/only-title-first-row-get-inserted-in-in-elasticsearch/292119 "2021-12-16T18:10:26Z")

</div>

Hello team, I am sending data to Elasticsearch , I have .log files which containes below data. But Only title/first row get inserted in in Elasticsearch Sample log: Server Started Timestamp SeverityID EventID Severity…

---

## [Extract domain with grok](https://discuss.elastic.co/t/extract-domain-with-grok/292172)

<div class="topic-metadata">

**Author:** [@vladislav](https://discuss.elastic.co/u/vladislav)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 5:31pm UTC](https://discuss.elastic.co/t/extract-domain-with-grok/292172 "2021-12-16T17:31:17Z")

</div>

Hello! I have the following logs, with field "destination" looks like one of those: s03.amazon.com a63.google.com ayndex.cc s23.a4.test.com test.google.co.uk Is it possible by Grok filter in Logstash, or maybe other w…

---

## [Optional text + field RegEx with filters in Logstash](https://discuss.elastic.co/t/optional-text-field-regex-with-filters-in-logstash/292151)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 5:17pm UTC](https://discuss.elastic.co/t/optional-text-field-regex-with-filters-in-logstash/292151 "2021-12-16T17:17:54Z")

</div>

Hello! how can i set a text I use as locator as optioanal with regular expresions or grok ?? For example : 2021-12-15 13:50:34,589 INFO Parámetros enviados a XXXXXX: accion : YYYYYYYYYYY mesNacimiento : YYYYYYYYYY…

---

## [Problem java while upgrading elasticsearch 7.9.3 to 7.16](https://discuss.elastic.co/t/problem-java-while-upgrading-elasticsearch-7-9-3-to-7-16/292197)

<div class="topic-metadata">

**Author:** [@sdesseaux](https://discuss.elastic.co/u/sdesseaux)\
**Replies:** 0\
**Last updated:** [December 16, 2021, 5:13pm UTC](https://discuss.elastic.co/t/problem-java-while-upgrading-elasticsearch-7-9-3-to-7-16/292197 "2021-12-16T17:13:28Z")

</div>

Hello, I've problem while upgrading elasticsearch 7.9.3 to 7.16. I've this message " could not find java in bundled JDK at /usr/share/elasticsearch/jdk/bin/java" But things seems to be OK java -version openjdk ve…

---

## [Kibana 7.16.1 plugin installation](https://discuss.elastic.co/t/kibana-7-16-1-plugin-installation/292047)

<div class="topic-metadata">

**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 4:40pm UTC](https://discuss.elastic.co/t/kibana-7-16-1-plugin-installation/292047 "2021-12-16T16:40:47Z")

</div>

Hello there, I am updating my Elasticstack from 7.13.3 to 7.16.1 due to apache Log4j2 vulnerability. Now I have a custom plugin which is compatible with 7.13.3. I assume it should be compatible with 7.16.1. can I just…

---

## [Grouping by a field and getting documents with lowest value for a given property](https://discuss.elastic.co/t/grouping-by-a-field-and-getting-documents-with-lowest-value-for-a-given-property/292185)

<div class="topic-metadata">

**Author:** [@jgmullor](https://discuss.elastic.co/u/jgmullor)\
**Replies:** 0\
**Last updated:** [December 16, 2021, 4:33pm UTC](https://discuss.elastic.co/t/grouping-by-a-field-and-getting-documents-with-lowest-value-for-a-given-property/292185 "2021-12-16T16:33:50Z")

</div>

Hello! I am trying to find in an index that contains multiple documents related to courses, having a structure like: \[ { "course\_id":"ADE778", "subscriptions":91, "source":"page1.com" }, { …

---

## [Multiple values in field json parser](https://discuss.elastic.co/t/multiple-values-in-field-json-parser/290530)

<div class="topic-metadata">

**Author:** [@svenvg93](https://discuss.elastic.co/u/svenvg93)\
**Replies:** 3\
**Last updated:** [December 16, 2021, 4:12pm UTC](https://discuss.elastic.co/t/multiple-values-in-field-json-parser/290530 "2021-12-16T16:12:17Z")

</div>

In order to learn more about ELK, I try to combine it with fun stuff to build :slight\_smile: . On of the things I try to make is dashboard with Formula 1 data. Im able to get the data in Elasticsearch by curl an json a…

---

## [Logstash substring a field using position getting error](https://discuss.elastic.co/t/logstash-substring-a-field-using-position-getting-error/292157)

<div class="topic-metadata">

**Author:** [@aeoker](https://discuss.elastic.co/u/aeoker)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 4:10pm UTC](https://discuss.elastic.co/t/logstash-substring-a-field-using-position-getting-error/292157 "2021-12-16T16:10:13Z")

</div>

Hello Everyone, I am getting below error while trying to produce new event from existing one as follows, any help? ruby { code =\> "event\['new\_field'\] = event.get\['dummy'\]\[1..4\]" } Error: Ruby exception occurred:…

---

## [Log4j security vulnerability and plugins which bundle / vendor dependencies](https://discuss.elastic.co/t/log4j-security-vulnerability-and-plugins-which-bundle-vendor-dependencies/291537)

<div class="topic-metadata">

**Author:** [@Kami](https://discuss.elastic.co/u/Kami)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 4:02pm UTC](https://discuss.elastic.co/t/log4j-security-vulnerability-and-plugins-which-bundle-vendor-dependencies/291537 "2021-12-16T16:02:59Z")

</div>

(this post has been moved from Zero-day-exploit in log4j2 which is part of elasticsearch - #25 by Kami) Dear logstash community, I would like to better understand on how log4j vulnerability affects logstash plugins whi…

---

## [Ask for a help. Does the logstash output s3 plugin support getting data from Kafka?](https://discuss.elastic.co/t/ask-for-a-help-does-the-logstash-output-s3-plugin-support-getting-data-from-kafka/292084)

<div class="topic-metadata">

**Author:** [@shaojielinux](https://discuss.elastic.co/u/shaojielinux)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 3:53pm UTC](https://discuss.elastic.co/t/ask-for-a-help-does-the-logstash-output-s3-plugin-support-getting-data-from-kafka/292084 "2021-12-16T15:53:15Z")

</div>

Ask for a help. Does the logstash output s3 plugin support getting data from Kafka? Below is my configuration input { kafka { bootstrap\_servers =\> "10.88.14.172:9092,10.88.6.9:9092,10.88.10.166:9092" #topics =\> \["k8s…

---

## [Combining two events in one to calculate time difference](https://discuss.elastic.co/t/combining-two-events-in-one-to-calculate-time-difference/292155)

<div class="topic-metadata">

**Author:** [@mangeshmj1992](https://discuss.elastic.co/u/mangeshmj1992)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 3:35pm UTC](https://discuss.elastic.co/t/combining-two-events-in-one-to-calculate-time-difference/292155 "2021-12-16T15:35:54Z")

</div>

Hello team, I have case where information is being displayed in different lines. These lines are not even consecutive lines. Unique field is log\_processed.companyId. I have to display time difference between entry and e…

---

## [Pipeline.ecs\_compatibility WARN logs](https://discuss.elastic.co/t/pipeline-ecs-compatibility-warn-logs/292164)

<div class="topic-metadata">

**Author:** [@adizalmanovich](https://discuss.elastic.co/u/adizalmanovich)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 3:27pm UTC](https://discuss.elastic.co/t/pipeline-ecs-compatibility-warn-logs/292164 "2021-12-16T15:27:34Z")

</div>

I have some question. I upgraded my ELK to 7.16.1 due to a Log4j2 security issue. In my logstash configuration, we are using to get input from Azure EventHub and Kubernetes cluster. after upgraded my ELK I am getting h…

---

## [Logstash stopped processing because of an error: (SystemExit) exit](https://discuss.elastic.co/t/logstash-stopped-processing-because-of-an-error-systemexit-exit/291997)

<div class="topic-metadata">

**Author:** [@sama.sowjanya](https://discuss.elastic.co/u/sama.sowjanya)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 3:10pm UTC](https://discuss.elastic.co/t/logstash-stopped-processing-because-of-an-error-systemexit-exit/291997 "2021-12-16T15:10:49Z")

</div>

Hi I am getting the error when I run the config file through 'systemctl start logstash' log---- \[2021-12-15T13:49:55,003\]\[INFO \]\[logstash.runner\] Log4j configuration path used is: /etc/logstash/log4j2.properties \[202…

---

## [Grouping Kibana Spaces](https://discuss.elastic.co/t/grouping-kibana-spaces/291063)

<div class="topic-metadata">

**Author:** [@Tim\_Mobley](https://discuss.elastic.co/u/Tim_Mobley)\
**Replies:** 2\
**Last updated:** [December 16, 2021, 3:00pm UTC](https://discuss.elastic.co/t/grouping-kibana-spaces/291063 "2021-12-16T15:00:55Z")

</div>

Is there a way to create groups of Kibana spaces? I know you can control which spaces users have access to using Roles, but other than that is there a way to create a group of spaces. For instance, if there were several …

---

## [Embed Kibana Dashboard via IFrame / csp config](https://discuss.elastic.co/t/embed-kibana-dashboard-via-iframe-csp-config/291128)

<div class="topic-metadata">

**Author:** [@ksremo](https://discuss.elastic.co/u/ksremo)\
**Replies:** 3\
**Last updated:** [December 16, 2021, 2:13pm UTC](https://discuss.elastic.co/t/embed-kibana-dashboard-via-iframe-csp-config/291128 "2021-12-16T14:13:32Z")

</div>

hi i want a third webserver to embed a dashboard via iframe, but default csp config denied it. what i tried so far in the kibana.yml xpack.security.sameSiteCookies: None xpack.security.secureCookies: true csp.strict:…

---

## [A way to pass on kibana's authentication credentials from a python flask app?](https://discuss.elastic.co/t/a-way-to-pass-on-kibanas-authentication-credentials-from-a-python-flask-app/290100)

<div class="topic-metadata">

**Author:** [@Shreesh\_Narayanan](https://discuss.elastic.co/u/Shreesh_Narayanan)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 1:45pm UTC](https://discuss.elastic.co/t/a-way-to-pass-on-kibanas-authentication-credentials-from-a-python-flask-app/290100 "2021-12-16T13:45:40Z")

</div>

Hello, I have a Flask app that redirects to an kibana instance that populates dashboards and works as expected . However,i'm wondering if there's a way to pass on kibana's credentials via the APP so that the kibana does…

---

## [Connecting Kibana to an OpenID provider without setting up TLS](https://discuss.elastic.co/t/connecting-kibana-to-an-openid-provider-without-setting-up-tls/291450)

<div class="topic-metadata">

**Author:** [@Tom\_Cook](https://discuss.elastic.co/u/Tom_Cook)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 1:38pm UTC](https://discuss.elastic.co/t/connecting-kibana-to-an-openid-provider-without-setting-up-tls/291450 "2021-12-16T13:38:38Z")

</div>

I've got a small Elasticsearch cluster (two nodes) running in docker along with Kibana. The only thing that's exposed outside of the docker network is the Kibana service on port 5601 - and that's only exposed to localho…

---

## [Export machine learning jobs in elastic cloud](https://discuss.elastic.co/t/export-machine-learning-jobs-in-elastic-cloud/292133)

<div class="topic-metadata">

**Author:** [@dabo](https://discuss.elastic.co/u/dabo)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 1:34pm UTC](https://discuss.elastic.co/t/export-machine-learning-jobs-in-elastic-cloud/292133 "2021-12-16T13:34:35Z")

</div>

Hi, How to export ML jobs from elastic cloud? Kind regards, Dane

---

## [Beat templates and ECS generator](https://discuss.elastic.co/t/beat-templates-and-ecs-generator/292159)

<div class="topic-metadata">

**Author:** [@Thomas74](https://discuss.elastic.co/u/Thomas74)\
**Replies:** 0\
**Last updated:** [December 16, 2021, 1:29pm UTC](https://discuss.elastic.co/t/beat-templates-and-ecs-generator/292159 "2021-12-16T13:29:35Z")

</div>

Hi, I wonder if I can generate an index template for every beats via ECS generator repo : GitHub - elastic/ecs: Elastic Common Schema It could be easier to generate one big file, with custom configs (example number …

---

## [Unable to start Kibana after enabling tls in Elasticsearch](https://discuss.elastic.co/t/unable-to-start-kibana-after-enabling-tls-in-elasticsearch/291482)

<div class="topic-metadata">

**Author:** [@mahmoudmaani](https://discuss.elastic.co/u/mahmoudmaani)\
**Replies:** 1\
**Last updated:** [December 16, 2021, 1:15pm UTC](https://discuss.elastic.co/t/unable-to-start-kibana-after-enabling-tls-in-elasticsearch/291482 "2021-12-16T13:15:42Z")

</div>

I configured the TLS in Elasticsearch.yml. Everything is working well in Elastic and I can access it via HTTPS like https://192.168.56.108:9200 but when I am trying to access Kibana I get "Kibana server is not ready yet"…

---

## [After restart, logstash doesn't read only new files](https://discuss.elastic.co/t/after-restart-logstash-doesnt-read-only-new-files/292012)

<div class="topic-metadata">

**Author:** [@khouloud](https://discuss.elastic.co/u/khouloud)\
**Replies:** 6\
**Last updated:** [December 16, 2021, 1:12pm UTC](https://discuss.elastic.co/t/after-restart-logstash-doesnt-read-only-new-files/292012 "2021-12-16T13:12:12Z")

</div>

Hello, is it possible when we stop and restart logstash doesn't read all the files that match the path from the beginning and read only new files appended?

---

## [Determine when clone index has completed](https://discuss.elastic.co/t/determine-when-clone-index-has-completed/291675)

<div class="topic-metadata">

**Author:** [@madshov](https://discuss.elastic.co/u/madshov)\
**Replies:** 4\
**Last updated:** [December 16, 2021, 11:52am UTC](https://discuss.elastic.co/t/determine-when-clone-index-has-completed/291675 "2021-12-16T11:52:03Z")

</div>

Hi, I'm writing some functionality where step 1 would be to backup the current ES index. For this I'm using the \_cloneIndex request. This seems like the most appropriate choice. But how would I know for sure when that h…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1122)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1124)
