# Latest **URL:** https://discuss.elastic.co/latest.md?page=993 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 994 --- ## [Dynamic filter according to the presence of a field](https://discuss.elastic.co/t/dynamic-filter-according-to-the-presence-of-a-field/312944)
**Author:** [@arnoz](https://discuss.elastic.co/u/arnoz)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 4:10pm UTC](https://discuss.elastic.co/t/dynamic-filter-according-to-the-presence-of-a-field/312944 "2022-08-25T16:10:55Z")
I have for example this type of documents. { "name": "sylvie dupont", "age": 25, "accounts": \[ { "name": "BankOfAmerica", "amount": 33 }, { "name": "GoldBank", "amount": 578 … --- ## [Logstash IndexOutOfBoundsException: writerIndex + minWritableBytes exceeds maxCapacity](https://discuss.elastic.co/t/logstash-indexoutofboundsexception-writerindex-minwritablebytes-exceeds-maxcapacity/312943)
**Author:** [@cotjoey](https://discuss.elastic.co/u/cotjoey)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 3:37pm UTC](https://discuss.elastic.co/t/logstash-indexoutofboundsexception-writerindex-minwritablebytes-exceeds-maxcapacity/312943 "2022-08-25T15:37:17Z")
Hello, Lately my logstash instance has been throwing the following exceptions intermittently. I cannot find a solution anywhere. All the posts in this forum with the string "writerIndex" with similar issues are left una… --- ## [Duplicate log on message field with springboot java](https://discuss.elastic.co/t/duplicate-log-on-message-field-with-springboot-java/312941)
**Author:** [@jluisv98](https://discuss.elastic.co/u/jluisv98)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 3:26pm UTC](https://discuss.elastic.co/t/duplicate-log-on-message-field-with-springboot-java/312941 "2022-08-25T15:26:35Z")
I'm new to the ELK stack, I'm trying to send the logs of a web application in springboot to logstash. This is the stream log I send: {"@timestamp":"2022-08-24T17:25:09.346-05:00","@version":"1"," message":"Starting \*\*\*… --- ## [Logstash http input plugin and azure load balancer](https://discuss.elastic.co/t/logstash-http-input-plugin-and-azure-load-balancer/312940)
**Author:** [@chapmantrain](https://discuss.elastic.co/u/chapmantrain)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 3:25pm UTC](https://discuss.elastic.co/t/logstash-http-input-plugin-and-azure-load-balancer/312940 "2022-08-25T15:25:25Z")
I am not able to get the http input plugin to connect to our azure load balancer. The input input { http { host =\> "igemsng-eastus2-nprd-elkcluster.test.att.com" port =\> 8808 password =\> XXXX… --- ## [Why does Kibana stops after 10seconds?](https://discuss.elastic.co/t/why-does-kibana-stops-after-10seconds/312860)
**Author:** [@Vinyl\_Down](https://discuss.elastic.co/u/Vinyl_Down)\ **Replies:** 12\ **Last updated:** [August 25, 2022, 3:08pm UTC](https://discuss.elastic.co/t/why-does-kibana-stops-after-10seconds/312860 "2022-08-25T15:08:59Z")
Dear all, I really didn't want to post a question here, and i am trying for a week to fix my issue, but i can't seem to figure this out. I am trying to do some tests on Elastic Search Endpoint Security (using elastic a… --- ## [Failed to install template {:message=\>"Got response code '400' contacting Elasticsearch at URL](https://discuss.elastic.co/t/failed-to-install-template-message-got-response-code-400-contacting-elasticsearch-at-url/312939)
**Author:** [@Queren\_Santos](https://discuss.elastic.co/u/Queren_Santos)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 3:05pm UTC](https://discuss.elastic.co/t/failed-to-install-template-message-got-response-code-400-contacting-elasticsearch-at-url/312939 "2022-08-25T15:05:48Z")
Can anyone help? My template in Elasticsearch is ready, but Logstash does not send the index to which it is already created: ERROR\]\[logstash.outputs.elasticsearch\]\[main\] Failed to install template {:message=\>"Got respon… --- ## [Mapper\_parsing\_exception: failed to parse ( Dataframe to Elastic - batch process)](https://discuss.elastic.co/t/mapper-parsing-exception-failed-to-parse-dataframe-to-elastic-batch-process/312930)
**Author:** [@visit2siva](https://discuss.elastic.co/u/visit2siva)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 2:10pm UTC](https://discuss.elastic.co/t/mapper-parsing-exception-failed-to-parse-dataframe-to-elastic-batch-process/312930 "2022-08-25T14:10:38Z")
We are adding documents through a pyspark dataframe to elastic. df.write.mode('append').format('org.elasticsearch.spark.sql') .option('es.nodes', 'https://xyz.com') .option('es.net.http.auth.user','userid') .optio… --- ## [Can't see the Snapshot features on Kibana UI](https://discuss.elastic.co/t/cant-see-the-snapshot-features-on-kibana-ui/312912)
**Author:** [@CountryBall\_Tube](https://discuss.elastic.co/u/CountryBall_Tube)\ **Replies:** 1\ **Last updated:** [August 25, 2022, 2:55pm UTC](https://discuss.elastic.co/t/cant-see-the-snapshot-features-on-kibana-ui/312912 "2022-08-25T14:55:31Z")
Hey i installed ES and Kibana on Docker but under the stack managament i can't see Stack Management \> Snapshot and Restore option, why? and how to fix it? --- ## [MongoDB to Elasticsearch synchronisation using Logstash JDBC Input plugin](https://discuss.elastic.co/t/mongodb-to-elasticsearch-synchronisation-using-logstash-jdbc-input-plugin/312934)
**Author:** [@hrasheed90](https://discuss.elastic.co/u/hrasheed90)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 2:27pm UTC](https://discuss.elastic.co/t/mongodb-to-elasticsearch-synchronisation-using-logstash-jdbc-input-plugin/312934 "2022-08-25T14:27:53Z")
I have defined several pipelines (each pipeline represents one to one relation with mongodb collection to elasticsearch index i.e. each mongodb collection will have its own index in elasticsearch). all my pipelines look… --- ## [Unable to upgrade from elastic-agent 8.3.3 to 8.4.0, or install 8.4.0 cleanly](https://discuss.elastic.co/t/unable-to-upgrade-from-elastic-agent-8-3-3-to-8-4-0-or-install-8-4-0-cleanly/312928)
**Author:** [@Curtis\_Ruck](https://discuss.elastic.co/u/Curtis_Ruck)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 1:57pm UTC](https://discuss.elastic.co/t/unable-to-upgrade-from-elastic-agent-8-3-3-to-8-4-0-or-install-8-4-0-cleanly/312928 "2022-08-25T13:57:22Z")
On Ubuntu 22.04.1, system had Elastic Agent 8.3.3 installed, doing daily apt upgrade -y and the 8.4.0 upgrade fails. Removing elastic-agent and reinstalling also fails. It fails during package configuration running ela… --- ## [Filebeat keeps file handle on deleted logfile](https://discuss.elastic.co/t/filebeat-keeps-file-handle-on-deleted-logfile/312608)
**Author:** [@asp](https://discuss.elastic.co/u/asp)\ **Replies:** 6\ **Last updated:** [August 25, 2022, 1:29pm UTC](https://discuss.elastic.co/t/filebeat-keeps-file-handle-on-deleted-logfile/312608 "2022-08-25T13:29:43Z")
Hi, I have following issue and hope you can provide a solution. We are using elastic stack for monitoring our application. Priority 1: application must run Priority 2: monitoring should run to support and monitor the… --- ## [How to calculate % growth for a sliding time window with a yearly offset?](https://discuss.elastic.co/t/how-to-calculate-growth-for-a-sliding-time-window-with-a-yearly-offset/312880)
**Author:** [@tastyminerals](https://discuss.elastic.co/u/tastyminerals)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 7:58am UTC](https://discuss.elastic.co/t/how-to-calculate-growth-for-a-sliding-time-window-with-a-yearly-offset/312880 "2022-08-25T07:58:58Z")
I would like to create a timelion visualizaiton which shows a % growth of received documents within a range of 1 week against the same week but a year ago. I am not sure if the below timelion expression does exactly that… --- ## [Deleting processed objects from S3 when using Beats input (and Filebeat with aws-s3 input)](https://discuss.elastic.co/t/deleting-processed-objects-from-s3-when-using-beats-input-and-filebeat-with-aws-s3-input/312922)
**Author:** [@G.E](https://discuss.elastic.co/u/G.E)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 1:15pm UTC](https://discuss.elastic.co/t/deleting-processed-objects-from-s3-when-using-beats-input-and-filebeat-with-aws-s3-input/312922 "2022-08-25T13:15:37Z")
Hi, Can anyone suggest a (hopefully uncomplicated) way to delete processed log files from S3 when using Filebeat and Logstash with SQS and S3? I had previously used the Logstash S3 plugin alone which does support this … --- ## [Error 1053 when starting winlogbeat or auditbeat](https://discuss.elastic.co/t/error-1053-when-starting-winlogbeat-or-auditbeat/312917)
**Author:** [@mammodde](https://discuss.elastic.co/u/mammodde)\ **Replies:** 1\ **Last updated:** [August 25, 2022, 1:12pm UTC](https://discuss.elastic.co/t/error-1053-when-starting-winlogbeat-or-auditbeat/312917 "2022-08-25T13:12:17Z")
Goodmorning, when i try to Start-Service winlogbeat i receive the error 1053m same thing for auditbeat. for the yml files i followed the getting started guide, so there should not be any error. i have a keystore and it… --- ## [Unable to run ElasticSearch after setting up SSL certificate](https://discuss.elastic.co/t/unable-to-run-elasticsearch-after-setting-up-ssl-certificate/312774)
**Author:** [@RonH8](https://discuss.elastic.co/u/RonH8)\ **Replies:** 2\ **Last updated:** [August 25, 2022, 9:34am UTC](https://discuss.elastic.co/t/unable-to-run-elasticsearch-after-setting-up-ssl-certificate/312774 "2022-08-25T09:34:09Z")
Hey I've followed the following guide to setup the SSL certificate for my Elasticsearch which is running on Ubuntu 22.04.1 LTS: https://www.elastic.co/guide/en/elasticsearch/reference/current/security-basic-setup.html … --- ## [Unable to install Elastic Agent 7.17.5 (Windows)](https://discuss.elastic.co/t/unable-to-install-elastic-agent-7-17-5-windows/311284)
**Author:** [@sirineb](https://discuss.elastic.co/u/sirineb)\ **Replies:** 2\ **Last updated:** [August 25, 2022, 12:19pm UTC](https://discuss.elastic.co/t/unable-to-install-elastic-agent-7-17-5-windows/311284 "2022-08-25T12:19:35Z")
Hi everyone, I have an issue trying to enroll elastic agent 7.17.5 in Windows. (My fleet server is 7.17.5 too) The first time I installed it, it worked perfectly but due to a storage issue on the machine that hosts ELK,… --- ## [Runtime Environment Requirement for FS Crawler](https://discuss.elastic.co/t/runtime-environment-requirement-for-fs-crawler/312753)
**Author:** [@zxuz111](https://discuss.elastic.co/u/zxuz111)\ **Replies:** 1\ **Last updated:** [August 25, 2022, 12:07pm UTC](https://discuss.elastic.co/t/runtime-environment-requirement-for-fs-crawler/312753 "2022-08-25T12:07:39Z")
We are planning to deploy FS Crawler to the VM on Azure, and I am trying to provisioning the VM. Here is the information to support the provision: OS: Ubuntu 20.4 PDF files total size: 1.5 TB FS Crawler Schedule: Set a… --- ## [Filebeatt doesn't create multiple index](https://discuss.elastic.co/t/filebeatt-doesnt-create-multiple-index/312717)
**Author:** [@pauldon2](https://discuss.elastic.co/u/pauldon2)\ **Replies:** 2\ **Last updated:** [August 25, 2022, 12:00pm UTC](https://discuss.elastic.co/t/filebeatt-doesnt-create-multiple-index/312717 "2022-08-25T12:00:26Z")
I use elasticsearch 8.3.3 and filebeat 8.3.3 I try read logs from different docker contaiters by using filebeat and when direct write to different indices to elasticsearch. My filebeat.yml # =========================… --- ## [Can Elasticsearch return position of the text within document](https://discuss.elastic.co/t/can-elasticsearch-return-position-of-the-text-within-document/312901)
**Author:** [@Dinesh\_Zende](https://discuss.elastic.co/u/Dinesh_Zende)\ **Replies:** 4\ **Last updated:** [August 25, 2022, 11:45am UTC](https://discuss.elastic.co/t/can-elasticsearch-return-position-of-the-text-within-document/312901 "2022-08-25T11:45:59Z")
I have created index with the attributes \, where the contents are the page content of the document. When I search for the particular query, it returns the appropriate Filename, Pageno. But to b… --- ## [Failed to setup SSL Elasticsearch](https://discuss.elastic.co/t/failed-to-setup-ssl-elasticsearch/312775)
**Author:** [@Sathiya](https://discuss.elastic.co/u/Sathiya)\ **Replies:** 3\ **Last updated:** [August 25, 2022, 11:40am UTC](https://discuss.elastic.co/t/failed-to-setup-ssl-elasticsearch/312775 "2022-08-25T11:40:59Z")
Hi All, I have tried to implement SSL for ELK which has 3 nodes in the cluster. So SAN certificate has been generated with all 3 node’s hostname and FQDN and exported as .pfx (PKCS12) format to configure same in elasti… --- ## [Index size based on Kibana Query Output](https://discuss.elastic.co/t/index-size-based-on-kibana-query-output/312909)
**Author:** [@hari\_priya1](https://discuss.elastic.co/u/hari_priya1)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 11:12am UTC](https://discuss.elastic.co/t/index-size-based-on-kibana-query-output/312909 "2022-08-25T11:12:15Z")
I have an index with a key field called adapter-id which I have to aggregate by adapter\_ids and calculate the index storage size for those buckets. Is it possible to get the index size concerning a certain key field in … --- ## [Permission error while trying to access file which is under mounted volume](https://discuss.elastic.co/t/permission-error-while-trying-to-access-file-which-is-under-mounted-volume/312881)
**Author:** [@cihady](https://discuss.elastic.co/u/cihady)\ **Replies:** 1\ **Last updated:** [August 25, 2022, 11:08am UTC](https://discuss.elastic.co/t/permission-error-while-trying-to-access-file-which-is-under-mounted-volume/312881 "2022-08-25T11:08:26Z")
I cant access the files that are in mounted volume elasticsearch | {"type": "server", "timestamp": "2022-08-25T07:52:51,332Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.na… --- ## [Elastic search issue with Open Distro](https://discuss.elastic.co/t/elastic-search-issue-with-open-distro/312886)
**Author:** [@smabdulazeez](https://discuss.elastic.co/u/smabdulazeez)\ **Replies:** 3\ **Last updated:** [August 25, 2022, 10:48am UTC](https://discuss.elastic.co/t/elastic-search-issue-with-open-distro/312886 "2022-08-25T10:48:34Z")
we have defined the following in .ini file: Assigned Values: opendistro\_security.ssl.http.enabled= True Kesystore type = PKCS12 keystore\_filepath = /relativepath.pfx truststore\_type = PKCS12 truststore-filepath =/relati… --- ## [Elastic-agent osquery through logstash doesn't work](https://discuss.elastic.co/t/elastic-agent-osquery-through-logstash-doesnt-work/312783)
**Author:** [@heikis](https://discuss.elastic.co/u/heikis)\ **Replies:** 3\ **Last updated:** [August 25, 2022, 10:31am UTC](https://discuss.elastic.co/t/elastic-agent-osquery-through-logstash-doesnt-work/312783 "2022-08-25T10:31:05Z")
Hello. We are managing Elastic Agents in Fleet. Entire Elastic Stack is on version 8.3.3. We have problems doing osqueries in Kibana- the query seems to be successful but we get no results and no indexes are created: "… --- ## [Serveur status RED](https://discuss.elastic.co/t/serveur-status-red/312891)
**Author:** [@Joachim\_Rodrigues](https://discuss.elastic.co/u/Joachim_Rodrigues)\ **Replies:** 1\ **Last updated:** [August 25, 2022, 10:16am UTC](https://discuss.elastic.co/t/serveur-status-red/312891 "2022-08-25T10:16:07Z")
Hi When i run : GET /\_cluster/health I can see that the cluster is RED : { "cluster\_name" : "es-monit-cluster", "status" : "red", "timed\_out" : false, "number\_of\_nodes" : 7, "number\_of\_data\_nodes" : 5, "acti… --- ## [Can´t remove mapping from index template](https://discuss.elastic.co/t/can-t-remove-mapping-from-index-template/312900)
**Author:** [@nunex\_17](https://discuss.elastic.co/u/nunex_17)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 10:13am UTC](https://discuss.elastic.co/t/can-t-remove-mapping-from-index-template/312900 "2022-08-25T10:13:31Z")
Hello, In an effort to trying to reduce the index size, i am removing unnecessary mapping from the index template. In Stack management -\> Index management -\> Templates -\> Edit template -\> Mappings i´m trying to delete … --- ## [Filebeat, nginx, elastic stack. Code printing out in Filebeat log](https://discuss.elastic.co/t/filebeat-nginx-elastic-stack-code-printing-out-in-filebeat-log/312899)
**Author:** [@marklad78](https://discuss.elastic.co/u/marklad78)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 10:11am UTC](https://discuss.elastic.co/t/filebeat-nginx-elastic-stack-code-printing-out-in-filebeat-log/312899 "2022-08-25T10:11:59Z")
Hi there folks, Hope you can help me as I'm at a bit of a loss. I've configured Filebeat v7.17.5 to enable the nginx module to scrape some logs located at /usr/local/kong/logs/access.log and /usr/local/kong/logs/error.… --- ## [Upgrade to 8.4.0 fails when snoozed alerting rules are defined \[Known issue\]](https://discuss.elastic.co/t/upgrade-to-8-4-0-fails-when-snoozed-alerting-rules-are-defined-known-issue/312875)
**Author:** [@Shani\_Sagiv](https://discuss.elastic.co/u/Shani_Sagiv)\ **Replies:** 0\ **Last updated:** [August 25, 2022, 7:19am UTC](https://discuss.elastic.co/t/upgrade-to-8-4-0-fails-when-snoozed-alerting-rules-are-defined-known-issue/312875 "2022-08-25T07:19:16Z")
Users that use Elastic 8.3.x and contain a currently snoozed rule, will fail to upgrade to 8.4 due to a known issue with saved object migration. This does not apply to indefinite snooze or mute, only to an on-demand snoo… --- ## [Move data between data stream backing indexes](https://discuss.elastic.co/t/move-data-between-data-stream-backing-indexes/312803)
**Author:** [@KAFFEdev](https://discuss.elastic.co/u/KAFFEdev)\ **Replies:** 8\ **Last updated:** [August 25, 2022, 8:53am UTC](https://discuss.elastic.co/t/move-data-between-data-stream-backing-indexes/312803 "2022-08-25T08:53:59Z")
We collect telemetry from our systems and store each event in a service bus, ready for ingestion. We have also setup a data stream for ingesting telemetry events, with a corresponding ILM policy with automatic rollover, … --- ## [Sending Log from Fluentd to Filebeat or Logstash](https://discuss.elastic.co/t/sending-log-from-fluentd-to-filebeat-or-logstash/312829)
**Author:** [@yago82](https://discuss.elastic.co/u/yago82)\ **Replies:** 2\ **Last updated:** [August 25, 2022, 8:49am UTC](https://discuss.elastic.co/t/sending-log-from-fluentd-to-filebeat-or-logstash/312829 "2022-08-25T08:49:53Z")
Having to take logs from Rhel 5.x machines and not being able to install neither Logstash nor Filebeat. I opted for the installation of Fluentd v0.12. So the question is: is it possible to send logs from Fluentd (Server … [Previous page](https://discuss.elastic.co/latest.md?page=992) [Next page](https://discuss.elastic.co/latest.md?page=994)