# Top

**URL:** https://discuss.elastic.co/top.md?page=1219&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1220

---

## [Filebeat is not closing files and open\_files count keeps on increasing](https://discuss.elastic.co/t/filebeat-is-not-closing-files-and-open-files-count-keeps-on-increasing/264344)

<div class="topic-metadata">

**Author:** [@abhishekkene](https://discuss.elastic.co/u/abhishekkene)\
**Replies:** 8\
**Last updated:** [February 19, 2021, 9:11pm UTC](https://discuss.elastic.co/t/filebeat-is-not-closing-files-and-open-files-count-keeps-on-increasing/264344 "2021-02-19T21:11:28Z")

</div>

The disk space on server shows full and when I checked the Filebeat logs, it was showing the open\_files as quite big number, it is continously increasing. The logs are rolling continously and new log file is being creat…

---

## [Issue with Coordinator node down](https://discuss.elastic.co/t/issue-with-coordinator-node-down/132722)

<div class="topic-metadata">

**Author:** [@softwareklinic](https://discuss.elastic.co/u/softwareklinic)\
**Replies:** 5\
**Last updated:** [May 23, 2018, 2:12am UTC](https://discuss.elastic.co/t/issue-with-coordinator-node-down/132722 "2018-05-23T02:12:57Z")

</div>

We are using Elasticsearch 5.x and in production - we have a Java based application that communicates with Elasticsearch using the TCP transport API -- we are passing 4 coordinator node HOST & PORT while establishing the…

---

## [Queue Size 5000 exceeded error (Elastic Search Optimization)](https://discuss.elastic.co/t/queue-size-5000-exceeded-error-elastic-search-optimization/21350)

<div class="topic-metadata">

**Author:** [@nilesh\_makwana](https://discuss.elastic.co/u/nilesh_makwana)\
**Replies:** 5\
**Last updated:** [December 23, 2014, 1:08pm UTC](https://discuss.elastic.co/t/queue-size-5000-exceeded-error-elastic-search-optimization/21350 "2014-12-23T13:08:16Z")

</div>

Hello All, I am nilesh makwana. I have set up elastic search for my web site which is world wide event discovery portal.We use elasticsearch for search operations. I am experiencing issues in elastic search, It …

---

## [Unable to run quickstart on bare metal k8s with error "Failed to apply spec change: adjust resources: adjust discovery config: Operation cannot be fulfilled on..."](https://discuss.elastic.co/t/unable-to-run-quickstart-on-bare-metal-k8s-with-error-failed-to-apply-spec-change-adjust-resources-adjust-discovery-config-operation-cannot-be-fulfilled-on/290049)

<div class="topic-metadata">

**Author:** [@Mehmet\_Giritli](https://discuss.elastic.co/u/Mehmet_Giritli)\
**Replies:** 1\
**Last updated:** [December 2, 2021, 9:14am UTC](https://discuss.elastic.co/t/unable-to-run-quickstart-on-bare-metal-k8s-with-error-failed-to-apply-spec-change-adjust-resources-adjust-discovery-config-operation-cannot-be-fulfilled-on/290049 "2021-12-02T09:14:32Z")

</div>

I'm trying to install Elasticsearch quickstart on bare metal kubernetes and es pods remain in a "Init:CrashLoopBackOff" state and never start. What I discovered as you can see from events log, is a message saying "Faile…

---

## [Creating alert for custom dashboard](https://discuss.elastic.co/t/creating-alert-for-custom-dashboard/259105)

<div class="topic-metadata">

**Author:** [@lokeshbabloo](https://discuss.elastic.co/u/lokeshbabloo)\
**Replies:** 2\
**Last updated:** [December 22, 2020, 7:49am UTC](https://discuss.elastic.co/t/creating-alert-for-custom-dashboard/259105 "2020-12-22T07:49:41Z")

</div>

Hi I am having a dashboard like this I want to create an alert for the partcular panel " Log messages with error" , so that i can get an email alert if the "Error " occurs in that panel. is there any way to do that?

---

## [How to get external url of kibana (loadBalancer)](https://discuss.elastic.co/t/how-to-get-external-url-of-kibana-loadbalancer/244962)

<div class="topic-metadata">

**Author:** [@melissajenner22](https://discuss.elastic.co/u/melissajenner22)\
**Replies:** 2\
**Last updated:** [September 4, 2020, 2:13pm UTC](https://discuss.elastic.co/t/how-to-get-external-url-of-kibana-loadbalancer/244962 "2020-09-04T14:13:43Z")

</div>

I use the chart https://github.com/elastic/helm-charts, version 7.7.1 installed elasticsearch, kibana and logstash into Kubernetes. helm version is 2.16.10. Kubernetes version is 1.16 (eks). I use default settings. Comm…

---

## [Max bucket aggregation (on @timestamp /s)](https://discuss.elastic.co/t/max-bucket-aggregation-on-timestamp-s/213684)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 2\
**Last updated:** [January 19, 2020, 7:27pm UTC](https://discuss.elastic.co/t/max-bucket-aggregation-on-timestamp-s/213684 "2020-01-19T19:27:29Z")

</div>

what is the correct approach to draw count of events (showing maximum events/seconds) I am trying to create visualisation (see picture below) show graf with maximum events/seconds Kibana is automatically scale @timest…

---

## [Visualize: "field" is a required parameter - ELK 5.5.2](https://discuss.elastic.co/t/visualize-field-is-a-required-parameter-elk-5-5-2/99334)

<div class="topic-metadata">

**Author:** [@TomD](https://discuss.elastic.co/u/TomD)\
**Replies:** 2\
**Last updated:** [September 4, 2017, 8:43pm UTC](https://discuss.elastic.co/t/visualize-field-is-a-required-parameter-elk-5-5-2/99334 "2017-09-04T20:43:16Z")

</div>

Hi I moved my elasticsearch, logstash, and kibana to a RHEL 7.4 box from a 6.9 and now I see the below errors on any of the sample dashboards. I am only using metricbeat and it’s sample dashboards. An identical setup wo…

---

## [Saturating the management thread pool](https://discuss.elastic.co/t/saturating-the-management-thread-pool/23277)

<div class="topic-metadata">

**Author:** [@Charlie\_Moad](https://discuss.elastic.co/u/Charlie_Moad)\
**Replies:** 2\
**Last updated:** [April 17, 2015, 4:23am UTC](https://discuss.elastic.co/t/saturating-the-management-thread-pool/23277 "2015-04-17T04:23:09Z")

</div>

A few days ago we started to receive a lot of timeouts across our cluster. This is causing shard allocation to fail and a perpetual red/yellow state. Examples: \[2015-04-16 15:04:50,970\]\[DEBUG\]\[action.admin.cluster.…

---

## [ElasticSearch plugin for SharePoint](https://discuss.elastic.co/t/elasticsearch-plugin-for-sharepoint/16190)

<div class="topic-metadata">

**Author:** [@Nitesh\_Earkara](https://discuss.elastic.co/u/Nitesh_Earkara)\
**Replies:** 2\
**Last updated:** [March 7, 2014, 6:57am UTC](https://discuss.elastic.co/t/elasticsearch-plugin-for-sharepoint/16190 "2014-03-07T06:57:39Z")

</div>

Hi, We have plugin fsriver to search within files in filesystem and jdbc-river for SQL database. Please let me know if plugin is available for ElasticSearch to search data within SharePoint. -- You receive…

---

## [LogStash Poll messages](https://discuss.elastic.co/t/logstash-poll-messages/253382)

<div class="topic-metadata">

**Author:** [@dfoot](https://discuss.elastic.co/u/dfoot)\
**Replies:** 3\
**Last updated:** [October 29, 2020, 2:09pm UTC](https://discuss.elastic.co/t/logstash-poll-messages/253382 "2020-10-29T14:09:22Z")

</div>

I am getting below logstash log message that stopping data flow for some reason I had to restart logstash and then re-occur. Please advise. \[org.apache.kafka.clients.consumer.internals.AbstractCoordinator\] \[Consumer cli…

---

## [Is it possible to read audio in ES](https://discuss.elastic.co/t/is-it-possible-to-read-audio-in-es/180428)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 3\
**Last updated:** [May 10, 2019, 5:55am UTC](https://discuss.elastic.co/t/is-it-possible-to-read-audio-in-es/180428 "2019-05-10T05:55:48Z")

</div>

i am using fscrawle and tesseract to index and read data from images , pdf,word but now i need to treat audio is there any solution? can i format audio to text and serahc words within it

---

## [Adding S3 Bucket Name in Output Logs](https://discuss.elastic.co/t/adding-s3-bucket-name-in-output-logs/110385)

<div class="topic-metadata">

**Author:** [@jmukhtar](https://discuss.elastic.co/u/jmukhtar)\
**Replies:** 3\
**Last updated:** [December 11, 2017, 3:07pm UTC](https://discuss.elastic.co/t/adding-s3-bucket-name-in-output-logs/110385 "2017-12-11T15:07:27Z")

</div>

I am a newbie to Logstash and ES in general, and struggling to add S3 bucket name to logstash output. I have a setup where we have multiple s3 buckets with RDS instance logs (1 bucket per instance) and we want to harves…

---

## [Elastic Stack as a syslog relay?](https://discuss.elastic.co/t/elastic-stack-as-a-syslog-relay/103030)

<div class="topic-metadata">

**Author:** [@s.essa](https://discuss.elastic.co/u/s.essa)\
**Replies:** 3\
**Last updated:** [October 10, 2017, 9:18pm UTC](https://discuss.elastic.co/t/elastic-stack-as-a-syslog-relay/103030 "2017-10-10T21:18:33Z")

</div>

Hello, I am completely new to the Elastic Stack and was wondering if the following was possible: I want to use the Elastic stack for log collection, forensics and as a relay to LogRhythm for specific use cases. I was w…

---

## [Pig - Lost documents while storing with EsStorage](https://discuss.elastic.co/t/pig-lost-documents-while-storing-with-esstorage/38996)

<div class="topic-metadata">

**Author:** [@pierregc](https://discuss.elastic.co/u/pierregc)\
**Replies:** 3\
**Last updated:** [January 13, 2016, 10:28am UTC](https://discuss.elastic.co/t/pig-lost-documents-while-storing-with-esstorage/38996 "2016-01-13T10:28:50Z")

</div>

Hi, I am using the EsStorage class to store millions of documents from a 40 nodes hadoop cluster to a 3 nodes elastic cluster. It is very convenient, but I found out that I am loosing many documents during this process…

---

## [Installing Watcher -- pitfall to avoid](https://discuss.elastic.co/t/installing-watcher-pitfall-to-avoid/33264)

<div class="topic-metadata">

**Author:** [@nielsoncr](https://discuss.elastic.co/u/nielsoncr)\
**Replies:** 3\
**Last updated:** [October 30, 2015, 1:01pm UTC](https://discuss.elastic.co/t/installing-watcher-pitfall-to-avoid/33264 "2015-10-30T13:01:24Z")

</div>

Just ran into this issue installing Watcher and want to get this out there to help someone else who might be having the same problem. The situation looks like a successful Watcher install -- ie GET /\_watcher returns so…

---

## [Mulitple domains](https://discuss.elastic.co/t/mulitple-domains/24633)

<div class="topic-metadata">

**Author:** [@matt](https://discuss.elastic.co/u/matt)\
**Replies:** 3\
**Last updated:** [July 1, 2015, 11:17am UTC](https://discuss.elastic.co/t/mulitple-domains/24633 "2015-07-01T11:17:01Z")

</div>

Hi guys, Quick question regarding Shield. We would like to use Shield to authenticate users using Active Directory. But the users are part of different domains. The current documentation shows that the domain\_name is …

---

## ["sync" command in Transform API](https://discuss.elastic.co/t/sync-command-in-transform-api/328960)

<div class="topic-metadata">

**Author:** [@SEUNGHYO](https://discuss.elastic.co/u/SEUNGHYO)\
**Replies:** 6\
**Last updated:** [April 27, 2023, 7:52am UTC](https://discuss.elastic.co/t/sync-command-in-transform-api/328960 "2023-04-27T07:52:28Z")

</div>

When a new document is indexed I want to implement a transform instance in which the transform index (dest) is updated every period of "frequency". This is the query I executed. PUT \_transform/test\_transform\_instance …

---

## [How to get logstash works](https://discuss.elastic.co/t/how-to-get-logstash-works/156221)

<div class="topic-metadata">

**Author:** [@liuuu](https://discuss.elastic.co/u/liuuu)\
**Replies:** 6\
**Last updated:** [November 12, 2018, 7:24am UTC](https://discuss.elastic.co/t/how-to-get-logstash-works/156221 "2018-11-12T07:24:05Z")

</div>

my csv file like below id,title,original\_air\_date,production\_code,season,number\_in\_season,number\_in\_series,us\_viewers\_in\_millions,views,imdb\_rating,imdb\_votes,image\_url,video\_url 10,Homer's Night Out,1990-03-25,7…

---

## [SearchRequest for JSON query](https://discuss.elastic.co/t/searchrequest-for-json-query/136970)

<div class="topic-metadata">

**Author:** [@kumarroopesh](https://discuss.elastic.co/u/kumarroopesh)\
**Replies:** 6\
**Last updated:** [July 2, 2018, 7:56am UTC](https://discuss.elastic.co/t/searchrequest-for-json-query/136970 "2018-07-02T07:56:04Z")

</div>

Hi, I am using RestHighLevelClient for my project. I have JSON queries to be executed and get the response and parse them. Earlier I was using low level RestClient.Get to get the response. Please help me in doing the …

---

## [Problem to create a new index patterns with kibana 5.3 graphique](https://discuss.elastic.co/t/problem-to-create-a-new-index-patterns-with-kibana-5-3-graphique/84434)

<div class="topic-metadata">

**Author:** [@Baco](https://discuss.elastic.co/u/Baco)\
**Replies:** 6\
**Last updated:** [May 11, 2017, 4:43am UTC](https://discuss.elastic.co/t/problem-to-create-a-new-index-patterns-with-kibana-5-3-graphique/84434 "2017-05-11T04:43:25Z")

</div>

Could you help me to understand why with logstash-\* (the default index pattern) , I have the time-field name (@timestamp) and the possibility to create it. But if I use another name like test-\*, the time-field name becom…

---

## [Replacing an Elasticsearch node](https://discuss.elastic.co/t/replacing-an-elasticsearch-node/326203)

<div class="topic-metadata">

**Author:** [@smutel](https://discuss.elastic.co/u/smutel)\
**Replies:** 4\
**Last updated:** [February 23, 2023, 9:22am UTC](https://discuss.elastic.co/t/replacing-an-elasticsearch-node/326203 "2023-02-23T09:22:29Z")

</div>

Hello, I have a cluster with 5 nodes (3 master nodes and 2 data nodes) hosted on vms. I am using Elasticsearch version 7.17.8. I need to replace these VMs (to destroy them and to create new ones). I replaced the seco…

---

## [I can't able get system & host uptime metric beat](https://discuss.elastic.co/t/i-cant-able-get-system-host-uptime-metric-beat/265690)

<div class="topic-metadata">

**Author:** [@psganeshk](https://discuss.elastic.co/u/psganeshk)\
**Replies:** 4\
**Last updated:** [March 4, 2021, 4:43pm UTC](https://discuss.elastic.co/t/i-cant-able-get-system-host-uptime-metric-beat/265690 "2021-03-04T16:43:22Z")

</div>

this is my system module but i am not getting uptime of the host Module: system Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.9/metricbeat-module-system.html module: system period: 10s metricsets: cpu …

---

## [ILM stuck at check-allocation on transition to Cold Node](https://discuss.elastic.co/t/ilm-stuck-at-check-allocation-on-transition-to-cold-node/260490)

<div class="topic-metadata">

**Author:** [@Charles\_Ferguson](https://discuss.elastic.co/u/Charles_Ferguson)\
**Replies:** 1\
**Last updated:** [January 8, 2021, 6:06pm UTC](https://discuss.elastic.co/t/ilm-stuck-at-check-allocation-on-transition-to-cold-node/260490 "2021-01-08T18:06:44Z")

</div>

Hi folks, We are having an issue whereour index life cycle policy is not completing the check-allocation phase to the cold nodes. It doesn't seem to be causing any errors just waiting and never completing. Interestingly…

---

## [Accessing parsed date values in Update by Query script](https://discuss.elastic.co/t/accessing-parsed-date-values-in-update-by-query-script/178980)

<div class="topic-metadata">

**Author:** [@Jeff\_Bolle](https://discuss.elastic.co/u/Jeff_Bolle)\
**Replies:** 4\
**Last updated:** [May 7, 2019, 7:08pm UTC](https://discuss.elastic.co/t/accessing-parsed-date-values-in-update-by-query-script/178980 "2019-05-07T19:08:39Z")

</div>

Inside of the script context for an Update By Query, is there any way (other than parsing the raw strings), to access the doc values for date fields? I'm trying to write a script to handle some dates on some of our obje…

---

## [Elasticsearch service static IP](https://discuss.elastic.co/t/elasticsearch-service-static-ip/140584)

<div class="topic-metadata">

**Author:** [@MiguelSalenda](https://discuss.elastic.co/u/MiguelSalenda)\
**Replies:** 4\
**Last updated:** [July 19, 2018, 5:18am UTC](https://discuss.elastic.co/t/elasticsearch-service-static-ip/140584 "2018-07-19T05:18:48Z")

</div>

Hello all, I've created a new deployment on Elastic cloud (Eslasticsearch Service) running on Amazon AWS. Now, I have some doubts about it: Is it possible to assign a static IP to this deployment? And even more, is i…

---

## [Kibana Filters in chrom revolver tabs](https://discuss.elastic.co/t/kibana-filters-in-chrom-revolver-tabs/133442)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 4\
**Last updated:** [May 28, 2018, 8:00am UTC](https://discuss.elastic.co/t/kibana-filters-in-chrom-revolver-tabs/133442 "2018-05-28T08:00:07Z")

</div>

Hi, I have 4 different filters on my dashboard. I want to put every filter in different tab of chrome using revolver tab plugin. On my dashboard, I select filterA, url gets updated in the browser. I copy that URL and…

---

## [Suricata](https://discuss.elastic.co/t/suricata/132428)

<div class="topic-metadata">

**Author:** [@skyluke.1987](https://discuss.elastic.co/u/skyluke.1987)\
**Replies:** 1\
**Last updated:** [May 18, 2018, 7:35am UTC](https://discuss.elastic.co/t/suricata/132428 "2018-05-18T07:35:56Z")

</div>

Anyone here implementing Suricata on Scirius ? I have difficulty connecting and error msg showing "Unable to get data". Is it related to elasticsearch? I need to setup that in order to get?

---

## [Beginner question - searching for string containing \[\] chars](https://discuss.elastic.co/t/beginner-question-searching-for-string-containing-chars/79696)

<div class="topic-metadata">

**Author:** [@msr](https://discuss.elastic.co/u/msr)\
**Replies:** 4\
**Last updated:** [March 23, 2017, 10:44am UTC](https://discuss.elastic.co/t/beginner-question-searching-for-string-containing-chars/79696 "2017-03-23T10:44:54Z")

</div>

I've just installed filebeats and I am trying to configure it to include\_lines that contain square brackets. For example, the log file entry would be something like "Storage swapped on \[DBName\].\[TableName1\]". I tried c…

---

## [Wildcard in URL finding base64](https://discuss.elastic.co/t/wildcard-in-url-finding-base64/79287)

<div class="topic-metadata">

**Author:** [@zokratez](https://discuss.elastic.co/u/zokratez)\
**Replies:** 4\
**Last updated:** [March 20, 2017, 6:09pm UTC](https://discuss.elastic.co/t/wildcard-in-url-finding-base64/79287 "2017-03-20T18:09:26Z")

</div>

I need to filter double equal in URL \*== to detect base64 attacks. I tried with the fields request\_page, request\_page.keyword and request\_page.raw and nothing hapens... { "wildcard": { "request\_page": "\*==\*" }…

---

## [Biztalk server event capture](https://discuss.elastic.co/t/biztalk-server-event-capture/75133)

<div class="topic-metadata">

**Author:** [@Prateek\_Kshtriya](https://discuss.elastic.co/u/Prateek_Kshtriya)\
**Replies:** 4\
**Last updated:** [February 17, 2017, 5:21am UTC](https://discuss.elastic.co/t/biztalk-server-event-capture/75133 "2017-02-17T05:21:55Z")

</div>

Hi All, Please suggest if we could capture biztalk event log without explicitly saving the logs in a file. PFB the sample log- Regards, Prateek

---

## [Storing rollup externally](https://discuss.elastic.co/t/storing-rollup-externally/46078)

<div class="topic-metadata">

**Author:** [@Dani](https://discuss.elastic.co/u/Dani)\
**Replies:** 4\
**Last updated:** [April 4, 2016, 9:48pm UTC](https://discuss.elastic.co/t/storing-rollup-externally/46078 "2016-04-04T21:48:02Z")

</div>

How difficult would it be to implement a process that would generate daily rollups in a separate document store, such as mongoDB. I've got a system that processes log files and stores them as aggregated rollups in mong…

---

## [First index document hit fails](https://discuss.elastic.co/t/first-index-document-hit-fails/44319)

<div class="topic-metadata">

**Author:** [@gdeak](https://discuss.elastic.co/u/gdeak)\
**Replies:** 4\
**Last updated:** [March 21, 2016, 12:06pm UTC](https://discuss.elastic.co/t/first-index-document-hit-fails/44319 "2016-03-21T12:06:41Z")

</div>

We have a cluster with 2 nodes running ES 2.1.0 and we are running a few tests by hitting only one of the nodes. One of the tests tries to index a document before running the actual test. We have seen errors trying to in…

---

## [Questions regarding ElasticSearch backup](https://discuss.elastic.co/t/questions-regarding-elasticsearch-backup/31309)

<div class="topic-metadata">

**Author:** [@MartinG](https://discuss.elastic.co/u/MartinG)\
**Replies:** 4\
**Last updated:** [October 6, 2015, 9:04am UTC](https://discuss.elastic.co/t/questions-regarding-elasticsearch-backup/31309 "2015-10-06T09:04:49Z")

</div>

Hello, I have some questions regarding ElasticSearch backups. As described in the documentation (https://www.elastic.co/guide/en/elasticsearch/guide/current/backing-up-your-cluster.html) the first backup is a full back…

---

## [No Information about index with \_cat](https://discuss.elastic.co/t/no-information-about-index-with--cat/26174)

<div class="topic-metadata">

**Author:** [@melcocha](https://discuss.elastic.co/u/melcocha)\
**Replies:** 4\
**Last updated:** [July 24, 2015, 8:58am UTC](https://discuss.elastic.co/t/no-information-about-index-with--cat/26174 "2015-07-24T08:58:55Z")

</div>

Hello, I get information about the status of my indices using: curl 'localhost:9200/\_cat/indices?v' It all was working fine until I did the last insertion of 500K documents to one of my indices. Apparently, the inserti…

---

## [Performance impact on latest git version](https://discuss.elastic.co/t/performance-impact-on-latest-git-version/24094)

<div class="topic-metadata">

**Author:** [@Stefan\_Sabolowitsch](https://discuss.elastic.co/u/Stefan_Sabolowitsch)\
**Replies:** 4\
**Last updated:** [June 23, 2015, 5:13pm UTC](https://discuss.elastic.co/t/performance-impact-on-latest-git-version/24094 "2015-06-23T17:13:27Z")

</div>

Hi all, i have here a large Desktop to analyze flow traffic in our network. On k3 i get this data (refresh) in 5-sec. and max. 180%CPU load, but with k4 in 73-sec. an 600 - 700% CPU load. CPU load with k4: \[image\] th…

---

## [Grouping logs into sessions](https://discuss.elastic.co/t/grouping-logs-into-sessions/347934)

<div class="topic-metadata">

**Author:** [@Dor-Alter](https://discuss.elastic.co/u/Dor-Alter)\
**Replies:** 7\
**Last updated:** [November 24, 2023, 3:35pm UTC](https://discuss.elastic.co/t/grouping-logs-into-sessions/347934 "2023-11-24T15:35:24Z")

</div>

My entries in Elasticsearch are logs of different event. I am trying to group the logs into sessions of users based on an attribute of the logs. Each log has action attribute, everytime there is the action "session\_start…

---

## [ElasticSearch snapshots are not visisble](https://discuss.elastic.co/t/elasticsearch-snapshots-are-not-visisble/316808)

<div class="topic-metadata">

**Author:** [@not\_correct](https://discuss.elastic.co/u/not_correct)\
**Replies:** 7\
**Last updated:** [October 18, 2022, 2:12pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshots-are-not-visisble/316808 "2022-10-18T14:12:39Z")

</div>

Hi, I have Elasticsearch cluster running and s3 bucket that contains snapshot files to this cluster. However, when I first listed \_snapshot/\_all no repository, and/or snapshots were found. I added the repository using t…

---

## [How to strip events from message field? Logstash syslog](https://discuss.elastic.co/t/how-to-strip-events-from-message-field-logstash-syslog/279110)

<div class="topic-metadata">

**Author:** [@RaonyO](https://discuss.elastic.co/u/RaonyO)\
**Replies:** 7\
**Last updated:** [July 21, 2021, 2:21pm UTC](https://discuss.elastic.co/t/how-to-strip-events-from-message-field-logstash-syslog/279110 "2021-07-21T14:21:08Z")

</div>

hello guys, i'm trying to send logs from a syslog-ng server to logstash and logstash to elasticsearch, but all events are coming in the message field. Is it possible to separate these events to create a new field for eac…

---

## [Is it possible to use filtered query with custom filters score?](https://discuss.elastic.co/t/is-it-possible-to-use-filtered-query-with-custom-filters-score/5479)

<div class="topic-metadata">

**Author:** [@BlueZero\_2](https://discuss.elastic.co/u/BlueZero_2)\
**Replies:** 7\
**Last updated:** [March 26, 2014, 3:19pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-filtered-query-with-custom-filters-score/5479 "2014-03-26T15:19:37Z")

</div>

I need to search documents that are matching some filters. But i want to sort them by custom score script. FI: filter by gender = 1 and calculate score: if ( age \> 10 ) \_score = age \* 2 else \_score = age \* 1 …

---

## [Executer/worker closing connection before trying to write, causing a SSLHandshakeException](https://discuss.elastic.co/t/executer-worker-closing-connection-before-trying-to-write-causing-a-sslhandshakeexception/123114)

<div class="topic-metadata">

**Author:** [@viktorqt](https://discuss.elastic.co/u/viktorqt)\
**Replies:** 1\
**Last updated:** [March 12, 2018, 9:24am UTC](https://discuss.elastic.co/t/executer-worker-closing-connection-before-trying-to-write-causing-a-sslhandshakeexception/123114 "2018-03-12T09:24:41Z")

</div>

Hello, around 1/3 of our files fail to write a DataFrame into Elasticsearch from our Spark-Application while using the ElasticSearch-Spark-Connector due to the following exception: org.elasticsearch.hadoop.rest.EsHadoo…

---

## [Logstash v2.1.3: A plugin had an unrecoverable error](https://discuss.elastic.co/t/logstash-v2-1-3-a-plugin-had-an-unrecoverable-error/53590)

<div class="topic-metadata">

**Author:** [@tuankun](https://discuss.elastic.co/u/tuankun)\
**Replies:** 1\
**Last updated:** [June 23, 2016, 1:01am UTC](https://discuss.elastic.co/t/logstash-v2-1-3-a-plugin-had-an-unrecoverable-error/53590 "2016-06-23T01:01:41Z")

</div>

Hi, I push windows eventlog using winlogbeat-dev(Version: 5.0.0-nightly2bfc1c4) to logstash v2.1.3,the logstash configuration is input{ beats { add\_field =\>\["itcategory","it\_security\_windo…

---

## [JDBC connect String Password Encryption](https://discuss.elastic.co/t/jdbc-connect-string-password-encryption/47892)

<div class="topic-metadata">

**Author:** [@daivenu](https://discuss.elastic.co/u/daivenu)\
**Replies:** 1\
**Last updated:** [June 10, 2016, 7:19pm UTC](https://discuss.elastic.co/t/jdbc-connect-string-password-encryption/47892 "2016-06-10T19:19:35Z")

</div>

i would like to know how to use encryp password in JDBC jdbcplugin.conf file i need to encrypt the below jdbc\_password, since i cant use as clear text. please let me know if any other info required input { jdbc { jdb…

---

## [Elasticsearch Docker 5.4.0 Image using the wrong JAVA\_ENV variable](https://discuss.elastic.co/t/elasticsearch-docker-5-4-0-image-using-the-wrong-java-env-variable/85275)

<div class="topic-metadata">

**Author:** [@jbaig](https://discuss.elastic.co/u/jbaig)\
**Replies:** 2\
**Last updated:** [May 10, 2017, 8:28pm UTC](https://discuss.elastic.co/t/elasticsearch-docker-5-4-0-image-using-the-wrong-java-env-variable/85275 "2017-05-10T20:28:50Z")

</div>

Hi it seems the JAVA\_ENV variable is set: ENV JAVA\_HOME /usr/lib/jvm/java-1.8-openjdk but when I run docker run --rm docker.elastic.co/elasticsearch/elasticsearch:5.4.0 ls /usr/lib/jvm It only lists the following: ja…

---

## [Logstash jdbc plugin password](https://discuss.elastic.co/t/logstash-jdbc-plugin-password/66448)

<div class="topic-metadata">

**Author:** [@FrankC](https://discuss.elastic.co/u/FrankC)\
**Replies:** 2\
**Last updated:** [November 21, 2016, 10:40pm UTC](https://discuss.elastic.co/t/logstash-jdbc-plugin-password/66448 "2016-11-21T22:40:26Z")

</div>

Hello, I am fairly new to logstash and plan to use the jdbc plugin to connect to oracle. Maybe I missed something, but I do not want to store the db password in the config file. What are the best options to provide …

---

## [Cluster recommended for crawling 150 million documents](https://discuss.elastic.co/t/cluster-recommended-for-crawling-150-million-documents/216126)

<div class="topic-metadata">

**Author:** [@Shubham\_Mittal](https://discuss.elastic.co/u/Shubham_Mittal)\
**Replies:** 5\
**Last updated:** [January 29, 2020, 1:04pm UTC](https://discuss.elastic.co/t/cluster-recommended-for-crawling-150-million-documents/216126 "2020-01-29T13:04:45Z")

</div>

Hi Team, I have to crawl 150 million documents from SQL server database using apache manifold jdbc connector to elasticsearch. Average size of document is 500KB. I was thinking of using 5 nodes elastic cluster as belo…

---

## [Apm-server SystemD unit file?](https://discuss.elastic.co/t/apm-server-systemd-unit-file/130403)

<div class="topic-metadata">

**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\
**Replies:** 5\
**Last updated:** [May 7, 2018, 11:38am UTC](https://discuss.elastic.co/t/apm-server-systemd-unit-file/130403 "2018-05-07T11:38:39Z")

</div>

Hello all, has anyone tried to create a apm-server SystemD unit file? I'm working on a puppet manifest to install apm-server and would like to manage the service using SystemD. Cheers, AB

---

## [Failed to restore snapshot to ES 5.5 with SearchGuard](https://discuss.elastic.co/t/failed-to-restore-snapshot-to-es-5-5-with-searchguard/113548)

<div class="topic-metadata">

**Author:** [@law](https://discuss.elastic.co/u/law)\
**Replies:** 5\
**Last updated:** [December 30, 2017, 6:24am UTC](https://discuss.elastic.co/t/failed-to-restore-snapshot-to-es-5-5-with-searchguard/113548 "2017-12-30T06:24:08Z")

</div>

hello everyone, I'm using elasticsearch 5.5.1 with SearchGurd. I want to backup my indices, that's ok. it's done now. But when i want to restore this snapshot, there is an error: {"error":{"root\_cause":\[{"type":"not\_x…

---

## [Dupilcate message on elasticsearch](https://discuss.elastic.co/t/dupilcate-message-on-elasticsearch/107182)

<div class="topic-metadata">

**Author:** [@pope843](https://discuss.elastic.co/u/pope843)\
**Replies:** 5\
**Last updated:** [December 3, 2017, 1:20am UTC](https://discuss.elastic.co/t/dupilcate-message-on-elasticsearch/107182 "2017-12-03T01:20:29Z")

</div>

Hello Guys, Need help regarding duplicate messages on my elasticsearch. I have below config. As you can see i'm using fingerprint plugin to fix duplicates but to no avail. input { beats { port =\> 5044 ssl =\> true s…

---

## [Corruption when indexing large number of documents (4 billion+)](https://discuss.elastic.co/t/corruption-when-indexing-large-number-of-documents-4-billion/21550)

<div class="topic-metadata">

**Author:** [@Darshat\_Shah](https://discuss.elastic.co/u/Darshat_Shah)\
**Replies:** 5\
**Last updated:** [January 20, 2015, 5:03pm UTC](https://discuss.elastic.co/t/corruption-when-indexing-large-number-of-documents-4-billion/21550 "2015-01-20T17:03:37Z")

</div>

Hi, We have a 98 node cluster of ES with each node 32GB RAM. 16GB is reserved for ES via config file. The index has 98 shards with 2 replicas. On this cluster we are loading a large number of documents (when done…

[Previous page](https://discuss.elastic.co/top.md?page=1218&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=1220&per_page=50&period=all)
