# Top

**URL:** https://discuss.elastic.co/top.md?page=624&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 625

---

## [Logstatsh throws cluster - Exception in monitor thread while connecting to server](https://discuss.elastic.co/t/logstatsh-throws-cluster-exception-in-monitor-thread-while-connecting-to-server/312049)

<div class="topic-metadata">

**Author:** [@momarious](https://discuss.elastic.co/u/momarious)\
**Replies:** 4\
**Last updated:** [August 14, 2022, 2:10pm UTC](https://discuss.elastic.co/t/logstatsh-throws-cluster-exception-in-monitor-thread-while-connecting-to-server/312049 "2022-08-14T14:10:17Z")

</div>

Hello everyone this is my first post in this forum, well I would like to synchronize a MongoDB database with Elasticsearch thanks to Logstash, I used version 8.3.3 of ELK with a MongoDriver4.4. I have configured the pipe…

---

## [Split date(yyyymmdd:hhmmss) and convert into default timestamp logstash](https://discuss.elastic.co/t/split-date-yyyymmdd-hhmmss-and-convert-into-default-timestamp-logstash/76986)

<div class="topic-metadata">

**Author:** [@Aditya\_Srivastava](https://discuss.elastic.co/u/Aditya_Srivastava)\
**Replies:** 4\
**Last updated:** [March 2, 2017, 9:16am UTC](https://discuss.elastic.co/t/split-date-yyyymmdd-hhmmss-and-convert-into-default-timestamp-logstash/76986 "2017-03-02T09:16:10Z")

</div>

I have an input as 20170301:18544482:INFO 10.0.0.67 ABCLOG sending request 20170301:18321276:ERROR 10.0.0.67 ABCLOG got response Above are sample input for my logstash, where input is in foll format yyyymmdd:hhmmssSS…

---

## [Need help with Too many open files](https://discuss.elastic.co/t/need-help-with-too-many-open-files/1388)

<div class="topic-metadata">

**Author:** [@bigfootxxl](https://discuss.elastic.co/u/bigfootxxl)\
**Replies:** 4\
**Last updated:** [December 31, 2016, 3:46am UTC](https://discuss.elastic.co/t/need-help-with-too-many-open-files/1388 "2016-12-31T03:46:34Z")

</div>

I have only one instance and now I get constant Too many open files errors: my settings are: \[root@server ~\]# cat /proc/sys/fs/file-max 512000 \[root@server ~\]# ulimit -Hn 131070 \[root@server ~\]# ulimit -Sn 131070 \[roo…

---

## [Geoip Issues with Logstash?](https://discuss.elastic.co/t/geoip-issues-with-logstash/28150)

<div class="topic-metadata">

**Author:** [@killmasta93](https://discuss.elastic.co/u/killmasta93)\
**Replies:** 6\
**Last updated:** [August 27, 2015, 5:06pm UTC](https://discuss.elastic.co/t/geoip-issues-with-logstash/28150 "2015-08-27T17:06:51Z")

</div>

Hi I was wondering if someone could help me out. I have been at it a while but nothing and whats funny is that sometimes it shows the geoip of some countries but others not. Did i miss something? http://pastebin.com/pE…

---

## [Filter a string value in kibana Timelion](https://discuss.elastic.co/t/filter-a-string-value-in-kibana-timelion/95161)

<div class="topic-metadata">

**Author:** [@sLuvpreet33](https://discuss.elastic.co/u/sLuvpreet33)\
**Replies:** 2\
**Last updated:** [July 31, 2017, 12:32pm UTC](https://discuss.elastic.co/t/filter-a-string-value-in-kibana-timelion/95161 "2017-07-31T12:32:51Z")

</div>

I have a status field. It has 5 values. 1 - completed 2 - pending 3 - ongoing 4 - cancelled 5 - upcoming I want to see 5 lines in Timelion over time, giving values corresponding to the status. But I am not gettin…

---

## [Plugin \[analysis-icu\] was built for Elasticsearch version 8.5.0 but version 8.9.1 is running](https://discuss.elastic.co/t/plugin-analysis-icu-was-built-for-elasticsearch-version-8-5-0-but-version-8-9-1-is-running/346062)

<div class="topic-metadata">

**Author:** [@lanz](https://discuss.elastic.co/u/lanz)\
**Replies:** 5\
**Last updated:** [November 6, 2023, 5:26pm UTC](https://discuss.elastic.co/t/plugin-analysis-icu-was-built-for-elasticsearch-version-8-5-0-but-version-8-9-1-is-running/346062 "2023-11-06T17:26:15Z")

</div>

Hello, I am trying to upgrade the ELK from 8.5.0 to 8.9.1 version, Once installed 8.9.1 version, I need to install the analysis-icu\] plug-in . Therefore I have followed the steps of this link ICU analysis plugin | Elas…

---

## [Kafka Bug?](https://discuss.elastic.co/t/kafka-bug/90682)

<div class="topic-metadata">

**Author:** [@StivOstenberg](https://discuss.elastic.co/u/StivOstenberg)\
**Replies:** 2\
**Last updated:** [June 26, 2017, 4:49pm UTC](https://discuss.elastic.co/t/kafka-bug/90682 "2017-06-26T16:49:33Z")

</div>

We are trying unsuccessfully to connect Filebeat to Kafka using SSL. We have dropped Kafka back to the "supported" version, and still we fail. In the course of troubleshooting, we found the following :slight\_smile: 1: …

---

## [Elasticsearch date format am pm](https://discuss.elastic.co/t/elasticsearch-date-format-am-pm/98470)

<div class="topic-metadata">

**Author:** [@svarup](https://discuss.elastic.co/u/svarup)\
**Replies:** 2\
**Last updated:** [August 27, 2017, 2:41pm UTC](https://discuss.elastic.co/t/elasticsearch-date-format-am-pm/98470 "2017-08-27T14:41:01Z")

</div>

In elasticsearch how to index a doc with date format 2017-08-27 01:34:15 PM

---

## [Issue of the upgrade from elasticsearch 1.6 to 2.0](https://discuss.elastic.co/t/issue-of-the-upgrade-from-elasticsearch-1-6-to-2-0/35401)

<div class="topic-metadata">

**Author:** [@tuankun](https://discuss.elastic.co/u/tuankun)\
**Replies:** 2\
**Last updated:** [November 25, 2015, 1:05am UTC](https://discuss.elastic.co/t/issue-of-the-upgrade-from-elasticsearch-1-6-to-2-0/35401 "2015-11-25T01:05:47Z")

</div>

hello everyone, We have an elasticsearch cluster which includes 3 nodes, elasticsearch 1.6(rpm package) was installed on them,and hold some indices on them. I just updated the es version from 1.6 to 2.0 on the 3 no…

---

## [Creating a cumalative sum visualization split on terms](https://discuss.elastic.co/t/creating-a-cumalative-sum-visualization-split-on-terms/169576)

<div class="topic-metadata">

**Author:** [@DrThyme](https://discuss.elastic.co/u/DrThyme)\
**Replies:** 4\
**Last updated:** [February 22, 2019, 2:52pm UTC](https://discuss.elastic.co/t/creating-a-cumalative-sum-visualization-split-on-terms/169576 "2019-02-22T14:52:01Z")

</div>

Hello! I've been struggling with getting a visualization together which it I thought would be simple but it's proven harder than I thought so I must be missing something. Therefore I turn to the combined knowledge of th…

---

## [Use (FreeBSD) native log shipping instead of Filebeat?](https://discuss.elastic.co/t/use-freebsd-native-log-shipping-instead-of-filebeat/42975)

<div class="topic-metadata">

**Author:** [@gregoryo](https://discuss.elastic.co/u/gregoryo)\
**Replies:** 4\
**Last updated:** [March 31, 2016, 7:53am UTC](https://discuss.elastic.co/t/use-freebsd-native-log-shipping-instead-of-filebeat/42975 "2016-03-31T07:53:34Z")

</div>

I am looking at deploying ELK for some FreeBSD machines, and have reached the section of documentation suggesting I use Filebeat to get logs from source machines into Logstash. I immediately wondered whether I could use …

---

## [Is there a graphical interface for Logstash?](https://discuss.elastic.co/t/is-there-a-graphical-interface-for-logstash/25192)

<div class="topic-metadata">

**Author:** [@Maruf789](https://discuss.elastic.co/u/Maruf789)\
**Replies:** 1\
**Last updated:** [July 8, 2015, 10:40pm UTC](https://discuss.elastic.co/t/is-there-a-graphical-interface-for-logstash/25192 "2015-07-08T22:40:50Z")

</div>

Hi Logstash Experts, I am using Logstash 1.5.1 for my project. I am new to Logstash, but I know that Kibana is preferred to be used as a graphical interface for users/developers to create nice graphs based on logs (da…

---

## [TSVB Table : is There a way to sort columns?](https://discuss.elastic.co/t/tsvb-table-is-there-a-way-to-sort-columns/227977)

<div class="topic-metadata">

**Author:** [@Hamza\_BENNANI](https://discuss.elastic.co/u/Hamza_BENNANI)\
**Replies:** 5\
**Last updated:** [April 20, 2020, 7:42am UTC](https://discuss.elastic.co/t/tsvb-table-is-there-a-way-to-sort-columns/227977 "2020-04-20T07:42:16Z")

</div>

Hello, I would like to know if there is a way to sort columns in TSVB Table in Kibana 7.6.2. Anyway, my need is to compute the top 10 of customers based on their turn over. Also, the table must show in a third column, …

---

## [Parse syslog-ng log to elasticsearch](https://discuss.elastic.co/t/parse-syslog-ng-log-to-elasticsearch/197830)

<div class="topic-metadata">

**Author:** [@ravipemmasani](https://discuss.elastic.co/u/ravipemmasani)\
**Replies:** 2\
**Last updated:** [September 4, 2019, 8:48am UTC](https://discuss.elastic.co/t/parse-syslog-ng-log-to-elasticsearch/197830 "2019-09-04T08:48:52Z")

</div>

Hi All, Iam glad to join this group. Basically i'm in the midst of setting up POC for centralize log collection and analyse the log. Following is my setup on RHEL 7.6. Syslog-ng-collect log from remote clients Elast…

---

## [Week of the year aggregations using Painless](https://discuss.elastic.co/t/week-of-the-year-aggregations-using-painless/140071)

<div class="topic-metadata">

**Author:** [@Paulo\_Silva](https://discuss.elastic.co/u/Paulo_Silva)\
**Replies:** 3\
**Last updated:** [August 6, 2018, 5:01am UTC](https://discuss.elastic.co/t/week-of-the-year-aggregations-using-painless/140071 "2018-08-06T05:01:46Z")

</div>

Hi guys, I'm facing a challenge while aggregating data by the "Week of Year" number. The use case is: The first day of the week is set as Sunday on my PC. create a data range: start='2018-06-24 Sunday' and end='2018-…

---

## [Instalacion de un cluster](https://discuss.elastic.co/t/instalacion-de-un-cluster/104556)

<div class="topic-metadata">

**Author:** [@Emiliano\_Baum](https://discuss.elastic.co/u/Emiliano_Baum)\
**Replies:** 3\
**Last updated:** [November 6, 2017, 11:44am UTC](https://discuss.elastic.co/t/instalacion-de-un-cluster/104556 "2017-11-06T11:44:05Z")

</div>

Buenas, tengo instalado un pequeño cluster de 6 mv y ahora voy a migrar a un servidor con mas recursos. El anterior cluster tenia destinados pocos recursos por maquina y ahora, en una etapa de verificacion de pruebas, qu…

---

## [Add\_docker\_metadata failing to get container id if logs are in different path](https://discuss.elastic.co/t/add-docker-metadata-failing-to-get-container-id-if-logs-are-in-different-path/143452)

<div class="topic-metadata">

**Author:** [@somelifeDev](https://discuss.elastic.co/u/somelifeDev)\
**Replies:** 5\
**Last updated:** [August 10, 2018, 6:30am UTC](https://discuss.elastic.co/t/add-docker-metadata-failing-to-get-container-id-if-logs-are-in-different-path/143452 "2018-08-10T06:30:58Z")

</div>

Setup: docker logs are not in the default folder "/var/lib/docker/containers//-json.log" but in "/home/var/docker/data/containers//-json.log" Filebeat works just fine and pushes docker logs into elasticsearch Problem: …

---

## [Custom Realm and JarHell](https://discuss.elastic.co/t/custom-realm-and-jarhell/82188)

<div class="topic-metadata">

**Author:** [@jhn134910](https://discuss.elastic.co/u/jhn134910)\
**Replies:** 8\
**Last updated:** [April 14, 2017, 2:20pm UTC](https://discuss.elastic.co/t/custom-realm-and-jarhell/82188 "2017-04-14T14:20:35Z")

</div>

Hello there, I've attempted to author a custom realm as a fat JAR. When installing it I get the following JarHell error: \[root@iel-dev-tfsr-vm1 x-pack\]# ./extension install file:///home/tango/john/ims-realm-1.0.0-SNAPS…

---

## [How to aggregate data like mysql query? - kibana](https://discuss.elastic.co/t/how-to-aggregate-data-like-mysql-query-kibana/67922)

<div class="topic-metadata">

**Author:** [@bu.gworks.mobi](https://discuss.elastic.co/u/bu.gworks.mobi)\
**Replies:** 4\
**Last updated:** [December 13, 2016, 8:22pm UTC](https://discuss.elastic.co/t/how-to-aggregate-data-like-mysql-query-kibana/67922 "2016-12-13T20:22:12Z")

</div>

Below mysql query return life time sales report and avg sales report from sales\_order table. I have pushed sale\_order table into elasticsearch but I don't know how to aggregate for the below query in kibana to view life …

---

## [Shortened URL added to .kibana](https://discuss.elastic.co/t/shortened-url-added-to-kibana/43901)

<div class="topic-metadata">

**Author:** [@lantern77](https://discuss.elastic.co/u/lantern77)\
**Replies:** 4\
**Last updated:** [March 9, 2016, 7:09pm UTC](https://discuss.elastic.co/t/shortened-url-added-to-kibana/43901 "2016-03-09T19:09:15Z")

</div>

This is a very specific issue however, in our kibana.yml we changed the index in kibana to "ui-kibana" #Kibana uses an index in Elasticsearch to store saved searches, visualizations # and dashboards. It will create a …

---

## [More like this scoring algorithm unclear](https://discuss.elastic.co/t/more-like-this-scoring-algorithm-unclear/15136)

<div class="topic-metadata">

**Author:** [@Maarten\_Roosendaal](https://discuss.elastic.co/u/Maarten_Roosendaal)\
**Replies:** 4\
**Last updated:** [May 6, 2014, 11:33am UTC](https://discuss.elastic.co/t/more-like-this-scoring-algorithm-unclear/15136 "2014-05-06T11:33:47Z")

</div>

Hi, I have a question about why the 'more like this' algorithm scores documents higher than others, while they are (at first glance) the same. What i've done is index wishlist-documents which contain 1 property: …

---

## [Logstash prune nested fields](https://discuss.elastic.co/t/logstash-prune-nested-fields/218984)

<div class="topic-metadata">

**Author:** [@gangireddy\_l](https://discuss.elastic.co/u/gangireddy_l)\
**Replies:** 3\
**Last updated:** [February 13, 2020, 2:22pm UTC](https://discuss.elastic.co/t/logstash-prune-nested-fields/218984 "2020-02-13T14:22:32Z")

</div>

HI TEAM, I am using ELK version 7.0. Facing an issue with prune filter. I need to blacklist exact nested fields coming from filebeat. When i tried with below format, prune is unable to blacklist host.architecture field…

---

## [Background color](https://discuss.elastic.co/t/background-color/120076)

<div class="topic-metadata">

**Author:** [@Pororo](https://discuss.elastic.co/u/Pororo)\
**Replies:** 3\
**Last updated:** [February 16, 2018, 1:11pm UTC](https://discuss.elastic.co/t/background-color/120076 "2018-02-16T13:11:07Z")

</div>

Is there any way to change the color of the background for each visualization? Cuz the default one is just plain white and data information covered on it.

---

## [Logstash JDBC input plugin - Set database date data timezone](https://discuss.elastic.co/t/logstash-jdbc-input-plugin-set-database-date-data-timezone/35672)

<div class="topic-metadata">

**Author:** [@razafinr](https://discuss.elastic.co/u/razafinr)\
**Replies:** 3\
**Last updated:** [May 25, 2016, 5:03am UTC](https://discuss.elastic.co/t/logstash-jdbc-input-plugin-set-database-date-data-timezone/35672 "2016-05-25T05:03:17Z")

</div>

I am using the logstash JDBC plugin to retrieve data from my SQL database to Elasticsearch. It is working fine except I have the following problem: I am storing my dates in UTC timezone in my database but when I use…

---

## [What's the difference between Elastic App Search and Elastic Site Search](https://discuss.elastic.co/t/whats-the-difference-between-elastic-app-search-and-elastic-site-search/218227)

<div class="topic-metadata">

**Author:** [@DickyKwok](https://discuss.elastic.co/u/DickyKwok)\
**Replies:** 2\
**Last updated:** [February 6, 2020, 10:13pm UTC](https://discuss.elastic.co/t/whats-the-difference-between-elastic-app-search-and-elastic-site-search/218227 "2020-02-06T22:13:27Z")

</div>

Hello guys, may I ask a silly question, what's the difference between Elastic App Search and Elastic Site Search? When I create an instance in elastic cloud, I could only use the service of elasticsearch and elastic app …

---

## [Java 7 upgrade to 8 problem with Logstash](https://discuss.elastic.co/t/java-7-upgrade-to-8-problem-with-logstash/27246)

<div class="topic-metadata">

**Author:** [@AymenChetoui](https://discuss.elastic.co/u/AymenChetoui)\
**Replies:** 2\
**Last updated:** [August 13, 2015, 11:59am UTC](https://discuss.elastic.co/t/java-7-upgrade-to-8-problem-with-logstash/27246 "2015-08-13T11:59:05Z")

</div>

Hi all, In my configuration, I have Logstash getting Syslog authentication in an EC2 instance (Instance 1) , and sending the to Elasticsearch/Kibana in a second EC2 instance (Instance 2). When Java 7 installed on (…

---

## [Curl: (56) Recv failure: Connection reset by peer with docker](https://discuss.elastic.co/t/curl-56-recv-failure-connection-reset-by-peer-with-docker/191199)

<div class="topic-metadata">

**Author:** [@ChenSijia](https://discuss.elastic.co/u/ChenSijia)\
**Replies:** 0\
**Last updated:** [July 18, 2019, 12:56pm UTC](https://discuss.elastic.co/t/curl-56-recv-failure-connection-reset-by-peer-with-docker/191199 "2019-07-18T12:56:02Z")

</div>

Hi,I user docker command docker run -itd -p 9200:9200 -p 9300:9300 --name elasticsearch -v /elasticsearch/data:/usr/share/elasticsearch/data --restart=always 45ff2ef9a219 the container is running but I use curl -GET loc…

---

## [Elastic cluster fell](https://discuss.elastic.co/t/elastic-cluster-fell/178728)

<div class="topic-metadata">

**Author:** [@Igor\_Beltek](https://discuss.elastic.co/u/Igor_Beltek)\
**Replies:** 0\
**Last updated:** [April 26, 2019, 10:02pm UTC](https://discuss.elastic.co/t/elastic-cluster-fell/178728 "2019-04-26T22:02:56Z")

</div>

Hello, community, I'm new here and I need help My elastic cluster (elasticsearch-5.6.10 )fell with an error: \[2019-04-26T22:47:08,882\]\[INFO \]\[o.e.m.j.JvmGcMonitorService\] \[front18\] \[gc\]\[1830096\] overhead, spent \[269ms…

---

## [Logstash 2.3.2 doesn't run with my Java?](https://discuss.elastic.co/t/logstash-2-3-2-doesnt-run-with-my-java/48566)

<div class="topic-metadata">

**Author:** [@Eric\_Amick](https://discuss.elastic.co/u/Eric_Amick)\
**Replies:** 8\
**Last updated:** [July 11, 2016, 1:27pm UTC](https://discuss.elastic.co/t/logstash-2-3-2-doesnt-run-with-my-java/48566 "2016-07-11T13:27:03Z")

</div>

When I try to run Logstash 2.3.2, I get the following message: \\Java\\jre1.8.0\_91 was unexpected at this time. 2.3.1 works without incident.

---

## [Configure ILM : Delete index = delete data?](https://discuss.elastic.co/t/configure-ilm-delete-index-delete-data/284273)

<div class="topic-metadata">

**Author:** [@vp096](https://discuss.elastic.co/u/vp096)\
**Replies:** 4\
**Last updated:** [September 15, 2021, 2:10pm UTC](https://discuss.elastic.co/t/configure-ilm-delete-index-delete-data/284273 "2021-09-15T14:10:25Z")

</div>

Hello everyone, I send data every day on a single index, and I would like to delete all the data that are older than one year in order to optimize the available space on my disk. Will choosing the "Delete after 2 days"…

---

## [Logstash stopped logging, but I don't see errors](https://discuss.elastic.co/t/logstash-stopped-logging-but-i-dont-see-errors/75538)

<div class="topic-metadata">

**Author:** [@ZillaG](https://discuss.elastic.co/u/ZillaG)\
**Replies:** 5\
**Last updated:** [February 20, 2017, 8:22pm UTC](https://discuss.elastic.co/t/logstash-stopped-logging-but-i-dont-see-errors/75538 "2017-02-20T20:22:46Z")

</div>

I have an ELK stack. Logstash v.2.3.4 and Kibana v4.5.4 services are running on one server. I have another box running Elasticsearch v2.4.1 in client mode, and then a 3-box Elasticsearch v2.4.1 cluster running in master …

---

## [Java client 5.0, encryption](https://discuss.elastic.co/t/java-client-5-0-encryption/58750)

<div class="topic-metadata">

**Author:** [@robert-blankenship](https://discuss.elastic.co/u/robert-blankenship)\
**Replies:** 5\
**Last updated:** [September 24, 2016, 6:09pm UTC](https://discuss.elastic.co/t/java-client-5-0-encryption/58750 "2016-09-24T18:09:28Z")

</div>

Hi all, I'm trying to make a secure java client for ES 5.0, but I'm met with the following error. Any ideas? Here is my code It's weird because it passes the type checker.

---

## [How to copy indices from one cluster to other with settings](https://discuss.elastic.co/t/how-to-copy-indices-from-one-cluster-to-other-with-settings/155778)

<div class="topic-metadata">

**Author:** [@elk11](https://discuss.elastic.co/u/elk11)\
**Replies:** 2\
**Last updated:** [November 7, 2018, 7:31pm UTC](https://discuss.elastic.co/t/how-to-copy-indices-from-one-cluster-to-other-with-settings/155778 "2018-11-07T19:31:53Z")

</div>

Hi, I want to copy indices (with settings and everything related to that index) from one cluster to other. But according to reindex documentation: " Reindex does not attempt to set up the destination index. It does no…

---

## [Logstash ssl-tcp configuration syslog output](https://discuss.elastic.co/t/logstash-ssl-tcp-configuration-syslog-output/238349)

<div class="topic-metadata">

**Author:** [@bambam](https://discuss.elastic.co/u/bambam)\
**Replies:** 6\
**Last updated:** [June 24, 2020, 2:44pm UTC](https://discuss.elastic.co/t/logstash-ssl-tcp-configuration-syslog-output/238349 "2020-06-24T14:44:56Z")

</div>

Hello, I'm trying to forward messages from Logstash to an external syslog server (Qradar). I need to use ssl-tcp, for the external connection only not the connection to Elasticsearch. I can't find any documentation on h…

---

## [Kibana 4 + marvel + shield: TypeError: callWithRequestFactory is not a function](https://discuss.elastic.co/t/kibana-4-marvel-shield-typeerror-callwithrequestfactory-is-not-a-function/46075)

<div class="topic-metadata">

**Author:** [@Baboune](https://discuss.elastic.co/u/Baboune)\
**Replies:** 6\
**Last updated:** [April 10, 2016, 8:52am UTC](https://discuss.elastic.co/t/kibana-4-marvel-shield-typeerror-callwithrequestfactory-is-not-a-function/46075 "2016-04-10T08:52:36Z")

</div>

Hi, Running kibana 4.4.2 linux-x64 on Centos 7. Marvel, and shield plugins installed. log \[14:48:36.876\] \[warning\]\[config\] Settings for "bundled\_plugin\_ids" were not applied, check for spelling errors and ensure th…

---

## [Filebeat lost data when elasticsearch is down](https://discuss.elastic.co/t/filebeat-lost-data-when-elasticsearch-is-down/134879)

<div class="topic-metadata">

**Author:** [@anson\_ch](https://discuss.elastic.co/u/anson_ch)\
**Replies:** 4\
**Last updated:** [June 8, 2018, 2:14am UTC](https://discuss.elastic.co/t/filebeat-lost-data-when-elasticsearch-is-down/134879 "2018-06-08T02:14:35Z")

</div>

I have experienced a lost data issue with filebeat ----\> elasticsearch. when one pod of elasticsearch cluster is down, i found that the filebeat had lost log data. The related configuration is as follows : elasticsea…

---

## [Slow Performance of Elastic Search with Spark](https://discuss.elastic.co/t/slow-performance-of-elastic-search-with-spark/277101)

<div class="topic-metadata">

**Author:** [@Hardik\_Aggarwal](https://discuss.elastic.co/u/Hardik_Aggarwal)\
**Replies:** 3\
**Last updated:** [July 1, 2021, 2:48pm UTC](https://discuss.elastic.co/t/slow-performance-of-elastic-search-with-spark/277101 "2021-07-01T14:48:46Z")

</div>

I am trying to read the data from Elastic Search into a dataframe using Java ES-Spark-connector.. Now when I try to execute a query for example count() on the dataframe, the performance is dismal. For a 3Gb data it takes…

---

## [Unbalanced Cluster I/O Operations](https://discuss.elastic.co/t/unbalanced-cluster-i-o-operations/313661)

<div class="topic-metadata">

**Author:** [@A\_Abdellah](https://discuss.elastic.co/u/A_Abdellah)\
**Replies:** 3\
**Last updated:** [September 21, 2022, 10:42am UTC](https://discuss.elastic.co/t/unbalanced-cluster-i-o-operations/313661 "2022-09-21T10:42:51Z")

</div>

Hello, I have a 3 master/data nodes cluster + 1 kibana client node using elasticsearch version 7.17.4 The cluster is deployed on Nutanix. I'm using auditbeat, packetbeat, filebeat and elastic agent as sources of data. …

---

## [K7 UI Design Feedback](https://discuss.elastic.co/t/k7-ui-design-feedback/157015)

<div class="topic-metadata">

**Author:** [@jong99](https://discuss.elastic.co/u/jong99)\
**Replies:** 5\
**Last updated:** [November 16, 2018, 3:52pm UTC](https://discuss.elastic.co/t/k7-ui-design-feedback/157015 "2018-11-16T15:52:03Z")

</div>

I've just upgraded to Kibana 6.5 and was excited to see the K7 UI design as an option, so I tried it out. It's a very sleek and pretty, so that's great. However I'm afraid that this is going to be a step backwards for …

---

## [Need help with parsing multiline XML file](https://discuss.elastic.co/t/need-help-with-parsing-multiline-xml-file/64599)

<div class="topic-metadata">

**Author:** [@pikuchan](https://discuss.elastic.co/u/pikuchan)\
**Replies:** 3\
**Last updated:** [November 2, 2016, 5:01am UTC](https://discuss.elastic.co/t/need-help-with-parsing-multiline-xml-file/64599 "2016-11-02T05:01:52Z")

</div>

Hey everyone, I am new to logstash and am trying to figure out how to get an xml file to load properly and I just can't seem to get it. I'm sure there's plenty of user error here, but I've done a ton of trial and error. …

---

## [Master not discovered, removed nodes have been totally destroyed](https://discuss.elastic.co/t/master-not-discovered-removed-nodes-have-been-totally-destroyed/206143)

<div class="topic-metadata">

**Author:** [@hackerwin7](https://discuss.elastic.co/u/hackerwin7)\
**Replies:** 7\
**Last updated:** [November 6, 2019, 11:49am UTC](https://discuss.elastic.co/t/master-not-discovered-removed-nodes-have-been-totally-destroyed/206143 "2019-11-06T11:49:58Z")

</div>

Hi, I have removed half of nodes of cluster, and the removed nodes and machines have been totally destroyed. the existing cluster log like: master not discovered or elected yet, an election requires at least nodes wit…

---

## [Elasticsearch not able to use persistent Volume](https://discuss.elastic.co/t/elasticsearch-not-able-to-use-persistent-volume/133390)

<div class="topic-metadata">

**Author:** [@viggunayak](https://discuss.elastic.co/u/viggunayak)\
**Replies:** 1\
**Last updated:** [May 29, 2018, 4:42am UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-use-persistent-volume/133390 "2018-05-29T04:42:15Z")

</div>

I m trying to setup an elastic search cluster using a persistent Volume as storage in a kubernetes cluster. I have a NFS mount acting as a persistent volume. I read in the documentation that elastic search uses elastic…

---

## [Maven dependencies with elasticsearch](https://discuss.elastic.co/t/maven-dependencies-with-elasticsearch/76220)

<div class="topic-metadata">

**Author:** [@zegdene](https://discuss.elastic.co/u/zegdene)\
**Replies:** 1\
**Last updated:** [February 23, 2017, 4:43pm UTC](https://discuss.elastic.co/t/maven-dependencies-with-elasticsearch/76220 "2017-02-23T16:43:29Z")

</div>

hello, i'm new with elasticsearch and i'm trying to make a java application that will allow me to communicate with a cluster elasticsearch . i started with creating a maven project and in the pom.xml i have put in my po…

---

## [Logstash Beats input lumberjack protocol v1 support lifetime](https://discuss.elastic.co/t/logstash-beats-input-lumberjack-protocol-v1-support-lifetime/56334)

<div class="topic-metadata">

**Author:** [@CVTJNII](https://discuss.elastic.co/u/CVTJNII)\
**Replies:** 7\
**Last updated:** [July 29, 2016, 11:39am UTC](https://discuss.elastic.co/t/logstash-beats-input-lumberjack-protocol-v1-support-lifetime/56334 "2016-07-29T11:39:32Z")

</div>

Currently the Beats input supports the Lumberjack v1 protocol, which is documented in the PROTOCOL.md file in the logstash-input-beats repository. I'm currently using this to test the beats input and am interested in ex…

---

## [Logstash Kafka Avro integration failing](https://discuss.elastic.co/t/logstash-kafka-avro-integration-failing/192499)

<div class="topic-metadata">

**Author:** [@NSK](https://discuss.elastic.co/u/NSK)\
**Replies:** 5\
**Last updated:** [July 30, 2019, 4:28pm UTC](https://discuss.elastic.co/t/logstash-kafka-avro-integration-failing/192499 "2019-07-30T16:28:03Z")

</div>

Hi - I am trying to consume a topic from Kafka using Avro Deserializer in Logstash and getting the below error. \[ERROR\]\[logstash.inputs.kafka \] Unable to create Kafka consumer from given configuration {:kafka\_error\_m…

---

## [Logstash filter not wroking](https://discuss.elastic.co/t/logstash-filter-not-wroking/100470)

<div class="topic-metadata">

**Author:** [@pope843](https://discuss.elastic.co/u/pope843)\
**Replies:** 6\
**Last updated:** [September 14, 2017, 9:20am UTC](https://discuss.elastic.co/t/logstash-filter-not-wroking/100470 "2017-09-14T09:20:19Z")

</div>

Hello I'm new with logstash and i'm having problems in filter condition, i would like to ship onlt llogs/lines with ERROR, DEBUG, INFO and WARN message. Here's the working config only one string on if condition. filte…

---

## [HUGE Transaction Log](https://discuss.elastic.co/t/huge-transaction-log/74261)

<div class="topic-metadata">

**Author:** [@rellimcire](https://discuss.elastic.co/u/rellimcire)\
**Replies:** 6\
**Last updated:** [February 7, 2017, 10:50pm UTC](https://discuss.elastic.co/t/huge-transaction-log/74261 "2017-02-07T22:50:49Z")

</div>

I'm running ES 2.0.0. During a 48 hour test I have transaction logs that are almost 60Gb and growing. It seems to not be flushing. I could try a manual flush but don't understand why I would need to do that. My understan…

---

## [How to search visualizations that use a specific index pattern](https://discuss.elastic.co/t/how-to-search-visualizations-that-use-a-specific-index-pattern/134236)

<div class="topic-metadata">

**Author:** [@Alexandre\_Bunn](https://discuss.elastic.co/u/Alexandre_Bunn)\
**Replies:** 4\
**Last updated:** [June 8, 2018, 7:16pm UTC](https://discuss.elastic.co/t/how-to-search-visualizations-that-use-a-specific-index-pattern/134236 "2018-06-08T19:16:04Z")

</div>

Good morning I would like to check which Visualizations on kibana are using a certain index pattern. I am trying to query it on .kibana indice but I'am doing something wrong. I am running the query on DevTools of Kibana…

---

## [Configure filebeat to use API keys](https://discuss.elastic.co/t/configure-filebeat-to-use-api-keys/291726)

<div class="topic-metadata">

**Author:** [@bbangerter](https://discuss.elastic.co/u/bbangerter)\
**Replies:** 2\
**Last updated:** [December 14, 2021, 12:58am UTC](https://discuss.elastic.co/t/configure-filebeat-to-use-api-keys/291726 "2021-12-14T00:58:06Z")

</div>

I have Elasticsearch, kibana, and filebeat (version 7.15.2 for all) running on a CentOS 8 machine using minimal security settings. I now want to get it working with TLS enabled. I have Elasticsearch and kibana working w…

---

## [Upgrade from 1.x to 5.x](https://discuss.elastic.co/t/upgrade-from-1-x-to-5-x/107834)

<div class="topic-metadata">

**Author:** [@Tomasz\_Kulig](https://discuss.elastic.co/u/Tomasz_Kulig)\
**Replies:** 2\
**Last updated:** [November 15, 2017, 10:31pm UTC](https://discuss.elastic.co/t/upgrade-from-1-x-to-5-x/107834 "2017-11-15T22:31:26Z")

</div>

Hi, I'm wondering. We are going to upgrade our ES server soon. I see two option here: migrate from 1.x to 2.4, then use the migration tool, reindex and upgrade to 5.x, create a new server, install ES5 there and just…

[Previous page](https://discuss.elastic.co/top.md?page=623&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=625&per_page=50&period=all)
