# Top

**URL:** https://discuss.elastic.co/top.md?page=1253&period=all

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1254

---

## [Kafka output and ssl support](https://discuss.elastic.co/t/kafka-output-and-ssl-support/42642)

<div class="topic-metadata">

**Author:** [@owulff](https://discuss.elastic.co/u/owulff)\
**Replies:** 4\
**Last updated:** [March 24, 2016, 12:16pm UTC](https://discuss.elastic.co/t/kafka-output-and-ssl-support/42642 "2016-03-24T12:16:00Z")

</div>

Hi there I appreciate the simplification of the architecture described here Is it planned to support SSL for the Kafka output? Thanks Oli

---

## [How to delete only last day's data in Elasticsearch?](https://discuss.elastic.co/t/how-to-delete-only-last-days-data-in-elasticsearch/39034)

<div class="topic-metadata">

**Author:** [@Bumblebee](https://discuss.elastic.co/u/Bumblebee)\
**Replies:** 4\
**Last updated:** [January 13, 2016, 8:10am UTC](https://discuss.elastic.co/t/how-to-delete-only-last-days-data-in-elasticsearch/39034 "2016-01-13T08:10:32Z")

</div>

Hello, How do I delete only last day's data in Elasticsearch ? Thanks

---

## [Repository-hdfs error while creating repository to backup elasticsearch index to HDFS](https://discuss.elastic.co/t/repository-hdfs-error-while-creating-repository-to-backup-elasticsearch-index-to-hdfs/299917)

<div class="topic-metadata">

**Author:** [@Sahana\_Murthy](https://discuss.elastic.co/u/Sahana_Murthy)\
**Replies:** 6\
**Last updated:** [March 23, 2022, 1:39pm UTC](https://discuss.elastic.co/t/repository-hdfs-error-while-creating-repository-to-backup-elasticsearch-index-to-hdfs/299917 "2022-03-23T13:39:29Z")

</div>

Hello everyone, I am stuck in a situation where my Elasticsearch(7.9.0) upgradation is pending due to backup /snapshot not being in place We have 10 ELK node in cluster based in Azure cloud out of which 3 master nodes …

---

## [Filebeat collect log and output to es but occur time parse error](https://discuss.elastic.co/t/filebeat-collect-log-and-output-to-es-but-occur-time-parse-error/252820)

<div class="topic-metadata">

**Author:** [@lucasyu](https://discuss.elastic.co/u/lucasyu)\
**Replies:** 6\
**Last updated:** [October 23, 2020, 1:38am UTC](https://discuss.elastic.co/t/filebeat-collect-log-and-output-to-es-but-occur-time-parse-error/252820 "2020-10-23T01:38:14Z")

</div>

Dear all I use filebeat to collect log and parse to json output to es but the "timestamp" field can not parse the value of timestamp is "2020-10-21 17:10:51.963" error description is "failed to parse date field \[202…

---

## [Index datetime from log file instead of auto datetime](https://discuss.elastic.co/t/index-datetime-from-log-file-instead-of-auto-datetime/127296)

<div class="topic-metadata">

**Author:** [@commonman.net](https://discuss.elastic.co/u/commonman.net)\
**Replies:** 6\
**Last updated:** [April 12, 2018, 2:43am UTC](https://discuss.elastic.co/t/index-datetime-from-log-file-instead-of-auto-datetime/127296 "2018-04-12T02:43:46Z")

</div>

Hi Team, I'm trying to load log data into Elasticsearch through Logstash. My log file is back dated. however, date is not indexed from log file. How to use log file date for searching.. Highly appreciated your respons…

---

## [Why I can see my Colleague's Index?](https://discuss.elastic.co/t/why-i-can-see-my-colleagues-index/24064)

<div class="topic-metadata">

**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\
**Replies:** 6\
**Last updated:** [June 23, 2015, 9:10am UTC](https://discuss.elastic.co/t/why-i-can-see-my-colleagues-index/24064 "2015-06-23T09:10:04Z")

</div>

Hi Experts, Me and my Colleague we are working on ELK stack on different machine but on same LAN . We both are using default ELK configurations i.e default yml settings . Now what is happening when I start my node and …

---

## [How to return only the matched object in a nested field, instead of the whole object?](https://discuss.elastic.co/t/how-to-return-only-the-matched-object-in-a-nested-field-instead-of-the-whole-object/251073)

<div class="topic-metadata">

**Author:** [@Bart\_de\_Man](https://discuss.elastic.co/u/Bart_de_Man)\
**Replies:** 2\
**Last updated:** [October 6, 2020, 10:16am UTC](https://discuss.elastic.co/t/how-to-return-only-the-matched-object-in-a-nested-field-instead-of-the-whole-object/251073 "2020-10-06T10:16:59Z")

</div>

Elasticsearch version ( bin/elasticsearch --version ): 5.6.11 Plugins installed : JVM version ( java -version ): openjdk version "1.8.0\_222" OpenJDK Runtime Environment (build 1.8.0\_222-8u222-b10-1ubuntu1~16.04.1-b1…

---

## [Elasticsearch-head Connect elasticsearch via HTTPS](https://discuss.elastic.co/t/elasticsearch-head-connect-elasticsearch-via-https/187699)

<div class="topic-metadata">

**Author:** [@pengxu](https://discuss.elastic.co/u/pengxu)\
**Replies:** 2\
**Last updated:** [June 27, 2019, 5:44am UTC](https://discuss.elastic.co/t/elasticsearch-head-connect-elasticsearch-via-https/187699 "2019-06-27T05:44:16Z")

</div>

My cluster is basic on 7.1.1 , HTTPS is enabled in my cluster ,but elasticsearch-head cannot be connected through https. What should I do?

---

## [Case insensitive search and doc\_values](https://discuss.elastic.co/t/case-insensitive-search-and-doc-values/54011)

<div class="topic-metadata">

**Author:** [@haizaar](https://discuss.elastic.co/u/haizaar)\
**Replies:** 2\
**Last updated:** [June 27, 2016, 1:21pm UTC](https://discuss.elastic.co/t/case-insensitive-search-and-doc-values/54011 "2016-06-27T13:21:46Z")

</div>

I'm storing lots of keyword like strings in my ES 2.3.3. I treat them like terms meaning that I don't want to analyze them. However I do want to perform case-insensitive term queries and aggregations. The only way I've…

---

## [Sort by non indexed field](https://discuss.elastic.co/t/sort-by-non-indexed-field/45378)

<div class="topic-metadata">

**Author:** [@pranesh002](https://discuss.elastic.co/u/pranesh002)\
**Replies:** 2\
**Last updated:** [March 24, 2016, 6:06pm UTC](https://discuss.elastic.co/t/sort-by-non-indexed-field/45378 "2016-03-24T18:06:56Z")

</div>

Is it possible to sort the result by non indexed field? Thanks Pranesh

---

## [Searching Human Names In Elastic Search](https://discuss.elastic.co/t/searching-human-names-in-elastic-search/14889)

<div class="topic-metadata">

**Author:** [@Nathan\_Smith](https://discuss.elastic.co/u/Nathan_Smith)\
**Replies:** 2\
**Last updated:** [December 16, 2013, 4:09pm UTC](https://discuss.elastic.co/t/searching-human-names-in-elastic-search/14889 "2013-12-16T16:09:37Z")

</div>

Hi, I'm currently build a replacement search service, it searches Scottish human names and its essential that the data being returned is as close to the current solution as possible.... Imagine this - I put …

---

## [JS Agent - Survey](https://discuss.elastic.co/t/js-agent-survey/130126)

<div class="topic-metadata">

**Author:** [@Hamidreza](https://discuss.elastic.co/u/Hamidreza)\
**Replies:** 0\
**Last updated:** [May 1, 2018, 1:58pm UTC](https://discuss.elastic.co/t/js-agent-survey/130126 "2018-05-01T13:58:34Z")

</div>

Hi folks, We've been working on our JS (Real User Monitoring) agent for a while and we'd love to hear your feedback to help us decide what to include in our agent next. If you're interested, please take a minute to fil…

---

## [How to replace existing index after reindexing using Logstash](https://discuss.elastic.co/t/how-to-replace-existing-index-after-reindexing-using-logstash/115100)

<div class="topic-metadata">

**Author:** [@barlask](https://discuss.elastic.co/u/barlask)\
**Replies:** 0\
**Last updated:** [January 11, 2018, 1:50pm UTC](https://discuss.elastic.co/t/how-to-replace-existing-index-after-reindexing-using-logstash/115100 "2018-01-11T13:50:49Z")

</div>

Hi, We are using Logstash mysql\_jdbc connector to fetch data from Database and push them to Elasticsearch index. We scheduled a job working every minute for delta imports where Logstash queries DB for changes in the las…

---

## [How does master node works?](https://discuss.elastic.co/t/how-does-master-node-works/186721)

<div class="topic-metadata">

**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\
**Replies:** 1\
**Last updated:** [June 21, 2019, 11:52am UTC](https://discuss.elastic.co/t/how-does-master-node-works/186721 "2019-06-21T11:52:44Z")

</div>

I am planning to setup a large elasticsearch cluster (eg. 100 machines) Each machine having a few ES jvm instances running. Out of all these instances, 3 will be dedicated master instances. Others will be dedicated data…

---

## [Rollup index](https://discuss.elastic.co/t/rollup-index/173804)

<div class="topic-metadata">

**Author:** [@SNJY](https://discuss.elastic.co/u/SNJY)\
**Replies:** 1\
**Last updated:** [March 25, 2019, 7:23pm UTC](https://discuss.elastic.co/t/rollup-index/173804 "2019-03-25T19:23:35Z")

</div>

Hi - I am trying to test feature of Rollup Index in ES6.6. From kibana, I created rollup job of metricbeat data based on time series @timestamp. While adding rollup index in grafana data source, there is error message "…

---

## [Cannot install a \[GOLD\] license unless TLS is configured](https://discuss.elastic.co/t/cannot-install-a-gold-license-unless-tls-is-configured/152162)

<div class="topic-metadata">

**Author:** [@nenjotsu](https://discuss.elastic.co/u/nenjotsu)\
**Replies:** 1\
**Last updated:** [October 14, 2018, 3:27am UTC](https://discuss.elastic.co/t/cannot-install-a-gold-license-unless-tls-is-configured/152162 "2018-10-14T03:27:34Z")

</div>

I have a gold license but once i uploaded it via kibana \> management \> elasticsearch \> license management I get this error. Error encountered uploading license: Cannot install a \[GOLD\] license unless TLS is configured…

---

## [How to send Logs from Apache Spark ( HDInsight Cluster in Azure) to Elastic Search / Kibana](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996)

<div class="topic-metadata">

**Author:** [@arvindsing](https://discuss.elastic.co/u/arvindsing)\
**Replies:** 1\
**Last updated:** [June 2, 2017, 12:54am UTC](https://discuss.elastic.co/t/how-to-send-logs-from-apache-spark-hdinsight-cluster-in-azure-to-elastic-search-kibana/87996 "2017-06-02T00:54:56Z")

</div>

Our logs are at DFS and we can access them using .... hadoop fs -cat wasbs://yourcontainer@youraccount.blob.core.windows.net/testDir/testFile test file content Now we want to configure filebeats here so that we can shi…

---

## [\[Filebeat 5.2.1\]Registry.new: too many open files](https://discuss.elastic.co/t/filebeat-5-2-1-registry-new-too-many-open-files/84072)

<div class="topic-metadata">

**Author:** [@Kareny](https://discuss.elastic.co/u/Kareny)\
**Replies:** 1\
**Last updated:** [May 2, 2017, 8:25am UTC](https://discuss.elastic.co/t/filebeat-5-2-1-registry-new-too-many-open-files/84072 "2017-05-02T08:25:48Z")

</div>

Getting errors in the filebeat log: \[filebeat\] registrar.go:151: Failed to create tempfile (/var/lib/filebeat/registry.new) for writing: open /var/lib/filebeat/registry.new: too many open files. The ulimit on my serve…

---

## [Find the number between two dates using ruby](https://discuss.elastic.co/t/find-the-number-between-two-dates-using-ruby/57820)

<div class="topic-metadata">

**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\
**Replies:** 7\
**Last updated:** [August 11, 2016, 1:59pm UTC](https://discuss.elastic.co/t/find-the-number-between-two-dates-using-ruby/57820 "2016-08-11T13:59:00Z")

</div>

HI, I want to find the days between to dates. I have written the code by using ruby in logstash but i didnt get the value. Can anyone help me to resolve it. field1:August 8th 2016, 03:52:35.000 field2:August 6th 2016, …

---

## [Logstash/Elasticsearch - tempate for array of ips from web log?](https://discuss.elastic.co/t/logstash-elasticsearch-tempate-for-array-of-ips-from-web-log/38362)

<div class="topic-metadata">

**Author:** [@Jeffrey\_Skilton](https://discuss.elastic.co/u/Jeffrey_Skilton)\
**Replies:** 1\
**Last updated:** [January 5, 2016, 3:10am UTC](https://discuss.elastic.co/t/logstash-elasticsearch-tempate-for-array-of-ips-from-web-log/38362 "2016-01-05T03:10:53Z")

</div>

How can i create a template to handle data inbound from my logs for an Array of IP addresses. I just can't seem to quite figure this out. The rest i have got down. I have all my numbers at numbers, float, integer, string…

---

## [Elastic search and attachment-mapping](https://discuss.elastic.co/t/elastic-search-and-attachment-mapping/34430)

<div class="topic-metadata">

**Author:** [@adisajohnson](https://discuss.elastic.co/u/adisajohnson)\
**Replies:** 7\
**Last updated:** [November 12, 2015, 9:13pm UTC](https://discuss.elastic.co/t/elastic-search-and-attachment-mapping/34430 "2015-11-12T21:13:32Z")

</div>

Hello, Trying to figure out how to use the attachment mapping by reading the readme: https://github.com/elastic/elasticsearch-mapper-attachments Are the fields of the mapping documented anywhere? For example, what d…

---

## [How export logs from Kibana 4?](https://discuss.elastic.co/t/how-export-logs-from-kibana-4/23551)

<div class="topic-metadata">

**Author:** [@Dnyaneshwar](https://discuss.elastic.co/u/Dnyaneshwar)\
**Replies:** 1\
**Last updated:** [September 3, 2015, 4:37pm UTC](https://discuss.elastic.co/t/how-export-logs-from-kibana-4/23551 "2015-09-03T16:37:47Z")

</div>

I have tried the export button in kibana 4, but it export the table with timestamp and count column.. there is not logs. How export logs from Kibana 4 ? Thanks -- You received this message because you are s…

---

## [File gzip output creating wrong file?](https://discuss.elastic.co/t/file-gzip-output-creating-wrong-file/1350)

<div class="topic-metadata">

**Author:** [@Sam\_Barham](https://discuss.elastic.co/u/Sam_Barham)\
**Replies:** 1\
**Last updated:** [May 27, 2015, 12:12am UTC](https://discuss.elastic.co/t/file-gzip-output-creating-wrong-file/1350 "2015-05-27T00:12:20Z")

</div>

Sorry about this - I managed to delete my previous post somehow! My issue is that I have an gzip output like: file { path =\> "/var/data/logstash/archive-%{+YYYY-MM-dd}.log.gz" gzip =\> true } The files cre…

---

## [How do I map an array of attachments](https://discuss.elastic.co/t/how-do-i-map-an-array-of-attachments/3419)

<div class="topic-metadata">

**Author:** [@Michiel](https://discuss.elastic.co/u/Michiel)\
**Replies:** 7\
**Last updated:** [October 9, 2010, 9:09am UTC](https://discuss.elastic.co/t/how-do-i-map-an-array-of-attachments/3419 "2010-10-09T09:09:08Z")

</div>

I have items, which I want to index, which have multiple attachments. On beforehand I don't know how much, so I want to make an array of attachments. Basic checks: \* Using Elasticsearch 0.11.0 \* Installed the at…

---

## [Create TimeSeries plots with Timelion](https://discuss.elastic.co/t/create-timeseries-plots-with-timelion/158416)

<div class="topic-metadata">

**Author:** [@stckwok](https://discuss.elastic.co/u/stckwok)\
**Replies:** 8\
**Last updated:** [November 28, 2018, 9:27pm UTC](https://discuss.elastic.co/t/create-timeseries-plots-with-timelion/158416 "2018-11-28T21:27:37Z")

</div>

Hi, I am new user to ELK (ver 6.5.1) I want to create TimeSeries plots with Timelion on ELK Server using the "fields" captured and shipped from Filebeat on the Client side. This log is generated continuously from appli…

---

## [Dynamic mapping and fields with underscores](https://discuss.elastic.co/t/dynamic-mapping-and-fields-with-underscores/39166)

<div class="topic-metadata">

**Author:** [@sgt\_b2002](https://discuss.elastic.co/u/sgt_b2002)\
**Replies:** 0\
**Last updated:** [January 13, 2016, 11:22pm UTC](https://discuss.elastic.co/t/dynamic-mapping-and-fields-with-underscores/39166 "2016-01-13T23:22:22Z")

</div>

I have an index template with a few static field mappings and a dynamic\_template section that maps all other fields as string/not\_analyzed. This works well and fields are mapped properly. That is, it was working well unt…

---

## [How to add geo information in Heartbeat?](https://discuss.elastic.co/t/how-to-add-geo-information-in-heartbeat/234386)

<div class="topic-metadata">

**Author:** [@ozonshak](https://discuss.elastic.co/u/ozonshak)\
**Replies:** 5\
**Last updated:** [May 27, 2020, 8:36pm UTC](https://discuss.elastic.co/t/how-to-add-geo-information-in-heartbeat/234386 "2020-05-27T20:36:56Z")

</div>

Hello. I'm attempting to set up Heartbeat for the first time. I believe I have this setup and I'm doing some basic pings against some web sites. I've noticed that when you click into a heartbeat, it says "geo informat…

---

## [Что будет при потере единственной мастер ноды](https://discuss.elastic.co/t/topic/109124)

<div class="topic-metadata">

**Author:** [@IvanTushin](https://discuss.elastic.co/u/IvanTushin)\
**Replies:** 5\
**Last updated:** [November 28, 2017, 10:54am UTC](https://discuss.elastic.co/t/topic/109124 "2017-11-28T10:54:58Z")

</div>

Добрый день! Игорь, ранее вы помогали со структурой безопасного кластера, однако, использование 3х мастер нод, оказалось достаточно затратным делом, поэтому, пока мы решили остановиться на 1 выделенной мастер ноде. Меня…

---

## [Prometheus Metricbeat non-beta?](https://discuss.elastic.co/t/prometheus-metricbeat-non-beta/97484)

<div class="topic-metadata">

**Author:** [@gregsh](https://discuss.elastic.co/u/gregsh)\
**Replies:** 5\
**Last updated:** [August 23, 2017, 11:28am UTC](https://discuss.elastic.co/t/prometheus-metricbeat-non-beta/97484 "2017-08-23T11:28:11Z")

</div>

Anyone know when the Metricbeat Prometheus addon will be out of beta? Or at least support basic metrics from Prometheus like CPU/Memory? Thanks

---

## [Change Kibana URL](https://discuss.elastic.co/t/change-kibana-url/292775)

<div class="topic-metadata">

**Author:** [@augandi](https://discuss.elastic.co/u/augandi)\
**Replies:** 3\
**Last updated:** [January 10, 2022, 8:43am UTC](https://discuss.elastic.co/t/change-kibana-url/292775 "2022-01-10T08:43:08Z")

</div>

Hi, I just set up the kibana Alerting but unfortunately the Link in the Mail ist unusable because of: (https://0.0.0.0:5601/app/monitoring#/elasticsearch/nodes/kbidk0kaQrSBNqIP\_QmvWA?\_g=(cluster\_uuid:XpQMlhk9TlCvzFukn0H…

---

## [Percentage Mode - 0-100% min/max Heat Map](https://discuss.elastic.co/t/percentage-mode-0-100-min-max-heat-map/233827)

<div class="topic-metadata">

**Author:** [@cb1kr](https://discuss.elastic.co/u/cb1kr)\
**Replies:** 3\
**Last updated:** [June 2, 2020, 5:09pm UTC](https://discuss.elastic.co/t/percentage-mode-0-100-min-max-heat-map/233827 "2020-06-02T17:09:37Z")

</div>

Newbie here! I am trying to create a dashboard that contains some systems reporting back with Metricbeat. Based on the input, I would like to create a heatmap that using the normalized CPU percent as the metric over tim…

---

## [ElasticSearch not indexing all the documents in MongoDB](https://discuss.elastic.co/t/elasticsearch-not-indexing-all-the-documents-in-mongodb/223254)

<div class="topic-metadata">

**Author:** [@pankaj676](https://discuss.elastic.co/u/pankaj676)\
**Replies:** 3\
**Last updated:** [March 12, 2020, 6:13am UTC](https://discuss.elastic.co/t/elasticsearch-not-indexing-all-the-documents-in-mongodb/223254 "2020-03-12T06:13:39Z")

</div>

Hello everyone I am using elastic search with mongo-connector to sync data between MongoDB and Elastic Search. I have 22k documents in MogoDB, but once elastic search indexes 4.5k documents it stops indexing after that. …

---

## [Query with NOT logic doesn't work in Kibana 6.5](https://discuss.elastic.co/t/query-with-not-logic-doesnt-work-in-kibana-6-5/169717)

<div class="topic-metadata">

**Author:** [@Andrey\_Tomilin](https://discuss.elastic.co/u/Andrey_Tomilin)\
**Replies:** 3\
**Last updated:** [March 1, 2019, 7:36pm UTC](https://discuss.elastic.co/t/query-with-not-logic-doesnt-work-in-kibana-6-5/169717 "2019-03-01T19:36:16Z")

</div>

When I want filter out some results, I use the '-' before the field name (in Kibana search bar according to this documentation: https://www.elastic.co/guide/en/elasticsearch/reference/6.7/query-dsl-query-string-query.htm…

---

## [Logstash doc\_as\_upsert =\> true not updating few fields sometimes](https://discuss.elastic.co/t/logstash-doc-as-upsert-true-not-updating-few-fields-sometimes/133293)

<div class="topic-metadata">

**Author:** [@shoaibjdev](https://discuss.elastic.co/u/shoaibjdev)\
**Replies:** 0\
**Last updated:** [May 25, 2018, 9:20am UTC](https://discuss.elastic.co/t/logstash-doc-as-upsert-true-not-updating-few-fields-sometimes/133293 "2018-05-25T09:20:04Z")

</div>

Hi, Have came across a strange issue where in if we are sending the doc\_as\_upsert =\> true for the data to be updated it doesn't update few fields at random. For example if I have 1000 records which after insert are upd…

---

## [Create Index Template in FileBeat and No Effect on datatype of Date](https://discuss.elastic.co/t/create-index-template-in-filebeat-and-no-effect-on-datatype-of-date/96033)

<div class="topic-metadata">

**Author:** [@markboo](https://discuss.elastic.co/u/markboo)\
**Replies:** 3\
**Last updated:** [August 8, 2017, 12:29pm UTC](https://discuss.elastic.co/t/create-index-template-in-filebeat-and-no-effect-on-datatype-of-date/96033 "2017-08-08T12:29:35Z")

</div>

I create a custom template.json in filebeat folder, and configured it to template.path in filebeat.yml. The template contains a field of local\_timestamp which is a date field in my logs. like this: “local\_timestamp”: …

---

## [If a Graph is saved, what is actually being stored?](https://discuss.elastic.co/t/if-a-graph-is-saved-what-is-actually-being-stored/61459)

<div class="topic-metadata">

**Author:** [@michelmooren](https://discuss.elastic.co/u/michelmooren)\
**Replies:** 3\
**Last updated:** [September 25, 2016, 8:44am UTC](https://discuss.elastic.co/t/if-a-graph-is-saved-what-is-actually-being-stored/61459 "2016-09-25T08:44:42Z")

</div>

Are the vertices and connections stored or are you storing the seeding query and all consecutive queries? or both? Actually both could also make sense, since then the user could choose to freeze a graph or to make it rea…

---

## [High Impact of NodeStatsCollector.doCollect()](https://discuss.elastic.co/t/high-impact-of-nodestatscollector-docollect/36075)

<div class="topic-metadata">

**Author:** [@Dominik\_Stadler](https://discuss.elastic.co/u/Dominik_Stadler)\
**Replies:** 3\
**Last updated:** [December 3, 2015, 8:34am UTC](https://discuss.elastic.co/t/high-impact-of-nodestatscollector-docollect/36075 "2015-12-03T08:34:04Z")

</div>

I have a test-cluster (6 Nodes) with a somewhat high number of indexes in the order to 600 and a high number of shards, up to 12 per index, I am doing some performance/limits testing and saw that NodeStatsCollector.doCol…

---

## [No node available while doing easticsearch data migration](https://discuss.elastic.co/t/no-node-available-while-doing-easticsearch-data-migration/13718)

<div class="topic-metadata">

**Author:** [@spancer\_ray](https://discuss.elastic.co/u/spancer_ray)\
**Replies:** 3\
**Last updated:** [September 25, 2013, 7:55pm UTC](https://discuss.elastic.co/t/no-node-available-while-doing-easticsearch-data-migration/13718 "2013-09-25T19:55:34Z")

</div>

Hi Guys, I'm using java api to migrate volume index data from one es cluster to another, and my code is somewhat like below: Migration code: int pageSize = 10000; String\[\] indices = { "myoldindex" }; C…

---

## [Logstash not pushing logs to loki](https://discuss.elastic.co/t/logstash-not-pushing-logs-to-loki/344007)

<div class="topic-metadata">

**Author:** [@sheldor](https://discuss.elastic.co/u/sheldor)\
**Replies:** 2\
**Last updated:** [September 28, 2023, 6:45am UTC](https://discuss.elastic.co/t/logstash-not-pushing-logs-to-loki/344007 "2023-09-28T06:45:00Z")

</div>

Below is my logstash config input { file { ecs\_compatibility =\> disabled path =\> \[ "/a/logs/project\_apps/\*\*/\*.log" \] start\_position =\> beginning exclude =\> \[ …

---

## [Filebeat will hang forever until you force a shutdown with "kill -9"](https://discuss.elastic.co/t/filebeat-will-hang-forever-until-you-force-a-shutdown-with-kill-9/314407)

<div class="topic-metadata">

**Author:** [@silence-linhl](https://discuss.elastic.co/u/silence-linhl)\
**Replies:** 2\
**Last updated:** [September 20, 2022, 8:16am UTC](https://discuss.elastic.co/t/filebeat-will-hang-forever-until-you-force-a-shutdown-with-kill-9/314407 "2022-09-20T08:16:48Z")

</div>

When I start filebeat with the config file below, I can't stop it using Ctrl + C config file : debug.yaml # genaral max\_procs: 1 logging.metrics.enabled: false # log logging.to\_files: true logging.files: path: /data…

---

## [Couldn't find any Elasticsearch data - again](https://discuss.elastic.co/t/couldnt-find-any-elasticsearch-data-again/160634)

<div class="topic-metadata">

**Author:** [@Kurt\_Sys](https://discuss.elastic.co/u/Kurt_Sys)\
**Replies:** 2\
**Last updated:** [December 13, 2018, 10:21am UTC](https://discuss.elastic.co/t/couldnt-find-any-elasticsearch-data-again/160634 "2018-12-13T10:21:50Z")

</div>

I've know this has already been reported a few times, but the solutions don't work... So, here it is again: I have ES running and want to connect Kibana to it. For some reason this seems to work partially: Kibana does f…

---

## [Can not create index pattern "syslog-ng\*"](https://discuss.elastic.co/t/can-not-create-index-pattern-syslog-ng/139110)

<div class="topic-metadata">

**Author:** [@T4iga](https://discuss.elastic.co/u/T4iga)\
**Replies:** 2\
**Last updated:** [July 9, 2018, 9:33am UTC](https://discuss.elastic.co/t/can-not-create-index-pattern-syslog-ng/139110 "2018-07-09T09:33:09Z")

</div>

Hi elastic community, I am currently trying to configure syslog-ng + elastic + kibana. I have been following https://www.syslog-ng.com/whitepaper/storing-logs-in-elasticsearch-using-syslogng8132318/ while looking at in…

---

## [Query documents present in both indexes](https://discuss.elastic.co/t/query-documents-present-in-both-indexes/127465)

<div class="topic-metadata">

**Author:** [@NerdSec](https://discuss.elastic.co/u/NerdSec)\
**Replies:** 2\
**Last updated:** [April 11, 2018, 5:30am UTC](https://discuss.elastic.co/t/query-documents-present-in-both-indexes/127465 "2018-04-11T05:30:25Z")

</div>

Hi, I have two indices: info-source info-destination Both the indices have a few similar field. One such field is the ip field. I wish to write a query that will give me a list of ip present in both indices. Can thi…

---

## [Logstash xml filter with xpath with multiple fields query](https://discuss.elastic.co/t/logstash-xml-filter-with-xpath-with-multiple-fields-query/116185)

<div class="topic-metadata">

**Author:** [@moriol](https://discuss.elastic.co/u/moriol)\
**Replies:** 2\
**Last updated:** [January 30, 2018, 9:55am UTC](https://discuss.elastic.co/t/logstash-xml-filter-with-xpath-with-multiple-fields-query/116185 "2018-01-30T09:55:57Z")

</div>

I have an xml file, which contains fields like: With xpath, within xml filter, I get the fields returned as below, with each element in its array: "PhaseName" =\> \[ \[ 0\] "CRITICAL", \[ 1\] "TEST", \[ 2\] "OTH…

---

## [Logstash saving to two different indexes at the same time](https://discuss.elastic.co/t/logstash-saving-to-two-different-indexes-at-the-same-time/105666)

<div class="topic-metadata">

**Author:** [@Rafael\_Carvallo](https://discuss.elastic.co/u/Rafael_Carvallo)\
**Replies:** 2\
**Last updated:** [October 30, 2017, 9:56pm UTC](https://discuss.elastic.co/t/logstash-saving-to-two-different-indexes-at-the-same-time/105666 "2017-10-30T21:56:13Z")

</div>

Hi, I'd like to request some help with logstash, currently I'm trying to use it as a rsyslog gatherer, basically I've got this setup: Devices Reporting to RSYSLOG RSYSLOG sending the logs to Logstash as JSON Logstash…

---

## [Path.repo cannot be supported in es 2.1.0?](https://discuss.elastic.co/t/path-repo-cannot-be-supported-in-es-2-1-0/37534)

<div class="topic-metadata">

**Author:** [@Benny](https://discuss.elastic.co/u/Benny)\
**Replies:** 2\
**Last updated:** [March 25, 2016, 12:38pm UTC](https://discuss.elastic.co/t/path-repo-cannot-be-supported-in-es-2-1-0/37534 "2016-03-25T12:38:08Z")

</div>

Hi. I want to use snapshot in es 2.1.0. But after I wrote the below setting in elasticsearch.yml as the way of es 1.7.2, es cannot be started. Is the setting wrong? Coule anyone tell me how to config? Thanks a lot. in …

---

## [Java Boolean Match Query](https://discuss.elastic.co/t/java-boolean-match-query/11630)

<div class="topic-metadata">

**Author:** [@Pat\_3](https://discuss.elastic.co/u/Pat_3)\
**Replies:** 2\
**Last updated:** [April 19, 2013, 8:28am UTC](https://discuss.elastic.co/t/java-boolean-match-query/11630 "2013-04-19T08:28:35Z")

</div>

Hi, how do I specify a boolean match query in Java? E.g. something like { "match" : { "message" : { "query" : "this is a test", "operator" : "and" } } } I t…

---

## [Runtime field script String to Integer](https://discuss.elastic.co/t/runtime-field-script-string-to-integer/315678)

<div class="topic-metadata">

**Author:** [@kibanauser4](https://discuss.elastic.co/u/kibanauser4)\
**Replies:** 1\
**Last updated:** [October 3, 2022, 12:21pm UTC](https://discuss.elastic.co/t/runtime-field-script-string-to-integer/315678 "2022-10-03T12:21:15Z")

</div>

Hi. I want to create a runtime field using this script: if (doc.containsKey('price') ) { return Integer.parseInt(doc\['price.keyword'\].value) } but I'm getting this error: Cannot cast from \[int\] to \[void\]. What does i…

---

## [Does regex work on timestamp?](https://discuss.elastic.co/t/does-regex-work-on-timestamp/287794)

<div class="topic-metadata">

**Author:** [@MasonNorris](https://discuss.elastic.co/u/MasonNorris)\
**Replies:** 1\
**Last updated:** [October 28, 2021, 6:36am UTC](https://discuss.elastic.co/t/does-regex-work-on-timestamp/287794 "2021-10-28T06:36:11Z")

</div>

I have created a regex to search for certain time periods in the data(ie search for all data out side of working hours). This regex should only return values from 00:00:00-07:59:59 or 16:00:00-23:59:59. It doesn't return…

---

## [Filebeat getting stopped automatically after sometime](https://discuss.elastic.co/t/filebeat-getting-stopped-automatically-after-sometime/242198)

<div class="topic-metadata">

**Author:** [@HariniGajendran](https://discuss.elastic.co/u/HariniGajendran)\
**Replies:** 1\
**Last updated:** [July 22, 2020, 11:23pm UTC](https://discuss.elastic.co/t/filebeat-getting-stopped-automatically-after-sometime/242198 "2020-07-22T23:23:18Z")

</div>

Hi, I am using 7.4.2 version filebeat. Issue is my filebeat service gets stopped automatically after running for sometime. But whenever I start it will crawl properly and log data into elastic search properly for certai…

[Previous page](https://discuss.elastic.co/top.md?page=1252&per_page=50&period=all)

[Next page](https://discuss.elastic.co/top.md?page=1254&per_page=50&period=all)
