# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1799

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1800

---

## [Investigating a "stuck" node](https://discuss.elastic.co/t/investigating-a-stuck-node/248864)

<div class="topic-metadata">

**Author:** [@JnBrymn](https://discuss.elastic.co/u/JnBrymn)\
**Replies:** 6\
**Last updated:** [September 17, 2020, 10:44pm UTC](https://discuss.elastic.co/t/investigating-a-stuck-node/248864 "2020-09-17T22:44:01Z")

</div>

I'm setting up a new search application on ES 7.3.1 and I am seeing some unusual behavior. I have 16 storage nodes and 5 coordinator nodes (no storage). All queries go though the coordinators. We have 400K docs, 4TB tota…

---

## [Bulk Requests and Routing](https://discuss.elastic.co/t/bulk-requests-and-routing/248995)

<div class="topic-metadata">

**Author:** [@munasia](https://discuss.elastic.co/u/munasia)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:38pm UTC](https://discuss.elastic.co/t/bulk-requests-and-routing/248995 "2020-09-17T22:38:51Z")

</div>

Is there a difference in indexing performance between a bulk request whose individual items have the same routing value vs a bulk request whose items have different values? Background: I'm fetching rows from a DB to be …

---

## [Es score from 0 to 1 when finding similar documents to existing one](https://discuss.elastic.co/t/es-score-from-0-to-1-when-finding-similar-documents-to-existing-one/248919)

<div class="topic-metadata">

**Author:** [@johanson](https://discuss.elastic.co/u/johanson)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:30pm UTC](https://discuss.elastic.co/t/es-score-from-0-to-1-when-finding-similar-documents-to-existing-one/248919 "2020-09-17T22:30:24Z")

</div>

Is it possible to calculate relative score from 0 to 1 when searching similar documents to existing one? Need to calculate relative score from 0 to 1 when searching similar documents to existing one. So existing one has…

---

## [Beat-xpack module doesn't work on localhost 5066 port](https://discuss.elastic.co/t/beat-xpack-module-doesnt-work-on-localhost-5066-port/248896)

<div class="topic-metadata">

**Author:** [@xpacker](https://discuss.elastic.co/u/xpacker)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:25pm UTC](https://discuss.elastic.co/t/beat-xpack-module-doesnt-work-on-localhost-5066-port/248896 "2020-09-17T22:25:40Z")

</div>

\[root@xyz modules.d\]# cat beat-xpack.yml # Module: beat # Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.6/metricbeat-module-beat.html - module: beat metricsets: - stats - state period: 10s http.…

---

## [How to change the huge amount of data formats of my index pattern at once?](https://discuss.elastic.co/t/how-to-change-the-huge-amount-of-data-formats-of-my-index-pattern-at-once/248937)

<div class="topic-metadata">

**Author:** [@m-amano](https://discuss.elastic.co/u/m-amano)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:23pm UTC](https://discuss.elastic.co/t/how-to-change-the-huge-amount-of-data-formats-of-my-index-pattern-at-once/248937 "2020-09-17T22:23:16Z")

</div>

I want to change the data format from default to string. However it is too many to change from the UI. Is Reindex API able to use or other Restful API to do so?

---

## [No filebeat index in Elasticsearch after running setup](https://discuss.elastic.co/t/no-filebeat-index-in-elasticsearch-after-running-setup/249017)

<div class="topic-metadata">

**Author:** [@stor314](https://discuss.elastic.co/u/stor314)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 10:21pm UTC](https://discuss.elastic.co/t/no-filebeat-index-in-elasticsearch-after-running-setup/249017 "2020-09-17T22:21:26Z")

</div>

New to filebeat, trying to get an index up and running in elasticsearch. I followed this guide: https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-installation-configuration.html but for some reason even af…

---

## [Logstash](https://discuss.elastic.co/t/logstash/248924)

<div class="topic-metadata">

**Author:** [@sai92](https://discuss.elastic.co/u/sai92)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 10:19pm UTC](https://discuss.elastic.co/t/logstash/248924 "2020-09-17T22:19:48Z")

</div>

Hello I am using elasticsearch and kibana for IoT platform to collect data from sensors I use seperate plugin of mine to calculate signal quality of each sensor and to collect data from sensor and push it to elasticsear…

---

## [Wrong data in Elasticsearch](https://discuss.elastic.co/t/wrong-data-in-elasticsearch/248913)

<div class="topic-metadata">

**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:14pm UTC](https://discuss.elastic.co/t/wrong-data-in-elasticsearch/248913 "2020-09-17T22:14:34Z")

</div>

I have installed elk on linux server and winlogbeat on windows.I am using syslog input plugin but i don't know why it is showing me winlogbeat data input { syslog { port =\> 10514 host =\> "10.198.0.133" } } output { el…

---

## [Open 92 00 port](https://discuss.elastic.co/t/open-92-00-port/248964)

<div class="topic-metadata">

**Author:** [@YURA](https://discuss.elastic.co/u/YURA)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:05pm UTC](https://discuss.elastic.co/t/open-92-00-port/248964 "2020-09-17T22:05:21Z")

</div>

Good day! CentOS Linux release 8.2.2004 (Core) there was installed (number "7.9.0") so what we need. open 9200 for only one IP. what I did iptables -I INPUT -s myserverip/32 -p tcp -m tcp --dport 9200 -j ACCEPT ip…

---

## [Elasticsearch - Setting replica to 0 for new indices](https://discuss.elastic.co/t/elasticsearch-setting-replica-to-0-for-new-indices/248986)

<div class="topic-metadata">

**Author:** [@Elk\_huh](https://discuss.elastic.co/u/Elk_huh)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 10:03pm UTC](https://discuss.elastic.co/t/elasticsearch-setting-replica-to-0-for-new-indices/248986 "2020-09-17T22:03:09Z")

</div>

If I wanted to set all new replicas to 0 , will the \* affect system indices ? { "index\_patterns": \["\*"\], "settings": { "index": { "number\_of\_replicas": 0 } } }

---

## [Elasticsearch query works in kibana but not code](https://discuss.elastic.co/t/elasticsearch-query-works-in-kibana-but-not-code/249032)

<div class="topic-metadata">

**Author:** [@martinradio](https://discuss.elastic.co/u/martinradio)\
**Replies:** 3\
**Last updated:** [September 17, 2020, 8:50pm UTC](https://discuss.elastic.co/t/elasticsearch-query-works-in-kibana-but-not-code/249032 "2020-09-17T20:50:26Z")

</div>

I have a query string source.keyword: "chewy" and is\_discontinued:"false" that if I run in the Kibana UI, returns the correct number: If I try to run the query in code though, it returns an incorrect number: GET /i…

---

## [ShardNotInPrimaryModeException when indexing to a cluster while shards move](https://discuss.elastic.co/t/shardnotinprimarymodeexception-when-indexing-to-a-cluster-while-shards-move/248925)

<div class="topic-metadata">

**Author:** [@zorah](https://discuss.elastic.co/u/zorah)\
**Replies:** 0\
**Last updated:** [September 17, 2020, 7:28am UTC](https://discuss.elastic.co/t/shardnotinprimarymodeexception-when-indexing-to-a-cluster-while-shards-move/248925 "2020-09-17T07:28:43Z")

</div>

When I add a new node to my Elasticsearch cluster, the cluster will rebalance shards and shards will move onto the new node. When I want to remove a node from the cluster, I will force shards off the node before decommis…

---

## [Just need to find the length of Array in DOC](https://discuss.elastic.co/t/just-need-to-find-the-length-of-array-in-doc/249021)

<div class="topic-metadata">

**Author:** [@Md\_Iburahimsha\_S](https://discuss.elastic.co/u/Md_Iburahimsha_S)\
**Replies:** 0\
**Last updated:** [September 17, 2020, 6:38pm UTC](https://discuss.elastic.co/t/just-need-to-find-the-length-of-array-in-doc/249021 "2020-09-17T18:38:22Z")

</div>

'''I have a doc, just need to get the length of array in kibana objects,' 'Query:''' ''' GET .kibana/\_search { "query": {"match": { "\_id" : "dashboard:Dashboard1" }} } ''' Query results: ''' { "\_index" : ".ki…

---

## [Transactions per hour elastic agent](https://discuss.elastic.co/t/transactions-per-hour-elastic-agent/245030)

<div class="topic-metadata">

**Author:** [@javig12](https://discuss.elastic.co/u/javig12)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 7:23pm UTC](https://discuss.elastic.co/t/transactions-per-hour-elastic-agent/245030 "2020-09-17T19:23:03Z")

</div>

Hello Community, In your experiences how many transaction or events can do per hour any device with agent? what about network devices? hope your comments. Regards!

---

## [Remote Filebeat cannot ship logs to elastic ERROR \[publisher\_pipeline\_output\]](https://discuss.elastic.co/t/remote-filebeat-cannot-ship-logs-to-elastic-error-publisher-pipeline-output/248893)

<div class="topic-metadata">

**Author:** [@Team\_K](https://discuss.elastic.co/u/Team_K)\
**Replies:** 5\
**Last updated:** [September 17, 2020, 7:00pm UTC](https://discuss.elastic.co/t/remote-filebeat-cannot-ship-logs-to-elastic-error-publisher-pipeline-output/248893 "2020-09-17T19:00:46Z")

</div>

I have been trying to ship logs from a remote server to my elk. Below is my conf file. I tested my conf file using filebeat -c filebeat.yml test output everything seems fine. Could you please help. Thank you ela…

---

## [Filebeat for binary files?](https://discuss.elastic.co/t/filebeat-for-binary-files/46479)

<div class="topic-metadata">

**Author:** [@rahin88](https://discuss.elastic.co/u/rahin88)\
**Replies:** 9\
**Last updated:** [September 17, 2020, 6:52pm UTC](https://discuss.elastic.co/t/filebeat-for-binary-files/46479 "2020-09-17T18:52:34Z")

</div>

Hello Folks, I am new to whole Logstash/ELK. But I am wondering if I can use filebeat for streaming binary data to network ? Here is what I am trying to do. Multiple processes (in hundreds) have lib in them to encod…

---

## [Metricbeat data not showing on kibana](https://discuss.elastic.co/t/metricbeat-data-not-showing-on-kibana/248907)

<div class="topic-metadata">

**Author:** [@Roberto\_Chacon](https://discuss.elastic.co/u/Roberto_Chacon)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 5:49pm UTC](https://discuss.elastic.co/t/metricbeat-data-not-showing-on-kibana/248907 "2020-09-17T17:49:03Z")

</div>

Trying to setup metricbeat to monitor the ES cluster. It was running fine on an AWS instance that was removed and now going to be self monitored on the sale ES cluster. So far got all the metricbeat configuration update…

---

## [Exception occurred java.lang.RuntimeException: Request cannot be executed; I/O reactor status: STOPPED](https://discuss.elastic.co/t/exception-occurred-java-lang-runtimeexception-request-cannot-be-executed-i-o-reactor-status-stopped/244479)

<div class="topic-metadata">

**Author:** [@reddroid](https://discuss.elastic.co/u/reddroid)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 5:07pm UTC](https://discuss.elastic.co/t/exception-occurred-java-lang-runtimeexception-request-cannot-be-executed-i-o-reactor-status-stopped/244479 "2020-09-17T17:07:43Z")

</div>

Exception occurred java.lang.RuntimeException: Request cannot be executed; I/O reactor status: STOPPED at org.elasticsearch.client.RestClient.extractAndWrapCause(RestClient.java:831) at org.elasticsearch…

---

## [Why so huge memory requirements when creating new replicas?](https://discuss.elastic.co/t/why-so-huge-memory-requirements-when-creating-new-replicas/248560)

<div class="topic-metadata">

**Author:** [@zdeseb](https://discuss.elastic.co/u/zdeseb)\
**Replies:** 14\
**Last updated:** [September 17, 2020, 5:04pm UTC](https://discuss.elastic.co/t/why-so-huge-memory-requirements-when-creating-new-replicas/248560 "2020-09-17T17:04:31Z")

</div>

Hello, does anyone know what exactly is going on on data nodes when number of replica setting is increased and new replicas are started to build? When I change the replica number from 0 to 1 on some slightly larger ind…

---

## [Large number of files causing IO Spike](https://discuss.elastic.co/t/large-number-of-files-causing-io-spike/249008)

<div class="topic-metadata">

**Author:** [@mahadevaprasadap](https://discuss.elastic.co/u/mahadevaprasadap)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 5:04pm UTC](https://discuss.elastic.co/t/large-number-of-files-causing-io-spike/249008 "2020-09-17T17:04:04Z")

</div>

Hello, There are \>300 inputs files needs to monitored by filebeat. We are facing IO spike. We are not in the position to tweak harvest\_limit or scan frequency as this would delay the detection of file change. Please le…

---

## [JSON parse error - Suricata](https://discuss.elastic.co/t/json-parse-error-suricata/248997)

<div class="topic-metadata">

**Author:** [@Paulogbr](https://discuss.elastic.co/u/Paulogbr)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 4:02pm UTC](https://discuss.elastic.co/t/json-parse-error-suricata/248997 "2020-09-17T16:02:30Z")

</div>

Hello Team, I mounted my lab with suricata and web servers. I tried send log suricata to ELK. But I received error when i did the parse My conf: input { udp { port =\> "514" type =\> "syslog" } } filter { json { …

---

## [I am unable to see system metrics of more than one host](https://discuss.elastic.co/t/i-am-unable-to-see-system-metrics-of-more-than-one-host/248962)

<div class="topic-metadata">

**Author:** [@Shriram\_Wasule](https://discuss.elastic.co/u/Shriram_Wasule)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 3:53pm UTC](https://discuss.elastic.co/t/i-am-unable-to-see-system-metrics-of-more-than-one-host/248962 "2020-09-17T15:53:11Z")

</div>

Hello, i have configured 2 metricbeat on 2 dfferent hosts, and i am sending the metrics to one central host where kibana and elasticsearch is running. but when i tried to monitor system data from 2 hosts i am only able …

---

## [Elastic Search High Level Client Aggregation to get Index wise Hits on Alias Search](https://discuss.elastic.co/t/elastic-search-high-level-client-aggregation-to-get-index-wise-hits-on-alias-search/248994)

<div class="topic-metadata">

**Author:** [@hackerzpark](https://discuss.elastic.co/u/hackerzpark)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 3:52pm UTC](https://discuss.elastic.co/t/elastic-search-high-level-client-aggregation-to-get-index-wise-hits-on-alias-search/248994 "2020-09-17T15:52:27Z")

</div>

Hi, I am using ES 7.3.1 and Elasticsearch high level client 7.3.1 We have an alias which comprises of 3 indexes. Alias Name : employee\_search Indexes in this alias : contract\_employee,permanent\_employee,client…

---

## [Filebeat Container Cannot Connect to Docker Daemon](https://discuss.elastic.co/t/filebeat-container-cannot-connect-to-docker-daemon/248876)

<div class="topic-metadata">

**Author:** [@JustinRSE](https://discuss.elastic.co/u/JustinRSE)\
**Replies:** 2\
**Last updated:** [September 17, 2020, 2:25pm UTC](https://discuss.elastic.co/t/filebeat-container-cannot-connect-to-docker-daemon/248876 "2020-09-17T14:25:15Z")

</div>

I'm attempting to configure Filebeat to monitor some log files on one of our machines. I've created a compose file that looks like the following: version: '2.2' services: filebeat: image: docker.elastic.co/beats/fil…

---

## [Tutorials and Examples of Aggregations in the Java High Level Client](https://discuss.elastic.co/t/tutorials-and-examples-of-aggregations-in-the-java-high-level-client/248980)

<div class="topic-metadata">

**Author:** [@robshep](https://discuss.elastic.co/u/robshep)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 2:16pm UTC](https://discuss.elastic.co/t/tutorials-and-examples-of-aggregations-in-the-java-high-level-client/248980 "2020-09-17T14:16:25Z")

</div>

Hi, I'm looking for tutorials and examples of building aggregates using the Java High Level client API. Google doesn't throw up much, the ES guide is an overview of functionality and the Javadocs just list the API of c…

---

## [Logstash file input mix up](https://discuss.elastic.co/t/logstash-file-input-mix-up/248942)

<div class="topic-metadata">

**Author:** [@logben](https://discuss.elastic.co/u/logben)\
**Replies:** 1\
**Last updated:** [September 17, 2020, 1:58pm UTC](https://discuss.elastic.co/t/logstash-file-input-mix-up/248942 "2020-09-17T13:58:49Z")

</div>

Hello! I read two Windows file shares with DNS logs with the following two seperate configuration files: DNS-Server 1: input { file { path =\> "/var/log/logstash/dns-share-pdc/dns.log" …

---

## [CPU usage behavior in the frozen indices](https://discuss.elastic.co/t/cpu-usage-behavior-in-the-frozen-indices/248988)

<div class="topic-metadata">

**Author:** [@vakhtang](https://discuss.elastic.co/u/vakhtang)\
**Replies:** 0\
**Last updated:** [September 17, 2020, 1:56pm UTC](https://discuss.elastic.co/t/cpu-usage-behavior-in-the-frozen-indices/248988 "2020-09-17T13:56:58Z")

</div>

Hello, We try to benchmark the frozen indices part, and recognize some strange CPU behavior: We have Hot - Cold architecture In the test time, we test the nodes only with frozen indices. We do not write in the test t…

---

## [Auto Reload conf file + Pipelines.yml](https://discuss.elastic.co/t/auto-reload-conf-file-pipelines-yml/248865)

<div class="topic-metadata">

**Author:** [@Pankaj\_Jadhav](https://discuss.elastic.co/u/Pankaj_Jadhav)\
**Replies:** 3\
**Last updated:** [September 17, 2020, 1:56pm UTC](https://discuss.elastic.co/t/auto-reload-conf-file-pipelines-yml/248865 "2020-09-17T13:56:42Z")

</div>

I am running conf files via pipelines.yml. pipeline.id: pipeline19 config.reload.automatic: true config.reload.interval: 3s path.config: "/etc/logstash/conf.d/ds-recentsearch.conf" queue.type: persisted After sett…

---

## [Word delimiter (or switch from hyphen to underline) for all existing indexes](https://discuss.elastic.co/t/word-delimiter-or-switch-from-hyphen-to-underline-for-all-existing-indexes/248984)

<div class="topic-metadata">

**Author:** [@sandikata](https://discuss.elastic.co/u/sandikata)\
**Replies:** 0\
**Last updated:** [September 17, 2020, 1:42pm UTC](https://discuss.elastic.co/t/word-delimiter-or-switch-from-hyphen-to-underline-for-all-existing-indexes/248984 "2020-09-17T13:42:24Z")

</div>

Hello, i am trying to use word\_delimiter for existing indexes, because all the hyphens are ignored while search for example "test-test" is searched as two separate patterns "test test" instead of test-test. Documentatio…

---

## [Starting a continuous Transform](https://discuss.elastic.co/t/starting-a-continuous-transform/248839)

<div class="topic-metadata">

**Author:** [@mykael](https://discuss.elastic.co/u/mykael)\
**Replies:** 3\
**Last updated:** [September 17, 2020, 6:20am UTC](https://discuss.elastic.co/t/starting-a-continuous-transform/248839 "2020-09-17T06:20:17Z")

</div>

I'm setting up a new ELK instance and want to have some continuous transforms running on it. So I load up may table definitions, my transform definitions, bootstrap the transfrom datasets and tell ELK to start them runn…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1798)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1800)
