# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1654

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1655

---

## [Elasticsearch muat\_not match on all elemets of array](https://discuss.elastic.co/t/elasticsearch-muat-not-match-on-all-elemets-of-array/257997)

<div class="topic-metadata">

**Author:** [@roy\_einhorn](https://discuss.elastic.co/u/roy_einhorn)\
**Replies:** 6\
**Last updated:** [December 9, 2020, 6:58am UTC](https://discuss.elastic.co/t/elasticsearch-muat-not-match-on-all-elemets-of-array/257997 "2020-12-09T06:58:01Z")

</div>

i have multiple documents with a field containing an array : for example: "person1" : \[ { "network" : "A" }, { "network" : "B" }, \] "person2" : \[ { "network" : "A" }, { "network" : "C" } \] i want to look…

---

## [Minimum Elasticsearch Hardware Requirement](https://discuss.elastic.co/t/minimum-elasticsearch-hardware-requirement/258074)

<div class="topic-metadata">

**Author:** [@Rohit\_Kumbhar](https://discuss.elastic.co/u/Rohit_Kumbhar)\
**Replies:** 1\
**Last updated:** [December 9, 2020, 6:57am UTC](https://discuss.elastic.co/t/minimum-elasticsearch-hardware-requirement/258074 "2020-12-09T06:57:37Z")

</div>

Hi Experts, I want to configure Elasticsearch Cluster from Data Ingested per day and retention period. Is there any formula to calculate Number of Nodes required , Minimum Ram and Processor cores and storage Requiremen…

---

## [General information regarding ELK](https://discuss.elastic.co/t/general-information-regarding-elk/258073)

<div class="topic-metadata">

**Author:** [@shiv97](https://discuss.elastic.co/u/shiv97)\
**Replies:** 1\
**Last updated:** [December 9, 2020, 6:36am UTC](https://discuss.elastic.co/t/general-information-regarding-elk/258073 "2020-12-09T06:36:10Z")

</div>

Hello Team, I wanted to know some of the information regarding elk as I am new to this topic a) Difference between ELK self vs ELk managed b) Approach for pushing logs into ELK to meet near / real-time requirement ki…

---

## [Translated SQL query to SearchRequest](https://discuss.elastic.co/t/translated-sql-query-to-searchrequest/254087)

<div class="topic-metadata">

**Author:** [@yuriy.kasterin](https://discuss.elastic.co/u/yuriy.kasterin)\
**Replies:** 7\
**Last updated:** [November 4, 2020, 11:20am UTC](https://discuss.elastic.co/t/translated-sql-query-to-searchrequest/254087 "2020-11-04T11:20:40Z")

</div>

Hello I want to create a search request from a translated SQL query. Here is the code that i use to translate the SQL query to json ES query: RestClient restClient = RestClient.builder( new HttpHost("local…

---

## [Kibana server not starting up](https://discuss.elastic.co/t/kibana-server-not-starting-up/257944)

<div class="topic-metadata">

**Author:** [@sudhakar\_u](https://discuss.elastic.co/u/sudhakar_u)\
**Replies:** 16\
**Last updated:** [December 9, 2020, 4:42am UTC](https://discuss.elastic.co/t/kibana-server-not-starting-up/257944 "2020-12-09T04:42:37Z")

</div>

iam seeing this error in the logs.It was working fine till 1 day back.Whta could be the issue here. i restarted the kibana.Still the same issue.ECerything was properly setup. {"type":"log","@timestamp":"2020-12-08T06:5…

---

## [Elasticsearch server could not be reached](https://discuss.elastic.co/t/elasticsearch-server-could-not-be-reached/257937)

<div class="topic-metadata">

**Author:** [@webapps](https://discuss.elastic.co/u/webapps)\
**Replies:** 5\
**Last updated:** [December 9, 2020, 3:57am UTC](https://discuss.elastic.co/t/elasticsearch-server-could-not-be-reached/257937 "2020-12-09T03:57:31Z")

</div>

I just want to integrate external https Elasticsearch server URI with Drupal 8 version. I got an external https Elasticsearch server URI and got the credentials for it. When I’m accessing the https Elasticsearch server …

---

## [Kibana interacting with Elasticsearch](https://discuss.elastic.co/t/kibana-interacting-with-elasticsearch/257940)

<div class="topic-metadata">

**Author:** [@anarnold](https://discuss.elastic.co/u/anarnold)\
**Replies:** 5\
**Last updated:** [December 9, 2020, 3:39am UTC](https://discuss.elastic.co/t/kibana-interacting-with-elasticsearch/257940 "2020-12-09T03:39:04Z")

</div>

Hi All, I was exploring the Kibana as one of our solutions for Observability. Had 2 queries: Q: How does Kibana interact with the elasticsearch? Does it internally call the same elasticsearch APIs that are already expo…

---

## [Query seach in elasticsearch](https://discuss.elastic.co/t/query-seach-in-elasticsearch/257939)

<div class="topic-metadata">

**Author:** [@111411](https://discuss.elastic.co/u/111411)\
**Replies:** 6\
**Last updated:** [December 8, 2020, 7:24am UTC](https://discuss.elastic.co/t/query-seach-in-elasticsearch/257939 "2020-12-08T07:24:24Z")

</div>

I'm trying to search in elasticsearch by query. I'm want to get uuid = 002A13AC-93E6-4141-AA28-0A86F1B5E5C2 of device index. GET device/\_search? { "query": { "match": { "uuid" : "0aaa02A13AC-93E6-4141-AA28-0A86F1B5…

---

## [Filebeat MISP module refresh](https://discuss.elastic.co/t/filebeat-misp-module-refresh/256281)

<div class="topic-metadata">

**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\
**Replies:** 11\
**Last updated:** [December 9, 2020, 1:33am UTC](https://discuss.elastic.co/t/filebeat-misp-module-refresh/256281 "2020-12-09T01:33:26Z")

</div>

Is there a way to get the filebeat misp module to delete & re-create the index that stores the misp data in? I'm wanting to refresh this data hourly?

---

## [Kibana authentication](https://discuss.elastic.co/t/kibana-authentication/257824)

<div class="topic-metadata">

**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\
**Replies:** 4\
**Last updated:** [December 9, 2020, 12:56am UTC](https://discuss.elastic.co/t/kibana-authentication/257824 "2020-12-09T00:56:57Z")

</div>

Hi all, Lets say I want to use authentication with kibana but I don't want to encript or authenticate my elasticsearch cluster. How cant I do that?

---

## [Elasticsearch 7.9 will spend long time to forcemerge](https://discuss.elastic.co/t/elasticsearch-7-9-will-spend-long-time-to-forcemerge/257983)

<div class="topic-metadata">

**Author:** [@gaocx2000cn](https://discuss.elastic.co/u/gaocx2000cn)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 11:43pm UTC](https://discuss.elastic.co/t/elasticsearch-7-9-will-spend-long-time-to-forcemerge/257983 "2020-12-08T23:43:26Z")

</div>

Elasticsearch 7.9 will spend long time to forcemerge. curl -s -XPOST http://:9200/\_forcemerge?max\_num\_segments=1 Elasticsearch 6.2 will spend less time to forcemerge. We have same data source on Elasticsearch 6.2 and …

---

## [Can we create custom datastream types?](https://discuss.elastic.co/t/can-we-create-custom-datastream-types/258060)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 0\
**Last updated:** [December 8, 2020, 10:34pm UTC](https://discuss.elastic.co/t/can-we-create-custom-datastream-types/258060 "2020-12-08T22:34:57Z")

</div>

Hello, So the new datastream concepts are slightly confusing. I'd like to play a bit with the details and possible configurations. Can I create my own datastream type? For example some documentations say only logs and m…

---

## [What do you think is more critical? To allocate more resources or change architecture?](https://discuss.elastic.co/t/what-do-you-think-is-more-critical-to-allocate-more-resources-or-change-architecture/258003)

<div class="topic-metadata">

**Author:** [@mahalabobis](https://discuss.elastic.co/u/mahalabobis)\
**Replies:** 12\
**Last updated:** [December 8, 2020, 10:29pm UTC](https://discuss.elastic.co/t/what-do-you-think-is-more-critical-to-allocate-more-resources-or-change-architecture/258003 "2020-12-08T22:29:29Z")

</div>

I have multiple issues with Elasticsearch right now. I'm running out of disk I'm running out of memory Architecture may need to change since I have more than 600 shards per node. For sure, I will add a new node to the …

---

## [Elastic-agent 7.10.0 install error](https://discuss.elastic.co/t/elastic-agent-7-10-0-install-error/255368)

<div class="topic-metadata">

**Author:** [@frankfoti](https://discuss.elastic.co/u/frankfoti)\
**Replies:** 6\
**Last updated:** [December 8, 2020, 10:02pm UTC](https://discuss.elastic.co/t/elastic-agent-7-10-0-install-error/255368 "2020-12-08T22:02:38Z")

</div>

I have tried this on a couple different GCP instances with the same error below ffoti@ep-test-gcp-debian:~$ sudo rpm -vi elastic-agent-7.10.0-x86\_64.rpm sudo: rpm: command not found ffoti@ep-test-gcp-debian:~$ curl -L …

---

## [Cannot connect to elasticsearch server instance on port 9200](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-server-instance-on-port-9200/257728)

<div class="topic-metadata">

**Author:** [@freshlinx](https://discuss.elastic.co/u/freshlinx)\
**Replies:** 3\
**Last updated:** [December 8, 2020, 9:54pm UTC](https://discuss.elastic.co/t/cannot-connect-to-elasticsearch-server-instance-on-port-9200/257728 "2020-12-08T21:54:12Z")

</div>

I have installed Elasticsearch and when I run a curl localhost:9200 request on the machine it returns the expected response showing that Elasticsearch is running. I have a Wordpress site on another server and I want to …

---

## [Create an Alert for top 10 exceptions in my Log](https://discuss.elastic.co/t/create-an-alert-for-top-10-exceptions-in-my-log/257966)

<div class="topic-metadata">

**Author:** [@sukanto](https://discuss.elastic.co/u/sukanto)\
**Replies:** 1\
**Last updated:** [December 8, 2020, 9:50pm UTC](https://discuss.elastic.co/t/create-an-alert-for-top-10-exceptions-in-my-log/257966 "2020-12-08T21:50:08Z")

</div>

I am looking to create an Alert for Top 10 Exceptions in my log during last 12 hours. The alert should trigger every 12 hours and email to a group of people the count of each of the top 10 Exceptions during last 12 hours…

---

## [Kibana Clustering](https://discuss.elastic.co/t/kibana-clustering/257961)

<div class="topic-metadata">

**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 9:48pm UTC](https://discuss.elastic.co/t/kibana-clustering/257961 "2020-12-08T21:48:45Z")

</div>

Hi guys I\`ve using a cluster with 5 nodes (Elasticsearch) The question is, in "Stack Monitoring" I see GREEN health and OK nodes(one of them is master) but my Kibana is like this: How can I have multi-instance of Ki…

---

## [Find hosts that do not have any documents matching a query](https://discuss.elastic.co/t/find-hosts-that-do-not-have-any-documents-matching-a-query/257871)

<div class="topic-metadata">

**Author:** [@jmcclelland](https://discuss.elastic.co/u/jmcclelland)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 9:42pm UTC](https://discuss.elastic.co/t/find-hosts-that-do-not-have-any-documents-matching-a-query/257871 "2020-12-08T21:42:58Z")

</div>

Is it possible to create a dashboard that lists all unique hosts that do not have any documents matching a particular query? Thanks for any tips you might have!

---

## [Elasticsearch ODBC Connector (AWS ES domain) Does Not Work with IAM Credentials](https://discuss.elastic.co/t/elasticsearch-odbc-connector-aws-es-domain-does-not-work-with-iam-credentials/258050)

<div class="topic-metadata">

**Author:** [@mcburn13](https://discuss.elastic.co/u/mcburn13)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 9:41pm UTC](https://discuss.elastic.co/t/elasticsearch-odbc-connector-aws-es-domain-does-not-work-with-iam-credentials/258050 "2020-12-08T21:41:41Z")

</div>

I installed the 64bit ODBC connector, and was able to connect to my AWS Elasticsearch domain when i turned off it's access policy. I created an IAM user, added to the policy and it then cannot connect to it.

---

## [AD/LDAP Authentication failure](https://discuss.elastic.co/t/ad-ldap-authentication-failure/258040)

<div class="topic-metadata">

**Author:** [@Chay\_Chait](https://discuss.elastic.co/u/Chay_Chait)\
**Replies:** 0\
**Last updated:** [December 8, 2020, 7:14pm UTC](https://discuss.elastic.co/t/ad-ldap-authentication-failure/258040 "2020-12-08T19:14:44Z")

</div>

Hi Team, We have configured the required settings as shown in the documents for elastic search integration with AD authentication and created all the required groups and users at AD end but when I try to login with the …

---

## [If you save dashboard as json, does it save visualization as well?](https://discuss.elastic.co/t/if-you-save-dashboard-as-json-does-it-save-visualization-as-well/258052)

<div class="topic-metadata">

**Author:** [@jhagen92](https://discuss.elastic.co/u/jhagen92)\
**Replies:** 3\
**Last updated:** [December 8, 2020, 9:34pm UTC](https://discuss.elastic.co/t/if-you-save-dashboard-as-json-does-it-save-visualization-as-well/258052 "2020-12-08T21:34:07Z")

</div>

Hi. I am trying to create development environment and production environment for Kibana dashboard (two separate VMs). Idea is to work on dev environment, export json -\> import json in production environment. If I work …

---

## [Logstash filter for firewall packet drops](https://discuss.elastic.co/t/logstash-filter-for-firewall-packet-drops/258042)

<div class="topic-metadata">

**Author:** [@hassan.rana](https://discuss.elastic.co/u/hassan.rana)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 8:48pm UTC](https://discuss.elastic.co/t/logstash-filter-for-firewall-packet-drops/258042 "2020-12-08T20:48:03Z")

</div>

I am trying to parse logs from an aggregate syslog server to logstash. I have been successful in shipping the logs from the syslog server to logstash. I can see multiple fields from the log that are being setup like (hos…

---

## [Filebeat dashboards are not loaded in kibana---filebeat version 7.10](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-filebeat-version-7-10/257933)

<div class="topic-metadata">

**Author:** [@prakash22](https://discuss.elastic.co/u/prakash22)\
**Replies:** 4\
**Last updated:** [December 8, 2020, 8:11pm UTC](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-filebeat-version-7-10/257933 "2020-12-08T20:11:49Z")

</div>

2020-12-08T09:58:34.256+0530 INFO instance/beat.go:299 Setup Beat: filebeat; Version: 7.10.0 2020-12-08T09:58:34.256+0530 DEBUG \[beat\] instance/beat.go:325 Initializing output plugins 2020-12-08T09:58…

---

## [Filebeat redis module not working](https://discuss.elastic.co/t/filebeat-redis-module-not-working/257806)

<div class="topic-metadata">

**Author:** [@Amy\_Peng](https://discuss.elastic.co/u/Amy_Peng)\
**Replies:** 1\
**Last updated:** [December 8, 2020, 6:48pm UTC](https://discuss.elastic.co/t/filebeat-redis-module-not-working/257806 "2020-12-08T18:48:27Z")

</div>

Hi all, I'm using filebeat 7.6.2 and my redis version is 6.0.3. From this reference below, I supposed my redis log would be parsed automatically and easily get all the useful fields. But redis module isn't working…

---

## [How to install multiple filebeat services in same host (Windows Server)?](https://discuss.elastic.co/t/how-to-install-multiple-filebeat-services-in-same-host-windows-server/257879)

<div class="topic-metadata">

**Author:** [@noobman2logstash](https://discuss.elastic.co/u/noobman2logstash)\
**Replies:** 1\
**Last updated:** [December 8, 2020, 6:39pm UTC](https://discuss.elastic.co/t/how-to-install-multiple-filebeat-services-in-same-host-windows-server/257879 "2020-12-08T18:39:34Z")

</div>

Hi i need help figuring out this issue as i want to run two filebeat services that points to two deferent directories in the c drive. we currently have a team using filebeat pointing to redis and now i want to install a …

---

## [How do I add a Custom Field to FileBeat with a Module?](https://discuss.elastic.co/t/how-do-i-add-a-custom-field-to-filebeat-with-a-module/257909)

<div class="topic-metadata">

**Author:** [@mstacy](https://discuss.elastic.co/u/mstacy)\
**Replies:** 1\
**Last updated:** [December 8, 2020, 6:34pm UTC](https://discuss.elastic.co/t/how-do-i-add-a-custom-field-to-filebeat-with-a-module/257909 "2020-12-08T18:34:23Z")

</div>

Below is the top portion of my filebeat yaml. This configuration works adequately. However I would like to append additional data to the events in order to better distinguish the source of the logs. I have gone throug…

---

## [Dashboard filter does not include fields from the index used in Vega visualization](https://discuss.elastic.co/t/dashboard-filter-does-not-include-fields-from-the-index-used-in-vega-visualization/258033)

<div class="topic-metadata">

**Author:** [@ege](https://discuss.elastic.co/u/ege)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 6:34pm UTC](https://discuss.elastic.co/t/dashboard-filter-does-not-include-fields-from-the-index-used-in-vega-visualization/258033 "2020-12-08T18:34:12Z")

</div>

Hi, I am trying to add an on-click signal to add a filter when clicked on each sector of a pie-chart using Vega. Even though the filter is added, it is not affected on the chart and shows an error within the filter. T…

---

## [Kibana 7.10 Pagination + Rows per page not working](https://discuss.elastic.co/t/kibana-7-10-pagination-rows-per-page-not-working/258013)

<div class="topic-metadata">

**Author:** [@jcotter91](https://discuss.elastic.co/u/jcotter91)\
**Replies:** 2\
**Last updated:** [December 8, 2020, 6:21pm UTC](https://discuss.elastic.co/t/kibana-7-10-pagination-rows-per-page-not-working/258013 "2020-12-08T18:21:34Z")

</div>

Kibana version : 7.10 Elasticsearch version : 7.10 Metricbeat version: 7.10 Browser: Google Chrome 87.0.4280.66 (Official Build) (64-bit) Revision fd98a29dd59b36f71e4741332c9ad5bda42094bf-refs/branch-heads/42…

---

## [Logstash monitoring with Metricbeat "logstash-xpack" module - data not collected and not sent to ES](https://discuss.elastic.co/t/logstash-monitoring-with-metricbeat-logstash-xpack-module-data-not-collected-and-not-sent-to-es/258006)

<div class="topic-metadata">

**Author:** [@Ilya\_Geller](https://discuss.elastic.co/u/Ilya_Geller)\
**Replies:** 7\
**Last updated:** [December 8, 2020, 6:18pm UTC](https://discuss.elastic.co/t/logstash-monitoring-with-metricbeat-logstash-xpack-module-data-not-collected-and-not-sent-to-es/258006 "2020-12-08T18:18:03Z")

</div>

Hi, I'm running version 7.7 of Logstash and Metricbeat, and I'm trying to setup stack monitoring using the metricbeat xpack modules. So far I've enabled the elasticsearch-xpack module and it works fine, ES and Kibana m…

---

## [Filebeat isn\`t collecting logs of short living containers like cronjobs](https://discuss.elastic.co/t/filebeat-isn-t-collecting-logs-of-short-living-containers-like-cronjobs/254984)

<div class="topic-metadata">

**Author:** [@Patrick\_Erber](https://discuss.elastic.co/u/Patrick_Erber)\
**Replies:** 6\
**Last updated:** [December 8, 2020, 6:12pm UTC](https://discuss.elastic.co/t/filebeat-isn-t-collecting-logs-of-short-living-containers-like-cronjobs/254984 "2020-12-08T18:12:31Z")

</div>

Hello, Filebeat isn\`t collecting logs of short living containers like cronjobs. We are using filebeat version 7.9.3 and also kubernetes autodiscovery. I've created a cronjob which prints just one line and exits afterw…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1653)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1655)
