# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1619

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1620

---

## [Monitoring Request Failed](https://discuss.elastic.co/t/monitoring-request-failed/259628)

<div class="topic-metadata">

**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\
**Replies:** 2\
**Last updated:** [January 5, 2021, 7:44am UTC](https://discuss.elastic.co/t/monitoring-request-failed/259628 "2021-01-05T07:44:51Z")

</div>

Hi everyone, I using kibana and elasticsearch verison 7.4.2 . When I set the time interval between 1-15 minutes in the Kibana Stack Monitoring panel, I get the error 'Monitoring Request Failed: Unable to find the clust…

---

## [Simultaneous Filebeats to handle high load](https://discuss.elastic.co/t/simultaneous-filebeats-to-handle-high-load/260108)

<div class="topic-metadata">

**Author:** [@talsh87](https://discuss.elastic.co/u/talsh87)\
**Replies:** 2\
**Last updated:** [January 5, 2021, 7:32am UTC](https://discuss.elastic.co/t/simultaneous-filebeats-to-handle-high-load/260108 "2021-01-05T07:32:49Z")

</div>

I'd like to leverage Filebeat so it'd fetch our o365\\azure\\aws logs using the various modules . How would it handle very high volumes? Is there any benchmark for example events\\MBs per second? Is there any way to maint…

---

## [DNS lookup failure "my-cluster-es-http": lookup my-cluster-es-http on 1xx.xx.xx.xx:53: no such host](https://discuss.elastic.co/t/dns-lookup-failure-my-cluster-es-http-lookup-my-cluster-es-http-on-1xx-xx-xx-xx-no-such-host/260172)

<div class="topic-metadata">

**Author:** [@umen](https://discuss.elastic.co/u/umen)\
**Replies:** 0\
**Last updated:** [January 5, 2021, 7:30am UTC](https://discuss.elastic.co/t/dns-lookup-failure-my-cluster-es-http-lookup-my-cluster-es-http-on-1xx-xx-xx-xx-no-such-host/260172 "2021-01-05T07:30:27Z")

</div>

Hey i followed the quickstart tutorial to setup elasticsearch on Kubernetes . installed it on pre created namespace not default . apiVersion: elasticsearch.k8s.elastic.co/v1 kind: Elasticsearch metadata: name: my-cl…

---

## [ERROR	pipeline/output.go:100	Failed to connect to backoff(async(tcp://0.0.0.0:5044)): dial tcp 0.0.0.0:5044: connect: connection refused](https://discuss.elastic.co/t/error-pipeline-output-go-100-failed-to-connect-to-backoff-async-tcp-0-0-0-0-5044-dial-tcp-0-0-0-0-connect-connection-refused/260121)

<div class="topic-metadata">

**Author:** [@UjjwalBera](https://discuss.elastic.co/u/UjjwalBera)\
**Replies:** 6\
**Last updated:** [January 5, 2021, 7:30am UTC](https://discuss.elastic.co/t/error-pipeline-output-go-100-failed-to-connect-to-backoff-async-tcp-0-0-0-0-5044-dial-tcp-0-0-0-0-connect-connection-refused/260121 "2021-01-05T07:30:11Z")

</div>

Here below filebeat.yml output configuration output.logstash: enabled: true hosts: \["0.0.0.0:5044"\] timeout: 86400\`\` logstash.conf input configuration input { beats { port =\> 5044 …

---

## [Create multiple indicies mapping at one elasticsearch](https://discuss.elastic.co/t/create-multiple-indicies-mapping-at-one-elasticsearch/260162)

<div class="topic-metadata">

**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\
**Replies:** 1\
**Last updated:** [January 5, 2021, 6:51am UTC](https://discuss.elastic.co/t/create-multiple-indicies-mapping-at-one-elasticsearch/260162 "2021-01-05T06:51:59Z")

</div>

Hi, I have a scenario where my index name is changing frequently, I want to create index mapping at one go. with my-index-\* But I am not able to create at one go. PUT /my-index-\*/\_mapping { "properties": { "emai…

---

## [Creating and deleting a small index every 3 minutes, posible problems?](https://discuss.elastic.co/t/creating-and-deleting-a-small-index-every-3-minutes-posible-problems/260158)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 5\
**Last updated:** [January 5, 2021, 6:44am UTC](https://discuss.elastic.co/t/creating-and-deleting-a-small-index-every-3-minutes-posible-problems/260158 "2021-01-05T06:44:51Z")

</div>

Hi, with a python script I run a single logstash pipeline that create an ES index, in the same script I delete the index every 3 minutes, the size of the index is less than 1 Mb, I was wandering if this constant deletio…

---

## [Multiple nodes docker-compose](https://discuss.elastic.co/t/multiple-nodes-docker-compose/260127)

<div class="topic-metadata">

**Author:** [@nyquillus](https://discuss.elastic.co/u/nyquillus)\
**Replies:** 8\
**Last updated:** [January 5, 2021, 6:32am UTC](https://discuss.elastic.co/t/multiple-nodes-docker-compose/260127 "2021-01-05T06:32:38Z")

</div>

Hi, I currently manage a docker ELK stack with 3 nodes (1 master/no-data, 2 master/data) on the same machine. If I add 2 mode data node containers to this(still on the same machine) will i experience significant perform…

---

## [Ingesting Oracle's Audit Trail](https://discuss.elastic.co/t/ingesting-oracles-audit-trail/259897)

<div class="topic-metadata">

**Author:** [@Anabella\_Cristaldi](https://discuss.elastic.co/u/Anabella_Cristaldi)\
**Replies:** 2\
**Last updated:** [January 5, 2021, 6:29am UTC](https://discuss.elastic.co/t/ingesting-oracles-audit-trail/259897 "2021-01-05T06:29:17Z")

</div>

Hi, I'm ingesting the content from sys.dba\_audit\_trail into ES using the jdbc input plugin. Everything goes ok with the exception of the field transactionid which is of type (at db level of RAW(8)) Here an example 000…

---

## [Kibana is not ready yet in 7.10.1](https://discuss.elastic.co/t/kibana-is-not-ready-yet-in-7-10-1/259232)

<div class="topic-metadata">

**Author:** [@Bhavya\_Sri](https://discuss.elastic.co/u/Bhavya_Sri)\
**Replies:** 4\
**Last updated:** [January 5, 2021, 4:43am UTC](https://discuss.elastic.co/t/kibana-is-not-ready-yet-in-7-10-1/259232 "2021-01-05T04:43:52Z")

</div>

Hi, I have installed Kibana v7.10. I have made the modifications for server.host in kibana.yml file. Post that when i start Kibana by using - sudo service kibana start it is says Starting kibana (via systemctl): …

---

## [File paths must be absolute, relative path specified](https://discuss.elastic.co/t/file-paths-must-be-absolute-relative-path-specified/260016)

<div class="topic-metadata">

**Author:** [@Cyphy](https://discuss.elastic.co/u/Cyphy)\
**Replies:** 9\
**Last updated:** [January 5, 2021, 4:09am UTC](https://discuss.elastic.co/t/file-paths-must-be-absolute-relative-path-specified/260016 "2021-01-05T04:09:27Z")

</div>

hey there, hope you can help me :slight\_smile: I started my ELK setup with docker-compose a few days ago. It looked fine as all 3 containers where running without any data. Today i wanted to import some xml files with …

---

## [No matching indices found: No indices match pattern "winlogbeat-\*"](https://discuss.elastic.co/t/no-matching-indices-found-no-indices-match-pattern-winlogbeat/260134)

<div class="topic-metadata">

**Author:** [@sixstringssteve](https://discuss.elastic.co/u/sixstringssteve)\
**Replies:** 14\
**Last updated:** [January 5, 2021, 2:14am UTC](https://discuss.elastic.co/t/no-matching-indices-found-no-indices-match-pattern-winlogbeat/260134 "2021-01-05T02:14:47Z")

</div>

I am getting the errors "No matching indices found: No indices match pattern "winlogbeat-\*" when I try to go to the Winlogbeat dashboard or Discover. There was a winlogbeat-\* index pattern created, just no traffic hitt…

---

## [Logstash best practice for filters order](https://discuss.elastic.co/t/logstash-best-practice-for-filters-order/259775)

<div class="topic-metadata">

**Author:** [@Mohammad\_Mousavi](https://discuss.elastic.co/u/Mohammad_Mousavi)\
**Replies:** 2\
**Last updated:** [January 5, 2021, 3:18am UTC](https://discuss.elastic.co/t/logstash-best-practice-for-filters-order/259775 "2021-01-05T03:18:49Z")

</div>

Hi, I have a lot of input and filters on my logstash and I've been thinking are they optimize and how can I measure logstash performance. I only monitor "heap used" and it's fine. I came up with a question. There are 2 t…

---

## [How can I configure kibana on different host?](https://discuss.elastic.co/t/how-can-i-configure-kibana-on-different-host/260069)

<div class="topic-metadata">

**Author:** [@Hi\_u\_Nguy\_n\_Dang](https://discuss.elastic.co/u/Hi_u_Nguy_n_Dang)\
**Replies:** 14\
**Last updated:** [January 5, 2021, 3:02am UTC](https://discuss.elastic.co/t/how-can-i-configure-kibana-on-different-host/260069 "2021-01-05T03:02:04Z")

</div>

How can I configure kibana if it run on a different host with elasticsearch and logstash? For example my elasticsearch server is 10.1.11.111 my kibana server is 10.1.11.112 and my logstash server is 10.1.11.113 ? In …

---

## [Show data in kibana, used snmp plugin](https://discuss.elastic.co/t/show-data-in-kibana-used-snmp-plugin/260125)

<div class="topic-metadata">

**Author:** [@aandrewsllp](https://discuss.elastic.co/u/aandrewsllp)\
**Replies:** 1\
**Last updated:** [January 5, 2021, 2:53am UTC](https://discuss.elastic.co/t/show-data-in-kibana-used-snmp-plugin/260125 "2021-01-05T02:53:38Z")

</div>

i need show data in kibana, used snmp plugin

---

## [JDBC\_Streaming plugin issue](https://discuss.elastic.co/t/jdbc-streaming-plugin-issue/260149)

<div class="topic-metadata">

**Author:** [@Ashok\_Botcha](https://discuss.elastic.co/u/Ashok_Botcha)\
**Replies:** 0\
**Last updated:** [January 5, 2021, 2:29am UTC](https://discuss.elastic.co/t/jdbc-streaming-plugin-issue/260149 "2021-01-05T02:29:26Z")

</div>

Hi, I am trying below sample logstash config, Output also pasted below. data related to table C not coming inside B, Can you suggest if anything wrong with config ? CONFIG: \`input { jdbc { ....... statement =\> "SELE…

---

## [Can logstash's Google Cloud Storage output plugin do persistent transmission after restart machine?](https://discuss.elastic.co/t/can-logstashs-google-cloud-storage-output-plugin-do-persistent-transmission-after-restart-machine/260139)

<div class="topic-metadata">

**Author:** [@iooi](https://discuss.elastic.co/u/iooi)\
**Replies:** 0\
**Last updated:** [January 4, 2021, 11:45pm UTC](https://discuss.elastic.co/t/can-logstashs-google-cloud-storage-output-plugin-do-persistent-transmission-after-restart-machine/260139 "2021-01-04T23:45:41Z")

</div>

Using this config for logstash's output. It's using /tmp/logstash-gcs as a local folder. Send to GCS when file become 1024 kbytes. input { beats { port =\> 5044 } } filter {} output { google\_cloud\_storage { …

---

## [7.x How do remove duplicates in search after query?](https://discuss.elastic.co/t/7-x-how-do-remove-duplicates-in-search-after-query/259692)

<div class="topic-metadata">

**Author:** [@Adin\_Sijamija](https://discuss.elastic.co/u/Adin_Sijamija)\
**Replies:** 1\
**Last updated:** [January 5, 2021, 12:54am UTC](https://discuss.elastic.co/t/7-x-how-do-remove-duplicates-in-search-after-query/259692 "2021-01-05T00:54:39Z")

</div>

I have several indexes spread across 3 shards that hold my data. I want to make a SearchAfter where I fetch 50 rows ordered by start time. When I run it I am returned 50 hits but half of them are duplicates as the data i…

---

## [Kibana not recognize my fields](https://discuss.elastic.co/t/kibana-not-recognize-my-fields/260088)

<div class="topic-metadata">

**Author:** [@learn\_and\_try](https://discuss.elastic.co/u/learn_and_try)\
**Replies:** 1\
**Last updated:** [January 5, 2021, 12:38am UTC](https://discuss.elastic.co/t/kibana-not-recognize-my-fields/260088 "2021-01-05T00:38:36Z")

</div>

hi guys i am new in elk and Kibana i am tried to put data via Logstah config file: this is the mapping details: "map\_date":{ "type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd||epoch\_millis" }, when i …

---

## [Notify slack when hosts are up](https://discuss.elastic.co/t/notify-slack-when-hosts-are-up/258942)

<div class="topic-metadata">

**Author:** [@minu.ajith](https://discuss.elastic.co/u/minu.ajith)\
**Replies:** 3\
**Last updated:** [January 5, 2021, 12:37am UTC](https://discuss.elastic.co/t/notify-slack-when-hosts-are-up/258942 "2021-01-05T00:37:26Z")

</div>

Hi team, Is there a way to get alerts in slack and auto-resolve pagerduty alerts when the hosts come back online ? Regards, Minu

---

## [Checkpoint Firewall Logs](https://discuss.elastic.co/t/checkpoint-firewall-logs/260133)

<div class="topic-metadata">

**Author:** [@somerandomitperson](https://discuss.elastic.co/u/somerandomitperson)\
**Replies:** 5\
**Last updated:** [January 5, 2021, 12:07am UTC](https://discuss.elastic.co/t/checkpoint-firewall-logs/260133 "2021-01-05T00:07:42Z")

</div>

This is my first experience with Elastic. I am trying to set up a Kibana dashboard and create dashboards for my Checkpoint firewall. The built in checkpoint module does not parse logs from my firewall. I have looked into…

---

## [Running elasticsearch as daemon from shell script with password-protected keystore file](https://discuss.elastic.co/t/running-elasticsearch-as-daemon-from-shell-script-with-password-protected-keystore-file/260033)

<div class="topic-metadata">

**Author:** [@dzyubanv](https://discuss.elastic.co/u/dzyubanv)\
**Replies:** 2\
**Last updated:** [January 4, 2021, 11:10pm UTC](https://discuss.elastic.co/t/running-elasticsearch-as-daemon-from-shell-script-with-password-protected-keystore-file/260033 "2021-01-04T23:10:00Z")

</div>

Issue - elasticsearch doesn't start when running it as daemon from shell script. Details: I installed elasticsearch version 7.9.3 from archive on RHEL Configured 2 nodes cluster with TLS/SSL in elasticsearch.yml Prote…

---

## [Data Table Time Offset](https://discuss.elastic.co/t/data-table-time-offset/260124)

<div class="topic-metadata">

**Author:** [@stevezemlicka](https://discuss.elastic.co/u/stevezemlicka)\
**Replies:** 2\
**Last updated:** [January 4, 2021, 10:53pm UTC](https://discuss.elastic.co/t/data-table-time-offset/260124 "2021-01-04T22:53:10Z")

</div>

I have been building a dashboard with a couple of indexes. After evaluation, it turns out one of the indexes seems to be off by 1hr. For all of my timelion visualizations, this was corrected by modifying each reference…

---

## [Which is better - requests or elasticsearch](https://discuss.elastic.co/t/which-is-better-requests-or-elasticsearch/259974)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 1\
**Last updated:** [January 4, 2021, 10:35pm UTC](https://discuss.elastic.co/t/which-is-better-requests-or-elasticsearch/259974 "2021-01-04T22:35:13Z")

</div>

Inside python I can use two different method to retrieve the data. one with requests.get or can use elasticsarch module. for requests.get I can use sql query. while in elasticsearch I have to use REST code. which one …

---

## [Mutate gsub regex pattern help](https://discuss.elastic.co/t/mutate-gsub-regex-pattern-help/260122)

<div class="topic-metadata">

**Author:** [@S3l3ct3d](https://discuss.elastic.co/u/S3l3ct3d)\
**Replies:** 6\
**Last updated:** [January 4, 2021, 10:27pm UTC](https://discuss.elastic.co/t/mutate-gsub-regex-pattern-help/260122 "2021-01-04T22:27:12Z")

</div>

I am having an issue with the regex pattern in mutate gsub function. My current filter is below filter { # Log types are "SIEM\_EVENTS", "TTP\_EVENTS", "AUDIT\_EVENTS". mutate { gsub =\> \[ "\[message\]", "^\<\\d+\>", "" \] …

---

## [Filebeats and xpack modules - Confusion about licensing](https://discuss.elastic.co/t/filebeats-and-xpack-modules-confusion-about-licensing/260106)

<div class="topic-metadata">

**Author:** [@talsh87](https://discuss.elastic.co/u/talsh87)\
**Replies:** 1\
**Last updated:** [January 4, 2021, 9:16pm UTC](https://discuss.elastic.co/t/filebeats-and-xpack-modules-confusion-about-licensing/260106 "2021-01-04T21:16:12Z")

</div>

In case I'd just like to leverage Filebeats including x-pack modules (such as Office365) and Logstash as part of a backend infrastructure - Is a license needed? The ingestion process (and Filebeats\\Logstash inside) isn'…

---

## [Filebeat 7.3.0 High CPU](https://discuss.elastic.co/t/filebeat-7-3-0-high-cpu/260130)

<div class="topic-metadata">

**Author:** [@tarpanpathak](https://discuss.elastic.co/u/tarpanpathak)\
**Replies:** 0\
**Last updated:** [January 4, 2021, 8:47pm UTC](https://discuss.elastic.co/t/filebeat-7-3-0-high-cpu/260130 "2021-01-04T20:47:55Z")

</div>

Hi, I am not sure if this is the best place to discuss this but one of our compute nodes in Kubernetes is constantly alerting on high CPU. After digging a bit deeper, we see that the Filebeat process on the node is trig…

---

## [Logstash multiline pattern](https://discuss.elastic.co/t/logstash-multiline-pattern/259997)

<div class="topic-metadata">

**Author:** [@Muhammad\_Faisal](https://discuss.elastic.co/u/Muhammad_Faisal)\
**Replies:** 3\
**Last updated:** [January 4, 2021, 6:19pm UTC](https://discuss.elastic.co/t/logstash-multiline-pattern/259997 "2021-01-04T18:19:49Z")

</div>

hi guys, i have a log file which consists of below pattern , i need to treat all lines of this log file as 1 aggregate event.file will close after 30 minutes and then new log will start..which pattern will work here...…

---

## [Logstash do not import file](https://discuss.elastic.co/t/logstash-do-not-import-file/260114)

<div class="topic-metadata">

**Author:** [@Sad\_Creem](https://discuss.elastic.co/u/Sad_Creem)\
**Replies:** 2\
**Last updated:** [January 4, 2021, 6:15pm UTC](https://discuss.elastic.co/t/logstash-do-not-import-file/260114 "2021-01-04T18:15:30Z")

</div>

Is Logstash have a limit for max line characters leight? I have 12 mb json file wich content single line json with multi objects. Logstash do not work with this file i'am dont know why no error no debug string just sta…

---

## [Fix broken cluster with elasticsearch-node detach-cluster not working](https://discuss.elastic.co/t/fix-broken-cluster-with-elasticsearch-node-detach-cluster-not-working/260070)

<div class="topic-metadata">

**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Replies:** 17\
**Last updated:** [January 4, 2021, 5:58pm UTC](https://discuss.elastic.co/t/fix-broken-cluster-with-elasticsearch-node-detach-cluster-not-working/260070 "2021-01-04T17:58:28Z")

</div>

I want to fix a broken cluster (when a node cannot join because differente cluster UUID by exemple) without removing all data folder (the dirty solution I can see every time....), currently I am testing it, using officia…

---

## [Using tokens with the endpoint /internal/security/login for logging instead of basic authentication](https://discuss.elastic.co/t/using-tokens-with-the-endpoint-internal-security-login-for-logging-instead-of-basic-authentication/259909)

<div class="topic-metadata">

**Author:** [@DMinovski](https://discuss.elastic.co/u/DMinovski)\
**Replies:** 4\
**Last updated:** [January 4, 2021, 5:29pm UTC](https://discuss.elastic.co/t/using-tokens-with-the-endpoint-internal-security-login-for-logging-instead-of-basic-authentication/259909 "2021-01-04T17:29:28Z")

</div>

In this post, Kibana 7.10 login issues, there is an example of using basic authentication to log through the /internal/security/login API endpoint by using: --data-raw '{"providerType":"basic","providerName":"basic","cu…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1618)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1620)
