# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1880

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1881

---

## [How to ssh into eleasticsearch vm host ? This is for self managed ES on Azure](https://discuss.elastic.co/t/how-to-ssh-into-eleasticsearch-vm-host-this-is-for-self-managed-es-on-azure/244110)

<div class="topic-metadata">

**Author:** [@jpatel](https://discuss.elastic.co/u/jpatel)\
**Replies:** 3\
**Last updated:** [August 7, 2020, 2:44pm UTC](https://discuss.elastic.co/t/how-to-ssh-into-eleasticsearch-vm-host-this-is-for-self-managed-es-on-azure/244110 "2020-08-07T14:44:37Z")

</div>

I can ssh into kibana vm host using the IP address using putty ssh. I have tried to do same for elastic node vm and it does not work. I tried to ssh into elastic node from kibana host and it does not work for me. Plea…

---

## [Multi shard vs Multi index (Assuming same data)](https://discuss.elastic.co/t/multi-shard-vs-multi-index-assuming-same-data/244103)

<div class="topic-metadata">

**Author:** [@TheWorkingDeveloper](https://discuss.elastic.co/u/TheWorkingDeveloper)\
**Replies:** 1\
**Last updated:** [August 7, 2020, 2:31pm UTC](https://discuss.elastic.co/t/multi-shard-vs-multi-index-assuming-same-data/244103 "2020-08-07T14:31:22Z")

</div>

I'm currently working on a project where I have quite a bit of freedom in the structure and size of data. Now, I'm wondering if there's performance difference between the following two scenarios: Assuming a two node set…

---

## [High CPU on Elasticsearch for single node](https://discuss.elastic.co/t/high-cpu-on-elasticsearch-for-single-node/244126)

<div class="topic-metadata">

**Author:** [@karthik8890](https://discuss.elastic.co/u/karthik8890)\
**Replies:** 1\
**Last updated:** [August 7, 2020, 2:08pm UTC](https://discuss.elastic.co/t/high-cpu-on-elasticsearch-for-single-node/244126 "2020-08-07T14:08:24Z")

</div>

Elasticsearch version : 6.8.9 JDK : 8 RAM : 8GB JVM arguments: -Xms4g -Xmx4g and the remaining are default configurations provided by package. CPU utilization is going more than 90% and also high response time taki…

---

## [Unable to connect to Kibana](https://discuss.elastic.co/t/unable-to-connect-to-kibana/243974)

<div class="topic-metadata">

**Author:** [@pchar](https://discuss.elastic.co/u/pchar)\
**Replies:** 17\
**Last updated:** [August 7, 2020, 1:48pm UTC](https://discuss.elastic.co/t/unable-to-connect-to-kibana/243974 "2020-08-07T13:48:17Z")

</div>

Hello, I have configured ELK with a nginx in front for HTTPS and authentication. This setup worked perfectly until this morning (I stopped the server for days and restarted it). WHen I try to connect to kibana with Fir…

---

## [Azure blob plugin to logstash](https://discuss.elastic.co/t/azure-blob-plugin-to-logstash/244183)

<div class="topic-metadata">

**Author:** [@Amit\_Agarwal](https://discuss.elastic.co/u/Amit_Agarwal)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 1:46pm UTC](https://discuss.elastic.co/t/azure-blob-plugin-to-logstash/244183 "2020-08-07T13:46:03Z")

</div>

Hi, I am trying to send logs from azure blob storage to logstash. I am using azureblob input plugin but i dont see any logs being sent to logstash and I get no errors in debug logs. The files have extension of .log.gz. …

---

## [Multi pipelines](https://discuss.elastic.co/t/multi-pipelines/243676)

<div class="topic-metadata">

**Author:** [@peretz\_shlomi](https://discuss.elastic.co/u/peretz_shlomi)\
**Replies:** 4\
**Last updated:** [August 7, 2020, 1:24pm UTC](https://discuss.elastic.co/t/multi-pipelines/243676 "2020-08-07T13:24:39Z")

</div>

hi i have two pipeline that collect csv file from different folder each folder collect the data to a different index The file name is the same (Inside the file the information is a bit different) i have problem that…

---

## [\[HADOOP\] Add custom mapping configuration key](https://discuss.elastic.co/t/hadoop-add-custom-mapping-configuration-key/244179)

<div class="topic-metadata">

**Author:** [@jpgilaberte](https://discuss.elastic.co/u/jpgilaberte)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 1:05pm UTC](https://discuss.elastic.co/t/hadoop-add-custom-mapping-configuration-key/244179 "2020-08-07T13:05:41Z")

</div>

Hi, maybe it makes sense to allow customizing the mapping in the creation of an index? For example, when a table is created from SparkSql and the index does not exist, there could be a configuration option that allows c…

---

## [JSON response parsing at attribute level](https://discuss.elastic.co/t/json-response-parsing-at-attribute-level/243552)

<div class="topic-metadata">

**Author:** [@Puneeth\_S\_B\_Gowda1](https://discuss.elastic.co/u/Puneeth_S_B_Gowda1)\
**Replies:** 9\
**Last updated:** [August 7, 2020, 12:09pm UTC](https://discuss.elastic.co/t/json-response-parsing-at-attribute-level/243552 "2020-08-07T12:09:27Z")

</div>

Hi, my logstash configuration for moving JSON response isinput { beats { port =\> 5044 } } filter {mutate { split =\> { "message" =\> "@$@" }} mutate { add\_field =\> { "response" =\> "%{\[message\]\[7\]}" "channel\_typ" =\> "%…

---

## [Kibana pipelines ui not found?](https://discuss.elastic.co/t/kibana-pipelines-ui-not-found/241622)

<div class="topic-metadata">

**Author:** [@lework](https://discuss.elastic.co/u/lework)\
**Replies:** 6\
**Last updated:** [August 7, 2020, 12:20pm UTC](https://discuss.elastic.co/t/kibana-pipelines-ui-not-found/241622 "2020-08-07T12:20:06Z")

</div>

version : 7.8.0 kibana ui http://node1:5601/logstash/pipelines/nginx?\_g=(cluster\_uuid:%278vWjGROoTxeIW2yGB2UUng%27,refreshInterval:(pause:!f,value:10000),time:(from:now-1h,to:now)) {"statusCode":404,"error":"Not Found"…

---

## [Logstash continues to restart itself on connection failures](https://discuss.elastic.co/t/logstash-continues-to-restart-itself-on-connection-failures/244172)

<div class="topic-metadata">

**Author:** [@VinayM30](https://discuss.elastic.co/u/VinayM30)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 12:10pm UTC](https://discuss.elastic.co/t/logstash-continues-to-restart-itself-on-connection-failures/244172 "2020-08-07T12:10:48Z")

</div>

I have a usecase where i need to ingest data from Oracle DB and send it to elastic search i have written a config file which is executing fine when connection is ok. but today when i ran it somehow password got wrong an…

---

## [Suspected bug: cannot disable a field using dynamic templates](https://discuss.elastic.co/t/suspected-bug-cannot-disable-a-field-using-dynamic-templates/244170)

<div class="topic-metadata">

**Author:** [@drs](https://discuss.elastic.co/u/drs)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 12:05pm UTC](https://discuss.elastic.co/t/suspected-bug-cannot-disable-a-field-using-dynamic-templates/244170 "2020-08-07T12:05:29Z")

</div>

I am trying to use a dynamic template to disable analysis on a field by setting enabled: false in its mapping. This is the mapping I'm using: { "mappings": { "dynamic": true, "dynamic\_templates": \[ { …

---

## [Clean scroll context after \`\_update\_by\_query\`](https://discuss.elastic.co/t/clean-scroll-context-after-update-by-query/244164)

<div class="topic-metadata">

**Author:** [@Toma\_Popov](https://discuss.elastic.co/u/Toma_Popov)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 11:36am UTC](https://discuss.elastic.co/t/clean-scroll-context-after-update-by-query/244164 "2020-08-07T11:36:27Z")

</div>

Hello, I have a question regarding scroll context-s created by the Update by query API. Currently we create a lot of scroll context, when we update events in our system. The scrolls are kept for just one minute, but du…

---

## [Error fetching data Bad Request msgs on my dashboard views](https://discuss.elastic.co/t/error-fetching-data-bad-request-msgs-on-my-dashboard-views/244076)

<div class="topic-metadata">

**Author:** [@Mark\_Duncan](https://discuss.elastic.co/u/Mark_Duncan)\
**Replies:** 2\
**Last updated:** [August 7, 2020, 11:33am UTC](https://discuss.elastic.co/t/error-fetching-data-bad-request-msgs-on-my-dashboard-views/244076 "2020-08-07T11:33:47Z")

</div>

I am getting these constantly. Any ideas how to solve? Thanks in advance, Mark Error fetching data Bad Request Error: Bad Request at Fetch.\_callee3$ (https://kibana.bobot.ai/bundles/commons.bundle.js:3:4049443) …

---

## [Auditbeat IP metadata missing](https://discuss.elastic.co/t/auditbeat-ip-metadata-missing/244162)

<div class="topic-metadata">

**Author:** [@mozam](https://discuss.elastic.co/u/mozam)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 11:22am UTC](https://discuss.elastic.co/t/auditbeat-ip-metadata-missing/244162 "2020-08-07T11:22:18Z")

</div>

Hello, I'm using the below pipeline to index data to Elasticsearch (Elastic 7.8.0 is used). Auditbeat -\> Logstash -\> Elasticsearch Using the below mutate filter I'm able to copy the IP address from metadata to a new f…

---

## [Metricbeat SSL to Elastic Setup](https://discuss.elastic.co/t/metricbeat-ssl-to-elastic-setup/244024)

<div class="topic-metadata">

**Author:** [@PiperMp3](https://discuss.elastic.co/u/PiperMp3)\
**Replies:** 1\
**Last updated:** [August 7, 2020, 11:15am UTC](https://discuss.elastic.co/t/metricbeat-ssl-to-elastic-setup/244024 "2020-08-07T11:15:52Z")

</div>

Hello, I'm about to lose my mind and scratch ELK all together due to this problem. Let me start with explaining the goal. There are 3 VMs. 2 are public VPS' and 1 is a local VM. All are Ubuntu 20.04. I will call th…

---

## [Overwriting the @timestamp work on stdout but don't work on es](https://discuss.elastic.co/t/overwriting-the-timestamp-work-on-stdout-but-dont-work-on-es/244131)

<div class="topic-metadata">

**Author:** [@Tristan\_D](https://discuss.elastic.co/u/Tristan_D)\
**Replies:** 4\
**Last updated:** [August 7, 2020, 10:36am UTC](https://discuss.elastic.co/t/overwriting-the-timestamp-work-on-stdout-but-dont-work-on-es/244131 "2020-08-07T10:36:53Z")

</div>

I want to overwrite the @timestamp with date filter. The result in the stdout is ok, the @timestamp is written by the log time, but there is no document written into the elasticsearch. If I remove the date filter, the …

---

## [Nginx as a reverse proxy for kibana gives 401 for /31997/bundles resources](https://discuss.elastic.co/t/nginx-as-a-reverse-proxy-for-kibana-gives-401-for-31997-bundles-resources/244151)

<div class="topic-metadata">

**Author:** [@Muhammad\_Umair\_Baig](https://discuss.elastic.co/u/Muhammad_Umair_Baig)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 10:11am UTC](https://discuss.elastic.co/t/nginx-as-a-reverse-proxy-for-kibana-gives-401-for-31997-bundles-resources/244151 "2020-08-07T10:11:54Z")

</div>

I am using 7.8.0 version of kibana and elasticsearch. on the front i have configured nginx 1.19 as a reverse proxy. i have put following configurations on nginx.conf but when i hit https://DNS:4443 (Nginx url) it ends u…

---

## [Kibana always showing unrelated fields](https://discuss.elastic.co/t/kibana-always-showing-unrelated-fields/242345)

<div class="topic-metadata">

**Author:** [@luminance](https://discuss.elastic.co/u/luminance)\
**Replies:** 4\
**Last updated:** [August 7, 2020, 9:40am UTC](https://discuss.elastic.co/t/kibana-always-showing-unrelated-fields/242345 "2020-08-07T09:40:34Z")

</div>

I am using Elastic Cloud Kibana and I am always seeing fields that are of date type, but have nothing to do with the indexed document. It is a metricbeat index and I am using the default mapping provided by metricbeat. A…

---

## [Elastic API query \_grokparsefailure tags](https://discuss.elastic.co/t/elastic-api-query-grokparsefailure-tags/243584)

<div class="topic-metadata">

**Author:** [@alces](https://discuss.elastic.co/u/alces)\
**Replies:** 8\
**Last updated:** [August 7, 2020, 9:21am UTC](https://discuss.elastic.co/t/elastic-api-query-grokparsefailure-tags/243584 "2020-08-07T09:21:12Z")

</div>

Hello, I'm currently trying to get all logs of an index which have a "\_grokparsefailure" tag assigned to it. Next step would be deleting these logs, but I'm not sure if this is going to work anyways: curl -X GET "http:…

---

## [Multi-fields with IP and Keyword Possible?](https://discuss.elastic.co/t/multi-fields-with-ip-and-keyword-possible/244038)

<div class="topic-metadata">

**Author:** [@michaelpietzsch](https://discuss.elastic.co/u/michaelpietzsch)\
**Replies:** 2\
**Last updated:** [August 7, 2020, 9:18am UTC](https://discuss.elastic.co/t/multi-fields-with-ip-and-keyword-possible/244038 "2020-08-07T09:18:40Z")

</div>

Hi Gals and Guys, i was wondering. With multi-fields it is possible to add multiple data types for one field while ingesting everything in to the database. Currently I have a specific field with the datatype IP, I also…

---

## [Kibana Fails to start : FATAL CLI ERROR Error: ENOENT: no such file or directory, open '/usr/share/kibana/config/kibana.yml'](https://discuss.elastic.co/t/kibana-fails-to-start-fatal-cli-error-error-enoent-no-such-file-or-directory-open-usr-share-kibana-config-kibana-yml/244123)

<div class="topic-metadata">

**Author:** [@Mr\_Chicken](https://discuss.elastic.co/u/Mr_Chicken)\
**Replies:** 1\
**Last updated:** [August 7, 2020, 8:45am UTC](https://discuss.elastic.co/t/kibana-fails-to-start-fatal-cli-error-error-enoent-no-such-file-or-directory-open-usr-share-kibana-config-kibana-yml/244123 "2020-08-07T08:45:27Z")

</div>

hi everyone, i've started installing ELK on my VM machine ( ubuntu 18.04 ). At first everything was okay, i started by installing elasticsearch and configuring some files etc.. but then moving on to Kibana i encountere…

---

## [Support for SCADA protocols](https://discuss.elastic.co/t/support-for-scada-protocols/244138)

<div class="topic-metadata">

**Author:** [@dewell](https://discuss.elastic.co/u/dewell)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 8:43am UTC](https://discuss.elastic.co/t/support-for-scada-protocols/244138 "2020-08-07T08:43:27Z")

</div>

Hello! For testing and simulation I wrote several tools that create or translate 608070-5-104, GOOSE and Sampled Values messages. Are there any Beats or logstash plugins that can read those protocols? I have a hard tim…

---

## [Not able to see all fields when trying to create visualization](https://discuss.elastic.co/t/not-able-to-see-all-fields-when-trying-to-create-visualization/244060)

<div class="topic-metadata">

**Author:** [@Dinesh\_Potey](https://discuss.elastic.co/u/Dinesh_Potey)\
**Replies:** 5\
**Last updated:** [August 7, 2020, 8:11am UTC](https://discuss.elastic.co/t/not-able-to-see-all-fields-when-trying-to-create-visualization/244060 "2020-08-07T08:11:44Z")

</div>

Hi , I am trying to create error dashboard for which firstly I have to create a visualization out of my Index pattern. I am not able to see all the elements of my xml when I am trying to filter out to create the visuali…

---

## [How to run logstash service in the background?](https://discuss.elastic.co/t/how-to-run-logstash-service-in-the-background/243645)

<div class="topic-metadata">

**Author:** [@evacch](https://discuss.elastic.co/u/evacch)\
**Replies:** 11\
**Last updated:** [August 7, 2020, 7:58am UTC](https://discuss.elastic.co/t/how-to-run-logstash-service-in-the-background/243645 "2020-08-07T07:58:16Z")

</div>

I installed and configured ELK in a CentOS environment. I have been using the following command to run logstash in the foreground and it works perfectly. ./usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/logst…

---

## [Help required! Auditbeat fails to push correct \`process.args\` field when using reverse shells](https://discuss.elastic.co/t/help-required-auditbeat-fails-to-push-correct-process-args-field-when-using-reverse-shells/244132)

<div class="topic-metadata">

**Author:** [@Simon\_Moller](https://discuss.elastic.co/u/Simon_Moller)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 7:49am UTC](https://discuss.elastic.co/t/help-required-auditbeat-fails-to-push-correct-process-args-field-when-using-reverse-shells/244132 "2020-08-07T07:49:20Z")

</div>

Hi, I am having problems with the process.args and process.title field that Auditbeat pushes when using a reverse shell. E.g. let's say that I add the following auditd rule to the /etc/auditbeat/audit.rules.d/blueprint-e…

---

## [Finetuning CPU usage](https://discuss.elastic.co/t/finetuning-cpu-usage/244129)

<div class="topic-metadata">

**Author:** [@evacch](https://discuss.elastic.co/u/evacch)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 7:17am UTC](https://discuss.elastic.co/t/finetuning-cpu-usage/244129 "2020-08-07T07:17:50Z")

</div>

Hi, I am new to ELK and I am running ELK in a CentOS 7 environment. I have 4 CPU cores in this machine and with the default configuration of Logstash, the CPU usage is always very high. Knowing that running Logstash …

---

## [Large dataset leads to TaskCancelledException: cancelled](https://discuss.elastic.co/t/large-dataset-leads-to-taskcancelledexception-cancelled/243720)

<div class="topic-metadata">

**Author:** [@sherzinger](https://discuss.elastic.co/u/sherzinger)\
**Replies:** 3\
**Last updated:** [August 7, 2020, 7:02am UTC](https://discuss.elastic.co/t/large-dataset-leads-to-taskcancelledexception-cancelled/243720 "2020-08-07T07:02:11Z")

</div>

Hi, When watching a dashboard or browsing Discovery of a large datas et (several 100GB) sometimes Elastic will just give up with the error message below. The cluster consists of 10 nodes with a total of 88 cores and 75…

---

## [Logstash 7.2.0 input jdbc plugin restarts itself and inserts data continuously in elastic](https://discuss.elastic.co/t/logstash-7-2-0-input-jdbc-plugin-restarts-itself-and-inserts-data-continuously-in-elastic/243966)

<div class="topic-metadata">

**Author:** [@VinayM30](https://discuss.elastic.co/u/VinayM30)\
**Replies:** 4\
**Last updated:** [August 7, 2020, 6:58am UTC](https://discuss.elastic.co/t/logstash-7-2-0-input-jdbc-plugin-restarts-itself-and-inserts-data-continuously-in-elastic/243966 "2020-08-07T06:58:53Z")

</div>

I am trying to import data from oracle db to elastic search, the process is happening with logstash in windows but when i run the same in a unix box it fetches the data from table then says \[Error\] \[logstash.javapipelin…

---

## [Error parsing JSON file](https://discuss.elastic.co/t/error-parsing-json-file/244014)

<div class="topic-metadata">

**Author:** [@Vikash\_Singh1](https://discuss.elastic.co/u/Vikash_Singh1)\
**Replies:** 4\
**Last updated:** [August 7, 2020, 6:53am UTC](https://discuss.elastic.co/t/error-parsing-json-file/244014 "2020-08-07T06:53:02Z")

</div>

I am trying to parse a json file which consists of multiple line but even though I am using multiline codec but still I am getting error. Sample of my Json file is as follows: \> \[ { "action": "drop", "clientAS…

---

## [Generate 'rollup\_index' name based on index being rolled-up](https://discuss.elastic.co/t/generate-rollup-index-name-based-on-index-being-rolled-up/244124)

<div class="topic-metadata">

**Author:** [@SpicyNotNumb](https://discuss.elastic.co/u/SpicyNotNumb)\
**Replies:** 0\
**Last updated:** [August 7, 2020, 6:39am UTC](https://discuss.elastic.co/t/generate-rollup-index-name-based-on-index-being-rolled-up/244124 "2020-08-07T06:39:35Z")

</div>

I have a bunch of indices, those are time-series data. GET \_cat/indices/jti-log\* green open jti-logical-usage-q3-raw hppahZg0Qj6dLFWTl4ouIw green open jti-logical-usage-q4-raw 6r5Y-bUFSqOIAl-Q-JSC5g green open jti-logic…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1879)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1881)
