# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1778 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1779 --- ## [o.e.b.Bootstrap](https://discuss.elastic.co/t/o-e-b-bootstrap/250365)
**Author:** [@muthug](https://discuss.elastic.co/u/muthug)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 6:52am UTC](https://discuss.elastic.co/t/o-e-b-bootstrap/250365 "2020-09-30T06:52:47Z")
\[2020-09-29T15:25:43,752\]\[ERROR\]\[o.e.b.Bootstrap \] \[VDCGraylogNode02\] Exception java.lang.IllegalArgumentException: node settings must not contain any index level settings at org.elasticsearch.common.settings.… --- ## [ES rally benchmarking for existing cluster on AWS](https://discuss.elastic.co/t/es-rally-benchmarking-for-existing-cluster-on-aws/250182)
**Author:** [@naga2](https://discuss.elastic.co/u/naga2)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 6:50am UTC](https://discuss.elastic.co/t/es-rally-benchmarking-for-existing-cluster-on-aws/250182 "2020-09-30T06:50:39Z")
I want to benchmark Elastic cluster which was on AWS with ES Rally on local machine. I got the below error when tried with following benchmarking command. Input: esrally --track=data --target-hosts= \[cluster public ip… --- ## [Query fails when value is empty - how do I work around this?](https://discuss.elastic.co/t/query-fails-when-value-is-empty-how-do-i-work-around-this/250439)
**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Replies:** 1\ **Last updated:** [September 30, 2020, 6:44am UTC](https://discuss.elastic.co/t/query-fails-when-value-is-empty-how-do-i-work-around-this/250439 "2020-09-30T06:44:58Z")
Hi there, We are parsing our query via a form, and this form has 29+ inputs. Therefore there are many occassions where part of the full JSON query might have an empty value if the end user does not use one of the 29 + … --- ## [Elasticsearch Cluster Adding node](https://discuss.elastic.co/t/elasticsearch-cluster-adding-node/249637)
**Author:** [@kkhadka](https://discuss.elastic.co/u/kkhadka)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 6:42am UTC](https://discuss.elastic.co/t/elasticsearch-cluster-adding-node/249637 "2020-09-30T06:42:33Z")
Hi, I want to switch from single node elasticsearch to three node cluster without the data loss. For that, I have modified the configuration files correctly. Let node1 be the one with data and node2, node3 are new node… --- ## [Doc\['field'\]. value not returning the correct value](https://discuss.elastic.co/t/doc-field-value-not-returning-the-correct-value/250386)
**Author:** [@raviswam](https://discuss.elastic.co/u/raviswam)\ **Replies:** 3\ **Last updated:** [September 30, 2020, 6:39am UTC](https://discuss.elastic.co/t/doc-field-value-not-returning-the-correct-value/250386 "2020-09-30T06:39:50Z")
\`indent preformatted text by 4 spaces\` Hi Guys, Very new to painless scripting and have the simplest of scripted fields which is not working. I am trying to extract a pattern from doc\["message"\] field but it fails. So… --- ## [How is data encrypted on Elastic Cloud for the scenarios: Data at rest and Data in Transit](https://discuss.elastic.co/t/how-is-data-encrypted-on-elastic-cloud-for-the-scenarios-data-at-rest-and-data-in-transit/249984)
**Author:** [@Pooja](https://discuss.elastic.co/u/Pooja)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 5:59am UTC](https://discuss.elastic.co/t/how-is-data-encrypted-on-elastic-cloud-for-the-scenarios-data-at-rest-and-data-in-transit/249984 "2020-09-30T05:59:12Z")
When you host Elasticsearch on Elastic Cloud and send logs from Azure Cloud and Onprem Logstash instances, How is data encrypted while in transit and How is the data that is at rest encrypted? --- ## [Is a loadbalancer required before logstash, to maintain high availability?](https://discuss.elastic.co/t/is-a-loadbalancer-required-before-logstash-to-maintain-high-availability/250341)
**Author:** [@Pooja](https://discuss.elastic.co/u/Pooja)\ **Replies:** 2\ **Last updated:** [September 30, 2020, 5:58am UTC](https://discuss.elastic.co/t/is-a-loadbalancer-required-before-logstash-to-maintain-high-availability/250341 "2020-09-30T05:58:43Z")
If I am reading data from multiple OS, and flavours of OS, network devices, around 60 different log sources altogether. Do I need a load balancer or does elastic have a loadbalancer in bulit? FYI, I do not want to use Fi… --- ## [Use kv filter on newline & return split pattern](https://discuss.elastic.co/t/use-kv-filter-on-newline-return-split-pattern/249655)
**Author:** [@ParashB](https://discuss.elastic.co/u/ParashB)\ **Replies:** 2\ **Last updated:** [September 30, 2020, 5:39am UTC](https://discuss.elastic.co/t/use-kv-filter-on-newline-return-split-pattern/249655 "2020-09-30T05:39:56Z")
Hi, I am trying to use kv filter to parse the below logs Name: abc\\r\\nAge: 39\\r\\nGender: Male\\r\\nSalary: 87 My kv filter is as below kv { source =\> "log" field\_split\_pattern =\> "\\\\\\r\\\\\\n" value\_split =\> ":" } I h… --- ## [How can make a cluster with Logstash? Is it possible?!?](https://discuss.elastic.co/t/how-can-make-a-cluster-with-logstash-is-it-possible/250444)
**Author:** [@Farid\_N](https://discuss.elastic.co/u/Farid_N)\ **Replies:** 2\ **Last updated:** [September 30, 2020, 5:15am UTC](https://discuss.elastic.co/t/how-can-make-a-cluster-with-logstash-is-it-possible/250444 "2020-09-30T05:15:22Z")
Hi I have 3 nodes for logstash. each logstash has it own pipeline (for example, one logstash has http module and some metricfiles. another one has two jdbc driver and some filebeats and....) So, I can\`t use file and h… --- ## [Logstash http plugin 'threads'](https://discuss.elastic.co/t/logstash-http-plugin-threads/250310)
**Author:** [@stsm](https://discuss.elastic.co/u/stsm)\ **Replies:** 2\ **Last updated:** [September 30, 2020, 4:59am UTC](https://discuss.elastic.co/t/logstash-http-plugin-threads/250310 "2020-09-30T04:59:50Z")
Hi there. I'm playing around with the "http" Logstash plugin. I ask myself, how should 'threads' be calculate? (As far as i remember, i read somewhere that the plugin depends on the "puma server") Can anyone give me a … --- ## [Primary vs replica inconsistency in ES5.6](https://discuss.elastic.co/t/primary-vs-replica-inconsistency-in-es5-6/249893)
**Author:** [@Priyanka\_Raju](https://discuss.elastic.co/u/Priyanka_Raju)\ **Replies:** 3\ **Last updated:** [September 30, 2020, 4:57am UTC](https://discuss.elastic.co/t/primary-vs-replica-inconsistency-in-es5-6/249893 "2020-09-30T04:57:30Z")
Hi, I recently noticed that some of our queries returned inconsistent results, digging deep, I found that the query returned 0 results when the query was executed against one replica and returned results when executed a… --- ## [Dissect string in filebeat](https://discuss.elastic.co/t/dissect-string-in-filebeat/250445)
**Author:** [@niv](https://discuss.elastic.co/u/niv)\ **Replies:** 0\ **Last updated:** [September 30, 2020, 4:54am UTC](https://discuss.elastic.co/t/dissect-string-in-filebeat/250445 "2020-09-30T04:54:33Z")
Hi I want to dissect the particular field . Original filed Value: "\\t{\\n \\"value\\": \\"dropfields\_nT8\\",\\n \\"PSN\\": \\"dropfields\_8\\",\\n \\"Id\\": \\"dropfields\_8\\",\\n \\"PSShowComputerName\\": … --- ## [Export CSV from search in Dashboard kibana](https://discuss.elastic.co/t/export-csv-from-search-in-dashboard-kibana/250441)
**Author:** [@umay\_fb](https://discuss.elastic.co/u/umay_fb)\ **Replies:** 1\ **Last updated:** [September 30, 2020, 4:24am UTC](https://discuss.elastic.co/t/export-csv-from-search-in-dashboard-kibana/250441 "2020-09-30T04:24:38Z")
hello.. i had a case i am using KIBANA 7.5. I create a Dashboard with Control filter and Discover. i using a filter from control and get 10548 data in discover. when i finish export it to csv i get csv with only 4 recor… --- ## [New Platform custom Kibana plugin installation - "No kibana plugins found in archive"](https://discuss.elastic.co/t/new-platform-custom-kibana-plugin-installation-no-kibana-plugins-found-in-archive/250267)
**Author:** [@npm\_install](https://discuss.elastic.co/u/npm_install)\ **Replies:** 1\ **Last updated:** [September 30, 2020, 4:21am UTC](https://discuss.elastic.co/t/new-platform-custom-kibana-plugin-installation-no-kibana-plugins-found-in-archive/250267 "2020-09-30T04:21:47Z")
I am trying to install my custom plugin on Kibana using the kibana-plugin command, and I am getting the message that No kibana plugins found in archive". I am using Kibana version 7.6.2. Are there any issues installing a… --- ## [Logstash 7.9.2 service will not start on Ubuntu 18.04](https://discuss.elastic.co/t/logstash-7-9-2-service-will-not-start-on-ubuntu-18-04/250270)
**Author:** [@Xeny](https://discuss.elastic.co/u/Xeny)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 4:09am UTC](https://discuss.elastic.co/t/logstash-7-9-2-service-will-not-start-on-ubuntu-18-04/250270 "2020-09-30T04:09:20Z")
Hello, I have a new installation on Ubuntu 18.04 where I have successfully installed "elasticsearch and kibana". However, after installing logstach and attempting to start it, it continues to fail with the following m… --- ## [Pass Envt Variables to Logstash config file](https://discuss.elastic.co/t/pass-envt-variables-to-logstash-config-file/250375)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 4\ **Last updated:** [September 30, 2020, 3:46am UTC](https://discuss.elastic.co/t/pass-envt-variables-to-logstash-config-file/250375 "2020-09-30T03:46:18Z")
Hello Team I am having Logstash v7.8.0 installed along with Elasticsearch v7.8.0. My Requirement is to run multiple logstash instances using pipelines via individual "conf" files. These conf files , are having va… --- ## [Custom log collection using filebeat with seperate ILM policy for each log](https://discuss.elastic.co/t/custom-log-collection-using-filebeat-with-seperate-ilm-policy-for-each-log/250432)
**Author:** [@naveenkumarsp](https://discuss.elastic.co/u/naveenkumarsp)\ **Replies:** 1\ **Last updated:** [September 30, 2020, 1:48am UTC](https://discuss.elastic.co/t/custom-log-collection-using-filebeat-with-seperate-ilm-policy-for-each-log/250432 "2020-09-30T01:48:03Z")
i have a requirement where i am collecting custom log from a container in a Kuberentes Cluster via filebeat agent. The same filebeat agent also collects containers logs as well. Currently the logs are dumped to hostPath… --- ## [Adding analysers to an ES Index without downtime](https://discuss.elastic.co/t/adding-analysers-to-an-es-index-without-downtime/249614)
**Author:** [@Ryan\_Davey](https://discuss.elastic.co/u/Ryan_Davey)\ **Replies:** 1\ **Last updated:** [September 29, 2020, 11:43pm UTC](https://discuss.elastic.co/t/adding-analysers-to-an-es-index-without-downtime/249614 "2020-09-29T23:43:27Z")
Just looking for some direction on solving a problem. Our requirements need us to change our index occasionally to add new mappings and filters/normalizers/analyzers. These operations are not always allowed as an updat… --- ## [Filbeat.yml process a csv header?](https://discuss.elastic.co/t/filbeat-yml-process-a-csv-header/250422)
**Author:** [@niv](https://discuss.elastic.co/u/niv)\ **Replies:** 1\ **Last updated:** [September 29, 2020, 11:41pm UTC](https://discuss.elastic.co/t/filbeat-yml-process-a-csv-header/250422 "2020-09-29T23:41:06Z")
Are there any configurations in filebeat.yml to process csv header? eg: header1,header2,header3 value1,value2,value3 --- ## [KIBANA CUSTOM FIELDS](https://discuss.elastic.co/t/kibana-custom-fields/250419)
**Author:** [@HenriqueNogueira](https://discuss.elastic.co/u/HenriqueNogueira)\ **Replies:** 2\ **Last updated:** [September 29, 2020, 11:00pm UTC](https://discuss.elastic.co/t/kibana-custom-fields/250419 "2020-09-29T23:00:55Z")
Hi Guys, can someone help me create custom fields in kibana? I have my json arriving at MESSAGE and I would like to create custom fields for each "attribute" in my log. I will paste an example: this is my MESSAGE, I w… --- ## [Best way to ensure logs from all hosts are being indexed](https://discuss.elastic.co/t/best-way-to-ensure-logs-from-all-hosts-are-being-indexed/250424)
**Author:** [@bruce289](https://discuss.elastic.co/u/bruce289)\ **Replies:** 1\ **Last updated:** [September 29, 2020, 10:29pm UTC](https://discuss.elastic.co/t/best-way-to-ensure-logs-from-all-hosts-are-being-indexed/250424 "2020-09-29T22:29:50Z")
Hi all, The log pipeline for our Linux systems is: rsyslog =\> logstash =\> elasticsearch We want to put something in place that would alert us if logs from any of our approximately 5000 hosts are not being indexed in E… --- ## [Calculations with values of different documents in painless query](https://discuss.elastic.co/t/calculations-with-values-of-different-documents-in-painless-query/249280)
**Author:** [@alexfritz](https://discuss.elastic.co/u/alexfritz)\ **Replies:** 10\ **Last updated:** [September 29, 2020, 10:15pm UTC](https://discuss.elastic.co/t/calculations-with-values-of-different-documents-in-painless-query/249280 "2020-09-29T22:15:25Z")
Hello I would like to use a painless script to do some calculations. The problem is, the values are stored in different documents as time series. For example the index has a mapping of 2 fields fieldA and fieldB. There … --- ## [Elasticsearch 7.8.0 user authentication with X-Pack security fails](https://discuss.elastic.co/t/elasticsearch-7-8-0-user-authentication-with-x-pack-security-fails/249889)
**Author:** [@dzyubanv](https://discuss.elastic.co/u/dzyubanv)\ **Replies:** 10\ **Last updated:** [September 29, 2020, 9:03pm UTC](https://discuss.elastic.co/t/elasticsearch-7-8-0-user-authentication-with-x-pack-security-fails/249889 "2020-09-29T21:03:00Z")
Hello, I'm experiencing user authentication issues for custom user, roles with X-Pack security. I'm using elasticsearch REST API for the user, roles, etc. setup (Not using Kibana). Responses with errors when checking … --- ## [How to curl PUT timestamp correctly](https://discuss.elastic.co/t/how-to-curl-put-timestamp-correctly/250256)
**Author:** [@buhruce](https://discuss.elastic.co/u/buhruce)\ **Replies:** 3\ **Last updated:** [September 29, 2020, 9:16pm UTC](https://discuss.elastic.co/t/how-to-curl-put-timestamp-correctly/250256 "2020-09-29T21:16:55Z")
I admin a Configuration Management tool and it's data visualization is not good. So I'm scraping the data from this tool and dumping it into Elastic Search. Config Tool API -\> Python Script -\> Elast Search API. All the d… --- ## [How to set mapping to run on a daily basis?](https://discuss.elastic.co/t/how-to-set-mapping-to-run-on-a-daily-basis/250391)
**Author:** [@kercio](https://discuss.elastic.co/u/kercio)\ **Replies:** 2\ **Last updated:** [September 29, 2020, 7:56pm UTC](https://discuss.elastic.co/t/how-to-set-mapping-to-run-on-a-daily-basis/250391 "2020-09-29T19:56:07Z")
My script sends data to Kibana on a daily basis on this format "xxxx-flat-2020-09-21" I created an index pattern "xxxx-flat-\*" which is working almost fine. For each index I need to run this mapping below, otherwise, t… --- ## [Logstash - Output - Http - Enpoint](https://discuss.elastic.co/t/logstash-output-http-enpoint/249401)
**Author:** [@rguerrero](https://discuss.elastic.co/u/rguerrero)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 8:36pm UTC](https://discuss.elastic.co/t/logstash-output-http-enpoint/249401 "2020-09-29T20:36:46Z")
I thank you in advance for your support. I am developing my pipeline that fetches data from DB and sends it to an EndPoint HTTP Post The input works fine, but I am having problems in my output, it does not get to send … --- ## [Problem with dates in Javascript](https://discuss.elastic.co/t/problem-with-dates-in-javascript/249702)
**Author:** [@HockeyFan0000](https://discuss.elastic.co/u/HockeyFan0000)\ **Replies:** 2\ **Last updated:** [September 29, 2020, 6:52pm UTC](https://discuss.elastic.co/t/problem-with-dates-in-javascript/249702 "2020-09-29T18:52:24Z")
I've seen many people having this same issue but I've not found an answer that has resolved my problem. I know this was a bug in ES 7.5 but I'm using ES 6.8. I've got logs with dates/times in the format "09/23 14:16:16… --- ## [Logstash persistent queues with pipelines behaivour](https://discuss.elastic.co/t/logstash-persistent-queues-with-pipelines-behaivour/250404)
**Author:** [@mtudisco](https://discuss.elastic.co/u/mtudisco)\ **Replies:** 0\ **Last updated:** [September 29, 2020, 6:19pm UTC](https://discuss.elastic.co/t/logstash-persistent-queues-with-pipelines-behaivour/250404 "2020-09-29T18:19:02Z")
Hi, I have the following configuration: 1 logstash machine l1 with 4 pipelines, p1 p2 p3 and p4 p1 has the input, does some procesing and then outputs to pipelines p2 p3 and p4 p2 does some procesing and outputs to s… --- ## [Logstash + SSL](https://discuss.elastic.co/t/logstash-ssl/250234)
**Author:** [@brapnda23](https://discuss.elastic.co/u/brapnda23)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 6:16pm UTC](https://discuss.elastic.co/t/logstash-ssl/250234 "2020-09-29T18:16:15Z")
Hey guys, As soon as I add below three SSL\* lines to the input section of logstash.conf, service gives me below error; \*\[2020-09-28T12:19:05,245\]\[ERROR\]\[logstash.agent \] Failed to execute action {:id=\>:main, … --- ## [Logstash Aggregate plugin not working](https://discuss.elastic.co/t/logstash-aggregate-plugin-not-working/250371)
**Author:** [@rfferrao](https://discuss.elastic.co/u/rfferrao)\ **Replies:** 6\ **Last updated:** [September 29, 2020, 5:55pm UTC](https://discuss.elastic.co/t/logstash-aggregate-plugin-not-working/250371 "2020-09-29T17:55:39Z")
Trying to implement aggregate plugin based on the documentation, but I'm having problems. Here's how I've configured it: aggregate { task\_id =\> "%{tunnelid}" code =\> " map\['user'\] = event.get('user') … [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1777) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1779)