# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1850 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1851 --- ## [Is it possible to remove node from ES 6.8?](https://discuss.elastic.co/t/is-it-possible-to-remove-node-from-es-6-8/245583)
**Author:** [@tarkhil](https://discuss.elastic.co/u/tarkhil)\ **Replies:** 4\ **Last updated:** [August 22, 2020, 5:35am UTC](https://discuss.elastic.co/t/is-it-possible-to-remove-node-from-es-6-8/245583 "2020-08-22T05:35:44Z")
Hello I've set up a server, started a ES 6.8 instance, run it for a while in cluster and found an error in disk setup requiring me to reinstall everything starting from OS. As far as I can understand, I have only one o… --- ## [Filebeat Log Message Parsing](https://discuss.elastic.co/t/filebeat-log-message-parsing/245967)
**Author:** [@batninja24601](https://discuss.elastic.co/u/batninja24601)\ **Replies:** 0\ **Last updated:** [August 22, 2020, 12:01am UTC](https://discuss.elastic.co/t/filebeat-log-message-parsing/245967 "2020-08-22T00:01:16Z")
Hello all. I've been reading the Filebeat docs. I need to confirm my understanding. I am using FileBeat to parse some custom local log text files using the log input type. I would to parse the message out and rename f… --- ## [Logstash error - bootstrap broker disconnected](https://discuss.elastic.co/t/logstash-error-bootstrap-broker-disconnected/245965)
**Author:** [@chandramouli\_sriniva](https://discuss.elastic.co/u/chandramouli_sriniva)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 11:31pm UTC](https://discuss.elastic.co/t/logstash-error-bootstrap-broker-disconnected/245965 "2020-08-21T23:31:53Z")
we are sending logs from file.txt to Kafka(SASL\_SSL with kerberos). Below are the parm being set in conf file: bootstrap\_servers =\> "broker:9093" codec =\> json topic\_id =\> "topic" jaas\_path =\> "jaas.conf" kerberos\_conf… --- ## [Alphabetical sorting of numeric labels not working](https://discuss.elastic.co/t/alphabetical-sorting-of-numeric-labels-not-working/245940)
**Author:** [@Dennis1](https://discuss.elastic.co/u/Dennis1)\ **Replies:** 3\ **Last updated:** [August 21, 2020, 10:30pm UTC](https://discuss.elastic.co/t/alphabetical-sorting-of-numeric-labels-not-working/245940 "2020-08-21T22:30:35Z")
I'm trying to order the response code labels in my stacked bar graph to be descending alphabetical, but it doesn't appear to be working properly. Further, when I select 'ascending', the response codes are re-ordered in s… --- ## [Using output Kafka Codec Avro with KafkaAvroSerializer (schema\_registry\_url issue)](https://discuss.elastic.co/t/using-output-kafka-codec-avro-with-kafkaavroserializer-schema-registry-url-issue/245953)
**Author:** [@belguith\_chachia](https://discuss.elastic.co/u/belguith_chachia)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 9:19pm UTC](https://discuss.elastic.co/t/using-output-kafka-codec-avro-with-kafkaavroserializer-schema-registry-url-issue/245953 "2020-08-21T21:19:54Z")
Hi guys, Our purpose is to post messages to event bus Kafka using Avro. We added all required jars libraries in LS\_HOME/vendor/jruby/lib/ And Logstash does recognize KafkaAvroSerializer and all other required classes… --- ## [Elastic Search with Docker](https://discuss.elastic.co/t/elastic-search-with-docker/245946)
**Author:** [@nages](https://discuss.elastic.co/u/nages)\ **Replies:** 8\ **Last updated:** [August 21, 2020, 8:43pm UTC](https://discuss.elastic.co/t/elastic-search-with-docker/245946 "2020-08-21T20:43:04Z")
I ran the following docker compose script and I am expecting two nodes to be up, however this only one. There seems to be some obvious error , please suggest your inputs Taken from the documentation https://www.elastic.… --- ## [\[Ingest Management\] - Multiple configs per agent?](https://discuss.elastic.co/t/ingest-management-multiple-configs-per-agent/245922)
**Author:** [@tjfred](https://discuss.elastic.co/u/tjfred)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 7:53pm UTC](https://discuss.elastic.co/t/ingest-management-multiple-configs-per-agent/245922 "2020-08-21T19:53:30Z")
Hello, I'm trying out the new Ingest Manager on 7.9.1, all looks great! I was wondering if anyone could clarify how best to design configurations and integrations. Consider this setup: All hosts require "System" and … --- ## [Kibana 7.8, Apache HTTPD proxy, internal server error](https://discuss.elastic.co/t/kibana-7-8-apache-httpd-proxy-internal-server-error/245308)
**Author:** [@hanover23](https://discuss.elastic.co/u/hanover23)\ **Replies:** 2\ **Last updated:** [August 21, 2020, 7:44pm UTC](https://discuss.elastic.co/t/kibana-7-8-apache-httpd-proxy-internal-server-error/245308 "2020-08-21T19:44:50Z")
I have seen nginx is a documented way to proxy requests to a local Kibana listening on TCP 5601, but I am wondering if anyone has experience getting this to work with Apache HTTPD. I have a Kibana 7.8.0-1 instance that … --- ## [System has not been booted with systemd as init system (PID 1). Can't operate](https://discuss.elastic.co/t/system-has-not-been-booted-with-systemd-as-init-system-pid-1-cant-operate/245954)
**Author:** [@Yanyan\_Liang](https://discuss.elastic.co/u/Yanyan_Liang)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 7:20pm UTC](https://discuss.elastic.co/t/system-has-not-been-booted-with-systemd-as-init-system-pid-1-cant-operate/245954 "2020-08-21T19:20:17Z")
I can't start logstash in Ubuntu (wsl 2). My command is as follows: Anyone has the same problem and how to solve it? Many thanks! --- ## [S3 Input Plugin Following Errors Execution Expired and Net::OpenTimeout](https://discuss.elastic.co/t/s3-input-plugin-following-errors-execution-expired-and-net-opentimeout/245951)
**Author:** [@daniel\_a](https://discuss.elastic.co/u/daniel_a)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 6:46pm UTC](https://discuss.elastic.co/t/s3-input-plugin-following-errors-execution-expired-and-net-opentimeout/245951 "2020-08-21T18:46:06Z")
I've been trying to use s3 input plugin in Logstash to pull data from the Tencent COS (cloud object storage). They're claiming they're using the AWS SDK. It works fine, I'm able to pull the COS data just fine, but it tim… --- ## [Logstash map id always detected as long, even it string](https://discuss.elastic.co/t/logstash-map-id-always-detected-as-long-even-it-string/245843)
**Author:** [@bayucandra](https://discuss.elastic.co/u/bayucandra)\ **Replies:** 2\ **Last updated:** [August 21, 2020, 5:21pm UTC](https://discuss.elastic.co/t/logstash-map-id-always-detected-as-long-even-it-string/245843 "2020-08-21T17:21:57Z")
Hi, Based on logs below, I assume that my logstsh always consider any record with field named "id" as a "long", even it "string". \[WARN \]\[logstash.outputs.elasticsearch\]\[main\]\[f4110a8e1e28ebbac18f43191bfa4dea9a1b050d31… --- ## [Docker ELK (multipipelines and pipeline error)](https://discuss.elastic.co/t/docker-elk-multipipelines-and-pipeline-error/245936)
**Author:** [@nb03briceno](https://discuss.elastic.co/u/nb03briceno)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 5:05pm UTC](https://discuss.elastic.co/t/docker-elk-multipipelines-and-pipeline-error/245936 "2020-08-21T17:05:25Z")
Hello everyone, I'm working with ELK in docker. I was able to run Elasticsearch, KIbana, Logstash, and Filebeat with docker containers through a docker-compose file. Ingesting appear to works when I use simple pipelines… --- ## [Logstash Date Filter not working on Kibana](https://discuss.elastic.co/t/logstash-date-filter-not-working-on-kibana/245822)
**Author:** [@userR](https://discuss.elastic.co/u/userR)\ **Replies:** 9\ **Last updated:** [August 21, 2020, 4:52pm UTC](https://discuss.elastic.co/t/logstash-date-filter-not-working-on-kibana/245822 "2020-08-21T16:52:48Z")
date { match =\> \["logdate", "YYYY.MM.dd HH:mm:ss,SSS"\] target =\> "logdate" } Above is my date filter configuration on my logstash config file. On kibana, when I create an index pattern, the only date option that sh… --- ## [E-commerce products with prices per customer](https://discuss.elastic.co/t/e-commerce-products-with-prices-per-customer/245832)
**Author:** [@dndeus](https://discuss.elastic.co/u/dndeus)\ **Replies:** 8\ **Last updated:** [August 21, 2020, 4:15pm UTC](https://discuss.elastic.co/t/e-commerce-products-with-prices-per-customer/245832 "2020-08-21T16:15:19Z")
Hello there! Let me give you the use case. I need to build this b2b commerce where the prices for each product is different for every logged in customer. One of the functionalities is, the customer should be able to fi… --- ## [\[Kibana Timelion\] - Cannot apply Dashboard filter on Timelion functions](https://discuss.elastic.co/t/kibana-timelion-cannot-apply-dashboard-filter-on-timelion-functions/241087)
**Author:** [@GitsBdr](https://discuss.elastic.co/u/GitsBdr)\ **Replies:** 9\ **Last updated:** [August 21, 2020, 4:11pm UTC](https://discuss.elastic.co/t/kibana-timelion-cannot-apply-dashboard-filter-on-timelion-functions/241087 "2020-08-21T16:11:41Z")
Hi there, Thanks in advance for your help I have written a couple of timelion functions and all of them request the same index-pattern, they just differ by their q='' filter and metric. However, from a dashboard, wher… --- ## [Logstash restarts continuously with below error when enabling ilm](https://discuss.elastic.co/t/logstash-restarts-continuously-with-below-error-when-enabling-ilm/245934)
**Author:** [@sai\_kiran1](https://discuss.elastic.co/u/sai_kiran1)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 3:48pm UTC](https://discuss.elastic.co/t/logstash-restarts-continuously-with-below-error-when-enabling-ilm/245934 "2020-08-21T15:48:20Z")
Hello, Am working on ilm settings in elasticsearch output plugin(logstash plugin) and I see Logstash restarts continuously with below error. \[2020-08-21T16:35:08,665\]\[FATAL\]\[logstash.runner \] An unexpected err… --- ## [Time Series Visual Builder - regexing top n field responses](https://discuss.elastic.co/t/time-series-visual-builder-regexing-top-n-field-responses/245582)
**Author:** [@Marcus\_Webb](https://discuss.elastic.co/u/Marcus_Webb)\ **Replies:** 2\ **Last updated:** [August 21, 2020, 3:39pm UTC](https://discuss.elastic.co/t/time-series-visual-builder-regexing-top-n-field-responses/245582 "2020-08-21T15:39:26Z")
Hi Guys I know that the Timelion feature is being deprecated so I'm learning TSVB and fast. My question is this: I have a field called responsefield which contains literally thousands of possibilities, as there are var… --- ## [Combine terms of multiple fields into one bucket aggregation](https://discuss.elastic.co/t/combine-terms-of-multiple-fields-into-one-bucket-aggregation/245935)
**Author:** [@tiptobi](https://discuss.elastic.co/u/tiptobi)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 3:37pm UTC](https://discuss.elastic.co/t/combine-terms-of-multiple-fields-into-one-bucket-aggregation/245935 "2020-08-21T15:37:29Z")
Hi community, Given the following index which contains media and its related products (simplified): { "media": { "mappings": { "doc": { "properties": { "color": { "type"… --- ## [Filebeat NGINX-Plugin sending multiples separate lines as one event](https://discuss.elastic.co/t/filebeat-nginx-plugin-sending-multiples-separate-lines-as-one-event/245933)
**Author:** [@iceman91176](https://discuss.elastic.co/u/iceman91176)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 3:33pm UTC](https://discuss.elastic.co/t/filebeat-nginx-plugin-sending-multiples-separate-lines-as-one-event/245933 "2020-08-21T15:33:27Z")
We have deployed filebeat as kubernetes daemon set and are using hint based configuration to send logs to logstash. Here is the filebeat configuration filebeat.autodiscover: providers: - type: kubernetes host:… --- ## [Log queries from elasticsearch output](https://discuss.elastic.co/t/log-queries-from-elasticsearch-output/245882)
**Author:** [@SpaceRaven](https://discuss.elastic.co/u/SpaceRaven)\ **Replies:** 3\ **Last updated:** [August 21, 2020, 3:32pm UTC](https://discuss.elastic.co/t/log-queries-from-elasticsearch-output/245882 "2020-08-21T15:32:16Z")
Hi, Is there any way to log somehow queries from elasticsearch output plugin for es updates? i mean i want to inspect json queris which will go es cluster for update/delete/insert. Thanks --- ## [How to run a verification bloc (one time) after scheduled output](https://discuss.elastic.co/t/how-to-run-a-verification-bloc-one-time-after-scheduled-output/245898)
**Author:** [@RiadhBH](https://discuss.elastic.co/u/RiadhBH)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 9:57am UTC](https://discuss.elastic.co/t/how-to-run-a-verification-bloc-one-time-after-scheduled-output/245898 "2020-08-21T09:57:00Z")
Hi, I'm using this configuration: SqlServer --\> LogStash --\> {ElasticSearch, Mysql}. I need to verify the number of input data (from logstash) and the output data (from mysql). It is possible to query elasticsearch on… --- ## [Ingestion performance issues - where to start?](https://discuss.elastic.co/t/ingestion-performance-issues-where-to-start/245849)
**Author:** [@wardallen](https://discuss.elastic.co/u/wardallen)\ **Replies:** 5\ **Last updated:** [August 21, 2020, 1:35pm UTC](https://discuss.elastic.co/t/ingestion-performance-issues-where-to-start/245849 "2020-08-21T13:35:04Z")
Hi all, I'm having ingestion performance issues that I haven't gotten to the bottom of, and I'm quite new to the elastic stack, so I thought I'd seek advice here. I have a cluster of 3 VMs (4 CPU/64GB RAM/500GB disk). … --- ## [Logstash: How to pass value from one Aggregate Filter Task ID to another](https://discuss.elastic.co/t/logstash-how-to-pass-value-from-one-aggregate-filter-task-id-to-another/245921)
**Author:** [@mastersmit](https://discuss.elastic.co/u/mastersmit)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 1:06pm UTC](https://discuss.elastic.co/t/logstash-how-to-pass-value-from-one-aggregate-filter-task-id-to-another/245921 "2020-08-21T13:06:48Z")
I have a requirement in which I need flow data from one aggreage filter of id different\_%{customer} to another %{traceid} logstash.conf code snippet: aggregate { task\_id =\> "different\_%{customer}" c… --- ## [Help with custom pattern](https://discuss.elastic.co/t/help-with-custom-pattern/245917)
**Author:** [@Jonathan\_Morin](https://discuss.elastic.co/u/Jonathan_Morin)\ **Replies:** 1\ **Last updated:** [August 21, 2020, 1:06pm UTC](https://discuss.elastic.co/t/help-with-custom-pattern/245917 "2020-08-21T13:06:02Z")
Hi guys, i'm trying to put parse a JDE log but i keep having a \_grokparsefailure and i really don't see where my problem is. Here's what i have filter { grok { pattern\_definitions =\> { "JDEPRO… --- ## [Can not parse bash output as json](https://discuss.elastic.co/t/can-not-parse-bash-output-as-json/245809)
**Author:** [@Yevhen\_Baidiuk](https://discuss.elastic.co/u/Yevhen_Baidiuk)\ **Replies:** 3\ **Last updated:** [August 21, 2020, 12:52pm UTC](https://discuss.elastic.co/t/can-not-parse-bash-output-as-json/245809 "2020-08-21T12:52:16Z")
I use shall script to generate dataset but logstash won't accept my message Thanks for feature help. --- ## [Fluentd not connected to elasticsearch](https://discuss.elastic.co/t/fluentd-not-connected-to-elasticsearch/245919)
**Author:** [@samra1810](https://discuss.elastic.co/u/samra1810)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 12:49pm UTC](https://discuss.elastic.co/t/fluentd-not-connected-to-elasticsearch/245919 "2020-08-21T12:49:04Z")
I have installed td-agent rpm on linux and trying to connect to elastic search. but however when i am starting td-agent, it is not getting connected to elasticsearch. Elastic Search service is up and running. Error on l… --- ## [X-Pack Anomaly Detection: multi-metric equals multivariate?](https://discuss.elastic.co/t/x-pack-anomaly-detection-multi-metric-equals-multivariate/245451)
**Author:** [@boxplot](https://discuss.elastic.co/u/boxplot)\ **Replies:** 8\ **Last updated:** [August 21, 2020, 12:12pm UTC](https://discuss.elastic.co/t/x-pack-anomaly-detection-multi-metric-equals-multivariate/245451 "2020-08-21T12:12:57Z")
Hi. I would like to detect anomalies using X-Pack. I have the following data: location user event (1 event is stored in 1 document) user behaviour per event (various features/fields) I would like to detect anomalous … --- ## [How to view multiple fields in kibana add filter section](https://discuss.elastic.co/t/how-to-view-multiple-fields-in-kibana-add-filter-section/245765)
**Author:** [@hemant\_472](https://discuss.elastic.co/u/hemant_472)\ **Replies:** 10\ **Last updated:** [August 21, 2020, 11:38am UTC](https://discuss.elastic.co/t/how-to-view-multiple-fields-in-kibana-add-filter-section/245765 "2020-08-21T11:38:34Z")
i am unable to see multiple filters in add filter field of kibana, can someone suggst anything as i cannot find anything in kibana settings --- ## [How to get node exporters metrics from Prometheus database without connecting to exporters explicitly](https://discuss.elastic.co/t/how-to-get-node-exporters-metrics-from-prometheus-database-without-connecting-to-exporters-explicitly/245911)
**Author:** [@mish](https://discuss.elastic.co/u/mish)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 11:15am UTC](https://discuss.elastic.co/t/how-to-get-node-exporters-metrics-from-prometheus-database-without-connecting-to-exporters-explicitly/245911 "2020-08-21T11:15:02Z")
Hello experts- Requirement is to create a Kibana dashboards of OS related metrics by reusing Prometheus Server setup. I am having a Prometheus server and multiple node exporters (30) already set up in AWS. Installed … --- ## [Parse\_origination\_date phase transition](https://discuss.elastic.co/t/parse-origination-date-phase-transition/245910)
**Author:** [@samaresh\_kirtania](https://discuss.elastic.co/u/samaresh_kirtania)\ **Replies:** 0\ **Last updated:** [August 21, 2020, 10:43am UTC](https://discuss.elastic.co/t/parse-origination-date-phase-transition/245910 "2020-08-21T10:43:32Z")
I am trying to use origination\_date with ILM phases and need some help. I am creating the indexes manually of the format shipdetails-2020.08.19. We can create 7 indexes on a given date. Now the events will be stored acc… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1849) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1851)