# Logstash **URL:** https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=299 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 300 --- ## [Logstash - Output - Http - Enpoint](https://discuss.elastic.co/t/logstash-output-http-enpoint/249401)
**Author:** [@rguerrero](https://discuss.elastic.co/u/rguerrero)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 8:36pm UTC](https://discuss.elastic.co/t/logstash-output-http-enpoint/249401 "2020-09-29T20:36:46Z")
I thank you in advance for your support. I am developing my pipeline that fetches data from DB and sends it to an EndPoint HTTP Post The input works fine, but I am having problems in my output, it does not get to send … --- ## [Logstash persistent queues with pipelines behaivour](https://discuss.elastic.co/t/logstash-persistent-queues-with-pipelines-behaivour/250404)
**Author:** [@mtudisco](https://discuss.elastic.co/u/mtudisco)\ **Replies:** 0\ **Last updated:** [September 29, 2020, 6:19pm UTC](https://discuss.elastic.co/t/logstash-persistent-queues-with-pipelines-behaivour/250404 "2020-09-29T18:19:02Z")
Hi, I have the following configuration: 1 logstash machine l1 with 4 pipelines, p1 p2 p3 and p4 p1 has the input, does some procesing and then outputs to pipelines p2 p3 and p4 p2 does some procesing and outputs to s… --- ## [Logstash + SSL](https://discuss.elastic.co/t/logstash-ssl/250234)
**Author:** [@brapnda23](https://discuss.elastic.co/u/brapnda23)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 6:16pm UTC](https://discuss.elastic.co/t/logstash-ssl/250234 "2020-09-29T18:16:15Z")
Hey guys, As soon as I add below three SSL\* lines to the input section of logstash.conf, service gives me below error; \*\[2020-09-28T12:19:05,245\]\[ERROR\]\[logstash.agent \] Failed to execute action {:id=\>:main, … --- ## [Logstash Aggregate plugin not working](https://discuss.elastic.co/t/logstash-aggregate-plugin-not-working/250371)
**Author:** [@rfferrao](https://discuss.elastic.co/u/rfferrao)\ **Replies:** 6\ **Last updated:** [September 29, 2020, 5:55pm UTC](https://discuss.elastic.co/t/logstash-aggregate-plugin-not-working/250371 "2020-09-29T17:55:39Z")
Trying to implement aggregate plugin based on the documentation, but I'm having problems. Here's how I've configured it: aggregate { task\_id =\> "%{tunnelid}" code =\> " map\['user'\] = event.get('user') … --- ## [Date freeze in index after rollover (only in windows) logstah 7.9.2](https://discuss.elastic.co/t/date-freeze-in-index-after-rollover-only-in-windows-logstah-7-9-2/250300)
**Author:** [@benji\_c](https://discuss.elastic.co/u/benji_c)\ **Replies:** 3\ **Last updated:** [September 29, 2020, 5:36pm UTC](https://discuss.elastic.co/t/date-freeze-in-index-after-rollover-only-in-windows-logstah-7-9-2/250300 "2020-09-29T17:36:17Z")
Hi! After a few hours reviewing configurations and creating and deleting index and creating ILM noticed an issue with the logstash 7.9.2 windows version, that freezes date fields in new index when doing rollover. Let … --- ## [Datetime format](https://discuss.elastic.co/t/datetime-format/250360)
**Author:** [@RPL\_Developer](https://discuss.elastic.co/u/RPL_Developer)\ **Replies:** 1\ **Last updated:** [September 29, 2020, 2:12pm UTC](https://discuss.elastic.co/t/datetime-format/250360 "2020-09-29T14:12:08Z")
I am using MariaDB database there I have enter simple date without any timestamp but when data is going to Elasticsearch there is some timestamp along with the date. Please someone help me out in this --- ## [Logstash integration with Amazon Elasticsearch](https://discuss.elastic.co/t/logstash-integration-with-amazon-elasticsearch/250232)
**Author:** [@Akhil96](https://discuss.elastic.co/u/Akhil96)\ **Replies:** 2\ **Last updated:** [September 29, 2020, 8:13am UTC](https://discuss.elastic.co/t/logstash-integration-with-amazon-elasticsearch/250232 "2020-09-29T08:13:28Z")
Hi Team, I have setup logstash to fetch from amazon MSK and then push the messages to Amazon Elasticsearch with Kibana integration. The setup works smoothly in QA and Dev environments but when I use the same logstash im… --- ## [Does running multiple logstash instance is a good idea?](https://discuss.elastic.co/t/does-running-multiple-logstash-instance-is-a-good-idea/250284)
**Author:** [@Kambing](https://discuss.elastic.co/u/Kambing)\ **Replies:** 1\ **Last updated:** [September 29, 2020, 4:43am UTC](https://discuss.elastic.co/t/does-running-multiple-logstash-instance-is-a-good-idea/250284 "2020-09-29T04:43:48Z")
Hi, Currently I'm running multiple instance of filebeat in my production environment, each filebeat module have it's own instance, so when I need to change the configuration on specific module, I'll not bother other modu… --- ## [java.lang.IllegalStateException: Logstash stopped processing because of an error: (SystemExit) exit](https://discuss.elastic.co/t/java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-systemexit-exit/249918)
**Author:** [@Rajan\_Gupta](https://discuss.elastic.co/u/Rajan_Gupta)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 4:22am UTC](https://discuss.elastic.co/t/java-lang-illegalstateexception-logstash-stopped-processing-because-of-an-error-systemexit-exit/249918 "2020-09-29T04:22:39Z")
Hi There, Got Stuck from last three days. I m getting this error while starting the logstash. Could anyone help me on this.Stack trace is defined below :- Sending Logstash logs to D:/Elasticsearch/logstash-7.9.1/logs … --- ## [Getting error SSLConnectionSocketFactory not found in packages?](https://discuss.elastic.co/t/getting-error-sslconnectionsocketfactory-not-found-in-packages/249902)
**Author:** [@talbehat](https://discuss.elastic.co/u/talbehat)\ **Replies:** 4\ **Last updated:** [September 29, 2020, 4:04am UTC](https://discuss.elastic.co/t/getting-error-sslconnectionsocketfactory-not-found-in-packages/249902 "2020-09-29T04:04:30Z")
NameError: SSLConnectionSocketFactory not found in packages org.apache.http.client.methods, org.apache.http.client.entity, org.apache.http.client.config, org.apache.http.config, org.apache.http.conn.socket, org.apache.ht… --- ## [Map nested field into DB output using Elastic input plugin](https://discuss.elastic.co/t/map-nested-field-into-db-output-using-elastic-input-plugin/250176)
**Author:** [@jasoninmel](https://discuss.elastic.co/u/jasoninmel)\ **Replies:** 6\ **Last updated:** [September 29, 2020, 3:54am UTC](https://discuss.elastic.co/t/map-nested-field-into-db-output-using-elastic-input-plugin/250176 "2020-09-29T03:54:20Z")
Hi there, I'm using Logstash as a ETL tool to copy data from Elastic index to DB table. I tried to map a nested field using following insert statement in the logstash configuration; statement =\> \["INSERT into assets (i… --- ## [Logstash connectivity to MYSQL in open source ELK](https://discuss.elastic.co/t/logstash-connectivity-to-mysql-in-open-source-elk/250278)
**Author:** [@DG13](https://discuss.elastic.co/u/DG13)\ **Replies:** 3\ **Last updated:** [September 29, 2020, 3:54am UTC](https://discuss.elastic.co/t/logstash-connectivity-to-mysql-in-open-source-elk/250278 "2020-09-29T03:54:10Z")
Is the MYSQL connectivity to Logstash available in open source ELK stack ? Thanks, --- ## [Logstash Avro data points are resulting into default value instead of the value from kafka output](https://discuss.elastic.co/t/logstash-avro-data-points-are-resulting-into-default-value-instead-of-the-value-from-kafka-output/250275)
**Author:** [@mastersmit](https://discuss.elastic.co/u/mastersmit)\ **Replies:** 0\ **Last updated:** [September 29, 2020, 2:33am UTC](https://discuss.elastic.co/t/logstash-avro-data-points-are-resulting-into-default-value-instead-of-the-value-from-kafka-output/250275 "2020-09-29T02:33:55Z")
Logstash output: { "timestamp" =\> 0, "username" =\> "", "tweet" =\> "", "@version" =\> "1", "@timestamp" =\> 2020-09-29T01:59:15.867Z } Kafka Consumer output: {"username":"John Smith","tweet"… --- ## [Logstash aggregate array of objects based on key field](https://discuss.elastic.co/t/logstash-aggregate-array-of-objects-based-on-key-field/250249)
**Author:** [@rfferrao](https://discuss.elastic.co/u/rfferrao)\ **Replies:** 5\ **Last updated:** [September 29, 2020, 12:11am UTC](https://discuss.elastic.co/t/logstash-aggregate-array-of-objects-based-on-key-field/250249 "2020-09-29T00:11:22Z")
I'm receiving some logs like these: datetime="2020-09-2020T14:40:00-0300" action="tunnel-up" tunneltype="ssl-tunnel" tunnelid=1171992131 remip=192.168.0.1 user="someuser" group="vpn\_ssl\_group" and datetime="2020-09-20… --- ## [Aggregation Based on File Path](https://discuss.elastic.co/t/aggregation-based-on-file-path/250254)
**Author:** [@NomadicCodeGuy](https://discuss.elastic.co/u/NomadicCodeGuy)\ **Replies:** 1\ **Last updated:** [September 28, 2020, 8:24pm UTC](https://discuss.elastic.co/t/aggregation-based-on-file-path/250254 "2020-09-28T20:24:20Z")
I need to combine "errorInfo" fields of events that share nothing in common except for their file path. The field "log.file.path" exists as a field for my data in kibana but am not sure if a field needs to be explicitly … --- ## [Converting more than one column destroys data](https://discuss.elastic.co/t/converting-more-than-one-column-destroys-data/250161)
**Author:** [@Christoph1](https://discuss.elastic.co/u/Christoph1)\ **Replies:** 6\ **Last updated:** [September 28, 2020, 4:26pm UTC](https://discuss.elastic.co/t/converting-more-than-one-column-destroys-data/250161 "2020-09-28T16:26:11Z")
converting more than one column from string \> integer completely invalidates the logstash output. The values are interpreted as keys somehow What am I missing when converting? regardless of: CSV { convert =\> {}} mut… --- ## [Using Java\_line codec on Kafka input](https://discuss.elastic.co/t/using-java-line-codec-on-kafka-input/250224)
**Author:** [@kbrisso](https://discuss.elastic.co/u/kbrisso)\ **Replies:** 0\ **Last updated:** [September 28, 2020, 3:39pm UTC](https://discuss.elastic.co/t/using-java-line-codec-on-kafka-input/250224 "2020-09-28T15:39:03Z")
Hello- Would this be a valid way to configure the java\_line codec for the Kafka input? I need to parse events with a custom line terminator like below. Currently I have \\n in my debug statements and \\n for line terminat… --- ## [Logstash JVM Settings](https://discuss.elastic.co/t/logstash-jvm-settings/250219)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 1\ **Last updated:** [September 28, 2020, 3:37pm UTC](https://discuss.elastic.co/t/logstash-jvm-settings/250219 "2020-09-28T15:37:15Z")
Hi, When running larger heap sizes (6-8GB+) would logstash benefit from using G1 garbage collection? Thx D --- ## [RuntimeError: attempted adding second root element to document](https://discuss.elastic.co/t/runtimeerror-attempted-adding-second-root-element-to-document/250146)
**Author:** [@Dinesh\_Potey](https://discuss.elastic.co/u/Dinesh_Potey)\ **Replies:** 4\ **Last updated:** [September 28, 2020, 3:12pm UTC](https://discuss.elastic.co/t/runtimeerror-attempted-adding-second-root-element-to-document/250146 "2020-09-28T15:12:52Z")
Hi, I am facing below error while Logstash is parsing my xml file which was extracted for the given pattern. DUe to this error , I am not able to create visualisation as well as the required fields in Visualisation is n… --- ## [Kibana - Gauge - fetch data based on threshold](https://discuss.elastic.co/t/kibana-gauge-fetch-data-based-on-threshold/250206)
**Author:** [@prashu421](https://discuss.elastic.co/u/prashu421)\ **Replies:** 0\ **Last updated:** [September 28, 2020, 2:11pm UTC](https://discuss.elastic.co/t/kibana-gauge-fetch-data-based-on-threshold/250206 "2020-09-28T14:11:40Z")
Hello, I am working with AWS Elasticsearch and have recently started looking into the Kibana Visualizations, I came across a blocker that I am not able to figure how to fix. I have data coming in from certain pipelines… --- ## [Convert Date String Into Date Format](https://discuss.elastic.co/t/convert-date-string-into-date-format/250153)
**Author:** [@wahzix](https://discuss.elastic.co/u/wahzix)\ **Replies:** 2\ **Last updated:** [September 28, 2020, 12:40pm UTC](https://discuss.elastic.co/t/convert-date-string-into-date-format/250153 "2020-09-28T12:40:59Z")
Hi, I want to convert a date which is like this : 2020-09-18 15:42:41.5721 To do so, I have tried to use date plugin but it seems that it doesn't work. I have this \_dateparsefailure and my @timestamp hasn't changed … --- ## [Indexing to Multiple Endpoints](https://discuss.elastic.co/t/indexing-to-multiple-endpoints/250166)
**Author:** [@dawiro](https://discuss.elastic.co/u/dawiro)\ **Replies:** 1\ **Last updated:** [September 28, 2020, 12:28pm UTC](https://discuss.elastic.co/t/indexing-to-multiple-endpoints/250166 "2020-09-28T12:28:33Z")
Hi, In a single pipeline scenario, how much of a performance cost is there to having more than one output configured? Will all outputs run at the speed of the slowest? Thx D --- ## [Manage different type of logs with logstash](https://discuss.elastic.co/t/manage-different-type-of-logs-with-logstash/249964)
**Author:** [@Luca\_Padovan](https://discuss.elastic.co/u/Luca_Padovan)\ **Replies:** 4\ **Last updated:** [September 28, 2020, 12:05pm UTC](https://discuss.elastic.co/t/manage-different-type-of-logs-with-logstash/249964 "2020-09-28T12:05:58Z")
I'm trying to managing different type of logs with logstash, but i don't see them in kibana. logstash pipeline: input { udp { port =\> 5000 type =\> "heartbeat" } udp { port =\> 6000 type =\> "startup\_shutdown" … --- ## [Calculating Percentage](https://discuss.elastic.co/t/calculating-percentage/250141)
**Author:** [@rcganesh](https://discuss.elastic.co/u/rcganesh)\ **Replies:** 0\ **Last updated:** [September 28, 2020, 7:56am UTC](https://discuss.elastic.co/t/calculating-percentage/250141 "2020-09-28T07:56:50Z")
Hello Experts, I am trying to find a way to calculate percentage of certain events in Elasticsearch using Logstash. Here is what I am trying to do. Injecting IIB data into Elasticsearch. Below is the sample json of th… --- ## [Heavy queuing on logstash nodes](https://discuss.elastic.co/t/heavy-queuing-on-logstash-nodes/250050)
**Author:** [@suyog1](https://discuss.elastic.co/u/suyog1)\ **Replies:** 5\ **Last updated:** [September 28, 2020, 7:20am UTC](https://discuss.elastic.co/t/heavy-queuing-on-logstash-nodes/250050 "2020-09-28T07:20:47Z")
Hello Team, I have below architecture in place. 400-800 EC2 ---\> AWS NLB ---\> 10 Logstash EC2s ---\> 14 EC2 of data node with filebeat … --- ## [Logstash beats input cant start with ssl enabled](https://discuss.elastic.co/t/logstash-beats-input-cant-start-with-ssl-enabled/249633)
**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\ **Replies:** 3\ **Last updated:** [September 28, 2020, 7:10am UTC](https://discuss.elastic.co/t/logstash-beats-input-cant-start-with-ssl-enabled/249633 "2020-09-28T07:10:50Z")
I would like to make secure connection between fielbeat and logstash. Both version 7.8.1. input { beats { port =\> 5000 ssl =\> true ssl\_certificate =\> "/ssl/instance.crt" ssl\_key =\> "/ssl/instance.key" … --- ## [Rufus scheduler error when using timestamp with time zone](https://discuss.elastic.co/t/rufus-scheduler-error-when-using-timestamp-with-time-zone/250135)
**Author:** [@PinballWizard](https://discuss.elastic.co/u/PinballWizard)\ **Replies:** 0\ **Last updated:** [September 28, 2020, 6:59am UTC](https://discuss.elastic.co/t/rufus-scheduler-error-when-using-timestamp-with-time-zone/250135 "2020-09-28T06:59:59Z")
I'm using Logstash jdbc plugin with DB2 on z/OS. Timestamp column is set to timestamp with time zone type. After initial execution of SQL statement I'm getting following error in Logstash log: logstash\[21949\]: { 2082 r… --- ## [How to run couchbase queries (n1ql) in logstash](https://discuss.elastic.co/t/how-to-run-couchbase-queries-n1ql-in-logstash/249564)
**Author:** [@puja](https://discuss.elastic.co/u/puja)\ **Replies:** 2\ **Last updated:** [September 27, 2020, 6:23pm UTC](https://discuss.elastic.co/t/how-to-run-couchbase-queries-n1ql-in-logstash/249564 "2020-09-27T18:23:05Z")
Hi, I am using 7.7.0 version of ELK stack. I am able to run sql, postgres and oracle queries in logstash using jdbc but I am stuck while doing the same for couchbase. Please suggest me how to run couchbase queries in … --- ## [ElasticSearch filter plugin "Failed to parse query" Was Expecting TO](https://discuss.elastic.co/t/elasticsearch-filter-plugin-failed-to-parse-query-was-expecting-to/250061)
**Author:** [@subash](https://discuss.elastic.co/u/subash)\ **Replies:** 1\ **Last updated:** [September 26, 2020, 3:25pm UTC](https://discuss.elastic.co/t/elasticsearch-filter-plugin-failed-to-parse-query-was-expecting-to/250061 "2020-09-26T15:25:36Z")
Hi, I am using Elasicsearch filter plugin to check the current event with the previous events. My elasticsearch filter plugin looks like this elasticsearch { hosts =\> "xx.xx.xx.xx" index … --- ## [Unable to download Logstash Avro Codec for Kafka Input](https://discuss.elastic.co/t/unable-to-download-logstash-avro-codec-for-kafka-input/250040)
**Author:** [@mastersmit](https://discuss.elastic.co/u/mastersmit)\ **Replies:** 1\ **Last updated:** [September 26, 2020, 2:33pm UTC](https://discuss.elastic.co/t/unable-to-download-logstash-avro-codec-for-kafka-input/250040 "2020-09-26T14:33:08Z")
In the organisation, the Kafka data is being sent in a Avro Schema and I am trying to load the data into Logstash using Kafka Input however without Avro Codec, I am getting the data in the below charset: \\u0001\\u000E\\u0… [Previous page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=298) [Next page](https://discuss.elastic.co/c/elastic-stack/logstash/14.md?page=300)