# \#none **URL:** https://discuss.elastic.co/tag/none.md?page=1682 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1683 --- ## [Ingesting latest logs from kafka with logstash](https://discuss.elastic.co/t/ingesting-latest-logs-from-kafka-with-logstash/215209)
**Author:** [@canaria](https://discuss.elastic.co/u/canaria)\ **Replies:** 2\ **Last updated:** [January 15, 2020, 10:20pm UTC](https://discuss.elastic.co/t/ingesting-latest-logs-from-kafka-with-logstash/215209 "2020-01-15T22:20:46Z")
Hi, I searched previous opened topics related that question but none of them have any reply. I’m ingesting logs from apache kafka with logstash, everything is fine but I noticed that whenever I started logstash instance… --- ## [Multiple nodes that get input from a scheduled JDBC database query?](https://discuss.elastic.co/t/multiple-nodes-that-get-input-from-a-scheduled-jdbc-database-query/215218)
**Author:** [@aidanoc15](https://discuss.elastic.co/u/aidanoc15)\ **Replies:** 1\ **Last updated:** [January 15, 2020, 10:17pm UTC](https://discuss.elastic.co/t/multiple-nodes-that-get-input-from-a-scheduled-jdbc-database-query/215218 "2020-01-15T22:17:36Z")
Right now we have one logstash node running in Docker that queries a database every 2 minutes using JDBC and sends it over to a collector. How does something like this work if you want to have this done by a swarm of nod… --- ## [Error FORBIDDEN/8/index write (api)\] and Elasticsearch stop to receiving logstash bulk requests](https://discuss.elastic.co/t/error-forbidden-8-index-write-api-and-elasticsearch-stop-to-receiving-logstash-bulk-requests/215028)
**Author:** [@ALEXANDRE\_BUNN1](https://discuss.elastic.co/u/ALEXANDRE_BUNN1)\ **Replies:** 7\ **Last updated:** [January 15, 2020, 10:16pm UTC](https://discuss.elastic.co/t/error-forbidden-8-index-write-api-and-elasticsearch-stop-to-receiving-logstash-bulk-requests/215028 "2020-01-15T22:16:55Z")
I have a server running Logstash, Kibana and ElasticSearch 6.8, all in the same server. I was setting up the ILM for the indexes, just to set a retention and executing force\_merge for the old indices (older than 1 day) … --- ## [Different charset in filter http](https://discuss.elastic.co/t/different-charset-in-filter-http/215219)
**Author:** [@Peter\_Li](https://discuss.elastic.co/u/Peter_Li)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 9:56pm UTC](https://discuss.elastic.co/t/different-charset-in-filter-http/215219 "2020-01-15T21:56:26Z")
I have a filter http module, but http returns nonUTF8 character sequences. Got this error: invalid byte sequence in utf-8 If one use input http, one can add "codec plain" to deal with this. But no such option exist fo… --- ## [Cannot join nodes to master](https://discuss.elastic.co/t/cannot-join-nodes-to-master/215166)
**Author:** [@Julio\_Edel\_Salas\_Dia](https://discuss.elastic.co/u/Julio_Edel_Salas_Dia)\ **Replies:** 3\ **Last updated:** [January 15, 2020, 9:53pm UTC](https://discuss.elastic.co/t/cannot-join-nodes-to-master/215166 "2020-01-15T21:53:32Z")
I am trying to create an elasticsearch cluster with several nodes, I have 3 master nodes, but every time they try to join it gives this error. \[2020-01-15T15:37:21,421\]\[WARN \]\[o.e.c.c.Coordinator \] \[emc-master-03\] … --- ## [Sqs input not working](https://discuss.elastic.co/t/sqs-input-not-working/215215)
**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 9:19pm UTC](https://discuss.elastic.co/t/sqs-input-not-working/215215 "2020-01-15T21:19:42Z")
I am trying to import SES logs from aws using sqs input. I have configured the pipeline. Was working for some time but after moving to 7.x it stopped working. My config looks like this: input { sqs { access\_key\_i… --- ## [My plugin will build and install, but kibana wont run](https://discuss.elastic.co/t/my-plugin-will-build-and-install-but-kibana-wont-run/214126)
**Author:** [@McKittrick\_Kaminski](https://discuss.elastic.co/u/McKittrick_Kaminski)\ **Replies:** 6\ **Last updated:** [January 15, 2020, 9:21pm UTC](https://discuss.elastic.co/t/my-plugin-will-build-and-install-but-kibana-wont-run/214126 "2020-01-15T21:21:16Z")
I'm developing a plugin with Kibana v7.5.1, and I have it in a state where I want to build the plugin and install it into a docker container, and recommit the container and save it to my private registry. All of these s… --- ## [How to get the recent snapshot of my dashboard as a picture/pdf to send to Slack?](https://discuss.elastic.co/t/how-to-get-the-recent-snapshot-of-my-dashboard-as-a-picture-pdf-to-send-to-slack/210585)
**Author:** [@EZprogramming](https://discuss.elastic.co/u/EZprogramming)\ **Replies:** 7\ **Last updated:** [January 15, 2020, 8:58pm UTC](https://discuss.elastic.co/t/how-to-get-the-recent-snapshot-of-my-dashboard-as-a-picture-pdf-to-send-to-slack/210585 "2020-01-15T20:58:23Z")
I would like to receive the recent picture of my graphs (not manually; automated) and post the image URL to my slack for my team to view. Is that possible to do using Elasticsearch Watcher? I am also working with Slack … --- ## [How to aggregate and sum the data grouped by some fields](https://discuss.elastic.co/t/how-to-aggregate-and-sum-the-data-grouped-by-some-fields/215207)
**Author:** [@Mihir\_Kothari](https://discuss.elastic.co/u/Mihir_Kothari)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 8:54pm UTC](https://discuss.elastic.co/t/how-to-aggregate-and-sum-the-data-grouped-by-some-fields/215207 "2020-01-15T20:54:24Z")
Based on below 2 messages, I need to aggregate the data based on: granularity (MyHeader.granularity) myType (MyHeader.myType) Currency. { "\_source": { "MyData": { "MyH… --- ## [Dashboard user and dashboard crator user](https://discuss.elastic.co/t/dashboard-user-and-dashboard-crator-user/215137)
**Author:** [@alexolivan](https://discuss.elastic.co/u/alexolivan)\ **Replies:** 3\ **Last updated:** [January 15, 2020, 8:47pm UTC](https://discuss.elastic.co/t/dashboard-user-and-dashboard-crator-user/215137 "2020-01-15T20:47:12Z")
Hi all. I'm playing with the x-pack features, and, once I have some data on a few indices, I want to achieve the following: I would like to have an user that is able to create dashborads, so it is granted explore, visu… --- ## [Conditional checks no longer work](https://discuss.elastic.co/t/conditional-checks-no-longer-work/215201)
**Author:** [@zozo6015](https://discuss.elastic.co/u/zozo6015)\ **Replies:** 2\ **Last updated:** [January 15, 2020, 8:39pm UTC](https://discuss.elastic.co/t/conditional-checks-no-longer-work/215201 "2020-01-15T20:39:46Z")
Hello, I am running logstash 7.5.0 and I am wondering if anything changed on the conditional checks because I have some checks like: if \[agent\]\[type\] == "filebeat" { ... } and it's not matching anymore. --- ## [How to ignore missing fields while reindexing in Elasticsearch](https://discuss.elastic.co/t/how-to-ignore-missing-fields-while-reindexing-in-elasticsearch/215200)
**Author:** [@OliverWu](https://discuss.elastic.co/u/OliverWu)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 8:14pm UTC](https://discuss.elastic.co/t/how-to-ignore-missing-fields-while-reindexing-in-elasticsearch/215200 "2020-01-15T20:14:49Z")
If I have a destination index with only portion of source index, and I only want to reindex these fields from source index to destination index, Can I still using the reindex API or what should I do with this situation? … --- ## [Autosuggest in 7.5.1](https://discuss.elastic.co/t/autosuggest-in-7-5-1/215190)
**Author:** [@PatOPaiar](https://discuss.elastic.co/u/PatOPaiar)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 7:05pm UTC](https://discuss.elastic.co/t/autosuggest-in-7-5-1/215190 "2020-01-15T19:05:48Z")
We have a working integration running a 5.6 ElasticSearch deployment on elastic.co connected to a site using the elasticsearch-php Branch 5.0 as suggested in the Version Matrix Everything works fine here, including our… --- ## [Rally 1.4.0 released](https://discuss.elastic.co/t/rally-1-4-0-released/215189)
**Author:** [@baz](https://discuss.elastic.co/u/baz)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 6:40pm UTC](https://discuss.elastic.co/t/rally-1-4-0-released/215189 "2020-01-15T18:40:03Z")
We have just released Rally 1.4.0. Some of the highlights of this release: The ability to use the bundled JDK that comes with Elasticsearch, rather than relying on a user supplied JVM. The addition of subcommands … --- ## [Drop documents with empty field](https://discuss.elastic.co/t/drop-documents-with-empty-field/215161)
**Author:** [@JeremyP](https://discuss.elastic.co/u/JeremyP)\ **Replies:** 5\ **Last updated:** [January 15, 2020, 6:07pm UTC](https://discuss.elastic.co/t/drop-documents-with-empty-field/215161 "2020-01-15T18:07:06Z")
I'm having difficulty finding the right syntax to drop a document with an empty field. I'm using aggregate maps. Here is my code.... filter { aggregate { task\_id =\> "%{asset\_id}%{vulnerability\_id}" code =\> … --- ## [Setup snapshot for s3 plugin](https://discuss.elastic.co/t/setup-snapshot-for-s3-plugin/211661)
**Author:** [@dg\_hivebrite](https://discuss.elastic.co/u/dg_hivebrite)\ **Replies:** 15\ **Last updated:** [January 15, 2020, 5:51pm UTC](https://discuss.elastic.co/t/setup-snapshot-for-s3-plugin/211661 "2020-01-15T17:51:14Z")
Hi, I'm trying to setup the s3 plugin but I have an issue. I don't how to format the secret for aws credentials for the operator. Actually I tried that (with terraform): resource "kubernetes\_secret" "aws\_credentials\_… --- ## [Logstash filter date "atypical" failure](https://discuss.elastic.co/t/logstash-filter-date-atypical-failure/215039)
**Author:** [@blenolopes](https://discuss.elastic.co/u/blenolopes)\ **Replies:** 4\ **Last updated:** [January 15, 2020, 5:38pm UTC](https://discuss.elastic.co/t/logstash-filter-date-atypical-failure/215039 "2020-01-15T17:38:41Z")
Hello logstashers, I have an "atypical" problem with a particular log format using date filter. Follow the tests. bin/logstash --version logstash 7.5.0 Success ~$ echo "14/01/2020 16:03:00,143" | bin/logstash … --- ## [Logstash parsing remote files from filebeat](https://discuss.elastic.co/t/logstash-parsing-remote-files-from-filebeat/215181)
**Author:** [@victor\_ide](https://discuss.elastic.co/u/victor_ide)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 5:21pm UTC](https://discuss.elastic.co/t/logstash-parsing-remote-files-from-filebeat/215181 "2020-01-15T17:21:48Z")
Hello logstashers! I was wondering if it is possible to read remote files like PDF, docx and import them into elasticsearch using the attachment processor + filebeat, where filebeat would send files to logstash, then lo… --- ## [Elasticsearch 7.5.1](https://discuss.elastic.co/t/elasticsearch-7-5-1/215178)
**Author:** [@akash.gund](https://discuss.elastic.co/u/akash.gund)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 5:00pm UTC](https://discuss.elastic.co/t/elasticsearch-7-5-1/215178 "2020-01-15T17:00:44Z")
while moving from ES7.2.0 to ES 7.5.1 have observed that the following JVM options thatwere present in ES 7.2 are not present in 7.5. pre-touch memory pages used by the JVM during initialization -XX:+AlwaysPreTouch bas… --- ## [A problem with numeric range query](https://discuss.elastic.co/t/a-problem-with-numeric-range-query/215174)
**Author:** [@D3ivid](https://discuss.elastic.co/u/D3ivid)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 4:30pm UTC](https://discuss.elastic.co/t/a-problem-with-numeric-range-query/215174 "2020-01-15T16:30:59Z")
Hi, My name is David and I have a problem with a query. I tried to search the forum for similar topics but I haven't found anything, I appreciate any help in advance. This is the query that is giving me problems: { … --- ## [Date format error in tooltip when splitting a chart with date histogram](https://discuss.elastic.co/t/date-format-error-in-tooltip-when-splitting-a-chart-with-date-histogram/215173)
**Author:** [@dcot](https://discuss.elastic.co/u/dcot)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 4:25pm UTC](https://discuss.elastic.co/t/date-format-error-in-tooltip-when-splitting-a-chart-with-date-histogram/215173 "2020-01-15T16:25:23Z")
Hello, When splitting chart with Date Histogram, the date is properly formatted in the axis label but it is in timestamp format inside the tooltip. I'm using Kibana 7.5.0 but I see the issue in Kibana demo which is c… --- ## [Removing leading character and trailing 2 characters](https://discuss.elastic.co/t/removing-leading-character-and-trailing-2-characters/214634)
**Author:** [@DWbank](https://discuss.elastic.co/u/DWbank)\ **Replies:** 14\ **Last updated:** [January 15, 2020, 3:58pm UTC](https://discuss.elastic.co/t/removing-leading-character-and-trailing-2-characters/214634 "2020-01-15T15:58:40Z")
I am using kv to parse my fields due to the fields change depends on the logs that are sent from the siem. kv { value\_split =\> “=’” field\_split =\> “’ “… --- ## [Log Management for Multiple Application Instances](https://discuss.elastic.co/t/log-management-for-multiple-application-instances/214940)
**Author:** [@amin224](https://discuss.elastic.co/u/amin224)\ **Replies:** 2\ **Last updated:** [January 15, 2020, 3:44pm UTC](https://discuss.elastic.co/t/log-management-for-multiple-application-instances/214940 "2020-01-15T15:44:45Z")
Hello, sorry if this has been asked before but i am new to ELK stack and did not find an answer for my question. If i have an application that is running multiple instances for example instance1, instance2, instance3 and… --- ## [S3 dynamic date prefix in folder name by using current date as backup\_add\_prefix](https://discuss.elastic.co/t/s3-dynamic-date-prefix-in-folder-name-by-using-current-date-as-backup-add-prefix/215104)
**Author:** [@Xandr90](https://discuss.elastic.co/u/Xandr90)\ **Replies:** 1\ **Last updated:** [January 15, 2020, 3:38pm UTC](https://discuss.elastic.co/t/s3-dynamic-date-prefix-in-folder-name-by-using-current-date-as-backup-add-prefix/215104 "2020-01-15T15:38:53Z")
So what i want to do is use Logstash to rename incoming files in a s3 bucket. I run it via docker and use the following logstash.conf input { s3 { access\_key\_id =\> "some\_key" secret\_access\_key =\> "some\_secret" reg… --- ## [Display data in kibana table from an elasticsearch query](https://discuss.elastic.co/t/display-data-in-kibana-table-from-an-elasticsearch-query/215108)
**Author:** [@reyhanadp](https://discuss.elastic.co/u/reyhanadp)\ **Replies:** 1\ **Last updated:** [January 15, 2020, 2:57pm UTC](https://discuss.elastic.co/t/display-data-in-kibana-table-from-an-elasticsearch-query/215108 "2020-01-15T14:57:40Z")
hi, i have an elasticsearch query as follows: GET default-2019.13/\_search?size=0 { "query": { "match\_all": {} }, "aggs": { "group": { "terms": { "field": "jobId.keyword", "size": 3 }, "aggs": { "group\_docs"… --- ## [Using date filter within split filter](https://discuss.elastic.co/t/using-date-filter-within-split-filter/214402)
**Author:** [@maksimize](https://discuss.elastic.co/u/maksimize)\ **Replies:** 4\ **Last updated:** [January 15, 2020, 2:47pm UTC](https://discuss.elastic.co/t/using-date-filter-within-split-filter/214402 "2020-01-15T14:47:59Z")
Hi All I'm receiving batch event from azure eventhub and I am using split filter to split each event into it's own record the problem I'm facing is that each split event has it's own datetime and I would like to use th… --- ## [Can I use elasticsearch for data warehouse?](https://discuss.elastic.co/t/can-i-use-elasticsearch-for-data-warehouse/215158)
**Author:** [@yogender20](https://discuss.elastic.co/u/yogender20)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 2:43pm UTC](https://discuss.elastic.co/t/can-i-use-elasticsearch-for-data-warehouse/215158 "2020-01-15T14:43:10Z")
Can I use elasticsearch for data warehouse or HDFS is better option? --- ## [Json::ParserError: Unrecognized token](https://discuss.elastic.co/t/json-unrecognized-token/215006)
**Author:** [@akuninja](https://discuss.elastic.co/u/akuninja)\ **Replies:** 6\ **Last updated:** [January 15, 2020, 2:37pm UTC](https://discuss.elastic.co/t/json-unrecognized-token/215006 "2020-01-15T14:37:18Z")
//////////////////////////////////THIS PART I SOLVED MYSELF /////////////////////////////////////// I am still getting a broken token within my logstash output, and I do not know where this timestamp (possibly) token co… --- ## [Sorting Result For Text is not proper](https://discuss.elastic.co/t/sorting-result-for-text-is-not-proper/215153)
**Author:** [@Shadab\_Imam](https://discuss.elastic.co/u/Shadab_Imam)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 2:28pm UTC](https://discuss.elastic.co/t/sorting-result-for-text-is-not-proper/215153 "2020-01-15T14:28:23Z")
Hi All, I am using Nest Library for elastic search in my .net core project. I am facing problem in sorting of result. the sorted result returned from elasticSearch is not properly sorted. I am also using paging. bel… --- ## [Sorting aggregation by specified value](https://discuss.elastic.co/t/sorting-aggregation-by-specified-value/215149)
**Author:** [@Sodium](https://discuss.elastic.co/u/Sodium)\ **Replies:** 0\ **Last updated:** [January 15, 2020, 2:25pm UTC](https://discuss.elastic.co/t/sorting-aggregation-by-specified-value/215149 "2020-01-15T14:25:29Z")
Hello, I'm building an ecommerce website using elastic search engine for my products. Product have tags that can be used for filtering using checkbox. I display the tags ordered by descending docs count with a limit of … [Previous page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1681) [Next page](https://discuss.elastic.co/tag/none.md?no_tags=true&page=1683)