# Latest **URL:** https://discuss.elastic.co/latest.md?page=1928 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1929 --- ## [Handling custom exception serialisation for plugins](https://discuss.elastic.co/t/handling-custom-exception-serialisation-for-plugins/259225)
**Author:** [@Bukhtawar\_Khan](https://discuss.elastic.co/u/Bukhtawar_Khan)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 7:37am UTC](https://discuss.elastic.co/t/handling-custom-exception-serialisation-for-plugins/259225 "2020-12-21T07:37:29Z")
The wire serialization of exceptions require exceptions to be registered. For instance if the transport node(transport inter-node communication) throws a custom exception, the caller node at transport needs to handle thi… --- ## [Logstash data type change in config file](https://discuss.elastic.co/t/logstash-data-type-change-in-config-file/258680)
**Author:** [@anjali28](https://discuss.elastic.co/u/anjali28)\ **Replies:** 3\ **Last updated:** [December 21, 2020, 7:19am UTC](https://discuss.elastic.co/t/logstash-data-type-change-in-config-file/258680 "2020-12-21T07:19:18Z")
Hello i am creating a config file to import the data from a csv file. when i call the config file as it is, its working properly and data is coming in kibana. But when i am changing the data type of a field in logstas… --- ## [Es update document very slow](https://discuss.elastic.co/t/es-update-document-very-slow/259072)
**Author:** [@111421](https://discuss.elastic.co/u/111421)\ **Replies:** 10\ **Last updated:** [December 21, 2020, 7:09am UTC](https://discuss.elastic.co/t/es-update-document-very-slow/259072 "2020-12-21T07:09:27Z")
Now it even takes about 7 minutes to update a doc. Single node, heap size: 8G, 30 shards, a total of 6.2G data, 2 million doc. This is too slow, if anyone can tell me how to solve it, I would appreciate it iostat Lin… --- ## [Cluster Health RED unassigned primary and replica shards](https://discuss.elastic.co/t/cluster-health-red-unassigned-primary-and-replica-shards/258891)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 7:08am UTC](https://discuss.elastic.co/t/cluster-health-red-unassigned-primary-and-replica-shards/258891 "2020-12-21T07:08:54Z")
Hello to everyone, Cluster health turned red when a node fell from the cluster. When I re-add the node, some directories automatically turned from red to green, but there is an index still red and I don't know what to d… --- ## [Filter Plugin - "Tried to load a plugin's code, but failed."](https://discuss.elastic.co/t/filter-plugin-tried-to-load-a-plugins-code-but-failed/259216)
**Author:** [@smm](https://discuss.elastic.co/u/smm)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 6:34am UTC](https://discuss.elastic.co/t/filter-plugin-tried-to-load-a-plugins-code-but-failed/259216 "2020-12-21T06:34:57Z")
Hi there, there is a logstash filter plugin called elapsed. I put (also) this into a config: elapsed { unique\_id\_field =\> "reqid" start\_tag =\> "TranBegin" end\_tag =\> "TranEnd" new\_event\_on\_match =\> false } a… --- ## [Why did apm-agent lose the original http body?](https://discuss.elastic.co/t/why-did-apm-agent-lose-the-original-http-body/259218)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 6:15am UTC](https://discuss.elastic.co/t/why-did-apm-agent-lose-the-original-http-body/259218 "2020-12-21T06:15:31Z")
The apm-agent should capture the parameters of Pic 1. --- ## [Why can't receive log from the ftp server?](https://discuss.elastic.co/t/why-cant-receive-log-from-the-ftp-server/259217)
**Author:** [@111418](https://discuss.elastic.co/u/111418)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 6:14am UTC](https://discuss.elastic.co/t/why-cant-receive-log-from-the-ftp-server/259217 "2020-12-21T06:14:20Z")
My conf is input { tcp { port =\> 10514 type=\> "leo\_ftp" } tcp { port =\> 10515 type =\> "jim\_ftp" } } filter { } output { if\[type\]=="leo\_ftp"{ elasticsearch { hosts =\> \["ip:9200"\] inde… --- ## [HAProxy + Logstash](https://discuss.elastic.co/t/haproxy-logstash/259215)
**Author:** [@Gigazo1d](https://discuss.elastic.co/u/Gigazo1d)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 6:04am UTC](https://discuss.elastic.co/t/haproxy-logstash/259215 "2020-12-21T06:04:45Z")
Hi! I plan to use HAProxy + Logstash to receive events and send them to another syslog server. Could you please share examples of your HAProxy config for my view. --- ## [Reading environment variables set with exec plugin](https://discuss.elastic.co/t/reading-environment-variables-set-with-exec-plugin/259189)
**Author:** [@Lukasz\_Geras](https://discuss.elastic.co/u/Lukasz_Geras)\ **Replies:** 4\ **Last updated:** [December 21, 2020, 5:56am UTC](https://discuss.elastic.co/t/reading-environment-variables-set-with-exec-plugin/259189 "2020-12-21T05:56:59Z")
Hello, could you please help me with reading environment variables set with exec plugin in logstash. Generally, my input looks like this: input{ exec{ command=\> „export FILENAME=$(ls -Arst /path/to/… --- ## [FileBeat/Modules for SNMP Trap](https://discuss.elastic.co/t/filebeat-modules-for-snmp-trap/259214)
**Author:** [@sreekeshava\_srihari](https://discuss.elastic.co/u/sreekeshava_srihari)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 5:41am UTC](https://discuss.elastic.co/t/filebeat-modules-for-snmp-trap/259214 "2020-12-21T05:41:41Z")
Hi All Does Elastic Beats/Modules provide to consume SNMP Traps so that Logstash can be avoided to consume SNMP Traps. Thanks in Advance Sreekeshava S --- ## [Logstash is picking messages quiet slowly](https://discuss.elastic.co/t/logstash-is-picking-messages-quiet-slowly/259160)
**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 5:02am UTC](https://discuss.elastic.co/t/logstash-is-picking-messages-quiet-slowly/259160 "2020-12-21T05:02:28Z")
Hi All, We have traffic around 100 million records per day and it was working fine till yesterday , but today I can see 50 million records are piled up at the the source system . i have tried increasing pipeline.workers… --- ## [Is this an error in documentation of "numeric\_detection"](https://discuss.elastic.co/t/is-this-an-error-in-documentation-of-numeric-detection/258944)
**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\ **Replies:** 5\ **Last updated:** [December 21, 2020, 4:50am UTC](https://discuss.elastic.co/t/is-this-an-error-in-documentation-of-numeric-detection/258944 "2020-12-21T04:50:57Z")
Hi, I was going through the documentation of Dynamic Field Mapping. In the table I see the last entry: JSON data type.......................................Elasticsearch data type string..............................… --- ## [Elastic Community Conference, Feb 26+27 2021 - CfP open now!](https://discuss.elastic.co/t/elastic-community-conference-feb-26-27-2021-cfp-open-now/259211)
**Author:** [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 3:58am UTC](https://discuss.elastic.co/t/elastic-community-conference-feb-26-27-2021-cfp-open-now/259211 "2020-12-21T03:58:33Z")
We're super excited to announce our first global Elastic Community Conference (ElasticCC in short), is a free technical conference from the community for the community. Open to developers, practitioners, customers, and p… --- ## [Filebeat dashboards are not loaded in kibana - Running on AWS](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-running-on-aws/259204)
**Author:** [@ats](https://discuss.elastic.co/u/ats)\ **Replies:** 3\ **Last updated:** [December 21, 2020, 3:31am UTC](https://discuss.elastic.co/t/filebeat-dashboards-are-not-loaded-in-kibana-running-on-aws/259204 "2020-12-21T03:31:57Z")
I am running 3 nodes in AWS: 1 master and 2 data nodes for Elasticsearch. I installed kibana fine with no issues. Now I'm running into an issue with setting up filebeat dashboard in Kibana. Getting the following error ro… --- ## [Kibana queries time out for some directories](https://discuss.elastic.co/t/kibana-queries-time-out-for-some-directories/258684)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:29am UTC](https://discuss.elastic.co/t/kibana-queries-time-out-for-some-directories/258684 "2020-12-21T03:29:20Z")
Kibana queries timed out for some directories. Stack Tracking is not working. I know that when I only query on one directory, the query times out. I have 12 nodes(9 data - 3 master). kibana 7.4.2 elasticsearch 7.4.2 --- ## [How to monitor/identify retry result with output elasticsearch](https://discuss.elastic.co/t/how-to-monitor-identify-retry-result-with-output-elasticsearch/258681)
**Author:** [@loker](https://discuss.elastic.co/u/loker)\ **Replies:** 0\ **Last updated:** [December 15, 2020, 8:28am UTC](https://discuss.elastic.co/t/how-to-monitor-identify-retry-result-with-output-elasticsearch/258681 "2020-12-15T08:28:00Z")
Hello there, Recently i meet some warning about es reject caused by queue exceed 200 limit. According to its retry policy for es output plugin, it should retry indefinitely for this kind of error(429). But i don't kno… --- ## [Getting MasterNotDiscoveredException: null in client nodes](https://discuss.elastic.co/t/getting-masternotdiscoveredexception-null-in-client-nodes/258699)
**Author:** [@nchalise](https://discuss.elastic.co/u/nchalise)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:23am UTC](https://discuss.elastic.co/t/getting-masternotdiscoveredexception-null-in-client-nodes/258699 "2020-12-21T03:23:43Z")
We have 3 master nodes, 2 client nodes, and 8 data nodes. And client nodes ES logs show below mentioned error even though resource usage(JVM and CPU ) looks fine at that time. And cluster went unresponsive mode. ALL node… --- ## [How to store service account file into embedded ES keystore?](https://discuss.elastic.co/t/how-to-store-service-account-file-into-embedded-es-keystore/258956)
**Author:** [@balakrishnan](https://discuss.elastic.co/u/balakrishnan)\ **Replies:** 1\ **Last updated:** [December 21, 2020, 3:13am UTC](https://discuss.elastic.co/t/how-to-store-service-account-file-into-embedded-es-keystore/258956 "2020-12-21T03:13:14Z")
We are using embedded ES (version 5.6) and am exploring the snapshot & restore options with GCS as snapshot repository. The repository-gcs plugin expects that the service account JSON file must be added into the elastics… --- ## [Elastic APM agent on Ruby on Rails elastic-apm gem not found error](https://discuss.elastic.co/t/elastic-apm-agent-on-ruby-on-rails-elastic-apm-gem-not-found-error/258996)
**Author:** [@renu\_jessi](https://discuss.elastic.co/u/renu_jessi)\ **Replies:** 0\ **Last updated:** [December 17, 2020, 1:07pm UTC](https://discuss.elastic.co/t/elastic-apm-agent-on-ruby-on-rails-elastic-apm-gem-not-found-error/258996 "2020-12-17T13:07:25Z")
Hi Team, iam trying to install apm agent on ruby on rails agent..iam getting below error pls help me. \[ERROR\] 2020-12-17 18:31:15.947 \[main\] Logstash - java.lang.IllegalStateException: Logstash stopped processing becau… --- ## [Issue with Strigo lab not starting - Elastic Eng 1 On-Demand](https://discuss.elastic.co/t/issue-with-strigo-lab-not-starting-elastic-eng-1-on-demand/259084)
**Author:** [@gv007](https://discuss.elastic.co/u/gv007)\ **Replies:** 0\ **Last updated:** [December 18, 2020, 11:01am UTC](https://discuss.elastic.co/t/issue-with-strigo-lab-not-starting-elastic-eng-1-on-demand/259084 "2020-12-18T11:01:35Z")
Issue with Strigo lab not starting Lab 4.1 - Elastic Eng 1 On-Demand When I try to access the workstation on Strigo it's failing with the following error We have encountered a technical issue while setting up you lab.… --- ## [Print Count of any particular field in watcher email body along with total Payload](https://discuss.elastic.co/t/print-count-of-any-particular-field-in-watcher-email-body-along-with-total-payload/259170)
**Author:** [@Sajal](https://discuss.elastic.co/u/Sajal)\ **Replies:** 0\ **Last updated:** [December 19, 2020, 5:04pm UTC](https://discuss.elastic.co/t/print-count-of-any-particular-field-in-watcher-email-body-along-with-total-payload/259170 "2020-12-19T17:04:19Z")
Hi Folks , I am able to get ctx.payload.hits.total in an index but i want to print count of any particular feild(like how many channel session ID occured in an index) in watcher email body. How should i get that ? Than… --- ## [Visual C++ Redistributable error](https://discuss.elastic.co/t/visual-c-redistributable-error/259210)
**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\ **Replies:** 0\ **Last updated:** [December 21, 2020, 2:35am UTC](https://discuss.elastic.co/t/visual-c-redistributable-error/259210 "2020-12-21T02:35:46Z")
Trying to install the ODBC driver but the esodbc driver keeps asking for Visual C++ 2017 Redistributable, which, i already installed. Any idea wheat is wrong ? --- ## [How to filter and narrow the data before aggregation](https://discuss.elastic.co/t/how-to-filter-and-narrow-the-data-before-aggregation/259147)
**Author:** [@jun\_miao](https://discuss.elastic.co/u/jun_miao)\ **Replies:** 2\ **Last updated:** [December 21, 2020, 1:44am UTC](https://discuss.elastic.co/t/how-to-filter-and-narrow-the-data-before-aggregation/259147 "2020-12-21T01:44:37Z")
Hello, all I have a query which group by groupId. { "aggs":{ "result":{ "terms":{ "field":"groupId", "size": 100 } } }, "size": 0 } Because the index co… --- ## [Should we create New Index or Use the same index for all application logs(number of app ~ 5)](https://discuss.elastic.co/t/should-we-create-new-index-or-use-the-same-index-for-all-application-logs-number-of-app-5/259011)
**Author:** [@SHOAIB\_AHMED](https://discuss.elastic.co/u/SHOAIB_AHMED)\ **Replies:** 3\ **Last updated:** [December 20, 2020, 11:52pm UTC](https://discuss.elastic.co/t/should-we-create-new-index-or-use-the-same-index-for-all-application-logs-number-of-app-5/259011 "2020-12-20T23:52:13Z")
I have about 5 apps to monitor using log parsing with ELK. Does it make sense to create new index for each application log or only one index is sufficient to store all app logs. The logs for these apps would also contai… --- ## [Q: ILM and Beats index-template thoughts in a lab 7.10.x setup](https://discuss.elastic.co/t/q-ilm-and-beats-index-template-thoughts-in-a-lab-7-10-x-setup/259208)
**Author:** [@Andreas\_Falk](https://discuss.elastic.co/u/Andreas_Falk)\ **Replies:** 0\ **Last updated:** [December 20, 2020, 11:51pm UTC](https://discuss.elastic.co/t/q-ilm-and-beats-index-template-thoughts-in-a-lab-7-10-x-setup/259208 "2020-12-20T23:51:50Z")
Hi, We are setting up a new 7.10.1 cluster and are struggling with some ILM and beat stuff :slight\_smile: First up, when doing a simple template setup through Filebeat docker run \\ docker.elastic.co/beats/filebeat:7… --- ## [ES hadoop Spark query returns too many partitions](https://discuss.elastic.co/t/es-hadoop-spark-query-returns-too-many-partitions/259201)
**Author:** [@Greg\_Jensen](https://discuss.elastic.co/u/Greg_Jensen)\ **Replies:** 0\ **Last updated:** [December 20, 2020, 8:04pm UTC](https://discuss.elastic.co/t/es-hadoop-spark-query-returns-too-many-partitions/259201 "2020-12-20T20:04:51Z")
I have a Java Spark application that is querying 15K \_ids. The query is against an alias, that is backed by 15 or more indexes, each with ~ 9 shards. This query is taking far longer then is necessary because based on the… --- ## [Parsing ip address coming at random places inside logs](https://discuss.elastic.co/t/parsing-ip-address-coming-at-random-places-inside-logs/259177)
**Author:** [@Muhammad\_Faisal](https://discuss.elastic.co/u/Muhammad_Faisal)\ **Replies:** 4\ **Last updated:** [December 20, 2020, 4:05pm UTC](https://discuss.elastic.co/t/parsing-ip-address-coming-at-random-places-inside-logs/259177 "2020-12-20T16:05:12Z")
hi guys, input log message contains IP address but the occurence of ip is random inside message and also some times the message will not contain any ip ...how can we extract this ip address using grok or other filters. … --- ## [My index contains all geo data but not showing in list while creating Maps from that index](https://discuss.elastic.co/t/my-index-contains-all-geo-data-but-not-showing-in-list-while-creating-maps-from-that-index/259196)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 8\ **Last updated:** [December 20, 2020, 7:31pm UTC](https://discuss.elastic.co/t/my-index-contains-all-geo-data-but-not-showing-in-list-while-creating-maps-from-that-index/259196 "2020-12-20T19:31:36Z")
I am performing Geo lookup via Logstash and added geoip filter to get required data. I am getting data in logs but some how it is not getting listed in indexes while configuring layers in Map. Here is my conf file. inpu… --- ## [Need to parse logs and enrich some values from mysql data at logstats](https://discuss.elastic.co/t/need-to-parse-logs-and-enrich-some-values-from-mysql-data-at-logstats/259176)
**Author:** [@abhi.coerian](https://discuss.elastic.co/u/abhi.coerian)\ **Replies:** 3\ **Last updated:** [December 20, 2020, 3:58pm UTC](https://discuss.elastic.co/t/need-to-parse-logs-and-enrich-some-values-from-mysql-data-at-logstats/259176 "2020-12-20T15:58:07Z")
Need to parse logs on logstash and enrich some values from mysql db based on the log message and generate json message . e.x JOB application\_1603918538928\_3286731 QUEUE default USER xyz Need to fetch details of USER :… --- ## [CircuitBreaking Exception](https://discuss.elastic.co/t/circuitbreaking-exception/258568)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 17\ **Last updated:** [December 20, 2020, 1:21pm UTC](https://discuss.elastic.co/t/circuitbreaking-exception/258568 "2020-12-20T13:21:11Z")
I am using ELK cluster(3 master+3 data +2 coordinate) + kafka cluster.I am also using winlogbeat and packetbeat at client side.In kibana discover i saw that winlogbeat data was coming slow and packetbeat data was coming … [Previous page](https://discuss.elastic.co/latest.md?page=1927) [Next page](https://discuss.elastic.co/latest.md?page=1929)