# Latest **URL:** https://discuss.elastic.co/latest.md?page=1530 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1531 --- ## [Pipeline worker error, the pipeline will be stopped {:pipeline\_id=\>"main", :error=\>"(TypeError) no implicit conversion of nil into Integer](https://discuss.elastic.co/t/pipeline-worker-error-the-pipeline-will-be-stopped-pipeline-id-main-error-typeerror-no-implicit-conversion-of-nil-into-integer/281167)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 8:16am UTC](https://discuss.elastic.co/t/pipeline-worker-error-the-pipeline-will-be-stopped-pipeline-id-main-error-typeerror-no-implicit-conversion-of-nil-into-integer/281167 "2021-08-12T08:16:12Z")
I have configured SQS as input, not sure why I am getting this error. I am not performing any conversation from my Logstash config file. Can anyone help to identify the issue? The following error message comes right af… --- ## [Fleet/Elastic-Agent trusted information from certificate](https://discuss.elastic.co/t/fleet-elastic-agent-trusted-information-from-certificate/281028)
**Author:** [@wsnet](https://discuss.elastic.co/u/wsnet)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 7:21am UTC](https://discuss.elastic.co/t/fleet-elastic-agent-trusted-information-from-certificate/281028 "2021-08-12T07:21:12Z")
Hello, With 7.14.0 Elasticsearch has started validating agent.id using the .fleet\_final\_pipeline-1 (see the PR), which greatly improves security. While using Elastic-Agent to fetch information from servers, e.g. web-lo… --- ## [Filebeats can see new lines in file only after restart](https://discuss.elastic.co/t/filebeats-can-see-new-lines-in-file-only-after-restart/281159)
**Author:** [@station72](https://discuss.elastic.co/u/station72)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 6:48am UTC](https://discuss.elastic.co/t/filebeats-can-see-new-lines-in-file-only-after-restart/281159 "2021-08-12T06:48:13Z")
I have a log file. It named access.log Each 30min new lines appears in this file from remote server (by synchronization). My filebeat config filebeat.inputs: - type: filestream scan\_frequency: 10s paths: - /sr… --- ## [Changing / Modifying / Customizing Visualize Library](https://discuss.elastic.co/t/changing-modifying-customizing-visualize-library/280946)
**Author:** [@bailarch](https://discuss.elastic.co/u/bailarch)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 6:47am UTC](https://discuss.elastic.co/t/changing-modifying-customizing-visualize-library/280946 "2021-08-12T06:47:50Z")
Hello everyone, I would like to create a set of dataset from Visualize Library since some of the templates that I see can be more powerful than Lens / Dashboard since you can set infinite about of data/values to show - … --- ## [Kibana startup failure in Windows](https://discuss.elastic.co/t/kibana-startup-failure-in-windows/280709)
**Author:** [@xubisid](https://discuss.elastic.co/u/xubisid)\ **Replies:** 3\ **Last updated:** [August 12, 2021, 6:47am UTC](https://discuss.elastic.co/t/kibana-startup-failure-in-windows/280709 "2021-08-12T06:47:05Z")
I have download the updated 7.14.0 kibana version and wait for the whole zip download but unfortunately getting the same error message Cannot find module './persistence\_google\_workspace\_api\_access\_granted\_via\_domain\_wid… --- ## [Question about Kibana Visualize](https://discuss.elastic.co/t/question-about-kibana-visualize/281111)
**Author:** [@FayeLu](https://discuss.elastic.co/u/FayeLu)\ **Replies:** 3\ **Last updated:** [August 12, 2021, 6:36am UTC](https://discuss.elastic.co/t/question-about-kibana-visualize/281111 "2021-08-12T06:36:24Z")
I am new to Kibana and I am learning how to create custom Kibana visualization chart. Is that possible we can create visualization of Elastic Search schema data using Kibana? eg. I have a data of colleges students with… --- ## [ELK cluster is not stable due to several issues related to shards and JVM configuration](https://discuss.elastic.co/t/elk-cluster-is-not-stable-due-to-several-issues-related-to-shards-and-jvm-configuration/281059)
**Author:** [@Dawood](https://discuss.elastic.co/u/Dawood)\ **Replies:** 2\ **Last updated:** [August 12, 2021, 6:25am UTC](https://discuss.elastic.co/t/elk-cluster-is-not-stable-due-to-several-issues-related-to-shards-and-jvm-configuration/281059 "2021-08-12T06:25:42Z")
Hi, First it is not the first time i am sharing the issues that i am encountering and hopefully this time somebody will help me with that !!! So i have an ELK cluster that is running on premise on a rancher k8s based … --- ## [Disable Alerts and Actions for some roles](https://discuss.elastic.co/t/disable-alerts-and-actions-for-some-roles/281155)
**Author:** [@Ankur\_Mahajan](https://discuss.elastic.co/u/Ankur_Mahajan)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 6:21am UTC](https://discuss.elastic.co/t/disable-alerts-and-actions-for-some-roles/281155 "2021-08-12T06:21:04Z")
I have set up Kibana alerts for multiple events for my production. I have other users also who can monitor the logs and dashboards. I've created a role for them with specific privileges but I couldn't find the option to … --- ## [Can we send jenkins Build console logs to Kibana using filebeat](https://discuss.elastic.co/t/can-we-send-jenkins-build-console-logs-to-kibana-using-filebeat/280547)
**Author:** [@Harindra\_Balanagired](https://discuss.elastic.co/u/Harindra_Balanagired)\ **Replies:** 7\ **Last updated:** [August 12, 2021, 5:47am UTC](https://discuss.elastic.co/t/can-we-send-jenkins-build-console-logs-to-kibana-using-filebeat/280547 "2021-08-12T05:47:08Z")
Can we send Jenkins Build console output to Kibana using the filebeat you figure out in the image? based on timestamp see highlighted time in that image. Based on the timestamp can we create a dashboard --- ## [Split Timelion Graph](https://discuss.elastic.co/t/split-timelion-graph/281152)
**Author:** [@Phanikumar\_21](https://discuss.elastic.co/u/Phanikumar_21)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 6:03am UTC](https://discuss.elastic.co/t/split-timelion-graph/281152 "2021-08-12T06:03:26Z")
Hi, We had ingested job monitoring information… start time / end time / target end time of job for SLA. However, some jobs start in the evening EST time and run into the next day – i.e. 11pm and ends at 2am . We are… --- ## [Kibana overrides original time format from Elasticsearch](https://discuss.elastic.co/t/kibana-overrides-original-time-format-from-elasticsearch/281124)
**Author:** [@rtemotfuorco123](https://discuss.elastic.co/u/rtemotfuorco123)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 5:29am UTC](https://discuss.elastic.co/t/kibana-overrides-original-time-format-from-elasticsearch/281124 "2021-08-12T05:29:10Z")
Hi, I have the index below and when I visualise it in Kibana, the log\_field.time format is changed. I want to keep it as the original one which is RFC3339. How do I get this sorted? See image at the bottom please. By th… --- ## [How to re run the failed transform job for that specific failed duration?](https://discuss.elastic.co/t/how-to-re-run-the-failed-transform-job-for-that-specific-failed-duration/281085)
**Author:** [@Mojahid\_Ahmad](https://discuss.elastic.co/u/Mojahid_Ahmad)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 5:23am UTC](https://discuss.elastic.co/t/how-to-re-run-the-failed-transform-job-for-that-specific-failed-duration/281085 "2021-08-12T05:23:17Z")
I have created one transform job, so the incoming document is passed to transform job and do aggregation, and then it gets ingested into a new index. It was running fine until I see the error failed to gather field map… --- ## [Grok filter by values](https://discuss.elastic.co/t/grok-filter-by-values/280988)
**Author:** [@IsAa](https://discuss.elastic.co/u/IsAa)\ **Replies:** 4\ **Last updated:** [August 12, 2021, 5:19am UTC](https://discuss.elastic.co/t/grok-filter-by-values/280988 "2021-08-12T05:19:42Z")
Hi Everyone, I have a text in my input as follows, The following text contains {"Food":"Fruit","Type":"Apple"} I am trying to structure my output data to also contain fields Food: Fruit Type: Apple I was looking int… --- ## [Dump elasticsearch documents into avro format](https://discuss.elastic.co/t/dump-elasticsearch-documents-into-avro-format/281146)
**Author:** [@Sagar\_kadu](https://discuss.elastic.co/u/Sagar_kadu)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 4:43am UTC](https://discuss.elastic.co/t/dump-elasticsearch-documents-into-avro-format/281146 "2021-08-12T04:43:10Z")
I want to store elasticsearch query results into avro files using logstash..As far as I know there file output logstash plugin which by default stores JSON documents. after going through logstash documentation,I co… --- ## [Setup Elasticsearch cluster result in two clusers](https://discuss.elastic.co/t/setup-elasticsearch-cluster-result-in-two-clusers/281135)
**Author:** [@Benli](https://discuss.elastic.co/u/Benli)\ **Replies:** 3\ **Last updated:** [August 12, 2021, 3:22am UTC](https://discuss.elastic.co/t/setup-elasticsearch-cluster-result-in-two-clusers/281135 "2021-08-12T03:22:35Z")
Hi there, I'm setting up Elasticsearch cluster by using two separate Linux machines. On the first Linux, elasticsearch.yml: # ---------------------------------- Cluster ----------------------------------- cluster.name:… --- ## [\[Canvas\] How to pass variable as timerange to savedVisualization](https://discuss.elastic.co/t/canvas-how-to-pass-variable-as-timerange-to-savedvisualization/279602)
**Author:** [@Salman\_Ahmed](https://discuss.elastic.co/u/Salman_Ahmed)\ **Replies:** 2\ **Last updated:** [August 12, 2021, 1:52am UTC](https://discuss.elastic.co/t/canvas-how-to-pass-variable-as-timerange-to-savedvisualization/279602 "2021-08-12T01:52:42Z")
I have created a canvas with multiple Kibana visualization and need to dynamically (from url parameter" pass the "from" argument of the visualization. It works until I save/run the expression at which point it changes th… --- ## [Update fileds in \_source by ES update api , when success, all data of stored\_fields are missing](https://discuss.elastic.co/t/update-fileds-in-source-by-es-update-api-when-success-all-data-of-stored-fields-are-missing/280896)
**Author:** [@jiangnanxue21](https://discuss.elastic.co/u/jiangnanxue21)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 1:48am UTC](https://discuss.elastic.co/t/update-fileds-in-source-by-es-update-api-when-success-all-data-of-stored-fields-are-missing/280896 "2021-08-12T01:48:21Z")
Update fileds in \_source by ES update api , when success, all data of stored\_fields are missing, and I am confused about that....What is the internal mechanism？ --- ## [Too\_many\_clauses but only with ip field type and ip\_range search values?](https://discuss.elastic.co/t/too-many-clauses-but-only-with-ip-field-type-and-ip-range-search-values/281133)
**Author:** [@philosobyte](https://discuss.elastic.co/u/philosobyte)\ **Replies:** 0\ **Last updated:** [August 12, 2021, 1:05am UTC](https://discuss.elastic.co/t/too-many-clauses-but-only-with-ip-field-type-and-ip-range-search-values/281133 "2021-08-12T01:05:35Z")
Hello, We are running into a too\_many\_clauses failure when using a terms query inside a filter context, but only when the target field has type ip and when the search values are CIDRs. Here's an example: PUT /test-ind… --- ## [Dead\_letter\_queueにおける複数pipelineの扱い方](https://discuss.elastic.co/t/dead-letter-queue-pipeline/280287)
**Author:** [@t-nakata](https://discuss.elastic.co/u/t-nakata)\ **Replies:** 1\ **Last updated:** [August 12, 2021, 1:01am UTC](https://discuss.elastic.co/t/dead-letter-queue-pipeline/280287 "2021-08-12T01:01:23Z")
logstashのdead\_letter\_queueについてご教示ください。 logstashのdead\_letter\_queue inputプラグインにて、以下のような設定をしております。 input { dead\_letter\_queue { commit\_offsets =\> true path =\> "/var/lib/logstash/dead\_letter\_queue" pipeline\_id… --- ## [Parse lvmeng WAF log](https://discuss.elastic.co/t/parse-lvmeng-waf-log/281073)
**Author:** [@star\_cool](https://discuss.elastic.co/u/star_cool)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 11:55pm UTC](https://discuss.elastic.co/t/parse-lvmeng-waf-log/281073 "2021-08-11T23:55:16Z")
hi \<11\>Aug 11 19:14:55 localhost waf: tag:waf\_log\_websec site\_id:1521041933 protect\_id:2623109843 dst\_ip:x.x.x.x dst\_port:80 src\_ip:183.209.173.69 src\_port:17506 method:GET domain:www.domain.com uri:/%5fupload/t… --- ## [Heartbeat setup failing because of incorrect user](https://discuss.elastic.co/t/heartbeat-setup-failing-because-of-incorrect-user/280870)
**Author:** [@Heroj04](https://discuss.elastic.co/u/Heroj04)\ **Replies:** 3\ **Last updated:** [August 11, 2021, 11:53pm UTC](https://discuss.elastic.co/t/heartbeat-setup-failing-because-of-incorrect-user/280870 "2021-08-11T23:53:58Z")
I'm trying to setup heartbeat on my new elastic stack server but it is failing because the user doesn't have permission to create indices. It seems to be using the writer user instead of the setup user that has the corr… --- ## [How to add APM agent in .NET](https://discuss.elastic.co/t/how-to-add-apm-agent-in-net/280974)
**Author:** [@Juan\_David\_Jaramillo](https://discuss.elastic.co/u/Juan_David_Jaramillo)\ **Replies:** 11\ **Last updated:** [August 11, 2021, 10:07pm UTC](https://discuss.elastic.co/t/how-to-add-apm-agent-in-net/280974 "2021-08-11T22:07:05Z")
hello, how are you? I have a problem adding the APM agent to my web application, I installed the agent from the NuGet, I created a class called 'Startup' as indicated in the documentation and also created the configurat… --- ## [Does Http\_poller use something simillar to "sincedb" as File input does?](https://discuss.elastic.co/t/does-http-poller-use-something-simillar-to-sincedb-as-file-input-does/281044)
**Author:** [@panagiss](https://discuss.elastic.co/u/panagiss)\ **Replies:** 2\ **Last updated:** [August 11, 2021, 8:00pm UTC](https://discuss.elastic.co/t/does-http-poller-use-something-simillar-to-sincedb-as-file-input-does/281044 "2021-08-11T20:00:29Z")
I know that File input plugin uses sincedb to "remember" the state of the file and the index position. But what about other input plugins and specifically http\_poller? Because i have noticed that if i make the same req… --- ## [Mongo Instrumentation on .NET Framework](https://discuss.elastic.co/t/mongo-instrumentation-on-net-framework/280566)
**Author:** [@ntp](https://discuss.elastic.co/u/ntp)\ **Replies:** 3\ **Last updated:** [August 11, 2021, 7:01pm UTC](https://discuss.elastic.co/t/mongo-instrumentation-on-net-framework/280566 "2021-08-11T19:01:05Z")
I'm using the latest Elastic agent (1.11) on .NET Framework, but having issues trying to instrument Mongo. Despite having MongoDb.Driver(+.Core) installed in the libraries that I have the Elastic agent installed in, when… --- ## [Configuration of Kibana running in Docker](https://discuss.elastic.co/t/configuration-of-kibana-running-in-docker/278181)
**Author:** [@ppuschmann](https://discuss.elastic.co/u/ppuschmann)\ **Replies:** 4\ **Last updated:** [August 11, 2021, 3:43pm UTC](https://discuss.elastic.co/t/configuration-of-kibana-running-in-docker/278181 "2021-08-11T15:43:55Z")
Hi, we're running Kibana as a Docker-container and can configure some options with environment-variables, but not all. These see to work just fine: "ELASTICSEARCH\_HOSTS": "http://xxxxxxx:9200", "ELASTICSEARCH\_PASSWORD… --- ## [How to use Azure Storage plugin in ECK for Snapshot](https://discuss.elastic.co/t/how-to-use-azure-storage-plugin-in-eck-for-snapshot/237513)
**Author:** [@robinhood\_lko](https://discuss.elastic.co/u/robinhood_lko)\ **Replies:** 7\ **Last updated:** [August 11, 2021, 5:35pm UTC](https://discuss.elastic.co/t/how-to-use-azure-storage-plugin-in-eck-for-snapshot/237513 "2021-08-11T17:35:19Z")
Hi All, I have to configure snapshot in ECK Deployment. Elasticsearch documentation has given example for Google cloud. Please can anyone list the steps for that. I tried this - Created a file azure.client.default.cre… --- ## [Why do N-gram Tokenizers don't treat + (plus) characters as part of a token?](https://discuss.elastic.co/t/why-do-n-gram-tokenizers-dont-treat-plus-characters-as-part-of-a-token/281096)
**Author:** [@ssephillip](https://discuss.elastic.co/u/ssephillip)\ **Replies:** 1\ **Last updated:** [August 11, 2021, 4:38pm UTC](https://discuss.elastic.co/t/why-do-n-gram-tokenizers-dont-treat-plus-characters-as-part-of-a-token/281096 "2021-08-11T16:38:11Z")
Hello everyone, I have a few questions about the behavior of the N-Gram Tokenizer. I am relatively new to this forum, so please forgive me if I'm asking this question in a wrong way. I created my own custom tokenizer … --- ## [Aggregate error](https://discuss.elastic.co/t/aggregate-error/281080)
**Author:** [@Divya\_Bansal](https://discuss.elastic.co/u/Divya_Bansal)\ **Replies:** 1\ **Last updated:** [August 11, 2021, 4:31pm UTC](https://discuss.elastic.co/t/aggregate-error/281080 "2021-08-11T16:31:34Z")
Hi, I am using the below filter to parse my log file. if \[mesg\] == "ERROR" { #This is prod tomcat log format grok { match =\> { "mesg" =\> \[ "^\\s?\[%{DATA:loglevel}\] %{TIMESTAMP\_ISO8601:logts} \[%{DATA:threadname}\] %{DA… --- ## [Communications link failure consistently after one hour with MySQL](https://discuss.elastic.co/t/communications-link-failure-consistently-after-one-hour-with-mysql/281031)
**Author:** [@Justin\_Morgan](https://discuss.elastic.co/u/Justin_Morgan)\ **Replies:** 1\ **Last updated:** [August 11, 2021, 4:25pm UTC](https://discuss.elastic.co/t/communications-link-failure-consistently-after-one-hour-with-mysql/281031 "2021-08-11T16:25:56Z")
I am using logstash with JDBC to import data from MySQL into Elasticsearch. This has worked before but now it is consistently failing after 1 hour with this exception: \`Exception when executing JDBC query {:exception=\>"… --- ## [Sql query return is empty](https://discuss.elastic.co/t/sql-query-return-is-empty/281092)
**Author:** [@Christophe\_Dumont](https://discuss.elastic.co/u/Christophe_Dumont)\ **Replies:** 1\ **Last updated:** [August 11, 2021, 4:24pm UTC](https://discuss.elastic.co/t/sql-query-return-is-empty/281092 "2021-08-11T16:24:50Z")
I would like to make a query to retrieve the records of the 'layers' column (index name = ids) When i run this command : GET /\_sql?format=txt { "query": "DESCRIBE ids" } it's ok column | type … [Previous page](https://discuss.elastic.co/latest.md?page=1529) [Next page](https://discuss.elastic.co/latest.md?page=1531)