# Elastic Stack **URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1717 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1718 --- ## [OAuth2.0 support for http\_poller input plugin](https://discuss.elastic.co/t/oauth2-0-support-for-http-poller-input-plugin/254199)
**Author:** [@pankaj](https://discuss.elastic.co/u/pankaj)\ **Replies:** 1\ **Last updated:** [November 4, 2020, 5:34am UTC](https://discuss.elastic.co/t/oauth2-0-support-for-http-poller-input-plugin/254199 "2020-11-04T05:34:59Z")
Hello Team I would like to know how to configure the OAuth2.0 in http\_poller input . --- ## [Same ES cluster for non prod environments (for both dev and qa)](https://discuss.elastic.co/t/same-es-cluster-for-non-prod-environments-for-both-dev-and-qa/253937)
**Author:** [@kcs08](https://discuss.elastic.co/u/kcs08)\ **Replies:** 4\ **Last updated:** [November 4, 2020, 5:33am UTC](https://discuss.elastic.co/t/same-es-cluster-for-non-prod-environments-for-both-dev-and-qa/253937 "2020-11-04T05:33:19Z")
Hello, I have setup Elasticsearch (ES) cluster and using it for dev environment with set of indexes. And wanted to use the same ES cluster for qa environment as well. I mean two different environments with same index na… --- ## [BulkIndexError: ('200 document(s) failed to index.'](https://discuss.elastic.co/t/bulkindexerror-200-document-s-failed-to-index/253780)
**Author:** [@subham\_p](https://discuss.elastic.co/u/subham_p)\ **Replies:** 3\ **Last updated:** [November 4, 2020, 5:24am UTC](https://discuss.elastic.co/t/bulkindexerror-200-document-s-failed-to-index/253780 "2020-11-04T05:24:32Z")
Hello Team, I am trying to push approx 10000 data by converting the pandas data frame to elk. But it fails to push all, some times it showing following error failed to establish a new connection errno 111 connection r… --- ## [Bulk Request java.lang.InterruptedException concurrency issue](https://discuss.elastic.co/t/bulk-request-java-lang-interruptedexception-concurrency-issue/253850)
**Author:** [@rex-remind](https://discuss.elastic.co/u/rex-remind)\ **Replies:** 4\ **Last updated:** [November 4, 2020, 4:40am UTC](https://discuss.elastic.co/t/bulk-request-java-lang-interruptedexception-concurrency-issue/253850 "2020-11-04T04:40:51Z")
Hello, Context: We have a simple Flink job (v1.11.2 in Scala) from Kafka to ES using the Table api with just 2 joins before writing to ES. It uses the Flink Elasticsearch Connector which under the hood uses the Java ES… --- ## [Timestamp differs by 6 seconds between Kafka record timestamp and the elasticsearch index timestamp](https://discuss.elastic.co/t/timestamp-differs-by-6-seconds-between-kafka-record-timestamp-and-the-elasticsearch-index-timestamp/254056)
**Author:** [@Strive](https://discuss.elastic.co/u/Strive)\ **Replies:** 6\ **Last updated:** [November 4, 2020, 4:20am UTC](https://discuss.elastic.co/t/timestamp-differs-by-6-seconds-between-kafka-record-timestamp-and-the-elasticsearch-index-timestamp/254056 "2020-11-04T04:20:46Z")
Hi, There is a ~6 seconds difference in the @timestamp field sent to elasticsearch through Kafka. Here are the details: The JSON object is built in java and is published to Kafka. The Logstash consumes data from Kafk… --- ## [@timestamp filter missing in Kibana time filter field](https://discuss.elastic.co/t/timestamp-filter-missing-in-kibana-time-filter-field/254191)
**Author:** [@rajdevworks](https://discuss.elastic.co/u/rajdevworks)\ **Replies:** 1\ **Last updated:** [November 4, 2020, 3:08am UTC](https://discuss.elastic.co/t/timestamp-filter-missing-in-kibana-time-filter-field/254191 "2020-11-04T03:08:52Z")
Kibana 6.8.12 management Logs are ingested using curl curl -v -XPOST 'http://localhost:9200/missing1/\_doc/\_bulk?pretty' -H 'Content-Type: application/json' --data-binary @missing Why is @timestamp missing in the list… --- ## [How to return results with ctx.payload](https://discuss.elastic.co/t/how-to-return-results-with-ctx-payload/253768)
**Author:** [@johno79](https://discuss.elastic.co/u/johno79)\ **Replies:** 5\ **Last updated:** [November 4, 2020, 1:38am UTC](https://discuss.elastic.co/t/how-to-return-results-with-ctx-payload/253768 "2020-11-04T01:38:55Z")
While creating a Kibana Alert and Trigger I have the following results from an extraction query response...and wondering how to properly use ctx.payload in the message(sending via webhook in slack) to return the Hospital… --- ## [Intermittent proxy errors in Kibana 7.9.3 stack monitoring through Apache httpd](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073)
**Author:** [@retzkek](https://discuss.elastic.co/u/retzkek)\ **Replies:** 2\ **Last updated:** [November 3, 2020, 11:29pm UTC](https://discuss.elastic.co/t/intermittent-proxy-errors-in-kibana-7-9-3-stack-monitoring-through-apache-httpd/254073 "2020-11-03T23:29:24Z")
We recently upgraded one of our clusters to 7.9.3 (from 6.8.12), and I'm now seeing frequent, but intermittent, proxy errors while in stack monitoring. For instance here is a screenshot of a minute or so in the monitorin… --- ## [Filebeat cannot connect to Logstash \[Logstash/Filebeat 7.9.x\]](https://discuss.elastic.co/t/filebeat-cannot-connect-to-logstash-logstash-filebeat-7-9-x/254189)
**Author:** [@fraballi](https://discuss.elastic.co/u/fraballi)\ **Replies:** 0\ **Last updated:** [November 3, 2020, 10:36pm UTC](https://discuss.elastic.co/t/filebeat-cannot-connect-to-logstash-logstash-filebeat-7-9-x/254189 "2020-11-03T22:36:02Z")
Dear colleagues, Version: 7.9.x I have two instances of Filebeat (docker, rpm in localhost), none can connect to Logstash (docker). I searched on similar topics and tried solutions, but still cannot reach safe port. T… --- ## [Regex performance with logstash using more general match](https://discuss.elastic.co/t/regex-performance-with-logstash-using-more-general-match/253917)
**Author:** [@vinci](https://discuss.elastic.co/u/vinci)\ **Replies:** 9\ **Last updated:** [November 3, 2020, 10:34pm UTC](https://discuss.elastic.co/t/regex-performance-with-logstash-using-more-general-match/253917 "2020-11-03T22:34:50Z")
Hi, I was wondering about regex performance in general and in particular with logstash and grok. I'm currently trying to parse firewall logs sent through the syslog protocol which mainly contains keys and values (a key… --- ## [Elastic Watcher custom alert help](https://discuss.elastic.co/t/elastic-watcher-custom-alert-help/254127)
**Author:** [@sumitmadhale](https://discuss.elastic.co/u/sumitmadhale)\ **Replies:** 1\ **Last updated:** [November 3, 2020, 10:18pm UTC](https://discuss.elastic.co/t/elastic-watcher-custom-alert-help/254127 "2020-11-03T22:18:37Z")
Hi, We are using elastic cloud Watcher for custom alerting, what I wanted to achieve is to search a field "docker.image" for all the docker containers and check if it is changed since one minute, if it has changed take … --- ## [Search query is slow and first query always takes too much time](https://discuss.elastic.co/t/search-query-is-slow-and-first-query-always-takes-too-much-time/253652)
**Author:** [@Code\_Wizard](https://discuss.elastic.co/u/Code_Wizard)\ **Replies:** 9\ **Last updated:** [October 30, 2020, 12:31pm UTC](https://discuss.elastic.co/t/search-query-is-slow-and-first-query-always-takes-too-much-time/253652 "2020-10-30T12:31:02Z")
Hi, search queries are slow when i do should match with multiple search terms and also for matching nested documents, basically it is taking 7-10 sec for first query and 5-6 sec later on due to elasticsearch cache, but… --- ## [Elasticsearch - Not able to see the latest logs](https://discuss.elastic.co/t/elasticsearch-not-able-to-see-the-latest-logs/249801)
**Author:** [@chintushah46](https://discuss.elastic.co/u/chintushah46)\ **Replies:** 7\ **Last updated:** [November 3, 2020, 8:40pm UTC](https://discuss.elastic.co/t/elasticsearch-not-able-to-see-the-latest-logs/249801 "2020-11-03T20:40:04Z")
Hi, Looking for the reason of not having updated logs in the log file. I did the following sanity tests too, Checked the owner of the process Have enough resources, like memory as well as disk space Log file is gener… --- ## [Process.name incomplete](https://discuss.elastic.co/t/process-name-incomplete/250804)
**Author:** [@wifi](https://discuss.elastic.co/u/wifi)\ **Replies:** 5\ **Last updated:** [November 3, 2020, 8:13pm UTC](https://discuss.elastic.co/t/process-name-incomplete/250804 "2020-11-03T20:13:06Z")
Somehow the process name gets cut off and i end up with process.name like "ansible-playboo" instead of "ansible-playbook" It seems tat the name is cut off after the 15th character I checked the mapping for process.name… --- ## [Ctx.payload object data disappearing after inclusion of script\_field in watcher api](https://discuss.elastic.co/t/ctx-payload-object-data-disappearing-after-inclusion-of-script-field-in-watcher-api/254185)
**Author:** [@esguy](https://discuss.elastic.co/u/esguy)\ **Replies:** 0\ **Last updated:** [November 3, 2020, 7:53pm UTC](https://discuss.elastic.co/t/ctx-payload-object-data-disappearing-after-inclusion-of-script-field-in-watcher-api/254185 "2020-11-03T19:53:45Z")
Hello, I'm having an issue where the data in my ctx.payload object is disappearing after I include "script\_field" in my watcher. The watcher executes perfectly fine with the desired output when the "script\_field" field … --- ## [Search\_as\_you\_type and highlight](https://discuss.elastic.co/t/search-as-you-type-and-highlight/253010)
**Author:** [@wos](https://discuss.elastic.co/u/wos)\ **Replies:** 2\ **Last updated:** [November 3, 2020, 6:35pm UTC](https://discuss.elastic.co/t/search-as-you-type-and-highlight/253010 "2020-11-03T18:35:48Z")
I am looking for working example of a search\_as\_you\_type and highlight. Could Someone provide me with example? Thanks --- ## [\[Vega\] geotile\_grid plotting/zooming?](https://discuss.elastic.co/t/vega-geotile-grid-plotting-zooming/254139)
**Author:** [@Kayak007](https://discuss.elastic.co/u/Kayak007)\ **Replies:** 2\ **Last updated:** [November 3, 2020, 5:19pm UTC](https://discuss.elastic.co/t/vega-geotile-grid-plotting-zooming/254139 "2020-11-03T17:19:16Z")
Hi, I had a Kibana Coordinate Map Vizualisation which displayed a Geohash aggregation. Since it didn't exactly fit my needs, I turned to Vega and it' great to customize data, legends, marks, ... But I can't manage to … --- ## [Auditbeat 7.8 file integrity module](https://discuss.elastic.co/t/auditbeat-7-8-file-integrity-module/253823)
**Author:** [@Mohammad\_Etemad](https://discuss.elastic.co/u/Mohammad_Etemad)\ **Replies:** 3\ **Last updated:** [November 3, 2020, 5:15pm UTC](https://discuss.elastic.co/t/auditbeat-7-8-file-integrity-module/253823 "2020-11-03T17:15:17Z")
Hello, I am using auditbeat to track file changes via the file integrity module. This works for a couple of minutes and logs the changes to files, but then stops working and no changes are detected anymore. Is this a kn… --- ## [Elastic Cloud Export Control Number (ECCN)](https://discuss.elastic.co/t/elastic-cloud-export-control-number-eccn/254037)
**Author:** [@Masok](https://discuss.elastic.co/u/Masok)\ **Replies:** 3\ **Last updated:** [November 3, 2020, 4:59pm UTC](https://discuss.elastic.co/t/elastic-cloud-export-control-number-eccn/254037 "2020-11-03T16:59:15Z")
Hi We are about to embark on a project which will initially make use of the Elastic Cloud Managed Service. However the compliance department in my organisation require the Export Control Classification Number before the… --- ## [Watcher, Creating a kibana watcher to check an integer\[0-9\] value appears in logs in a give period of time](https://discuss.elastic.co/t/watcher-creating-a-kibana-watcher-to-check-an-integer-0-9-value-appears-in-logs-in-a-give-period-of-time/252589)
**Author:** [@fredrick.bb](https://discuss.elastic.co/u/fredrick.bb)\ **Replies:** 5\ **Last updated:** [November 3, 2020, 4:58pm UTC](https://discuss.elastic.co/t/watcher-creating-a-kibana-watcher-to-check-an-integer-0-9-value-appears-in-logs-in-a-give-period-of-time/252589 "2020-11-03T16:58:25Z")
Hi, I'm creating a kibana watcher to check an integer field has a value runs between 0 and 9. A field of type Integer, will have values between 0 through 9 on each record. The business conditions are, Each value sho… --- ## [Logstash does not send logs into the file](https://discuss.elastic.co/t/logstash-does-not-send-logs-into-the-file/254165)
**Author:** [@Andex](https://discuss.elastic.co/u/Andex)\ **Replies:** 4\ **Last updated:** [November 3, 2020, 4:35pm UTC](https://discuss.elastic.co/t/logstash-does-not-send-logs-into-the-file/254165 "2020-11-03T16:35:34Z")
Hi, from filebeat, i send log to logstash, if I listen in tcpdump I see the logs arrive but Logstash don't send Log tothe file i specified in the pipelines, this is the Pipelines : input { beats { port =\> 5044 } } … --- ## [Connections Graph](https://discuss.elastic.co/t/connections-graph/253214)
**Author:** [@cyberzlo](https://discuss.elastic.co/u/cyberzlo)\ **Replies:** 5\ **Last updated:** [November 3, 2020, 4:32pm UTC](https://discuss.elastic.co/t/connections-graph/253214 "2020-11-03T16:32:56Z")
It is possible some easy way (I know that are there some special possibilites but it is too much for me) to create in Kibana network connections graph? Something like: --- ## [New Installation Kibana 500 Internal Server Error](https://discuss.elastic.co/t/new-installation-kibana-500-internal-server-error/252720)
**Author:** [@KNXLabGeek](https://discuss.elastic.co/u/KNXLabGeek)\ **Replies:** 4\ **Last updated:** [November 3, 2020, 4:28pm UTC](https://discuss.elastic.co/t/new-installation-kibana-500-internal-server-error/252720 "2020-11-03T16:28:56Z")
I am new to elastic search and having a problem narrowing down the issue. I have followed the install instructions verbatim and this is my 3rd attempt and after installing Kibana I hit the same issue. I am doing a new in… --- ## [Elasticsearch-setup-password kills elastic process](https://discuss.elastic.co/t/elasticsearch-setup-password-kills-elastic-process/254067)
**Author:** [@martinsz](https://discuss.elastic.co/u/martinsz)\ **Replies:** 5\ **Last updated:** [November 3, 2020, 4:13pm UTC](https://discuss.elastic.co/t/elasticsearch-setup-password-kills-elastic-process/254067 "2020-11-03T16:13:03Z")
Hi, I'm setting up a new cluster with security after successfully fixing it (earlier post https://discuss.elastic.co/t/help-a-non-profit-stir-the-data/251589). The difference is that I've now configured TLS on the HTTP … --- ## [How to limit logging to only 3 months](https://discuss.elastic.co/t/how-to-limit-logging-to-only-3-months/253025)
**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\ **Replies:** 3\ **Last updated:** [November 3, 2020, 4:17pm UTC](https://discuss.elastic.co/t/how-to-limit-logging-to-only-3-months/253025 "2020-11-03T16:17:16Z")
Hi, I am trying to figure out how to limit the number of logs on Elastic/Kibana/Logstash to only hold 3 months worth of data. It is all installed on windows servers. --- ## [Elasticsearch client for Update By Query API](https://discuss.elastic.co/t/elasticsearch-client-for-update-by-query-api/253956)
**Author:** [@bob3](https://discuss.elastic.co/u/bob3)\ **Replies:** 1\ **Last updated:** [November 3, 2020, 4:15pm UTC](https://discuss.elastic.co/t/elasticsearch-client-for-update-by-query-api/253956 "2020-11-03T16:15:35Z")
Hello. I'm trying to use Update By Query API for elasticsearch version 6.3. I can't use Java High Level REST Client because Update By Query API is supported by Java High Level REST Client starting from elasticsearch vers… --- ## [What is the downside of increasing index.mapping.total\_fields.limit dramatically?](https://discuss.elastic.co/t/what-is-the-downside-of-increasing-index-mapping-total-fields-limit-dramatically/253729)
**Author:** [@redec](https://discuss.elastic.co/u/redec)\ **Replies:** 5\ **Last updated:** [November 3, 2020, 3:53pm UTC](https://discuss.elastic.co/t/what-is-the-downside-of-increasing-index-mapping-total-fields-limit-dramatically/253729 "2020-11-03T15:53:04Z")
In my use case, I have dynamic fields in my documents which need to be searchable. Each document will only have a couple of these fields (so the total document size will never be massive). I will also only ever be search… --- ## [Error while running file configuration in Logstash - \*\*ERROR at line 4, column 19 (byte 62) after input {\\r\\nhttp\_poller {\\r\\n urls =\> {\\r\\n users ", :backtrace=\>\["C:/ELK/logstash-7.9.2/logstash-core/lib/logstash/compiler.rb:32:in \`compile\_imperative'"](https://discuss.elastic.co/t/error-while-running-file-configuration-in-logstash-error-at-line-4-column-19-byte-62-after-input-r-nhttp-poller-r-n-urls-r-n-users-backtrace-c-elk-logstash-7-9-2-logstash-core-lib-logstash-compiler-rbin-compile-imperative/254099)
**Author:** [@salma\_widiarti](https://discuss.elastic.co/u/salma_widiarti)\ **Replies:** 1\ **Last updated:** [November 3, 2020, 3:45pm UTC](https://discuss.elastic.co/t/error-while-running-file-configuration-in-logstash-error-at-line-4-column-19-byte-62-after-input-r-nhttp-poller-r-n-urls-r-n-users-backtrace-c-elk-logstash-7-9-2-logstash-core-lib-logstash-compiler-rbin-compile-imperative/254099 "2020-11-03T15:45:37Z")
Hi all, Can any guide me to create file configuration logstash with API? I've been using this syntax but i found error. input { http\_poller { urls =\> { users = { method =\> get url =\> "https://api.id/api/categories"… --- ## [Is there an elegant way of identifying mapping conflict exceptions programmatically?](https://discuss.elastic.co/t/is-there-an-elegant-way-of-identifying-mapping-conflict-exceptions-programmatically/254171)
**Author:** [@vangap](https://discuss.elastic.co/u/vangap)\ **Replies:** 0\ **Last updated:** [November 3, 2020, 3:17pm UTC](https://discuss.elastic.co/t/is-there-an-elegant-way-of-identifying-mapping-conflict-exceptions-programmatically/254171 "2020-11-03T15:17:39Z")
Below are some sample errors that ES returns for mapping conflicts which don't have any info that I can rely on programmatically.. I can't even seem to do regex parsing since different scenarios have different messages. … --- ## [Java high-level REST client: There is no way to recover after a \`ContentTooLongException\` and \`IOReactorException\`](https://discuss.elastic.co/t/java-high-level-rest-client-there-is-no-way-to-recover-after-a-contenttoolongexception-and-ioreactorexception/254167)
**Author:** [@RomanWuattier](https://discuss.elastic.co/u/RomanWuattier)\ **Replies:** 0\ **Last updated:** [November 3, 2020, 2:49pm UTC](https://discuss.elastic.co/t/java-high-level-rest-client-there-is-no-way-to-recover-after-a-contenttoolongexception-and-ioreactorexception/254167 "2020-11-03T14:49:04Z")
Hi, version: 7.9.1 Context We are using the Java high-level REST client. When executing a search request, and the response's size exceeds the buffered heap, then a ContentTooLongException and IOReactorException are t… [Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1716) [Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1718)