# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1644

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1645

---

## [Need some explanation on Watcher execution](https://discuss.elastic.co/t/need-some-explanation-on-watcher-execution/258399)

<div class="topic-metadata">

**Author:** [@prajwalgmpp](https://discuss.elastic.co/u/prajwalgmpp)\
**Replies:** 3\
**Last updated:** [December 15, 2020, 7:11am UTC](https://discuss.elastic.co/t/need-some-explanation-on-watcher-execution/258399 "2020-12-15T07:11:39Z")

</div>

Under watch execution, it is noted that "On each node, that contains one of the .watches shards, a scheduler, that is bound to the watcher lifecycle runs. On each node, that contains one of the .watches shards, a sched…

---

## [Null values while indexing using logstash](https://discuss.elastic.co/t/null-values-while-indexing-using-logstash/258677)

<div class="topic-metadata">

**Author:** [@Sammeta\_David\_Raju](https://discuss.elastic.co/u/Sammeta_David_Raju)\
**Replies:** 0\
**Last updated:** [December 15, 2020, 7:05am UTC](https://discuss.elastic.co/t/null-values-while-indexing-using-logstash/258677 "2020-12-15T07:05:12Z")

</div>

what happens if sql statement has record while indexing and later it changes to null value while using the same select query in logstash in a regular intervals

---

## [ConnectionClosedException: Connection is closed exception in secure elastic search](https://discuss.elastic.co/t/connectionclosedexception-connection-is-closed-exception-in-secure-elastic-search/258540)

<div class="topic-metadata">

**Author:** [@atulthakre](https://discuss.elastic.co/u/atulthakre)\
**Replies:** 8\
**Last updated:** [December 15, 2020, 6:55am UTC](https://discuss.elastic.co/t/connectionclosedexception-connection-is-closed-exception-in-secure-elastic-search/258540 "2020-12-15T06:55:45Z")

</div>

java-version: 1.8 elastic-version: 7.10 Ubuntu: 18.04LTS we created separate Machine for Elastic search 7.10.0 in Ubuntu.In the same machine ,we installed java1.8 and also install Kibana .we setup the security in el…

---

## [Error creating connection to Oracle](https://discuss.elastic.co/t/error-creating-connection-to-oracle/257980)

<div class="topic-metadata">

**Author:** [@jenssc](https://discuss.elastic.co/u/jenssc)\
**Replies:** 24\
**Last updated:** [December 15, 2020, 6:24am UTC](https://discuss.elastic.co/t/error-creating-connection-to-oracle/257980 "2020-12-15T06:24:06Z")

</div>

Hi I'm having a lot of problems getting the metricbeat connect to my Oracle database! What ever I'm trying to put in my YML-file I always end up with this error: Error fetching data for metricset oracle.tablespace: er…

---

## [Pie chart of element count of an array](https://discuss.elastic.co/t/pie-chart-of-element-count-of-an-array/258612)

<div class="topic-metadata">

**Author:** [@NiclasK](https://discuss.elastic.co/u/NiclasK)\
**Replies:** 1\
**Last updated:** [December 15, 2020, 6:14am UTC](https://discuss.elastic.co/t/pie-chart-of-element-count-of-an-array/258612 "2020-12-15T06:14:21Z")

</div>

Hi, I'm indexing a documents that can look like this: { "ProcessID": "id1", "ErrorList": \[{ "ErrorCode": 123, "Time": "2020-01-01T12:23:45" }, { "ErrorCode": 123, "Time": "2020-01-01T12:44:00" }, …

---

## [Searchable snapshots hidden in the UI?](https://discuss.elastic.co/t/searchable-snapshots-hidden-in-the-ui/258674)

<div class="topic-metadata">

**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\
**Replies:** 2\
**Last updated:** [December 15, 2020, 5:50am UTC](https://discuss.elastic.co/t/searchable-snapshots-hidden-in-the-ui/258674 "2020-12-15T05:50:58Z")

</div>

Is the searchable snapshots feature available in Kibana / UI? I don't have a "searchable snapshot" action in Kibana 7.10.1 on Elastic cloud..?

---

## ["\\"\\\\xF8\\" from ASCII-8BIT to UTF-8", :error\_class=\>"LogStash::Json::GeneratorError"](https://discuss.elastic.co/t/xf8-from-ascii-8bit-to-utf-8-error-class-logstash-generatorerror/258668)

<div class="topic-metadata">

**Author:** [@charan\_teja\_sana](https://discuss.elastic.co/u/charan_teja_sana)\
**Replies:** 0\
**Last updated:** [December 15, 2020, 3:54am UTC](https://discuss.elastic.co/t/xf8-from-ascii-8bit-to-utf-8-error-class-logstash-generatorerror/258668 "2020-12-15T03:54:08Z")

</div>

Hello Team, I am getting below message while running JDBC Connection against MS-SQL DB, Could you please help Error Message: \[ERROR\] 2020-12-14 23:55:12.404 \[\[main\]\>worker0\] elasticsearch - An unknown error occurred s…

---

## [Logstash comma delimited csv file with quoted strings](https://discuss.elastic.co/t/logstash-comma-delimited-csv-file-with-quoted-strings/258671)

<div class="topic-metadata">

**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\
**Replies:** 0\
**Last updated:** [December 15, 2020, 5:13am UTC](https://discuss.elastic.co/t/logstash-comma-delimited-csv-file-with-quoted-strings/258671 "2020-12-15T05:13:05Z")

</div>

Hi, I have following comma delimited csv file, which content has a comma in some of the columns. LogTime,Level,ApplicationId,UserId,ProcessId,FormId,Action,Status,Reference,TranRef,IP,SessionId,CIF\_REF\_NO,UserAgent 11…

---

## [Exception in pipelineworker, the pipeline stopped processing new events, please check your filter configuration and restart Logstash. org.jruby.exceptions.ArgumentError: (ArgumentError) key cannot be blank](https://discuss.elastic.co/t/exception-in-pipelineworker-the-pipeline-stopped-processing-new-events-please-check-your-filter-configuration-and-restart-logstash-org-jruby-exceptions-argumenterror-argumenterror-key-cannot-be-blank/258670)

<div class="topic-metadata">

**Author:** [@bhavanikallam](https://discuss.elastic.co/u/bhavanikallam)\
**Replies:** 2\
**Last updated:** [December 15, 2020, 4:42am UTC](https://discuss.elastic.co/t/exception-in-pipelineworker-the-pipeline-stopped-processing-new-events-please-check-your-filter-configuration-and-restart-logstash-org-jruby-exceptions-argumenterror-argumenterror-key-cannot-be-blank/258670 "2020-12-15T04:42:17Z")

</div>

Plz kindly help

---

## [Searching local files/folders to test elastic search](https://discuss.elastic.co/t/searching-local-files-folders-to-test-elastic-search/258531)

<div class="topic-metadata">

**Author:** [@robo20](https://discuss.elastic.co/u/robo20)\
**Replies:** 4\
**Last updated:** [December 15, 2020, 4:36am UTC](https://discuss.elastic.co/t/searching-local-files-folders-to-test-elastic-search/258531 "2020-12-15T04:36:55Z")

</div>

Is there a simple way to do full text search on a bunch of files in various formats (e.g. PDF, EPUB, TXT, DOC) - on locally connected storage? I see the connectors for the cloud services, I just want to do local search. …

---

## [Elastitcsearch 7 : mapping types](https://discuss.elastic.co/t/elastitcsearch-7-mapping-types/258584)

<div class="topic-metadata">

**Author:** [@nages](https://discuss.elastic.co/u/nages)\
**Replies:** 3\
**Last updated:** [December 15, 2020, 3:55am UTC](https://discuss.elastic.co/t/elastitcsearch-7-mapping-types/258584 "2020-12-15T03:55:16Z")

</div>

I come across the following phrase and I am under impression that a valid 6.x query with type might give an error. I am using the cluster ES 7.10 Note that in 7.0, \_doc is a permanent part of the path, and represents t…

---

## [Getting unique results on highlight or multiple fields](https://discuss.elastic.co/t/getting-unique-results-on-highlight-or-multiple-fields/258650)

<div class="topic-metadata">

**Author:** [@sec\_r\_and\_d](https://discuss.elastic.co/u/sec_r_and_d)\
**Replies:** 2\
**Last updated:** [December 15, 2020, 3:41am UTC](https://discuss.elastic.co/t/getting-unique-results-on-highlight-or-multiple-fields/258650 "2020-12-15T03:41:53Z")

</div>

My indices contain various analyses of executable files. DELETE static\_index,strings\_index PUT static\_index/\_doc/1 { "md5": "85e9e2c4a9c0a7af309c906516aa4548", "static\_api": "ShellExecuteW" } PUT static\_index/\_doc/2…

---

## [How to calculate shard\_size](https://discuss.elastic.co/t/how-to-calculate-shard-size/258664)

<div class="topic-metadata">

**Author:** [@mohammad\_hanifah\_nur](https://discuss.elastic.co/u/mohammad_hanifah_nur)\
**Replies:** 4\
**Last updated:** [December 15, 2020, 2:41am UTC](https://discuss.elastic.co/t/how-to-calculate-shard-size/258664 "2020-12-15T02:41:20Z")

</div>

this issue came when i trying to find a top ten summary amount with aggregation by term variable A. variable A have a lot of unique data . that makes the result of the top ten summary amount is invalid. the first thing…

---

## [No need to set \`xpack.monitoring.collection.enabled\` to true when using metricbeat-based stack monitoring?](https://discuss.elastic.co/t/no-need-to-set-xpack-monitoring-collection-enabled-to-true-when-using-metricbeat-based-stack-monitoring/258237)

<div class="topic-metadata">

**Author:** [@tetsuyasodo](https://discuss.elastic.co/u/tetsuyasodo)\
**Replies:** 4\
**Last updated:** [December 15, 2020, 2:35am UTC](https://discuss.elastic.co/t/no-need-to-set-xpack-monitoring-collection-enabled-to-true-when-using-metricbeat-based-stack-monitoring/258237 "2020-12-15T02:35:26Z")

</div>

Reading this document, I'm testing stack monitoring using metricbeat not Legacy collection method. In this stack monitoring document, it says: 1.Enable the collection of monitoring data. Set xpack.monitoring.collec…

---

## [How to specify Default Quote Analyzer](https://discuss.elastic.co/t/how-to-specify-default-quote-analyzer/258659)

<div class="topic-metadata">

**Author:** [@jacksumit](https://discuss.elastic.co/u/jacksumit)\
**Replies:** 2\
**Last updated:** [December 15, 2020, 2:27am UTC](https://discuss.elastic.co/t/how-to-specify-default-quote-analyzer/258659 "2020-12-15T02:27:30Z")

</div>

Is there a way to specify default quote analyzer on index level? We can specify default index analyzer using analysis.analyzer.default. Similarly we can specify default search analyzer using analysis.analyzer.default\_se…

---

## [Best option to parse some data GROK or reindex?](https://discuss.elastic.co/t/best-option-to-parse-some-data-grok-or-reindex/258663)

<div class="topic-metadata">

**Author:** [@fastxl](https://discuss.elastic.co/u/fastxl)\
**Replies:** 0\
**Last updated:** [December 15, 2020, 2:08am UTC](https://discuss.elastic.co/t/best-option-to-parse-some-data-grok-or-reindex/258663 "2020-12-15T02:08:30Z")

</div>

I am collecting machine tool data and the logs I am getting are in the JSON format that can be sent to logstash. However I need to break down one of the JSON lines into some more documents. Should I try to run this throu…

---

## [How to search for errors in logs of Elasticsearch (Cloud instance)](https://discuss.elastic.co/t/how-to-search-for-errors-in-logs-of-elasticsearch-cloud-instance/258656)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 0\
**Last updated:** [December 15, 2020, 1:00am UTC](https://discuss.elastic.co/t/how-to-search-for-errors-in-logs-of-elasticsearch-cloud-instance/258656 "2020-12-15T01:00:27Z")

</div>

Hi, I have a cloud instance of Elasticsearch and I was intrested to see the error logs for the events which got rejected. In an in house instance the logs are availiable at the location I specify in Elasticsearch.yml, …

---

## [Diff documents](https://discuss.elastic.co/t/diff-documents/258565)

<div class="topic-metadata">

**Author:** [@pskhanapur](https://discuss.elastic.co/u/pskhanapur)\
**Replies:** 1\
**Last updated:** [December 15, 2020, 12:36am UTC](https://discuss.elastic.co/t/diff-documents/258565 "2020-12-15T00:36:19Z")

</div>

Is there a way to show diff between two documents in Kibana? Ref. example attached screenshot. Any visualizations or any plugg-in that can do that sort of the diff? Json in the screenshot is just an example, basically …

---

## [How can I delete all indices that don't have documents?](https://discuss.elastic.co/t/how-can-i-delete-all-indices-that-dont-have-documents/258571)

<div class="topic-metadata">

**Author:** [@mahalabobis](https://discuss.elastic.co/u/mahalabobis)\
**Replies:** 1\
**Last updated:** [December 15, 2020, 12:35am UTC](https://discuss.elastic.co/t/how-can-i-delete-all-indices-that-dont-have-documents/258571 "2020-12-15T00:35:09Z")

</div>

How can I delete all Elasticsearch that have no documents within? Also, is this safe ? I mean if an index has no documents then it's practically useless right?

---

## [Index pattern's Time Filter on multiple fields](https://discuss.elastic.co/t/index-patterns-time-filter-on-multiple-fields/258644)

<div class="topic-metadata">

**Author:** [@Qazeer](https://discuss.elastic.co/u/Qazeer)\
**Replies:** 1\
**Last updated:** [December 15, 2020, 12:29am UTC](https://discuss.elastic.co/t/index-patterns-time-filter-on-multiple-fields/258644 "2020-12-15T00:29:02Z")

</div>

Hello! I have an use case where events have multiple timestamps. Would it be possible to create an index pattern with a Time Filter on those multiple timestamp fields? I would prefer to it through Kibana rather than t…

---

## [Query Data in ELK](https://discuss.elastic.co/t/query-data-in-elk/258628)

<div class="topic-metadata">

**Author:** [@hassan.rana](https://discuss.elastic.co/u/hassan.rana)\
**Replies:** 4\
**Last updated:** [December 14, 2020, 11:56pm UTC](https://discuss.elastic.co/t/query-data-in-elk/258628 "2020-12-14T23:56:05Z")

</div>

I need to query messages that are sent from syslog server to logstash via filebeat . I need to curl some data out of the filebeat index. How can I write that query to get the field that what I need? Anyone? Thank you.

---

## [What security roles or rights does functionbeat require for the username in the output.elasticsearch?](https://discuss.elastic.co/t/what-security-roles-or-rights-does-functionbeat-require-for-the-username-in-the-output-elasticsearch/258646)

<div class="topic-metadata">

**Author:** [@Jonathan\_Detert](https://discuss.elastic.co/u/Jonathan_Detert)\
**Replies:** 0\
**Last updated:** [December 14, 2020, 8:52pm UTC](https://discuss.elastic.co/t/what-security-roles-or-rights-does-functionbeat-require-for-the-username-in-the-output-elasticsearch/258646 "2020-12-14T20:52:35Z")

</div>

I want to create an elasticsearch user for function beat to use in the output.elasticsearch section. The documentation doesn't say anything about what rights or roles within elasticsearch the user will need. Can someon…

---

## [Logstash - SNS output plugin - Pipeline - MissingCredentialsError](https://discuss.elastic.co/t/logstash-sns-output-plugin-pipeline-missingcredentialserror/258649)

<div class="topic-metadata">

**Author:** [@chandra2037](https://discuss.elastic.co/u/chandra2037)\
**Replies:** 0\
**Last updated:** [December 14, 2020, 9:41pm UTC](https://discuss.elastic.co/t/logstash-sns-output-plugin-pipeline-missingcredentialserror/258649 "2020-12-14T21:41:09Z")

</div>

Currently configured Logstash V 7.8.1 with SNS output plugin . It is running okay for a while then getting the following error message, then pipeline stops and never recovers. {"level":"ERROR","loggerName":"logstash.…

---

## [No enrollment token for Fleet Agent](https://discuss.elastic.co/t/no-enrollment-token-for-fleet-agent/258453)

<div class="topic-metadata">

**Author:** [@AirJordan](https://discuss.elastic.co/u/AirJordan)\
**Replies:** 2\
**Last updated:** [December 14, 2020, 9:16pm UTC](https://discuss.elastic.co/t/no-enrollment-token-for-fleet-agent/258453 "2020-12-14T21:16:31Z")

</div>

I went to do the wizard for creating a fleet agent user and let it setup everything. When I clicked create user all of a sudden it timed out my web session. I went back in and the user for fleet enrollment is there. The …

---

## [ES 8.0.0 Deletion with index lifecycle policy does nothing](https://discuss.elastic.co/t/es-8-0-0-deletion-with-index-lifecycle-policy-does-nothing/258346)

<div class="topic-metadata">

**Author:** [@nlavrov](https://discuss.elastic.co/u/nlavrov)\
**Replies:** 5\
**Last updated:** [December 14, 2020, 9:12pm UTC](https://discuss.elastic.co/t/es-8-0-0-deletion-with-index-lifecycle-policy-does-nothing/258346 "2020-12-14T21:12:26Z")

</div>

I am running an elk stack set up with helm chart running 8.0.0 version. I have a simple delete policy I created in the kibana dashboard that just deletes indices older than 1 minute (this is for testing). I then applied …

---

## [Missing Converter handling for full class name=org.postgresql.util.PGobject, simple name=PGobject](https://discuss.elastic.co/t/missing-converter-handling-for-full-class-name-org-postgresql-util-pgobject-simple-name-pgobject/258645)

<div class="topic-metadata">

**Author:** [@frankfoti](https://discuss.elastic.co/u/frankfoti)\
**Replies:** 0\
**Last updated:** [December 14, 2020, 8:52pm UTC](https://discuss.elastic.co/t/missing-converter-handling-for-full-class-name-org-postgresql-util-pgobject-simple-name-pgobject/258645 "2020-12-14T20:52:09Z")

</div>

Getting this error trying to use logstash jjdbc to extract complex objects from postgres. Converting to TEXT did not work as well \]\[WARN \]\[logstash.inputs.jdbc \]\[rivi-poc\_people\]\[ed94f8a65daf945d07d8fd7ebea8d75acad…

---

## [Indexing realtime data to elastic search](https://discuss.elastic.co/t/indexing-realtime-data-to-elastic-search/258486)

<div class="topic-metadata">

**Author:** [@pksinghal](https://discuss.elastic.co/u/pksinghal)\
**Replies:** 3\
**Last updated:** [December 14, 2020, 8:50pm UTC](https://discuss.elastic.co/t/indexing-realtime-data-to-elastic-search/258486 "2020-12-14T20:50:54Z")

</div>

Hi, I am creating a new user profiling system. I am using Elasticsearch to store user data for fast search. User profiles have various data like registration-data, comment-added-data, reply-data, etc. So whenever the …

---

## [Elasticsearch error: missing authentication credentials for REST request \[/logstash-filebeat-2020.12.11/\_mapping\]](https://discuss.elastic.co/t/elasticsearch-error-missing-authentication-credentials-for-rest-request-logstash-filebeat-2020-12-11-mapping/258435)

<div class="topic-metadata">

**Author:** [@mjcammilleri](https://discuss.elastic.co/u/mjcammilleri)\
**Replies:** 1\
**Last updated:** [December 14, 2020, 8:21pm UTC](https://discuss.elastic.co/t/elasticsearch-error-missing-authentication-credentials-for-rest-request-logstash-filebeat-2020-12-11-mapping/258435 "2020-12-14T20:21:37Z")

</div>

Hi Everyone, This could be an issue that crosses with Grafana, but I'm hoping for some insight here. I am able to access the Elasticsearch API using my active token. I can test using curl in various python scripts to pu…

---

## [Problems with Java and Elasticsearch: JVM flavor 'sun6' not understood](https://discuss.elastic.co/t/problems-with-java-and-elasticsearch-jvm-flavor-sun6-not-understood/258510)

<div class="topic-metadata">

**Author:** [@waynesmallman](https://discuss.elastic.co/u/waynesmallman)\
**Replies:** 1\
**Last updated:** [December 14, 2020, 7:56pm UTC](https://discuss.elastic.co/t/problems-with-java-and-elasticsearch-jvm-flavor-sun6-not-understood/258510 "2020-12-14T19:56:49Z")

</div>

Hello! I'm preparing a Raspberry Pi 4 as a development environment, and I've hit a snag having installed and configured Java. I've installed Elastic from the official documentation here on Elastic for Debian. However,…

---

## [How can i connect to cluster when master node changed?](https://discuss.elastic.co/t/how-can-i-connect-to-cluster-when-master-node-changed/258490)

<div class="topic-metadata">

**Author:** [@hamidreza\_ghadir](https://discuss.elastic.co/u/hamidreza_ghadir)\
**Replies:** 4\
**Last updated:** [December 14, 2020, 7:15pm UTC](https://discuss.elastic.co/t/how-can-i-connect-to-cluster-when-master-node-changed/258490 "2020-12-14T19:15:13Z")

</div>

Hi, I have a cluster with three nodes on docker. MasterNode: 0.0.0.0:9200, Node2: 0.0.0.0:9201, Node3: 0.0.0.0:9202 I use Nest in .NetCore Application. and i connect to cluster with http://:9200/ and this connection …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1643)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1645)
