# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=784

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 785

---

## [Want to set ssl.verification\_mode as none for default fleet output in kibana.yml](https://discuss.elastic.co/t/want-to-set-ssl-verification-mode-as-none-for-default-fleet-output-in-kibana-yml/315098)

<div class="topic-metadata">

**Author:** [@Naveen\_Kumar\_Reddy\_S](https://discuss.elastic.co/u/Naveen_Kumar_Reddy_S)\
**Replies:** 0\
**Last updated:** [September 25, 2022, 11:30am UTC](https://discuss.elastic.co/t/want-to-set-ssl-verification-mode-as-none-for-default-fleet-output-in-kibana-yml/315098 "2022-09-25T11:30:51Z")

</div>

HI I am trying to send data from fleet managed Elastic agent to elastic master node with self-signed certificate. The auto generated self signed certificate doesnot have the publicip of the node. So to send data i want …

---

## [Filebeat log file input empty in Kibana](https://discuss.elastic.co/t/filebeat-log-file-input-empty-in-kibana/315093)

<div class="topic-metadata">

**Author:** [@Karthik\_ELK](https://discuss.elastic.co/u/Karthik_ELK)\
**Replies:** 1\
**Last updated:** [September 25, 2022, 11:04pm UTC](https://discuss.elastic.co/t/filebeat-log-file-input-empty-in-kibana/315093 "2022-09-25T23:04:45Z")

</div>

Hi, I just started learning ELK stack. I'm trying to send logs via a log file from Filebeat directly to Elastic. Each row in the log file is a json. filebeat.yml file is shown below. I'm running all these services using…

---

## [How to get ctx.payload.\_value size and apply condition on that](https://discuss.elastic.co/t/how-to-get-ctx-payload-value-size-and-apply-condition-on-that/315104)

<div class="topic-metadata">

**Author:** [@akhand\_1](https://discuss.elastic.co/u/akhand_1)\
**Replies:** 1\
**Last updated:** [September 25, 2022, 6:23pm UTC](https://discuss.elastic.co/t/how-to-get-ctx-payload-value-size-and-apply-condition-on-that/315104 "2022-09-25T18:23:17Z")

</div>

Hi team, @leandrojmp @stephenb @Badger I want to implement condition such that if the value to ctx.payload.\_value exceeds a certain number then only alerts need to be sent by watchers. Please suggest on this.

---

## [New user confused about odd @Timestamp](https://discuss.elastic.co/t/new-user-confused-about-odd-timestamp/315088)

<div class="topic-metadata">

**Author:** [@nfored](https://discuss.elastic.co/u/nfored)\
**Replies:** 4\
**Last updated:** [September 25, 2022, 5:30pm UTC](https://discuss.elastic.co/t/new-user-confused-about-odd-timestamp/315088 "2022-09-25T17:30:58Z")

</div>

I have 1 logs stash server that host 8 end points, outputs to elasticsearch 6 of the index correctly log @timestamp in UTC and life is lovely two index @timestamp is in the local timezone. This is the time stamp shown in…

---

## [Error when creating a kibana token](https://discuss.elastic.co/t/error-when-creating-a-kibana-token/315090)

<div class="topic-metadata">

**Author:** [@morad\_della3](https://discuss.elastic.co/u/morad_della3)\
**Replies:** 3\
**Last updated:** [September 25, 2022, 3:58pm UTC](https://discuss.elastic.co/t/error-when-creating-a-kibana-token/315090 "2022-09-25T15:58:39Z")

</div>

ubuntu 22.04 elastic 8.4.1 kibana 8.4.1 filebeat 8.4.1 auditbeat suricata elastic and kibana were working well with an old IP and when now i changed the IP to both of them i try to create a token it doesn't work ..…

---

## [ELK Docker stack exiting with code 139 after upgraded from 7.8 to 7.17.6](https://discuss.elastic.co/t/elk-docker-stack-exiting-with-code-139-after-upgraded-from-7-8-to-7-17-6/315100)

<div class="topic-metadata">

**Author:** [@Bhanu\_Praveen](https://discuss.elastic.co/u/Bhanu_Praveen)\
**Replies:** 0\
**Last updated:** [September 25, 2022, 12:59pm UTC](https://discuss.elastic.co/t/elk-docker-stack-exiting-with-code-139-after-upgraded-from-7-8-to-7-17-6/315100 "2022-09-25T12:59:33Z")

</div>

Hello, I am using Docker compose and ELK stack working fine on 7.8 version till date. I have tried to upgrade to 7.17.6 by running below command: docker-compose up --force-recreate --build -d Post that all 3 container…

---

## [Tf-idf custom similarity and bm25 gives same scores and identical results along with a minor problem](https://discuss.elastic.co/t/tf-idf-custom-similarity-and-bm25-gives-same-scores-and-identical-results-along-with-a-minor-problem/314814)

<div class="topic-metadata">

**Author:** [@dayzero](https://discuss.elastic.co/u/dayzero)\
**Replies:** 2\
**Last updated:** [September 25, 2022, 11:08am UTC](https://discuss.elastic.co/t/tf-idf-custom-similarity-and-bm25-gives-same-scores-and-identical-results-along-with-a-minor-problem/314814 "2022-09-25T11:08:40Z")

</div>

\#custom\_similarity #\_ignored #search\_problem #bm25 #tfidf Hi guys, First doubt: while indexing a field with large text along with other lightweight fields, the field gets ignored. But searching works in that field. how…

---

## [Extract query result in csv file](https://discuss.elastic.co/t/extract-query-result-in-csv-file/315095)

<div class="topic-metadata">

**Author:** [@Shubh](https://discuss.elastic.co/u/Shubh)\
**Replies:** 0\
**Last updated:** [September 25, 2022, 8:18am UTC](https://discuss.elastic.co/t/extract-query-result-in-csv-file/315095 "2022-09-25T08:18:49Z")

</div>

Hi all, can you help me how would i extract the java query output in csv file my code is given below. try { RangeQueryBuilder rangeQ = QueryBuilders .rangeQuery("@timestamp") …

---

## [Bucket aggregation with java api](https://discuss.elastic.co/t/bucket-aggregation-with-java-api/315074)

<div class="topic-metadata">

**Author:** [@Shubh](https://discuss.elastic.co/u/Shubh)\
**Replies:** 6\
**Last updated:** [September 25, 2022, 8:12am UTC](https://discuss.elastic.co/t/bucket-aggregation-with-java-api/315074 "2022-09-25T08:12:17Z")

</div>

Hi all can anyone pls help me convert below query in java i have been stuck to this from very long and frustrated.. pls help here GET /\_search { "query": { "bool": { "filter": \[ { "range": …

---

## [Retrieve documents matching criteria along with missing documentIds](https://discuss.elastic.co/t/retrieve-documents-matching-criteria-along-with-missing-documentids/314665)

<div class="topic-metadata">

**Author:** [@priyakc](https://discuss.elastic.co/u/priyakc)\
**Replies:** 10\
**Last updated:** [September 25, 2022, 3:01am UTC](https://discuss.elastic.co/t/retrieve-documents-matching-criteria-along-with-missing-documentids/314665 "2022-09-25T03:01:47Z")

</div>

I have list of document ids. When I query Elasticsearch, In result I need document ids which are matching my criteria and documentIds for which documents do not exist in Elasticsearch. Background on use case I need to …

---

## [Match\_phrase with exact substring without space](https://discuss.elastic.co/t/match-phrase-with-exact-substring-without-space/315064)

<div class="topic-metadata">

**Author:** [@ansamHox](https://discuss.elastic.co/u/ansamHox)\
**Replies:** 2\
**Last updated:** [September 24, 2022, 6:59pm UTC](https://discuss.elastic.co/t/match-phrase-with-exact-substring-without-space/315064 "2022-09-24T18:59:55Z")

</div>

I have a dataset like Text: a==b==c== Text: a==b== c== Text: a== b==c== And my own analyzer to create tokens for each letter "analysis": { "analyzer": { "my\_analyzer": { "char\_filter": \[ "my\_char\_filter" …

---

## [Wordcloud code changes](https://discuss.elastic.co/t/wordcloud-code-changes/315083)

<div class="topic-metadata">

**Author:** [@Shashank02](https://discuss.elastic.co/u/Shashank02)\
**Replies:** 0\
**Last updated:** [September 24, 2022, 4:29pm UTC](https://discuss.elastic.co/t/wordcloud-code-changes/315083 "2022-09-24T16:29:06Z")

</div>

Is there any way we can change the colors in the WORD CLOUD for a specific purpose? For ex. I am having some values like negative and positive. For negative, I want red color and for positive I want green color. So do we…

---

## [Parsing a list of lists with logstash filter](https://discuss.elastic.co/t/parsing-a-list-of-lists-with-logstash-filter/314747)

<div class="topic-metadata">

**Author:** [@amirfarsi](https://discuss.elastic.co/u/amirfarsi)\
**Replies:** 2\
**Last updated:** [September 24, 2022, 12:52pm UTC](https://discuss.elastic.co/t/parsing-a-list-of-lists-with-logstash-filter/314747 "2022-09-24T12:52:49Z")

</div>

Hello friends. I have a list of lists in the form below: doc 1: \[\[40004, 10\], \[40005, 12\]\] doc 2: \[\[40004, 8\], \[40006, 12\], \[20002, 3\]\] I want to change them to the following form: doc 1: { "40004": 10, "…

---

## [Persian synonyms](https://discuss.elastic.co/t/persian-synonyms/315079)

<div class="topic-metadata">

**Author:** [@Mahdi\_Abbasi](https://discuss.elastic.co/u/Mahdi_Abbasi)\
**Replies:** 0\
**Last updated:** [September 24, 2022, 10:06am UTC](https://discuss.elastic.co/t/persian-synonyms/315079 "2022-09-24T10:06:59Z")

</div>

Hey, I was wondering if there is a dataset of persian synonym words for my analyzer. I expect the dataset to contain at least same words with different spacings. for example: "اسید لاکتیک" and "اسیدلاکتیک". Thank you …

---

## [Does SetProcessor require dynamic mapping?](https://discuss.elastic.co/t/does-setprocessor-require-dynamic-mapping/315078)

<div class="topic-metadata">

**Author:** [@fifthist](https://discuss.elastic.co/u/fifthist)\
**Replies:** 1\
**Last updated:** [September 24, 2022, 10:01am UTC](https://discuss.elastic.co/t/does-setprocessor-require-dynamic-mapping/315078 "2022-09-24T10:01:08Z")

</div>

Does an index require dynamic mapping for a SetProcessor to be able to enrich a document with a new field? If using strict mapping, would the field that a SetProcessor is going to set need to be added to the mapping bef…

---

## [Preparing Logs analytics with Logstash (for kibana)](https://discuss.elastic.co/t/preparing-logs-analytics-with-logstash-for-kibana/314834)

<div class="topic-metadata">

**Author:** [@Mark\_S](https://discuss.elastic.co/u/Mark_S)\
**Replies:** 8\
**Last updated:** [September 24, 2022, 8:35am UTC](https://discuss.elastic.co/t/preparing-logs-analytics-with-logstash-for-kibana/314834 "2022-09-24T08:35:18Z")

</div>

When creating analytics (for kibana) I need to create keywords Because unfortunately simple text cannot be analyzed in kibana Dashboards. So I am trying to break up the logs. Grok constructor works fine when the logs …

---

## [Cannot Start .\\elasticsearch.bat on windows](https://discuss.elastic.co/t/cannot-start-elasticsearch-bat-on-windows/315037)

<div class="topic-metadata">

**Author:** [@miawu8](https://discuss.elastic.co/u/miawu8)\
**Replies:** 4\
**Last updated:** [September 24, 2022, 5:17am UTC](https://discuss.elastic.co/t/cannot-start-elasticsearch-bat-on-windows/315037 "2022-09-24T05:17:02Z")

</div>

Last month I installed V8.3.2 on windows 2022, everything was ok, but today I stop and deleted V8.3.2, and downloaded 8.4.2 from the official website, use the same config, the system reported an error and could not start…

---

## [Consult, send the alerts by rules created through mail](https://discuss.elastic.co/t/consult-send-the-alerts-by-rules-created-through-mail/315067)

<div class="topic-metadata">

**Author:** [@Hector\_miran](https://discuss.elastic.co/u/Hector_miran)\
**Replies:** 2\
**Last updated:** [September 24, 2022, 3:09am UTC](https://discuss.elastic.co/t/consult-send-the-alerts-by-rules-created-through-mail/315067 "2022-09-24T03:09:00Z")

</div>

Good morning everyone, currently I have managed to create alert rules and I have validated that alerts are being generated. I would like to be able to send these alerts to my email to be able to better monitor them. Is …

---

## [Puzzling Scoring situation using multi\_match](https://discuss.elastic.co/t/puzzling-scoring-situation-using-multi-match/315065)

<div class="topic-metadata">

**Author:** [@terzano](https://discuss.elastic.co/u/terzano)\
**Replies:** 1\
**Last updated:** [September 24, 2022, 2:57am UTC](https://discuss.elastic.co/t/puzzling-scoring-situation-using-multi-match/315065 "2022-09-24T02:57:56Z")

</div>

I am having a hard time understading why the scoring of record #1 is higher than #2. The one on #2 has more matches (see Highlight entry). Both terms are found on fields with higher boosting criteria ss\_categories\_full …

---

## [Field with different types on same index](https://discuss.elastic.co/t/field-with-different-types-on-same-index/315047)

<div class="topic-metadata">

**Author:** [@prabello](https://discuss.elastic.co/u/prabello)\
**Replies:** 5\
**Last updated:** [September 23, 2022, 11:41pm UTC](https://discuss.elastic.co/t/field-with-different-types-on-same-index/315047 "2022-09-23T23:41:33Z")

</div>

Currently, we are indexing information on elastic for each business that is our customer (B2B), this is causing us to have too many indexes, some with very small shards (500mb shards) But due to the nature of the data, …

---

## [Elasticsearch: \[Python Client\] Search does not return documents](https://discuss.elastic.co/t/elasticsearch-python-client-search-does-not-return-documents/315066)

<div class="topic-metadata">

**Author:** [@Ivo\_Tavares](https://discuss.elastic.co/u/Ivo_Tavares)\
**Replies:** 0\
**Last updated:** [September 23, 2022, 10:41pm UTC](https://discuss.elastic.co/t/elasticsearch-python-client-search-does-not-return-documents/315066 "2022-09-23T22:41:48Z")

</div>

When I run the following: search\_doc = Document.search( using=client, index=custom\_index ) search\_doc = search\_doc.query("term", doc\_field = f"string\_{num}") and then use .scan() I get Hit objects. So…

---

## [Okta SSO not working](https://discuss.elastic.co/t/okta-sso-not-working/315053)

<div class="topic-metadata">

**Author:** [@sean.doody](https://discuss.elastic.co/u/sean.doody)\
**Replies:** 3\
**Last updated:** [September 23, 2022, 10:32pm UTC](https://discuss.elastic.co/t/okta-sso-not-working/315053 "2022-09-23T22:32:00Z")

</div>

I am having trouble getting SAML integrated with Elastic. I used a 14-day Trail and got it to work there, but now that I tried to integrate it into our production environment I am getting errors. Below is the yaml for o…

---

## [Logstash Error Failed to Execute action](https://discuss.elastic.co/t/logstash-error-failed-to-execute-action/315051)

<div class="topic-metadata">

**Author:** [@Technolust](https://discuss.elastic.co/u/Technolust)\
**Replies:** 7\
**Last updated:** [September 23, 2022, 9:38pm UTC](https://discuss.elastic.co/t/logstash-error-failed-to-execute-action/315051 "2022-09-23T21:38:01Z")

</div>

Team, I've lost all my hair... For whatever reason, I can't figure this out. \[2022-09-23T15:09:46,265\]\[ERROR\]\[logstash.agent \] Failed to execute action {:action=\>LogStash::PipelineAction::Create/pipeline\_id:m…

---

## [VMWare NSX Parsing](https://discuss.elastic.co/t/vmware-nsx-parsing/315054)

<div class="topic-metadata">

**Author:** [@groth](https://discuss.elastic.co/u/groth)\
**Replies:** 2\
**Last updated:** [September 23, 2022, 9:18pm UTC](https://discuss.elastic.co/t/vmware-nsx-parsing/315054 "2022-09-23T21:18:42Z")

</div>

I'm currently working on a Logstash pipeline for VMWare NSX firewall logs coming in over syslog forwarding. Some of the ICMP logs have a couple numbers between the protocol name and the source and destination IPs that VM…

---

## [Error when starting elasticsearch](https://discuss.elastic.co/t/error-when-starting-elasticsearch/315026)

<div class="topic-metadata">

**Author:** [@morad\_della3](https://discuss.elastic.co/u/morad_della3)\
**Replies:** 5\
**Last updated:** [September 23, 2022, 9:18pm UTC](https://discuss.elastic.co/t/error-when-starting-elasticsearch/315026 "2022-09-23T21:18:21Z")

</div>

I HAVE elastic 8.4.1 in ubuntu 22.04 and when i make this cmd "discovery.type: single-node" in elasticsearch.yml because i installed elastic ad kibana in the same server i have this error \[2022-09-23T14:30:10,954\]\[ERRO…

---

## [Multiple log entries in filebeat each with its id and multiple processors](https://discuss.elastic.co/t/multiple-log-entries-in-filebeat-each-with-its-id-and-multiple-processors/314987)

<div class="topic-metadata">

**Author:** [@erwin339](https://discuss.elastic.co/u/erwin339)\
**Replies:** 2\
**Last updated:** [September 23, 2022, 6:41pm UTC](https://discuss.elastic.co/t/multiple-log-entries-in-filebeat-each-with-its-id-and-multiple-processors/314987 "2022-09-23T18:41:42Z")

</div>

I am trying to configure filebeat so that it obtains logs from a server which is running 3 applications, the most logical thing is that each one has its id as a reference, for this configure 3 entries with its specific p…

---

## [Visualize inequality with a Lorenz Curve](https://discuss.elastic.co/t/visualize-inequality-with-a-lorenz-curve/315048)

<div class="topic-metadata">

**Author:** [@Andreas\_Schennings](https://discuss.elastic.co/u/Andreas_Schennings)\
**Replies:** 0\
**Last updated:** [September 23, 2022, 6:41pm UTC](https://discuss.elastic.co/t/visualize-inequality-with-a-lorenz-curve/315048 "2022-09-23T18:41:21Z")

</div>

Hi! I am quite new to Kibana. But I must say I really like its diversity and possibilites. Lets say I would like to visualize inequalities e.g. income over population. I have heard that this could be achieved by using …

---

## [Timepicker parameters as input to painless scripts](https://discuss.elastic.co/t/timepicker-parameters-as-input-to-painless-scripts/314900)

<div class="topic-metadata">

**Author:** [@antoniolopescorreia](https://discuss.elastic.co/u/antoniolopescorreia)\
**Replies:** 3\
**Last updated:** [September 23, 2022, 6:01pm UTC](https://discuss.elastic.co/t/timepicker-parameters-as-input-to-painless-scripts/314900 "2022-09-23T18:01:21Z")

</div>

Is it currently possible to pass the timepicker values as input parameters to runtime painless scripts? The question occurs because I would like to dynamically calculate some time interval value sums, which are calculate…

---

## [Block in coverage\_state Error in Logstash Pipeline](https://discuss.elastic.co/t/block-in-coverage-state-error-in-logstash-pipeline/315040)

<div class="topic-metadata">

**Author:** [@andreakatie](https://discuss.elastic.co/u/andreakatie)\
**Replies:** 2\
**Last updated:** [September 23, 2022, 5:25pm UTC](https://discuss.elastic.co/t/block-in-coverage-state-error-in-logstash-pipeline/315040 "2022-09-23T17:25:42Z")

</div>

Hello all, I am running an ELK stack (Elasticsearch v. 7.1.2, Filebeat v. 7.8.0, and Logstash v. 7.16.3) and recently added the following code to a Logstash .conf template (one of many in the stack which has been succes…

---

## [Filebeat log gets flooded if no Kafka topic is available](https://discuss.elastic.co/t/filebeat-log-gets-flooded-if-no-kafka-topic-is-available/314702)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 1\
**Last updated:** [September 23, 2022, 5:14pm UTC](https://discuss.elastic.co/t/filebeat-log-gets-flooded-if-no-kafka-topic-is-available/314702 "2022-09-23T17:14:42Z")

</div>

Hi, I have an issue where Filebeat tries to send data to a Kafka topic that doesn't exist anymore. The Filebeat logs are flooded with: 2022-09-19T13:47:29.111Z INFO \[publisher\] pipeline/retry.go:223 d…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=783)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=785)
