# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1686

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1687

---

## [Execute Cosine Similarity inside script\_score function if field is present in the document](https://discuss.elastic.co/t/execute-cosine-similarity-inside-script-score-function-if-field-is-present-in-the-document/253006)

<div class="topic-metadata">

**Author:** [@SatyaAditya](https://discuss.elastic.co/u/SatyaAditya)\
**Replies:** 3\
**Last updated:** [November 20, 2020, 10:56am UTC](https://discuss.elastic.co/t/execute-cosine-similarity-inside-script-score-function-if-field-is-present-in-the-document/253006 "2020-11-20T10:56:10Z")

</div>

I am trying to use cosine similarity in script\_score function. The query is breaking when the dense vector field is missing in the document against which I am trying to measure similarity is missing. I spent a lot of ti…

---

## [How to change the display name of elastic field in kibana dashboard?](https://discuss.elastic.co/t/how-to-change-the-display-name-of-elastic-field-in-kibana-dashboard/254380)

<div class="topic-metadata">

**Author:** [@ramashish](https://discuss.elastic.co/u/ramashish)\
**Replies:** 3\
**Last updated:** [November 20, 2020, 10:56am UTC](https://discuss.elastic.co/t/how-to-change-the-display-name-of-elastic-field-in-kibana-dashboard/254380 "2020-11-20T10:56:06Z")

</div>

We are facing the following two issues in Kibana(v7.6) while creating a dashboard: How to change the display name of field in kibana. Usually in elastic search we have created fields like docketNo,bookingDate,actualWe…

---

## [Unable to start Elastic search when i delete jar from lang-mustache and place it in lib](https://discuss.elastic.co/t/unable-to-start-elastic-search-when-i-delete-jar-from-lang-mustache-and-place-it-in-lib/256090)

<div class="topic-metadata">

**Author:** [@rakeshdkaatkar](https://discuss.elastic.co/u/rakeshdkaatkar)\
**Replies:** 3\
**Last updated:** [November 20, 2020, 9:06am UTC](https://discuss.elastic.co/t/unable-to-start-elastic-search-when-i-delete-jar-from-lang-mustache-and-place-it-in-lib/256090 "2020-11-20T09:06:21Z")

</div>

Im getting below error java.lang.IllegalStateException: Plugin \[lang-mustache\] must reference a class loader local Plugin class \[org.elasticsearch.script.mustache.MustachePlugin\] (class loader \[sun.misc.Launcher$AppClas…

---

## [Managing "is\_write\_index"](https://discuss.elastic.co/t/managing-is-write-index/256089)

<div class="topic-metadata">

**Author:** [@koos](https://discuss.elastic.co/u/koos)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 8:50am UTC](https://discuss.elastic.co/t/managing-is-write-index/256089 "2020-11-20T08:50:38Z")

</div>

Hi there, We've created a Lambda function (python) in order to steam logs from AWS CloudWatch to our ELK stack. I'm also making use of life cycle policies to rotate the index on a specific size and delete after the spe…

---

## [Find documents which is older then specified date range based on list of ids](https://discuss.elastic.co/t/find-documents-which-is-older-then-specified-date-range-based-on-list-of-ids/255843)

<div class="topic-metadata">

**Author:** [@sibasish.palo](https://discuss.elastic.co/u/sibasish.palo)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 8:23am UTC](https://discuss.elastic.co/t/find-documents-which-is-older-then-specified-date-range-based-on-list-of-ids/255843 "2020-11-20T08:23:13Z")

</div>

After searching for sometime and seeing some answer not able to quite figure out the query for my requirement My requirement is i have a list of document ids, what i need to find is the documents which are older than a …

---

## [Index status Open but in Delete phase](https://discuss.elastic.co/t/index-status-open-but-in-delete-phase/256043)

<div class="topic-metadata">

**Author:** [@PhilA](https://discuss.elastic.co/u/PhilA)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 8:14am UTC](https://discuss.elastic.co/t/index-status-open-but-in-delete-phase/256043 "2020-11-20T08:14:46Z")

</div>

Hi I have recently been working on a new data source for Threat Intel data to make use of the Indicator Match detection. My plan was to ingest the TI data in to an index and then roll that index over every 12hrs in to …

---

## [Add \_routing via document not query string](https://discuss.elastic.co/t/add-routing-via-document-not-query-string/255458)

<div class="topic-metadata">

**Author:** [@pcb](https://discuss.elastic.co/u/pcb)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 8:11am UTC](https://discuss.elastic.co/t/add-routing-via-document-not-query-string/255458 "2020-11-20T08:11:08Z")

</div>

Hi ya, I'm attempting to use Elasticsearch custom routing in conjunction with Confluent's Kafka Elasticsearch Sink. Every thing is going well until I've run into custom routing which it doesn't seem to support. I can't…

---

## [Ingest pipeline with enrich policy that matches by \_id - not supported?](https://discuss.elastic.co/t/ingest-pipeline-with-enrich-policy-that-matches-by-id-not-supported/255543)

<div class="topic-metadata">

**Author:** [@djmcgreal](https://discuss.elastic.co/u/djmcgreal)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 8:08am UTC](https://discuss.elastic.co/t/ingest-pipeline-with-enrich-policy-that-matches-by-id-not-supported/255543 "2020-11-20T08:08:41Z")

</div>

Hi, I'd like to deduplicate data. We're hashing a subset of fields of the events into the document identifier. To do this in an ingest pipeline, I'd like to have an enrich policy like so: PUT /\_enrich/policy/event-…

---

## [Sql query giving null ouput](https://discuss.elastic.co/t/sql-query-giving-null-ouput/255945)

<div class="topic-metadata">

**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\
**Replies:** 5\
**Last updated:** [November 20, 2020, 7:44am UTC](https://discuss.elastic.co/t/sql-query-giving-null-ouput/255945 "2020-11-20T07:44:52Z")

</div>

Hi All, I am stuck with sql query output, can anyone please help POST \_sql?format=txt { "query": "SELECT SERVICE\_NAME,CASE WHEN MSA\_STATUS.keyword ='PUBLISH' AND MSA\_FLOW\_DIR.keyword ='EAI - SCRM specific processing' …

---

## [Logstash on cifs mounted windows drive](https://discuss.elastic.co/t/logstash-on-cifs-mounted-windows-drive/256070)

<div class="topic-metadata">

**Author:** [@pk.241011](https://discuss.elastic.co/u/pk.241011)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 7:14am UTC](https://discuss.elastic.co/t/logstash-on-cifs-mounted-windows-drive/256070 "2020-11-20T07:14:45Z")

</div>

I have to pull in some logs which will be dumped on a shared windows drive. The files are small. But their number will be high. There is no chance of files appearing again once they have been processed and deleted. The…

---

## [How to find out if password of elastic user is already set or not](https://discuss.elastic.co/t/how-to-find-out-if-password-of-elastic-user-is-already-set-or-not/254872)

<div class="topic-metadata">

**Author:** [@MartinG](https://discuss.elastic.co/u/MartinG)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 7:08am UTC](https://discuss.elastic.co/t/how-to-find-out-if-password-of-elastic-user-is-already-set-or-not/254872 "2020-11-20T07:08:48Z")

</div>

Hi there, I am building up Elasticsearch clusters automatically with Ansible and have a problem with the initial setting of the "elastic" user password. As described in the documentation a initial and transient bootstr…

---

## [Split is not working on multivalued string fields](https://discuss.elastic.co/t/split-is-not-working-on-multivalued-string-fields/256068)

<div class="topic-metadata">

**Author:** [@Abdul\_Aziz](https://discuss.elastic.co/u/Abdul_Aziz)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 7:06am UTC](https://discuss.elastic.co/t/split-is-not-working-on-multivalued-string-fields/256068 "2020-11-20T07:06:08Z")

</div>

I have record like below in my text file; id=1 name=Paint category=Decorative color=2345|red|5|| color=123|green|4|| color=345|yellow|8|| REC$$ I wanted output (stdout) as below using logstash configuration; "id…

---

## [Constant session timeouts in Kibana 7.10.0 on OpenShift but not with 7.9.3](https://discuss.elastic.co/t/constant-session-timeouts-in-kibana-7-10-0-on-openshift-but-not-with-7-9-3/256000)

<div class="topic-metadata">

**Author:** [@ngilmore](https://discuss.elastic.co/u/ngilmore)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 6:52am UTC](https://discuss.elastic.co/t/constant-session-timeouts-in-kibana-7-10-0-on-openshift-but-not-with-7-9-3/256000 "2020-11-20T06:52:30Z")

</div>

I have installed a secured Elastic 7.10.0 cluster (3 master, 2 client, 5 data nodes) on OpenShift and added Kibana (2 node cluster). However, with Kibana 7.10.0 installed it constantly experiences session timeouts. I h…

---

## [Logstash Grok filters, split and path](https://discuss.elastic.co/t/logstash-grok-filters-split-and-path/256015)

<div class="topic-metadata">

**Author:** [@Priyanka3](https://discuss.elastic.co/u/Priyanka3)\
**Replies:** 1\
**Last updated:** [November 20, 2020, 5:46am UTC](https://discuss.elastic.co/t/logstash-grok-filters-split-and-path/256015 "2020-11-20T05:46:58Z")

</div>

Hi, I am new to Elastic search. So, can anyone explain me the difference between Split, xpath and Grok filters? and under what situation do we use these? Thanks, Priyanka

---

## [Having read-only shard greater than 50 GB](https://discuss.elastic.co/t/having-read-only-shard-greater-than-50-gb/256061)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 5:32am UTC](https://discuss.elastic.co/t/having-read-only-shard-greater-than-50-gb/256061 "2020-11-20T05:32:39Z")

</div>

I recently re-indexed past 18 months of day-wise indices (18 months \*30 days = 540 indices with 1 primary shard per index) into 18 monthly indices (18 indices with 12 primary shards per index). No indexing happens on th…

---

## [Failed to set password for user \[apm\_system\] with elastic password](https://discuss.elastic.co/t/failed-to-set-password-for-user-apm-system-with-elastic-password/256005)

<div class="topic-metadata">

**Author:** [@xziten](https://discuss.elastic.co/u/xziten)\
**Replies:** 3\
**Last updated:** [November 20, 2020, 5:12am UTC](https://discuss.elastic.co/t/failed-to-set-password-for-user-apm-system-with-elastic-password/256005 "2020-11-20T05:12:24Z")

</div>

Hi, I'm trying to setup an elasticsearch cluster. 3 nodes : 1 master, 1 master / data\_hot, 1 data\_warm Elastic Version : 7.10 System : RHEL 8.3 Step by step : Installing Configuring nodes and test if everything…

---

## [Chart Data Not Available in Time Windows of Two Hours or Less?](https://discuss.elastic.co/t/chart-data-not-available-in-time-windows-of-two-hours-or-less/255450)

<div class="topic-metadata">

**Author:** [@astorm](https://discuss.elastic.co/u/astorm)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 4:44am UTC](https://discuss.elastic.co/t/chart-data-not-available-in-time-windows-of-two-hours-or-less/255450 "2020-11-20T04:44:55Z")

</div>

I'm relatively new to Elastic Search and Kibaba, so I'm unsure if this is user error or a bug. The short version is my chart data does not show up with time windows less than three hours I'm using Elastic Cloud. I've …

---

## [Config SSL/TLS Kibana and Elasticsearch](https://discuss.elastic.co/t/config-ssl-tls-kibana-and-elasticsearch/255820)

<div class="topic-metadata">

**Author:** [@aloalo2242](https://discuss.elastic.co/u/aloalo2242)\
**Replies:** 4\
**Last updated:** [November 20, 2020, 2:37am UTC](https://discuss.elastic.co/t/config-ssl-tls-kibana-and-elasticsearch/255820 "2020-11-20T02:37:23Z")

</div>

Hi, Im trying to enable Fleet in Ingest Manager. And it say I have to enable this xpack.security.authc.api\_key.enabled: true in elasticsearch.yml. But if add that line, I have to add bellow line too: xpack.security.en…

---

## [Modsecurity Log Grok Filter](https://discuss.elastic.co/t/modsecurity-log-grok-filter/256057)

<div class="topic-metadata">

**Author:** [@reza\_naipospos](https://discuss.elastic.co/u/reza_naipospos)\
**Replies:** 10\
**Last updated:** [November 20, 2020, 4:21am UTC](https://discuss.elastic.co/t/modsecurity-log-grok-filter/256057 "2020-11-20T04:21:28Z")

</div>

I make grok filter with this condition but noting show anything on grok debugger. Log format is Modsecurity audit log (?%{YEAR}\[./\]%{MONTHNUM}\[./\]%{MONTHDAY} %{TIME}) \[%{LOGLEVEL:severity}\] %{POSINT:pid}#%{NUMBER:thread…

---

## [Add custom field on IIS log](https://discuss.elastic.co/t/add-custom-field-on-iis-log/256054)

<div class="topic-metadata">

**Author:** [@victortamotsu](https://discuss.elastic.co/u/victortamotsu)\
**Replies:** 0\
**Last updated:** [November 20, 2020, 2:34am UTC](https://discuss.elastic.co/t/add-custom-field-on-iis-log/256054 "2020-11-20T02:34:52Z")

</div>

Hi everybody! I added a custom field on IIS log to register the original client IP (x-forwarded-for). This is necessary because I use a reverse proxy to publish my webserver, so the Client IP Address (c-ip) show only th…

---

## [Policy to automatically delete indexes with max days and size](https://discuss.elastic.co/t/policy-to-automatically-delete-indexes-with-max-days-and-size/255995)

<div class="topic-metadata">

**Author:** [@cruizba](https://discuss.elastic.co/u/cruizba)\
**Replies:** 2\
**Last updated:** [November 20, 2020, 12:28am UTC](https://discuss.elastic.co/t/policy-to-automatically-delete-indexes-with-max-days-and-size/255995 "2020-11-20T00:28:14Z")

</div>

Hello to all the Elastic Stack community and developers :slight\_smile: We have a server that use Elasticsearch to store logs, events and metrics. This server configure a policy which delete an Index if it is older that …

---

## [Non-negative Serial Diff for a "counter" that resets to 0 from time to time](https://discuss.elastic.co/t/non-negative-serial-diff-for-a-counter-that-resets-to-0-from-time-to-time/256046)

<div class="topic-metadata">

**Author:** [@mludvig](https://discuss.elastic.co/u/mludvig)\
**Replies:** 2\
**Last updated:** [November 19, 2020, 11:35pm UTC](https://discuss.elastic.co/t/non-negative-serial-diff-for-a-counter-that-resets-to-0-from-time-to-time/256046 "2020-11-19T23:35:48Z")

</div>

I'm collecting stats from some industrial process that has variable number of workers that produce some output at a variable rate, that is accumulating to a balance queue that from time to time is flushed and reset to 0. …

---

## [Canvas workpad - intermittently broken visualizations](https://discuss.elastic.co/t/canvas-workpad-intermittently-broken-visualizations/255780)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 2\
**Last updated:** [November 19, 2020, 11:29pm UTC](https://discuss.elastic.co/t/canvas-workpad-intermittently-broken-visualizations/255780 "2020-11-19T23:29:26Z")

</div>

Hey All Elastic/Kibana Version 7.9.1 Have this weird issue in canvas. I get 0 results when counting docs. It happens in all visualisations. Here is an example. In this sample, I want to count the number of backups. …

---

## [Metricbeat doesn't communicate with Elasticsearch](https://discuss.elastic.co/t/metricbeat-doesnt-communicate-with-elasticsearch/256035)

<div class="topic-metadata">

**Author:** [@Cosmin\_Ciobanu1](https://discuss.elastic.co/u/Cosmin_Ciobanu1)\
**Replies:** 1\
**Last updated:** [November 19, 2020, 11:03pm UTC](https://discuss.elastic.co/t/metricbeat-doesnt-communicate-with-elasticsearch/256035 "2020-11-19T23:03:13Z")

</div>

Hi! I have installed Metricbeat and I have Security feature installed on my ELK! After I make all configurations with certificates and modules I get this error: "service": { "type": "elasticsearch", "address…

---

## [Action Shrink n Reindex with Curator](https://discuss.elastic.co/t/action-shrink-n-reindex-with-curator/256028)

<div class="topic-metadata">

**Author:** [@Beuhlet\_Reseau](https://discuss.elastic.co/u/Beuhlet_Reseau)\
**Replies:** 0\
**Last updated:** [November 19, 2020, 6:25pm UTC](https://discuss.elastic.co/t/action-shrink-n-reindex-with-curator/256028 "2020-11-19T18:25:18Z")

</div>

Hello, I need to shrink an index called log\_index\_ARC (too many shards/replicas). Also, i want after shrink process, add an alias on new shrink index (log\_index\_ARC-shrink) to log\_index\_ARC (original value so). Here m…

---

## [Is it possible to use payload as input to an exec output command?](https://discuss.elastic.co/t/is-it-possible-to-use-payload-as-input-to-an-exec-output-command/256042)

<div class="topic-metadata">

**Author:** [@esguy](https://discuss.elastic.co/u/esguy)\
**Replies:** 1\
**Last updated:** [November 19, 2020, 10:18pm UTC](https://discuss.elastic.co/t/is-it-possible-to-use-payload-as-input-to-an-exec-output-command/256042 "2020-11-19T22:18:14Z")

</div>

Hello, I have a watcher set up with multiple email actions where each email action has a conditional checking whats in the user field of the payload. For example, if user = 'userGroupA', then it will execute the action …

---

## [Heat Map visualization of Azure DevOps Pipeline build](https://discuss.elastic.co/t/heat-map-visualization-of-azure-devops-pipeline-build/255868)

<div class="topic-metadata">

**Author:** [@sachin1112](https://discuss.elastic.co/u/sachin1112)\
**Replies:** 1\
**Last updated:** [November 19, 2020, 9:37pm UTC](https://discuss.elastic.co/t/heat-map-visualization-of-azure-devops-pipeline-build/255868 "2020-11-19T21:37:33Z")

</div>

Hello Experts, we are trying to create a Heat map to reflect last 10 pipeline builds for environments (Dev, Test, Prod) In the metric section we had chosen the count , in the x axis we had taken the Date histogram an…

---

## [Integration Office365](https://discuss.elastic.co/t/integration-office365/256023)

<div class="topic-metadata">

**Author:** [@nottellingyou](https://discuss.elastic.co/u/nottellingyou)\
**Replies:** 1\
**Last updated:** [November 19, 2020, 9:13pm UTC](https://discuss.elastic.co/t/integration-office365/256023 "2020-11-19T21:13:55Z")

</div>

Has anyone successfully integrated o365 with integrations in ElasticCloud?

---

## [Logstash.bat generates new .jar files every time it is run](https://discuss.elastic.co/t/logstash-bat-generates-new-jar-files-every-time-it-is-run/255747)

<div class="topic-metadata">

**Author:** [@Mefhisto1](https://discuss.elastic.co/u/Mefhisto1)\
**Replies:** 5\
**Last updated:** [November 19, 2020, 9:01pm UTC](https://discuss.elastic.co/t/logstash-bat-generates-new-jar-files-every-time-it-is-run/255747 "2020-11-19T21:01:10Z")

</div>

Hi, I'm running logstash every minute via a task scheduler. The task is to call logstash.bat with the appropriate .config file. This is done every minute. Logstash is generating a lot of files in TEMP folder every ti…

---

## [Kibana server is not ready after upgrading to 7.10](https://discuss.elastic.co/t/kibana-server-is-not-ready-after-upgrading-to-7-10/256029)

<div class="topic-metadata">

**Author:** [@patrickr](https://discuss.elastic.co/u/patrickr)\
**Replies:** 6\
**Last updated:** [November 19, 2020, 8:19pm UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-after-upgrading-to-7-10/256029 "2020-11-19T20:19:34Z")

</div>

Hello, We seem to constantly have issues when attempting to upgrade. This time, after the upgrade is complete and the server has rebooted, we simply get a kibana is not ready message. Can someone provide any informati…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1685)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1687)
