# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1572

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1573

---

## [Rally gets stuck on check-cluster-health](https://discuss.elastic.co/t/rally-gets-stuck-on-check-cluster-health/262480)

<div class="topic-metadata">

**Author:** [@rsarpal](https://discuss.elastic.co/u/rsarpal)\
**Replies:** 6\
**Last updated:** [February 4, 2021, 8:04am UTC](https://discuss.elastic.co/t/rally-gets-stuck-on-check-cluster-health/262480 "2021-02-04T08:04:10Z")

</div>

Hi, We have older version of elastic 2.4 , I am trying to test it with rally. I have tried to test with latest and the older versions of rally (1.3.0, 1.4.1, latest) Rally gets stuck on check-cluster-health Running pu…

---

## [Elastic search not starting](https://discuss.elastic.co/t/elastic-search-not-starting/262886)

<div class="topic-metadata">

**Author:** [@SumeshGopu](https://discuss.elastic.co/u/SumeshGopu)\
**Replies:** 6\
**Last updated:** [February 4, 2021, 7:57am UTC](https://discuss.elastic.co/t/elastic-search-not-starting/262886 "2021-02-04T07:57:13Z")

</div>

Hello, We have a simple elasticsearch setup. Yesterday the diskspace went full and I was not able to get into index management to delete old index. So I deleted the files from disk. Now elasticsearch wont start I am…

---

## [Delete too many indexes at once leads the cluster to red](https://discuss.elastic.co/t/delete-too-many-indexes-at-once-leads-the-cluster-to-red/262849)

<div class="topic-metadata">

**Author:** [@sebastienf](https://discuss.elastic.co/u/sebastienf)\
**Replies:** 8\
**Last updated:** [February 4, 2021, 7:55am UTC](https://discuss.elastic.co/t/delete-too-many-indexes-at-once-leads-the-cluster-to-red/262849 "2021-02-04T07:55:33Z")

</div>

I work on a ES 5.6 "on premises", and we work to switch to ES 7.x. Before that, we aim to reduce our over-sharding issue : we generate too much index (every day when every month is ok) and espacially, with 5 shards (def…

---

## [Heartbeat autodiscover not working: protocol not available](https://discuss.elastic.co/t/heartbeat-autodiscover-not-working-protocol-not-available/262780)

<div class="topic-metadata">

**Author:** [@jeffrey008](https://discuss.elastic.co/u/jeffrey008)\
**Replies:** 4\
**Last updated:** [February 4, 2021, 7:37am UTC](https://discuss.elastic.co/t/heartbeat-autodiscover-not-working-protocol-not-available/262780 "2021-02-04T07:37:00Z")

</div>

I was trying Heartbeat autodiscover on my Windows. Here is my heartbeast.yml: heartbeat.autodiscover: providers: - type: docker templates: - condition: contains: docker.cont…

---

## [Elasticsearch reindex API is not able to copy the documents](https://discuss.elastic.co/t/elasticsearch-reindex-api-is-not-able-to-copy-the-documents/263121)

<div class="topic-metadata">

**Author:** [@chaitra\_hegde](https://discuss.elastic.co/u/chaitra_hegde)\
**Replies:** 7\
**Last updated:** [February 4, 2021, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-reindex-api-is-not-able-to-copy-the-documents/263121 "2021-02-04T07:21:50Z")

</div>

Hi, I am using Elasticsearch 7.8.0. I am trying to copy documents from one index to another using reindex API. I tried 2 cases. Case 1. Only source index is present in the Elasticsearch cluster. Destination index is n…

---

## [How to enable elasticsearch on ipv4](https://discuss.elastic.co/t/how-to-enable-elasticsearch-on-ipv4/263204)

<div class="topic-metadata">

**Author:** [@Somesh\_ng](https://discuss.elastic.co/u/Somesh_ng)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 7:21am UTC](https://discuss.elastic.co/t/how-to-enable-elasticsearch-on-ipv4/263204 "2021-02-04T07:21:08Z")

</div>

Can someone let me know how to run elasticsearch only on ipv4.

---

## [Understanding Elasticsearch ILM Lifecycle Actions](https://discuss.elastic.co/t/understanding-elasticsearch-ilm-lifecycle-actions/263202)

<div class="topic-metadata">

**Author:** [@BBQigniter](https://discuss.elastic.co/u/BBQigniter)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 7:13am UTC](https://discuss.elastic.co/t/understanding-elasticsearch-ilm-lifecycle-actions/263202 "2021-02-04T07:13:20Z")

</div>

Hi, I want to better understand ILM and the actions it is doing in sequence. For example: What do I have to do if I want to move a hot-index (phase complete) to the next warm-phase and then to cold? I found the ilm-move…

---

## [Cannot detect ES version - using spark](https://discuss.elastic.co/t/cannot-detect-es-version-using-spark/263201)

<div class="topic-metadata">

**Author:** [@Nenad13](https://discuss.elastic.co/u/Nenad13)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 6:21am UTC](https://discuss.elastic.co/t/cannot-detect-es-version-using-spark/263201 "2021-02-04T06:21:44Z")

</div>

I am using and AWS Glue Job to use a Spark cluster and trying to connect to an elasticsearch node. val esHost = "10.196.67.240" val esPort = "9200" val indexName = "xxx" val sparkConfig = new SparkConf().set("es.nodes"…

---

## [Kibana 7.10.0 visualization throwing error on aggregation \[esaggs\]\>bad request](https://discuss.elastic.co/t/kibana-7-10-0-visualization-throwing-error-on-aggregation-esaggs-bad-request/263086)

<div class="topic-metadata">

**Author:** [@Rakesh\_Rayabarapu](https://discuss.elastic.co/u/Rakesh_Rayabarapu)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 6:23am UTC](https://discuss.elastic.co/t/kibana-7-10-0-visualization-throwing-error-on-aggregation-esaggs-bad-request/263086 "2021-02-04T06:23:09Z")

</div>

Hello Team, While we creating a visualization with any aggregation except count renders an error. please find error details below. Thanks in advance. search\_phase\_execution\_exception all shards failed Error: Bad Req…

---

## [Need help to get logstash output in following format](https://discuss.elastic.co/t/need-help-to-get-logstash-output-in-following-format/263198)

<div class="topic-metadata">

**Author:** [@onkarborade](https://discuss.elastic.co/u/onkarborade)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 5:57am UTC](https://discuss.elastic.co/t/need-help-to-get-logstash-output-in-following-format/263198 "2021-02-04T05:57:03Z")

</div>

Hi, I am struggling to get bellow format "tch\_id" : 201, "rosterentry": \[ { "rolerosterid": 100, "rosterdaterange": \[ …

---

## [How convert datetime(string) in days](https://discuss.elastic.co/t/how-convert-datetime-string-in-days/262876)

<div class="topic-metadata">

**Author:** [@ITchandj](https://discuss.elastic.co/u/ITchandj)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 5:54am UTC](https://discuss.elastic.co/t/how-convert-datetime-string-in-days/262876 "2021-02-04T05:54:44Z")

</div>

How to convert a Datetime(string) to days(number) in Kibana. Indeed i would like to convert SessionLogonTime into days. thank you for your ideas and solutions if possible.

---

## [Kibana pie chart not showing all the labels](https://discuss.elastic.co/t/kibana-pie-chart-not-showing-all-the-labels/263192)

<div class="topic-metadata">

**Author:** [@mohanss08](https://discuss.elastic.co/u/mohanss08)\
**Replies:** 2\
**Last updated:** [February 4, 2021, 5:15am UTC](https://discuss.elastic.co/t/kibana-pie-chart-not-showing-all-the-labels/263192 "2021-02-04T05:15:20Z")

</div>

I m using Elasticsearch and Kibana - 7.10.1 Have created Pie-Chart visualization but currently it is not showing labels for all the slices. Below is my Chart and Label settings image. Currently i have totally five sli…

---

## [How to find top\_metrics value in watcher context when dots in field](https://discuss.elastic.co/t/how-to-find-top-metrics-value-in-watcher-context-when-dots-in-field/262843)

<div class="topic-metadata">

**Author:** [@WernerKwas](https://discuss.elastic.co/u/WernerKwas)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 5:22am UTC](https://discuss.elastic.co/t/how-to-find-top-metrics-value-in-watcher-context-when-dots-in-field/262843 "2021-02-04T05:22:36Z")

</div>

Hi, I need some help with the following issue i cannot resolve. Thanks in advance. Possibly because the field "transaction.duration.us" contains dots i'm not able to get the value isolated in the condition section of t…

---

## [How to round up value in metric visualization](https://discuss.elastic.co/t/how-to-round-up-value-in-metric-visualization/261783)

<div class="topic-metadata">

**Author:** [@Sourabh\_Korde](https://discuss.elastic.co/u/Sourabh_Korde)\
**Replies:** 1\
**Last updated:** [February 4, 2021, 4:59am UTC](https://discuss.elastic.co/t/how-to-round-up-value-in-metric-visualization/261783 "2021-02-04T04:59:32Z")

</div>

The average of a numeric field doesn't get rounded through advanced settings. Please help with the solution. Kibana 7.10 Regards, Sourabh.

---

## [Is there a graphical interface for Logstash?](https://discuss.elastic.co/t/is-there-a-graphical-interface-for-logstash/263024)

<div class="topic-metadata">

**Author:** [@SUMANT\_MISHRA](https://discuss.elastic.co/u/SUMANT_MISHRA)\
**Replies:** 2\
**Last updated:** [February 4, 2021, 3:27am UTC](https://discuss.elastic.co/t/is-there-a-graphical-interface-for-logstash/263024 "2021-02-04T03:27:11Z")

</div>

Is there a graphical interface for Logstash? If no, can I get a documentation for highly scalable setup for logstash? As I read another post, it was somewhere down the line in 2015. I am not able to get a full-proof s…

---

## [\[Filebeat\] Azure Module - Additional Azure AD Log Sources](https://discuss.elastic.co/t/filebeat-azure-module-additional-azure-ad-log-sources/262026)

<div class="topic-metadata">

**Author:** [@Matthew\_Lubbers](https://discuss.elastic.co/u/Matthew_Lubbers)\
**Replies:** 5\
**Last updated:** [February 4, 2021, 3:22am UTC](https://discuss.elastic.co/t/filebeat-azure-module-additional-azure-ad-log-sources/262026 "2021-02-04T03:22:03Z")

</div>

Recently Microsoft Azure has added 4 new Azure AD log sources to be consumed by Azure Monitor Diagnostic Settings. When would be able to receive support for these new log sources for the Azure module? New Log Sources N…

---

## [S\_s\_l\_handshake\_exception error](https://discuss.elastic.co/t/s-s-l-handshake-exception-error/263041)

<div class="topic-metadata">

**Author:** [@edster](https://discuss.elastic.co/u/edster)\
**Replies:** 2\
**Last updated:** [February 4, 2021, 2:42am UTC](https://discuss.elastic.co/t/s-s-l-handshake-exception-error/263041 "2021-02-04T02:42:57Z")

</div>

I am getting the following error { "error" : { "root\_cause" : \[ { "type" : "s\_s\_l\_handshake\_exception", "reason" : "Received fatal alert: handshake\_failure" } \], "type" : "s\_s\_l\_handshake\_exception", "reason" …

---

## [Elasticsearch get rid of yellow status](https://discuss.elastic.co/t/elasticsearch-get-rid-of-yellow-status/261141)

<div class="topic-metadata">

**Author:** [@first100](https://discuss.elastic.co/u/first100)\
**Replies:** 6\
**Last updated:** [February 4, 2021, 2:20am UTC](https://discuss.elastic.co/t/elasticsearch-get-rid-of-yellow-status/261141 "2021-02-04T02:20:00Z")

</div>

Hi I have Elasticsearch that I installed as a single node at the beginning and then the indices were created this configuration, after I added two other nodes and restarted elastic, and I always have the health status y…

---

## [Updating index analyzer with html char strip filter - blocking?](https://discuss.elastic.co/t/updating-index-analyzer-with-html-char-strip-filter-blocking/263182)

<div class="topic-metadata">

**Author:** [@barry2](https://discuss.elastic.co/u/barry2)\
**Replies:** 0\
**Last updated:** [February 4, 2021, 12:03am UTC](https://discuss.elastic.co/t/updating-index-analyzer-with-html-char-strip-filter-blocking/263182 "2021-02-04T00:03:08Z")

</div>

Hello, I have an index with around 11,000,000 documents in it. I need to update the index analyzer to include a html strip character filter. I know I have to close the index first, apply the new analyzer, then open the …

---

## [How to get a function beat (configured to listen to kinesis stream) to push data into Elasticsearch](https://discuss.elastic.co/t/how-to-get-a-function-beat-configured-to-listen-to-kinesis-stream-to-push-data-into-elasticsearch/263171)

<div class="topic-metadata">

**Author:** [@ryantomaselli](https://discuss.elastic.co/u/ryantomaselli)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 11:56pm UTC](https://discuss.elastic.co/t/how-to-get-a-function-beat-configured-to-listen-to-kinesis-stream-to-push-data-into-elasticsearch/263171 "2021-02-03T23:56:50Z")

</div>

Hi everyone... I'm wet behind the ears on the Elasticsearch product so bear with me. My goal is to stream data from AWS DynamoDB (via a AWS Kinesis stream) to my hosted Elasticsearch instance. I'm using the functionbea…

---

## [Kibana Search bar visualization plugin to dynamically retrieve any typed info from elasticsearch index pattern](https://discuss.elastic.co/t/kibana-search-bar-visualization-plugin-to-dynamically-retrieve-any-typed-info-from-elasticsearch-index-pattern/262996)

<div class="topic-metadata">

**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 11:58pm UTC](https://discuss.elastic.co/t/kibana-search-bar-visualization-plugin-to-dynamically-retrieve-any-typed-info-from-elasticsearch-index-pattern/262996 "2021-02-03T23:58:46Z")

</div>

Hi all, Basically i'm looking for the below feature in Kibana Visualizations. Search bar visualization plugin to dynamically retrieve any typed info from elasticsearch index pattern Currently we have a query bar which…

---

## [Get Month From Date/Time Field \[Painless\]](https://discuss.elastic.co/t/get-month-from-date-time-field-painless/262916)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 17\
**Last updated:** [February 3, 2021, 10:54pm UTC](https://discuss.elastic.co/t/get-month-from-date-time-field-painless/262916 "2021-02-03T22:54:57Z")

</div>

Hello Following this example When using doc\['timestamp'\].value.getMonth(); Getting an error \[Possible causing node crash, still monitoring\] doc\['timestamp'\].value.getMonthValue(); works as expected and returning mont…

---

## [Elastic Search Query for cross document reference counts](https://discuss.elastic.co/t/elastic-search-query-for-cross-document-reference-counts/263061)

<div class="topic-metadata">

**Author:** [@mobius](https://discuss.elastic.co/u/mobius)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 10:40pm UTC](https://discuss.elastic.co/t/elastic-search-query-for-cross-document-reference-counts/263061 "2021-02-03T22:40:12Z")

</div>

I have emails in the index which look like these: { "emailId" : 1, "to" : "a@example.com", "from" : "b@example.com", "subject" : "xyz subject" }, { "emailId" : 2, …

---

## [Filebeats not sending logs to Logstash to be viewed in stdout](https://discuss.elastic.co/t/filebeats-not-sending-logs-to-logstash-to-be-viewed-in-stdout/263051)

<div class="topic-metadata">

**Author:** [@Juunis](https://discuss.elastic.co/u/Juunis)\
**Replies:** 7\
**Last updated:** [February 3, 2021, 9:31pm UTC](https://discuss.elastic.co/t/filebeats-not-sending-logs-to-logstash-to-be-viewed-in-stdout/263051 "2021-02-03T21:31:48Z")

</div>

Hi guys I'm new to the Elastic stack and I'm currently trying to setup a quick and easy pipeline between Logstash and Filebeats where filebeat will send a test log file and logstash will display it on stdout. Currently n…

---

## [Elasticsearch query - Most recent log for each user, for field logtype='x'](https://discuss.elastic.co/t/elasticsearch-query-most-recent-log-for-each-user-for-field-logtype-x/263170)

<div class="topic-metadata">

**Author:** [@brennan](https://discuss.elastic.co/u/brennan)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 9:24pm UTC](https://discuss.elastic.co/t/elasticsearch-query-most-recent-log-for-each-user-for-field-logtype-x/263170 "2021-02-03T21:24:31Z")

</div>

I am trying to query elasticsearch to get the most recent log for all userIDs where we only include one log per user with field logtype='x' if logtype='x' then get 1 log per userID where the date of this log is the most…

---

## [Socket, REST, or WebSocket API into Elastic?](https://discuss.elastic.co/t/socket-rest-or-websocket-api-into-elastic/263167)

<div class="topic-metadata">

**Author:** [@kmiklas](https://discuss.elastic.co/u/kmiklas)\
**Replies:** 1\
**Last updated:** [February 3, 2021, 8:58pm UTC](https://discuss.elastic.co/t/socket-rest-or-websocket-api-into-elastic/263167 "2021-02-03T20:58:08Z")

</div>

Hello All, Is there a way to push logs/metrics directly into Elastic without FB and LS? Imagine a process where I have a metric called "Price" for a NASDAQ security. I want to push the {"ticker": "MSFT", "price", 250.6…

---

## [Microsoft Graph Security API integration](https://discuss.elastic.co/t/microsoft-graph-security-api-integration/263074)

<div class="topic-metadata">

**Author:** [@opiedrah](https://discuss.elastic.co/u/opiedrah)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 6:35am UTC](https://discuss.elastic.co/t/microsoft-graph-security-api-integration/263074 "2021-02-03T06:35:33Z")

</div>

Filebeat has an o365 module that connects to the Microsoft Management API. Does anyone if there are working or is there a connector available for the Microsoft Graph Security API Microsoft Graph Security API overview - …

---

## [App\_insights data configuration \[AZURE \]](https://discuss.elastic.co/t/app-insights-data-configuration-azure/263166)

<div class="topic-metadata">

**Author:** [@miki\_haiat](https://discuss.elastic.co/u/miki_haiat)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 8:22pm UTC](https://discuss.elastic.co/t/app-insights-data-configuration-azure/263166 "2021-02-03T20:22:42Z")

</div>

Im trying to configure and ingest data from azure to elastic cloud I generated an API key as the docs suggested and setup the metrics list as you can see below. I can see that Azure dashboards have been loaded successf…

---

## [Cant' import Machine Learning Anomaly Jobs - I have Enterprise Cloud Subscription](https://discuss.elastic.co/t/cant-import-machine-learning-anomaly-jobs-i-have-enterprise-cloud-subscription/261970)

<div class="topic-metadata">

**Author:** [@opiedrah](https://discuss.elastic.co/u/opiedrah)\
**Replies:** 7\
**Last updated:** [February 3, 2021, 7:41pm UTC](https://discuss.elastic.co/t/cant-import-machine-learning-anomaly-jobs-i-have-enterprise-cloud-subscription/261970 "2021-02-03T19:41:35Z")

</div>

Hi, We are an Elastic Cloud Enterprise customer. The machine learning jobs that are to be prebuilt are missing. I have a ML node assigned to the cluster, i can't find where to import them. Cluster is running 7.10…

---

## [Saved field "engines.time" is invalid for use with the "Date Histogram" aggregation. Please select a new field](https://discuss.elastic.co/t/saved-field-engines-time-is-invalid-for-use-with-the-date-histogram-aggregation-please-select-a-new-field/263160)

<div class="topic-metadata">

**Author:** [@Ankit4](https://discuss.elastic.co/u/Ankit4)\
**Replies:** 0\
**Last updated:** [February 3, 2021, 6:26pm UTC](https://discuss.elastic.co/t/saved-field-engines-time-is-invalid-for-use-with-the-date-histogram-aggregation-please-select-a-new-field/263160 "2021-02-03T18:26:42Z")

</div>

I am getting this error, while creating index pattern in kibana; Error: Saved field "engines.time" is invalid for use with the "Date Histogram" aggregation. Please select a new field. at FieldParamType.\_this.deseria…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1571)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1573)
