# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1704

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1705

---

## [Integer instead of Float](https://discuss.elastic.co/t/integer-instead-of-float/255025)

<div class="topic-metadata">

**Author:** [@M2M](https://discuss.elastic.co/u/M2M)\
**Replies:** 0\
**Last updated:** [November 11, 2020, 8:59am UTC](https://discuss.elastic.co/t/integer-instead-of-float/255025 "2020-11-11T08:59:53Z")

</div>

Hi I have problem when trying to display a value as float. kindly note that I can displayed properly in Discover but not the case for any type of visualisation for more details please refer to the below snapshots from…

---

## [AWS Elasticsearch](https://discuss.elastic.co/t/aws-elasticsearch/254544)

<div class="topic-metadata">

**Author:** [@alfredo.deluca](https://discuss.elastic.co/u/alfredo.deluca)\
**Replies:** 6\
**Last updated:** [November 11, 2020, 8:33am UTC](https://discuss.elastic.co/t/aws-elasticsearch/254544 "2020-11-11T08:33:40Z")

</div>

Hi all. is it possible with the ELK opendistro to send logs and metrics directly to Elasticsearch without Xpack? I implemented the above but filebeat of metricbeat complains about xpack so I am using the OSS version. …

---

## [Setting up TLS](https://discuss.elastic.co/t/setting-up-tls/254905)

<div class="topic-metadata">

**Author:** [@Craig2188](https://discuss.elastic.co/u/Craig2188)\
**Replies:** 2\
**Last updated:** [November 11, 2020, 7:36am UTC](https://discuss.elastic.co/t/setting-up-tls/254905 "2020-11-11T07:36:22Z")

</div>

Hi, I am trying to set up TLS encryption for accessing Kibana internally. I am trying to follow the following article: Setting up TLS on a cluster | Elasticsearch Reference \[7.9\] | Elastic On the first step in creatin…

---

## [Queries without fully qualified field names failing in the latest versions of Elasticsearch](https://discuss.elastic.co/t/queries-without-fully-qualified-field-names-failing-in-the-latest-versions-of-elasticsearch/254958)

<div class="topic-metadata">

**Author:** [@Bhargav\_Balu](https://discuss.elastic.co/u/Bhargav_Balu)\
**Replies:** 4\
**Last updated:** [November 11, 2020, 6:55am UTC](https://discuss.elastic.co/t/queries-without-fully-qualified-field-names-failing-in-the-latest-versions-of-elasticsearch/254958 "2020-11-11T06:55:30Z")

</div>

Hi, We are currently running Elasticsearch 1.4 and are trying to upgrade to the newer versions 7.x. As part of that effort, we noticed our queries are failing on the latest versions i.e 7.x if the fileds used in queries…

---

## [Delete the data in Elasticsearch index based on a date/timestamp column in that index using python](https://discuss.elastic.co/t/delete-the-data-in-elasticsearch-index-based-on-a-date-timestamp-column-in-that-index-using-python/254775)

<div class="topic-metadata">

**Author:** [@vidhyadhara](https://discuss.elastic.co/u/vidhyadhara)\
**Replies:** 4\
**Last updated:** [November 11, 2020, 6:42am UTC](https://discuss.elastic.co/t/delete-the-data-in-elasticsearch-index-based-on-a-date-timestamp-column-in-that-index-using-python/254775 "2020-11-11T06:42:35Z")

</div>

I have several indexes which has a column named "date" or "timestamp", I want to delete only the data from that index which older than certain days/weeks. I do not want to delete the entire index. In fact I want to do i…

---

## [What is the use of internal verison\_type now that one should use seq\_no and primary\_term for Optimistic Concurrency Control?](https://discuss.elastic.co/t/what-is-the-use-of-internal-verison-type-now-that-one-should-use-seq-no-and-primary-term-for-optimistic-concurrency-control/252061)

<div class="topic-metadata">

**Author:** [@Bhargav\_Balu](https://discuss.elastic.co/u/Bhargav_Balu)\
**Replies:** 1\
**Last updated:** [November 11, 2020, 6:29am UTC](https://discuss.elastic.co/t/what-is-the-use-of-internal-verison-type-now-that-one-should-use-seq-no-and-primary-term-for-optimistic-concurrency-control/252061 "2020-11-11T06:29:23Z")

</div>

Hi, Why is internal version type still supported here The latest versions doesn't support this way of concurrency control anymore and one should use seq\_no and primary\_term right?

---

## [Filebeat Cisco IOS problem](https://discuss.elastic.co/t/filebeat-cisco-ios-problem/254995)

<div class="topic-metadata">

**Author:** [@Fikrat\_Karimli](https://discuss.elastic.co/u/Fikrat_Karimli)\
**Replies:** 1\
**Last updated:** [November 11, 2020, 6:14am UTC](https://discuss.elastic.co/t/filebeat-cisco-ios-problem/254995 "2020-11-11T06:14:06Z")

</div>

Hi, We are having such trouble with Cisco IOS logs. We enabled cisco ios module but it has parsing error 2020-11-11T01:03:27.650Z DEBUG \[processors\] processing/processors.go:112 Fail to apply processor client{add\_local…

---

## [What should I do if the 'state' file is corrupted](https://discuss.elastic.co/t/what-should-i-do-if-the-state-file-is-corrupted/254999)

<div class="topic-metadata">

**Author:** [@cigarl](https://discuss.elastic.co/u/cigarl)\
**Replies:** 1\
**Last updated:** [November 11, 2020, 6:09am UTC](https://discuss.elastic.co/t/what-should-i-do-if-the-state-file-is-corrupted/254999 "2020-11-11T06:09:31Z")

</div>

When shard-data is corrupt, I can use 'reroute' or 'elasticSearch-shard' to restore the cluster, even if some data of the shard could be lost. But when the 'state' file is corrupted, the cluster cannot even be started. …

---

## [Nginx field disappeared after filebeat upgrade](https://discuss.elastic.co/t/nginx-field-disappeared-after-filebeat-upgrade/254774)

<div class="topic-metadata">

**Author:** [@yukpun](https://discuss.elastic.co/u/yukpun)\
**Replies:** 2\
**Last updated:** [November 11, 2020, 5:17am UTC](https://discuss.elastic.co/t/nginx-field-disappeared-after-filebeat-upgrade/254774 "2020-11-11T05:17:45Z")

</div>

Hi all. I upgraded Elastic Stack (Elasticsearch + Kibana + Filebeat) from 6.6 to 7.9.3 version. Previously I used to filter logs by nginx.access.host field. After upgrade - this field disappeared. And I don't see any n…

---

## [Functionbeat does not update documents with existing \_id](https://discuss.elastic.co/t/functionbeat-does-not-update-documents-with-existing-id/252901)

<div class="topic-metadata">

**Author:** [@amiPorat](https://discuss.elastic.co/u/amiPorat)\
**Replies:** 4\
**Last updated:** [November 11, 2020, 4:52am UTC](https://discuss.elastic.co/t/functionbeat-does-not-update-documents-with-existing-id/252901 "2020-11-11T04:52:44Z")

</div>

Hello, I am currently deploying Functionbeat configured to accept events from an SQS queue. The goal is to use a processor/ingest pipeline to extract and set \_id from fields in the incoming messages. Documents with exis…

---

## [Limit of total fields \[1000\] exceeded](https://discuss.elastic.co/t/limit-of-total-fields-1000-exceeded/254747)

<div class="topic-metadata">

**Author:** [@ahmedbrandver](https://discuss.elastic.co/u/ahmedbrandver)\
**Replies:** 17\
**Last updated:** [November 11, 2020, 4:26am UTC](https://discuss.elastic.co/t/limit-of-total-fields-1000-exceeded/254747 "2020-11-11T04:26:36Z")

</div>

I am getting Limit of total fields \[1000\] in index \[products\] has been exceeded. Although total number of properties that is added dynamically is 499. Every where I search is asking me to increase total\_fields length sin…

---

## [Regex question on dsl](https://discuss.elastic.co/t/regex-question-on-dsl/254998)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 1\
**Last updated:** [November 11, 2020, 3:23am UTC](https://discuss.elastic.co/t/regex-question-on-dsl/254998 "2020-11-11T03:23:45Z")

</div>

Hi all The regex on the search api have some limitation that i need to overcome somehow so please help me. i would like to search for something like this: test123.test\[.\]com something.test\[.\]com now the regex that i…

---

## [Visualization TSVB Error message: The request for this panel failed Cannot cast from \[boolean\] to \[java.lang.Number\]](https://discuss.elastic.co/t/visualization-tsvb-error-message-the-request-for-this-panel-failed-cannot-cast-from-boolean-to-java-lang-number/254869)

<div class="topic-metadata">

**Author:** [@111207](https://discuss.elastic.co/u/111207)\
**Replies:** 2\
**Last updated:** [November 11, 2020, 2:37am UTC](https://discuss.elastic.co/t/visualization-tsvb-error-message-the-request-for-this-panel-failed-cannot-cast-from-boolean-to-java-lang-number/254869 "2020-11-11T02:37:22Z")

</div>

I have create the visualization type TSVB on elasticsearch version 7.5.2 I need to Unique Count of Serail ID of sum value Duration \< 1 But error message "The request for this panel failed Cannot cast from \[boolean\] t…

---

## [Save queries elsewhere besides inside Python app](https://discuss.elastic.co/t/save-queries-elsewhere-besides-inside-python-app/254965)

<div class="topic-metadata">

**Author:** [@ErikvdVen](https://discuss.elastic.co/u/ErikvdVen)\
**Replies:** 2\
**Last updated:** [November 10, 2020, 11:55pm UTC](https://discuss.elastic.co/t/save-queries-elsewhere-besides-inside-python-app/254965 "2020-11-10T23:55:13Z")

</div>

We use Elasticsearch queries inside our Python application, which are quite big. For now we saved them as JSON files, to keep the code a bit clean. But I was wondering if anyone knows a better solution? I guess it would…

---

## [Should filebeat's cisco module export ecs fields when outputting to non-elasticsearch](https://discuss.elastic.co/t/should-filebeats-cisco-module-export-ecs-fields-when-outputting-to-non-elasticsearch/254801)

<div class="topic-metadata">

**Author:** [@justinainsworth](https://discuss.elastic.co/u/justinainsworth)\
**Replies:** 4\
**Last updated:** [November 10, 2020, 11:42pm UTC](https://discuss.elastic.co/t/should-filebeats-cisco-module-export-ecs-fields-when-outputting-to-non-elasticsearch/254801 "2020-11-10T23:42:55Z")

</div>

I'm new to filebeat, and I am trying to understand what data it should be exporting when sending to logstash. I have setup filebeat to read cisco asa log files, and output to logstash. I guess I expected it to parse mo…

---

## [How to re-index Elasticsearch without stale reads?](https://discuss.elastic.co/t/how-to-re-index-elasticsearch-without-stale-reads/254860)

<div class="topic-metadata">

**Author:** [@Callonski](https://discuss.elastic.co/u/Callonski)\
**Replies:** 1\
**Last updated:** [November 10, 2020, 11:40pm UTC](https://discuss.elastic.co/t/how-to-re-index-elasticsearch-without-stale-reads/254860 "2020-11-10T23:40:22Z")

</div>

I have indices with heavy read/write operations. My indices have a read and a write alias. When I need to update the mapping in my indices I go about this process: create a new index with the new mapping, add write-ali…

---

## [Sending instance ID in watcher alert](https://discuss.elastic.co/t/sending-instance-id-in-watcher-alert/254903)

<div class="topic-metadata">

**Author:** [@Agneb](https://discuss.elastic.co/u/Agneb)\
**Replies:** 0\
**Last updated:** [November 10, 2020, 12:20pm UTC](https://discuss.elastic.co/t/sending-instance-id-in-watcher-alert/254903 "2020-11-10T12:20:41Z")

</div>

Hi , i would like to create an alert using json , which sends the cloud.instance.id with the high CPU in the mail { "trigger": { "schedule": { "interval": "1m" } }, "input": { "search": { "request": { "body": { …

---

## [Use template for webhook action in Watcher](https://discuss.elastic.co/t/use-template-for-webhook-action-in-watcher/254966)

<div class="topic-metadata">

**Author:** [@Ofir\_Edi](https://discuss.elastic.co/u/Ofir_Edi)\
**Replies:** 0\
**Last updated:** [November 10, 2020, 7:31pm UTC](https://discuss.elastic.co/t/use-template-for-webhook-action-in-watcher/254966 "2020-11-10T19:31:03Z")

</div>

Hi, we have multiple watchers (different inputs and conditions) that are doing the exactly same webhook action. Is there a way to create/store action (like the \_scripts or \_templates api) and refer to it in the watcher…

---

## [Load LimeSurvey results in ELK for analysis](https://discuss.elastic.co/t/load-limesurvey-results-in-elk-for-analysis/254971)

<div class="topic-metadata">

**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\
**Replies:** 1\
**Last updated:** [November 10, 2020, 11:32pm UTC](https://discuss.elastic.co/t/load-limesurvey-results-in-elk-for-analysis/254971 "2020-11-10T23:32:39Z")

</div>

Does anyone knows of a Beat product that would allow to load in realtime LimeSurvey results in ELK for analysis and Dashboard in Kibana? Or maybe there is something even more efficient? Thanks.

---

## [ELK stack 5.4 to 6.6 Upgrade](https://discuss.elastic.co/t/elk-stack-5-4-to-6-6-upgrade/254580)

<div class="topic-metadata">

**Author:** [@Bader](https://discuss.elastic.co/u/Bader)\
**Replies:** 6\
**Last updated:** [November 10, 2020, 11:29pm UTC](https://discuss.elastic.co/t/elk-stack-5-4-to-6-6-upgrade/254580 "2020-11-10T23:29:15Z")

</div>

Hello! I am looking to upgrade a single-node ELK stack cluster running version 5.4.0 to 6.6.0 on RHEL 7.6. I have read through the ELK documentation and have found that a "rolling upgrade" is the way to go. I do have a…

---

## [Functionbeat - kinesis seems not ingesting data stream](https://discuss.elastic.co/t/functionbeat-kinesis-seems-not-ingesting-data-stream/254921)

<div class="topic-metadata">

**Author:** [@hyochang](https://discuss.elastic.co/u/hyochang)\
**Replies:** 2\
**Last updated:** [November 10, 2020, 11:21pm UTC](https://discuss.elastic.co/t/functionbeat-kinesis-seems-not-ingesting-data-stream/254921 "2020-11-10T23:21:31Z")

</div>

Hi With functionbeat-kinesis, I have been trying to steam AWS Kinese Data stream to my locally deployed Elastic. All set-up seems okay. the functionbeat lambda deployed and I don't see any error from the functionbeat l…

---

## [Ignoring certain values in average aggregation](https://discuss.elastic.co/t/ignoring-certain-values-in-average-aggregation/254820)

<div class="topic-metadata">

**Author:** [@jonVR](https://discuss.elastic.co/u/jonVR)\
**Replies:** 2\
**Last updated:** [November 10, 2020, 10:57pm UTC](https://discuss.elastic.co/t/ignoring-certain-values-in-average-aggregation/254820 "2020-11-10T22:57:47Z")

</div>

I'm in the Visualize section of Kibana, and I'm trying to create a Metric that is an average. However, I want the calculation of the average to ignore values under 15 (or actually, under 900, but the point is I want to i…

---

## [Few questions as I take over from an external Dev](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705)

<div class="topic-metadata">

**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\
**Replies:** 5\
**Last updated:** [November 10, 2020, 10:49pm UTC](https://discuss.elastic.co/t/few-questions-as-i-take-over-from-an-external-dev/254705 "2020-11-10T22:49:13Z")

</div>

Hey all, I'm starting to transition our ES from our external dev to myself. I'm no developer, but can generally learn most things. I have a few questions just to stat getting my head around things. Our current mappi…

---

## [Templates matching specific date patterns](https://discuss.elastic.co/t/templates-matching-specific-date-patterns/254972)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 1\
**Last updated:** [November 10, 2020, 10:48pm UTC](https://discuss.elastic.co/t/templates-matching-specific-date-patterns/254972 "2020-11-10T22:48:50Z")

</div>

I have day-wise indices that are named like prefix-yyyy-mm-dd e.g myindex-2020-10-01, myindex-2020-10-02 and so on. I want to re-index them into monthly indices named prefix-yyyy-mm e.g. myindex-2020-10, myindex-2020-09 …

---

## [Rollup job unable to start](https://discuss.elastic.co/t/rollup-job-unable-to-start/254266)

<div class="topic-metadata">

**Author:** [@kaijun](https://discuss.elastic.co/u/kaijun)\
**Replies:** 9\
**Last updated:** [November 10, 2020, 10:46pm UTC](https://discuss.elastic.co/t/rollup-job-unable-to-start/254266 "2020-11-10T22:46:29Z")

</div>

I've created a new rollup job using the PUT \_rollup/job/\<job\_id\> api. I received an acknowledged response and the new rollup index is created. However, when I try to start the job using POST \_rollup/job/\<job\_id\>/\_start, …

---

## [List of Elasticsearch error states when at a RED state](https://discuss.elastic.co/t/list-of-elasticsearch-error-states-when-at-a-red-state/254985)

<div class="topic-metadata">

**Author:** [@21908](https://discuss.elastic.co/u/21908)\
**Replies:** 0\
**Last updated:** [November 10, 2020, 10:33pm UTC](https://discuss.elastic.co/t/list-of-elasticsearch-error-states-when-at-a-red-state/254985 "2020-11-10T22:33:06Z")

</div>

I’m interested in getting a list of states/reasons on why an Elasticsearch cluster would be in the RED state. Is there a full list somewhere within the Elasticsearch documentation? I would then like to take this a step…

---

## [How to delete bunch of documents by list of ids](https://discuss.elastic.co/t/how-to-delete-bunch-of-documents-by-list-of-ids/254511)

<div class="topic-metadata">

**Author:** [@Alex12](https://discuss.elastic.co/u/Alex12)\
**Replies:** 6\
**Last updated:** [November 6, 2020, 12:33pm UTC](https://discuss.elastic.co/t/how-to-delete-bunch-of-documents-by-list-of-ids/254511 "2020-11-06T12:33:33Z")

</div>

Is it possible to delete list of documents by list of documents id? i tryed like this but it does not work at all deleteAllByIdIn(List\<UUID\> ids); from ElasticsearchRepository and it does not work at all please guid me…

---

## [Statistical Mode, on visualizations?](https://discuss.elastic.co/t/statistical-mode-on-visualizations/254970)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 3\
**Last updated:** [November 10, 2020, 9:42pm UTC](https://discuss.elastic.co/t/statistical-mode-on-visualizations/254970 "2020-11-10T21:42:29Z")

</div>

Hi, is there any vizualization on wich you can display the mode of the data? the definition of mode: The mode is the value that appears most often in a set of data values.

---

## [Updating elasticsearch entities with bulk](https://discuss.elastic.co/t/updating-elasticsearch-entities-with-bulk/254936)

<div class="topic-metadata">

**Author:** [@Alex12](https://discuss.elastic.co/u/Alex12)\
**Replies:** 0\
**Last updated:** [November 10, 2020, 3:30pm UTC](https://discuss.elastic.co/t/updating-elasticsearch-entities-with-bulk/254936 "2020-11-10T15:30:12Z")

</div>

I have this database data as below (ES 7.xx) version { "id":"1234", "expirationDate":"17343234234", "paths":"http:localhost:9090", "work":"software dev", "family":{ "baba":"jams", "mother"…

---

## [How to access nested docs in scripted\_metric after nested aggregation](https://discuss.elastic.co/t/how-to-access-nested-docs-in-scripted-metric-after-nested-aggregation/254947)

<div class="topic-metadata">

**Author:** [@drewblin](https://discuss.elastic.co/u/drewblin)\
**Replies:** 1\
**Last updated:** [November 10, 2020, 8:53pm UTC](https://discuss.elastic.co/t/how-to-access-nested-docs-in-scripted-metric-after-nested-aggregation/254947 "2020-11-10T20:53:55Z")

</div>

How can i access nested docs in scripted\_metric after nested aggregation? I make request { "query": { "match\_all": {} }, "aggs": { "q1": { "nested": { "path": "pp" }, "aggs": { "q2": { "scripted…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1703)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1705)
