# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1961

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1962

---

## [Kibana not showing any results in Discover with custom timestamp](https://discuss.elastic.co/t/kibana-not-showing-any-results-in-discover-with-custom-timestamp/239273)

<div class="topic-metadata">

**Author:** [@Terizian](https://discuss.elastic.co/u/Terizian)\
**Replies:** 4\
**Last updated:** [June 30, 2020, 3:57pm UTC](https://discuss.elastic.co/t/kibana-not-showing-any-results-in-discover-with-custom-timestamp/239273 "2020-06-30T15:57:32Z")

</div>

Version: 7.7.1 I've pushed some data into Elasticsearch using the Python client library. Here is the mapping for my data that I got by running GET rss-test/\_mapping in the Dev Tools Console: { "rss-test" : { …

---

## [Not able to access kibana UI hosted on aws](https://discuss.elastic.co/t/not-able-to-access-kibana-ui-hosted-on-aws/238956)

<div class="topic-metadata">

**Author:** [@pathri](https://discuss.elastic.co/u/pathri)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 3:39pm UTC](https://discuss.elastic.co/t/not-able-to-access-kibana-ui-hosted-on-aws/238956 "2020-06-30T15:39:20Z")

</div>

kibana is running on a server on AWS (ELK is also on the same server) but i am not able to access it on UI. It's public DNS : ec2-13-126-209-194.ap-south-1.compute.amazonaws.com private IP: 172.31.4.164 i am trying h…

---

## [Zlib::GzipFile::Error: not in gzip format with input file codec =\> "gzip\_lines"](https://discuss.elastic.co/t/zlib-not-in-gzip-format-with-input-file-codec-gzip-lines/239334)

<div class="topic-metadata">

**Author:** [@jdelouche](https://discuss.elastic.co/u/jdelouche)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 3:14pm UTC](https://discuss.elastic.co/t/zlib-not-in-gzip-format-with-input-file-codec-gzip-lines/239334 "2020-06-30T15:14:46Z")

</div>

Hi, I am not able to use the logstash-codec-gzip\_lines plugin because it tells me that .gz files are not in gzip format, but if I check the file I find no specific issue: gunzip -tv sl\_trace.trace.gz sl\_trace.trace.gz:…

---

## [Need Help on Logstash filter If-Else Condition](https://discuss.elastic.co/t/need-help-on-logstash-filter-if-else-condition/239333)

<div class="topic-metadata">

**Author:** [@Kim\_Mendoza](https://discuss.elastic.co/u/Kim_Mendoza)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 3:12pm UTC](https://discuss.elastic.co/t/need-help-on-logstash-filter-if-else-condition/239333 "2020-06-30T15:12:32Z")

</div>

Please check my Logstash filter config. I cannot find my error logs cannot transfer to elasticsearch. filter { if \[fields\]\[logtype\] == "access.log" { grok { match =\> \[ "message", "%{WORD:host} %{WORD:host}\[ "%{NOTSP…

---

## [Kibana 7.7.0 Custom Label not present](https://discuss.elastic.co/t/kibana-7-7-0-custom-label-not-present/233754)

<div class="topic-metadata">

**Author:** [@EsequiasNeto](https://discuss.elastic.co/u/EsequiasNeto)\
**Replies:** 6\
**Last updated:** [June 30, 2020, 2:58pm UTC](https://discuss.elastic.co/t/kibana-7-7-0-custom-label-not-present/233754 "2020-06-30T14:58:39Z")

</div>

When I use bucket metric I can't find the "Custom Label". It happens in all visualizations!

---

## [Kubernetes module](https://discuss.elastic.co/t/kubernetes-module/239329)

<div class="topic-metadata">

**Author:** [@wadhah](https://discuss.elastic.co/u/wadhah)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 2:53pm UTC](https://discuss.elastic.co/t/kubernetes-module/239329 "2020-06-30T14:53:01Z")

</div>

Hello, I hope you guys are doing well! I am running ELK stack on kubernetes, along with metricbeat. I am using Kubernetes module to get relevant data regarding the pods performance. Everything is working as expected. …

---

## [Configuration for ELK+filebeat with docker-compose](https://discuss.elastic.co/t/configuration-for-elk-filebeat-with-docker-compose/239239)

<div class="topic-metadata">

**Author:** [@Govinda8594](https://discuss.elastic.co/u/Govinda8594)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 7:28am UTC](https://discuss.elastic.co/t/configuration-for-elk-filebeat-with-docker-compose/239239 "2020-06-30T07:28:24Z")

</div>

Hello Team, i am new to ELK and i have problem with setting this configuration ,My filebeat.yml is taking input from docker log (with respective file path) and send this log to logstash for indexing based on log file but…

---

## [Unable to use painless script in group\_by term in transform](https://discuss.elastic.co/t/unable-to-use-painless-script-in-group-by-term-in-transform/239294)

<div class="topic-metadata">

**Author:** [@ayazahmed](https://discuss.elastic.co/u/ayazahmed)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 2:38pm UTC](https://discuss.elastic.co/t/unable-to-use-painless-script-in-group-by-term-in-transform/239294 "2020-06-30T14:38:07Z")

</div>

following the tutorial from https://www.elastic.co/guide/en/elasticsearch/reference/current/transform-painless-examples.html#painless-group-by POST \_transform/\_preview { "source": { "index": \[ "kibana\_sampl…

---

## [Measure for uncertainty of the Anomaly Detection algorihtm](https://discuss.elastic.co/t/measure-for-uncertainty-of-the-anomaly-detection-algorihtm/238662)

<div class="topic-metadata">

**Author:** [@JorritvdLaan](https://discuss.elastic.co/u/JorritvdLaan)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 2:37pm UTC](https://discuss.elastic.co/t/measure-for-uncertainty-of-the-anomaly-detection-algorihtm/238662 "2020-06-30T14:37:08Z")

</div>

Hello, We are trying to find anomalies in people's daily power usage using Elastic's Anomaly Detection. Of course, in order to detect a day-night cylce, the algorithm first needs some data before it can recognize patte…

---

## [Remove old index automatically](https://discuss.elastic.co/t/remove-old-index-automatically/239321)

<div class="topic-metadata">

**Author:** [@jgonzalez](https://discuss.elastic.co/u/jgonzalez)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:23pm UTC](https://discuss.elastic.co/t/remove-old-index-automatically/239321 "2020-06-30T14:23:49Z")

</div>

Hello All, I need to remove all the indexes older than 6 days automatically, I tried to create a lifecycle in Kibana but it didn't work fine, so i saw an option called Curator but for some reason, the curator can't fin…

---

## [ML job update](https://discuss.elastic.co/t/ml-job-update/239220)

<div class="topic-metadata">

**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 2:19pm UTC](https://discuss.elastic.co/t/ml-job-update/239220 "2020-06-30T14:19:25Z")

</div>

Hi Is there a way to update job id (or some other attribute which is not supported in \_update API) while keeping previous results/models for a long-running job? or a way to clone a job, but also including model/results? …

---

## [Why anomalies with score less than 1 are shown in the anomaly explorer?](https://discuss.elastic.co/t/why-anomalies-with-score-less-than-1-are-shown-in-the-anomaly-explorer/239241)

<div class="topic-metadata">

**Author:** [@ElasticLiver](https://discuss.elastic.co/u/ElasticLiver)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 2:16pm UTC](https://discuss.elastic.co/t/why-anomalies-with-score-less-than-1-are-shown-in-the-anomaly-explorer/239241 "2020-06-30T14:16:14Z")

</div>

Why anomalies with score less than 1 are shown in the anomaly explorer? what is their relevance?

---

## [Query for a new entry on a field](https://discuss.elastic.co/t/query-for-a-new-entry-on-a-field/239296)

<div class="topic-metadata">

**Author:** [@ginu](https://discuss.elastic.co/u/ginu)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 2:10pm UTC](https://discuss.elastic.co/t/query-for-a-new-entry-on-a-field/239296 "2020-06-30T14:10:28Z")

</div>

Hi I have an index which contains a field network\_device\_ID I want to alert whenever there a new entry coming into the Index. what is the best way to achieve this? Cheers, Ginu

---

## [ECK YAML examples for production-grade deployment](https://discuss.elastic.co/t/eck-yaml-examples-for-production-grade-deployment/238603)

<div class="topic-metadata">

**Author:** [@Nikhil\_Utane](https://discuss.elastic.co/u/Nikhil_Utane)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 12:12pm UTC](https://discuss.elastic.co/t/eck-yaml-examples-for-production-grade-deployment/238603 "2020-06-30T12:12:52Z")

</div>

Hello, I have an on-prem setup that I want to move to the cloud. I want to run it on Kubernetes for portability. I have selected AWS EKS (since I have credits). I am able to follow the ECK document and get basic nodes up…

---

## [ELK : logstash with 3 different beats inputs on different ports with 3 different indexes](https://discuss.elastic.co/t/elk-logstash-with-3-different-beats-inputs-on-different-ports-with-3-different-indexes/239318)

<div class="topic-metadata">

**Author:** [@olivierdrueuil](https://discuss.elastic.co/u/olivierdrueuil)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:50pm UTC](https://discuss.elastic.co/t/elk-logstash-with-3-different-beats-inputs-on-different-ports-with-3-different-indexes/239318 "2020-06-30T13:50:11Z")

</div>

hello I have setup an ELK with 3 beats configurations for 3 different services : httpd,mysql,ibm MQ \<\[root@elktest20 conf.d\]# pwd /etc/logstash/conf.d \[root@elktest20 conf.d\]# ls 02-beats-mysql.conf 03.beats-mq.c…

---

## [Sharing Dashboards Perma URL / Locked Parameters](https://discuss.elastic.co/t/sharing-dashboards-perma-url-locked-parameters/239317)

<div class="topic-metadata">

**Author:** [@Kalyse](https://discuss.elastic.co/u/Kalyse)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:39pm UTC](https://discuss.elastic.co/t/sharing-dashboards-perma-url-locked-parameters/239317 "2020-06-30T13:39:05Z")

</div>

My goal is to allow the creation of a dashboard, which can be embedded on to my users account, so that they can view only their data. What I was thinking was: Create a user which has access to a specific global\* index…

---

## [Logstash sending duplicate \_bulk requests without any apparent reason](https://discuss.elastic.co/t/logstash-sending-duplicate-bulk-requests-without-any-apparent-reason/239311)

<div class="topic-metadata">

**Author:** [@bartier](https://discuss.elastic.co/u/bartier)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:11pm UTC](https://discuss.elastic.co/t/logstash-sending-duplicate-bulk-requests-without-any-apparent-reason/239311 "2020-06-30T13:11:37Z")

</div>

Hello, Today we have a setup like this: kafka cluster --\> (4 instances) logstash 5.6.8 --\> elasticsearch cluster Logstash instances consumes multiple topics from kafka and send \_bulk requests to elasticsearch cluster,…

---

## [Reindex not copying every document that exists on the source index](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313)

<div class="topic-metadata">

**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:27pm UTC](https://discuss.elastic.co/t/reindex-not-copying-every-document-that-exists-on-the-source-index/239313 "2020-06-30T13:27:32Z")

</div>

I have around 20 indexes to reindex after some mapping changes but on any index that has a high number of documents e.g 500.000 the reindexing process stops abruptly and only a random number of document is reindexed. Le…

---

## [Is ILM ia available in basic subscription of elasticsearch 7.8?](https://discuss.elastic.co/t/is-ilm-ia-available-in-basic-subscription-of-elasticsearch-7-8/239304)

<div class="topic-metadata">

**Author:** [@gokulnath112](https://discuss.elastic.co/u/gokulnath112)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 1:26pm UTC](https://discuss.elastic.co/t/is-ilm-ia-available-in-basic-subscription-of-elasticsearch-7-8/239304 "2020-06-30T13:26:26Z")

</div>

Hi Friends...! Hope everyone doing good. Please let me know ILM is available for free in elasticsearch 7.8. Currently I'm using the elastic version of 7.2.1. I want to create index for every 3 months. But the thing is…

---

## [Datatable Visualization how to add average vales for two different time range](https://discuss.elastic.co/t/datatable-visualization-how-to-add-average-vales-for-two-different-time-range/239309)

<div class="topic-metadata">

**Author:** [@ulas\_yuksel](https://discuss.elastic.co/u/ulas_yuksel)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 1:09pm UTC](https://discuss.elastic.co/t/datatable-visualization-how-to-add-average-vales-for-two-different-time-range/239309 "2020-06-30T13:09:16Z")

</div>

Hi, I've sample application server log and I've created simple "Uri, Count,Average" Datatable visualization. I need additional column which gives X (defined as one of 15min, 1 week, etc depend on the requirement) minute…

---

## [Winlogbeat gives unathorized error when using keystore](https://discuss.elastic.co/t/winlogbeat-gives-unathorized-error-when-using-keystore/238891)

<div class="topic-metadata">

**Author:** [@kaushas](https://discuss.elastic.co/u/kaushas)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 1:00pm UTC](https://discuss.elastic.co/t/winlogbeat-gives-unathorized-error-when-using-keystore/238891 "2020-06-30T13:00:28Z")

</div>

When using winlogbeat Keystore for PWD, I get 401 unauthorized error. Just passing elastic password value itself in the config file works. I have looked at few of these issues raised by others already but none of the so…

---

## [Enabling Pagination using spring-data-elasticsearch](https://discuss.elastic.co/t/enabling-pagination-using-spring-data-elasticsearch/239267)

<div class="topic-metadata">

**Author:** [@Punj\_Shah](https://discuss.elastic.co/u/Punj_Shah)\
**Replies:** 3\
**Last updated:** [June 30, 2020, 12:57pm UTC](https://discuss.elastic.co/t/enabling-pagination-using-spring-data-elasticsearch/239267 "2020-06-30T12:57:49Z")

</div>

Hello! I've integrated Spring-elastic-data into Spring Boot Project to achieve the Pagination functionality in ES. Previously I was using query and response into List as below, SearchResponse searchResponse = client.s…

---

## [Custom logs not appearing in visualization](https://discuss.elastic.co/t/custom-logs-not-appearing-in-visualization/239118)

<div class="topic-metadata">

**Author:** [@TheNmaptomyHeartBeat](https://discuss.elastic.co/u/TheNmaptomyHeartBeat)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 12:56pm UTC](https://discuss.elastic.co/t/custom-logs-not-appearing-in-visualization/239118 "2020-06-30T12:56:43Z")

</div>

Hi all, I created custom logs in NGINX to log for http.response.time and http.response.upstream.time. I updated the grok filter on the NGINX module pipeline for Filebeat. I am receiving the data on the Filebeat-\* inde…

---

## [Beat for RDD files](https://discuss.elastic.co/t/beat-for-rdd-files/239299)

<div class="topic-metadata">

**Author:** [@anikajaninaelfie](https://discuss.elastic.co/u/anikajaninaelfie)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:42pm UTC](https://discuss.elastic.co/t/beat-for-rdd-files/239299 "2020-06-30T12:42:26Z")

</div>

Hello there! I want to read RDD Files and transfer them to Kibana. Unfortunately, Filebeat can't manage that. Is there any other solution than to develop a beat for that purpose. I fount this post from 2016: Any prog…

---

## [Obtaining a list of filtered document properties](https://discuss.elastic.co/t/obtaining-a-list-of-filtered-document-properties/238829)

<div class="topic-metadata">

**Author:** [@alcalin](https://discuss.elastic.co/u/alcalin)\
**Replies:** 5\
**Last updated:** [June 30, 2020, 9:02am UTC](https://discuss.elastic.co/t/obtaining-a-list-of-filtered-document-properties/238829 "2020-06-30T09:02:12Z")

</div>

Hello, I have the following index mappings: { "mappings": { "properties": { "library": { "type": "keyword" }, "books": { "properties": { …

---

## [Internal Server Error at Fetch.\_callee3$](https://discuss.elastic.co/t/internal-server-error-at-fetch-callee3/239298)

<div class="topic-metadata">

**Author:** [@Alvaro\_Sanz](https://discuss.elastic.co/u/Alvaro_Sanz)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:37pm UTC](https://discuss.elastic.co/t/internal-server-error-at-fetch-callee3/239298 "2020-06-30T12:37:06Z")

</div>

Hello, The following error keeps appearing and I dont know why it is happening. I am not cabable to find anything online that can help me with this issue: Error: Internal Server Error at Fetch.\_callee3$ (https://ki…

---

## [Remove 'field.keyword' from index](https://discuss.elastic.co/t/remove-field-keyword-from-index/239271)

<div class="topic-metadata">

**Author:** [@ajayraghuraj](https://discuss.elastic.co/u/ajayraghuraj)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 12:30pm UTC](https://discuss.elastic.co/t/remove-field-keyword-from-index/239271 "2020-06-30T12:30:26Z")

</div>

How do I remove 'field.keyword' from my index ? I should be able to see 'field' only here is my GET \_mapping output { "collectd-2020.06.29" : { "mappings" : { "doc" : { "properties" : { …

---

## [How to get unique count with a condition?](https://discuss.elastic.co/t/how-to-get-unique-count-with-a-condition/239168)

<div class="topic-metadata">

**Author:** [@Marcos\_Suarez](https://discuss.elastic.co/u/Marcos_Suarez)\
**Replies:** 2\
**Last updated:** [June 30, 2020, 12:15pm UTC](https://discuss.elastic.co/t/how-to-get-unique-count-with-a-condition/239168 "2020-06-30T12:15:16Z")

</div>

Hello, I am new in kibana and would like to know how can I do a unique count applying a condition? For example: Unique customers (customerid field) count where sales(sales field) are greater than $100 Can i create th…

---

## [Calculate increase in queue size](https://discuss.elastic.co/t/calculate-increase-in-queue-size/239291)

<div class="topic-metadata">

**Author:** [@spike83](https://discuss.elastic.co/u/spike83)\
**Replies:** 0\
**Last updated:** [June 30, 2020, 12:08pm UTC](https://discuss.elastic.co/t/calculate-increase-in-queue-size/239291 "2020-06-30T12:08:33Z")

</div>

Hi, Im monitoring activemq queue data, I would like to have a graph to show may many messages were enqueued since the last check. I can capture the enqueued number which will always be increasing , but is it possible t…

---

## [Winlogbeat not sending logs via logstash on port 5044](https://discuss.elastic.co/t/winlogbeat-not-sending-logs-via-logstash-on-port-5044/237327)

<div class="topic-metadata">

**Author:** [@proxx](https://discuss.elastic.co/u/proxx)\
**Replies:** 1\
**Last updated:** [June 30, 2020, 11:46am UTC](https://discuss.elastic.co/t/winlogbeat-not-sending-logs-via-logstash-on-port-5044/237327 "2020-06-30T11:46:56Z")

</div>

My Logstash is running on port 5044, however when i started my Winlogbeat service on my windows server, which it show running, checking my Kibana i couldn't find the indices to index Here is my Logstash result \[root@o…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1960)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1962)
