# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1848

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1849

---

## [Datafeed has missed documents due to ingest latency error](https://discuss.elastic.co/t/datafeed-has-missed-documents-due-to-ingest-latency-error/246016)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 4\
**Last updated:** [August 24, 2020, 2:42pm UTC](https://discuss.elastic.co/t/datafeed-has-missed-documents-due-to-ingest-latency-error/246016 "2020-08-24T14:42:33Z")

</div>

Hello, I have many of these in the Job Management \> Job Messages tab, and I'm looking for a way to check it. first of all, the dates don't make since, but I guess it's a timezone bug in Kibana (first column's date is…

---

## [\[Ingest Pipeline\] \[Performance\] Filebeat Cisco module ingest performance](https://discuss.elastic.co/t/ingest-pipeline-performance-filebeat-cisco-module-ingest-performance/246133)

<div class="topic-metadata">

**Author:** [@pcosic](https://discuss.elastic.co/u/pcosic)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 2:13pm UTC](https://discuss.elastic.co/t/ingest-pipeline-performance-filebeat-cisco-module-ingest-performance/246133 "2020-08-24T14:13:52Z")

</div>

Hi, I recently tried the Filebeat Cisco module. I tested the module with a 3 Node cluster where all nodes are: dilmrt There is no other data ingested in the Cluster except Filebeat Cisco Asa log syslogs. Every node h…

---

## [Logstash and Grok filter problem with username](https://discuss.elastic.co/t/logstash-and-grok-filter-problem-with-username/246130)

<div class="topic-metadata">

**Author:** [@mcoa](https://discuss.elastic.co/u/mcoa)\
**Replies:** 1\
**Last updated:** [August 24, 2020, 2:16pm UTC](https://discuss.elastic.co/t/logstash-and-grok-filter-problem-with-username/246130 "2020-08-24T14:16:30Z")

</div>

Hi, I try parser apache (access\_log) log but i've problem with username section (not capture the complete name), log example: 10.13.252.185 - - \[23/Aug/2020:23:56:14 -0400\] "PROPFIND /remote.php/dav/files/JF009-01/PAP…

---

## [Logstash to Elasticsearch](https://discuss.elastic.co/t/logstash-to-elasticsearch/246034)

<div class="topic-metadata">

**Author:** [@headtea](https://discuss.elastic.co/u/headtea)\
**Replies:** 3\
**Last updated:** [August 24, 2020, 2:12pm UTC](https://discuss.elastic.co/t/logstash-to-elasticsearch/246034 "2020-08-24T14:12:43Z")

</div>

I'm trying to send data from logstash to ES and I get an error. I can't make much sense of it. This is my logstash output: output{ elasticsearch { hosts =\> \["https://localhost:9200"\] cacert =\> "/etc/elasticsearch/http.c…

---

## [Confused about ignore\_above and how to update](https://discuss.elastic.co/t/confused-about-ignore-above-and-how-to-update/245962)

<div class="topic-metadata">

**Author:** [@gswartz](https://discuss.elastic.co/u/gswartz)\
**Replies:** 2\
**Last updated:** [August 24, 2020, 2:12pm UTC](https://discuss.elastic.co/t/confused-about-ignore-above-and-how-to-update/245962 "2020-08-24T14:12:30Z")

</div>

I have an index that I created simply by importing a bunch of docs, so elasticsearch created all the mappings by default. One of the fields is a potentially large text field that we need the whole thing to be keyword se…

---

## [Enable Kerberos realm in Elastic docker container for Kibana authentication](https://discuss.elastic.co/t/enable-kerberos-realm-in-elastic-docker-container-for-kibana-authentication/245924)

<div class="topic-metadata">

**Author:** [@Michal\_Stefanec](https://discuss.elastic.co/u/Michal_Stefanec)\
**Replies:** 7\
**Last updated:** [August 24, 2020, 2:01pm UTC](https://discuss.elastic.co/t/enable-kerberos-realm-in-elastic-docker-container-for-kibana-authentication/245924 "2020-08-24T14:01:30Z")

</div>

Hello, we have ELK stack (7.8.0) deployed on our on-premise server. We user docker-compose deployment and currently we are using Trial license. We would like to authenticate domain users when logging in Kibana. Kerbero…

---

## [Logstash can't send to elastic higher 3500 rps on one node](https://discuss.elastic.co/t/logstash-cant-send-to-elastic-higher-3500-rps-on-one-node/246126)

<div class="topic-metadata">

**Author:** [@karvet](https://discuss.elastic.co/u/karvet)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 1:38pm UTC](https://discuss.elastic.co/t/logstash-cant-send-to-elastic-higher-3500-rps-on-one-node/246126 "2020-08-24T13:38:19Z")

</div>

Hi i tested ELK stack to use in our enviroment. I send about 5k and more for one logstash node but always saw in Kibana about 3000-3500 reqest. All node is Ubuntu Os 18.04 used 1.9 version of ELK stack. When i used 4 no…

---

## [Kibana 6.8.3 doesn't show numbers](https://discuss.elastic.co/t/kibana-6-8-3-doesnt-show-numbers/246082)

<div class="topic-metadata">

**Author:** [@111382](https://discuss.elastic.co/u/111382)\
**Replies:** 6\
**Last updated:** [August 24, 2020, 1:12pm UTC](https://discuss.elastic.co/t/kibana-6-8-3-doesnt-show-numbers/246082 "2020-08-24T13:12:59Z")

</div>

Hi! I tried to create a simple visualization: one number value in date histogram. Values actually are in docs, but I receive only zeros on the graph and I can't fix it. Please help. I thought the mistake is in wr…

---

## [ML model lifecycle](https://discuss.elastic.co/t/ml-model-lifecycle/246062)

<div class="topic-metadata">

**Author:** [@saraKM](https://discuss.elastic.co/u/saraKM)\
**Replies:** 1\
**Last updated:** [August 24, 2020, 12:56pm UTC](https://discuss.elastic.co/t/ml-model-lifecycle/246062 "2020-08-24T12:56:31Z")

</div>

Hi, If I have a job with both partition\_by and by\_field names defined, does that mean we have models created for all combinations of values for these two fields? How these models are managed (do we keep all of them or g…

---

## [Collection terminated exception for min aggregation when field is not present in the documents](https://discuss.elastic.co/t/collection-terminated-exception-for-min-aggregation-when-field-is-not-present-in-the-documents/246111)

<div class="topic-metadata">

**Author:** [@ahmadimt07](https://discuss.elastic.co/u/ahmadimt07)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 12:04pm UTC](https://discuss.elastic.co/t/collection-terminated-exception-for-min-aggregation-when-field-is-not-present-in-the-documents/246111 "2020-08-24T12:04:23Z")

</div>

I am getting collection\_terminated\_exception when running nested min aggregation. However, max, avg, and sum are returning empty buckets. This is happening when the field we are doing aggregation is not present in any of…

---

## [Kibana prone to CSRF Attack](https://discuss.elastic.co/t/kibana-prone-to-csrf-attack/245873)

<div class="topic-metadata">

**Author:** [@robinhood\_lko](https://discuss.elastic.co/u/robinhood_lko)\
**Replies:** 3\
**Last updated:** [August 24, 2020, 12:19pm UTC](https://discuss.elastic.co/t/kibana-prone-to-csrf-attack/245873 "2020-08-24T12:19:53Z")

</div>

Dear Team, Security team has raised a flag that Kibana is prone to CSRF attack . We have deployed latest version of ECK Components. Please can you guide me if there is any settings which can help to fix this. ECK 1.1.2 …

---

## [How to rewrite this groovy script into painless script ? Facing a lot of issues](https://discuss.elastic.co/t/how-to-rewrite-this-groovy-script-into-painless-script-facing-a-lot-of-issues/246110)

<div class="topic-metadata">

**Author:** [@prasad98](https://discuss.elastic.co/u/prasad98)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 11:52am UTC](https://discuss.elastic.co/t/how-to-rewrite-this-groovy-script-into-painless-script-facing-a-lot-of-issues/246110 "2020-08-24T11:52:15Z")

</div>

My ES document model is as follows "hits": \[ { "\_source": { "variant\_group": { "variant\_info": \[ { "name": …

---

## [Elasticsearch upgrade Snapshot in cluster nodes](https://discuss.elastic.co/t/elasticsearch-upgrade-snapshot-in-cluster-nodes/245532)

<div class="topic-metadata">

**Author:** [@katara](https://discuss.elastic.co/u/katara)\
**Replies:** 4\
**Last updated:** [August 24, 2020, 11:17am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-snapshot-in-cluster-nodes/245532 "2020-08-24T11:17:42Z")

</div>

Hi Team, I am trying to upgrade my 7.2 ES cluster to 7.7.1. I have a few questions on the snapshot process. I have a 6 node cluster - 3 Master and 3 Data Nodes. 1. How should i take snapshots? Should i create a repo…

---

## [Can we achieve TreeMap like functionality using canvas](https://discuss.elastic.co/t/can-we-achieve-treemap-like-functionality-using-canvas/245850)

<div class="topic-metadata">

**Author:** [@adityaPsl](https://discuss.elastic.co/u/adityaPsl)\
**Replies:** 3\
**Last updated:** [August 24, 2020, 11:06am UTC](https://discuss.elastic.co/t/can-we-achieve-treemap-like-functionality-using-canvas/245850 "2020-08-24T11:06:52Z")

</div>

Hello Team, Could you please help me understand if treemap is possible using Vega or Canvas ref: Thank you, Aditya

---

## [How to add a plugin to ELK in a docker-compose file?](https://discuss.elastic.co/t/how-to-add-a-plugin-to-elk-in-a-docker-compose-file/246091)

<div class="topic-metadata">

**Author:** [@nb03briceno](https://discuss.elastic.co/u/nb03briceno)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 10:17am UTC](https://discuss.elastic.co/t/how-to-add-a-plugin-to-elk-in-a-docker-compose-file/246091 "2020-08-24T10:17:16Z")

</div>

Hello everyone, i have an important question. If I would like to add a logstash plugin to my docker-compose file, how I could do it? This is the section of logstash I have in my docker-compose (it's not working because…

---

## [Logstash script for both insert and update](https://discuss.elastic.co/t/logstash-script-for-both-insert-and-update/246088)

<div class="topic-metadata">

**Author:** [@Vamshi3](https://discuss.elastic.co/u/Vamshi3)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 10:11am UTC](https://discuss.elastic.co/t/logstash-script-for-both-insert-and-update/246088 "2020-08-24T10:11:36Z")

</div>

Newbie with Elastic Stack I have an oracle database table where rows gets inserted daily at 12 AM and later on those column values will get updated if there is any change in their values. I tried with doc\_as\_upsert but…

---

## [Canvas display current date](https://discuss.elastic.co/t/canvas-display-current-date/246068)

<div class="topic-metadata">

**Author:** [@probson](https://discuss.elastic.co/u/probson)\
**Replies:** 4\
**Last updated:** [August 24, 2020, 10:08am UTC](https://discuss.elastic.co/t/canvas-display-current-date/246068 "2020-08-24T10:08:58Z")

</div>

Hi, I am looking to put the current date in to canvas for our reports, any ideas how i could do this? Thanks

---

## [Elastic 401 error after upgrading to version 7.5.1](https://discuss.elastic.co/t/elastic-401-error-after-upgrading-to-version-7-5-1/242762)

<div class="topic-metadata">

**Author:** [@Aadil](https://discuss.elastic.co/u/Aadil)\
**Replies:** 1\
**Last updated:** [August 24, 2020, 9:54am UTC](https://discuss.elastic.co/t/elastic-401-error-after-upgrading-to-version-7-5-1/242762 "2020-08-24T09:54:51Z")

</div>

Hi Team, i am new to this system, I had upgraded from version 6.3.2 to version 7.5.1 and now i get the below error on all 3 nodes: {"error":{"root\_cause":\[{"type":"security\_exception","reason":"missing authentication cr…

---

## [Do I get help for trial license](https://discuss.elastic.co/t/do-i-get-help-for-trial-license/245861)

<div class="topic-metadata">

**Author:** [@bharat1](https://discuss.elastic.co/u/bharat1)\
**Replies:** 1\
**Last updated:** [August 24, 2020, 9:19am UTC](https://discuss.elastic.co/t/do-i-get-help-for-trial-license/245861 "2020-08-24T09:19:44Z")

</div>

Have a clarification, Do I get help to fix the issues from support team for my trial license if I got stuck?

---

## [Logstash configuration input error with if statement](https://discuss.elastic.co/t/logstash-configuration-input-error-with-if-statement/246019)

<div class="topic-metadata">

**Author:** [@anon56147639](https://discuss.elastic.co/u/anon56147639)\
**Replies:** 10\
**Last updated:** [August 24, 2020, 9:11am UTC](https://discuss.elastic.co/t/logstash-configuration-input-error-with-if-statement/246019 "2020-08-24T09:11:25Z")

</div>

Hi everyone, I'm trying to create a pipeline in logstash which receives CEF events and other input from Filebeat. Since not all input is in CEF format, I created an IF-statement. My logstash.conf looks like this: b…

---

## [Send data to logstash from filebeat using HTTP/HTTPS](https://discuss.elastic.co/t/send-data-to-logstash-from-filebeat-using-http-https/246078)

<div class="topic-metadata">

**Author:** [@aaleman](https://discuss.elastic.co/u/aaleman)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 9:07am UTC](https://discuss.elastic.co/t/send-data-to-logstash-from-filebeat-using-http-https/246078 "2020-08-24T09:07:23Z")

</div>

Hello, Do you know how can I send my filebeat data to logstash through HTTP/HTTPS?¿ I think that beats are not compatible with this, is correct? I have: Filebeat machines outside my private cloud -- NGINX 80/443 loadba…

---

## [Sync data from mssql to elasticsearch](https://discuss.elastic.co/t/sync-data-from-mssql-to-elasticsearch/246074)

<div class="topic-metadata">

**Author:** [@Gagana\_C](https://discuss.elastic.co/u/Gagana_C)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 8:58am UTC](https://discuss.elastic.co/t/sync-data-from-mssql-to-elasticsearch/246074 "2020-08-24T08:58:54Z")

</div>

i have mssql database as source of truth, and people keep inserting or updating data into that, but i need to sync all that transaction by traction to elastic search, how can i do that. i tried using CDC and kafka to ge…

---

## [Filter by value on multiple events](https://discuss.elastic.co/t/filter-by-value-on-multiple-events/245907)

<div class="topic-metadata">

**Author:** [@Unkownfo](https://discuss.elastic.co/u/Unkownfo)\
**Replies:** 4\
**Last updated:** [August 24, 2020, 8:28am UTC](https://discuss.elastic.co/t/filter-by-value-on-multiple-events/245907 "2020-08-24T08:28:43Z")

</div>

Hi, I'm starting with Elastic Stack. My purpose is to handle log for many applications (stored in same index because i need to follow reference field across all applications), i got application in a json field as key/v…

---

## [org.elasticsearch.search.SearchHit](https://discuss.elastic.co/t/org-elasticsearch-search-searchhit/246069)

<div class="topic-metadata">

**Author:** [@Pete\_Watcharawit](https://discuss.elastic.co/u/Pete_Watcharawit)\
**Replies:** 0\
**Last updated:** [August 24, 2020, 7:51am UTC](https://discuss.elastic.co/t/org-elasticsearch-search-searchhit/246069 "2020-08-24T07:51:43Z")

</div>

From version 2.3.1, there is a method called isSourceEmpty() Is it compatible with 7.8.1 hasSource()? I bet they are very similar in terms of logic.

---

## [Timestamp disabled in Kibana Alert and Actions after 7.9.0 update](https://discuss.elastic.co/t/timestamp-disabled-in-kibana-alert-and-actions-after-7-9-0-update/245900)

<div class="topic-metadata">

**Author:** [@msszafar](https://discuss.elastic.co/u/msszafar)\
**Replies:** 3\
**Last updated:** [August 24, 2020, 7:43am UTC](https://discuss.elastic.co/t/timestamp-disabled-in-kibana-alert-and-actions-after-7-9-0-update/245900 "2020-08-24T07:43:30Z")

</div>

Hi, Elasticstack is latest 7.9.0. Before update, we were able to save timestamp when alert was getting triggered but now it's disable. we are unable to save timestamp in alert content being saved on index. Highlighte…

---

## [Kibana 7.8 can't start but Elastic 7.8 was running normally](https://discuss.elastic.co/t/kibana-7-8-cant-start-but-elastic-7-8-was-running-normally/245586)

<div class="topic-metadata">

**Author:** [@psanggabuana](https://discuss.elastic.co/u/psanggabuana)\
**Replies:** 2\
**Last updated:** [August 24, 2020, 7:34am UTC](https://discuss.elastic.co/t/kibana-7-8-cant-start-but-elastic-7-8-was-running-normally/245586 "2020-08-24T07:34:28Z")

</div>

I have issue which my Kibana 7.8 cant start. My Kibana connect to Elastic 7.8, elastic was running normally. The Elastic Output: { "name" : "DEVGRAFANA", "cluster\_name" : "elasticsearch", "cluster\_uuid" : "eQ8SrmsG…

---

## [How to implement pagination using java](https://discuss.elastic.co/t/how-to-implement-pagination-using-java/246018)

<div class="topic-metadata">

**Author:** [@abhishek\_chaturvedi](https://discuss.elastic.co/u/abhishek_chaturvedi)\
**Replies:** 4\
**Last updated:** [August 24, 2020, 6:59am UTC](https://discuss.elastic.co/t/how-to-implement-pagination-using-java/246018 "2020-08-24T06:59:32Z")

</div>

Hi All, Could someone guide me with some code snippet on writing pagination logic using ES java rest high level client api. Below is my service code: @Override public List getResponses(ZonedDateTime startDate, ZonedDa…

---

## [ElasticSearch C# Nested List Filter Not Working when i compare array using 7.5.1](https://discuss.elastic.co/t/elasticsearch-c-nested-list-filter-not-working-when-i-compare-array-using-7-5-1/246052)

<div class="topic-metadata">

**Author:** [@kotishwerreddy](https://discuss.elastic.co/u/kotishwerreddy)\
**Replies:** 3\
**Last updated:** [August 24, 2020, 6:46am UTC](https://discuss.elastic.co/t/elasticsearch-c-nested-list-filter-not-working-when-i-compare-array-using-7-5-1/246052 "2020-08-24T06:46:35Z")

</div>

Hello Every one, i'm using Elasticsearch 7.5.1 with .Net core 3.1, in that i'm want to search using country filters in the nested object (list detail object), but when i trying to filter i'm unable to filter returning…

---

## [Any way to sign requests to AWS elasticsearch using ASP.NET NEST?](https://discuss.elastic.co/t/any-way-to-sign-requests-to-aws-elasticsearch-using-asp-net-nest/245938)

<div class="topic-metadata">

**Author:** [@primico](https://discuss.elastic.co/u/primico)\
**Replies:** 2\
**Last updated:** [August 24, 2020, 5:30am UTC](https://discuss.elastic.co/t/any-way-to-sign-requests-to-aws-elasticsearch-using-asp-net-nest/245938 "2020-08-24T05:30:16Z")

</div>

For production we restrict access to AWS elasticsearch to only the web server IP, but for development where developers are in different locations with different IP's is there a way to sign the requests using ASP.NET NEST…

---

## [Kibana server is not ready yet with 503 status but the service is running](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-with-503-status-but-the-service-is-running/245897)

<div class="topic-metadata">

**Author:** [@BTH.S3](https://discuss.elastic.co/u/BTH.S3)\
**Replies:** 2\
**Last updated:** [August 24, 2020, 4:46am UTC](https://discuss.elastic.co/t/kibana-server-is-not-ready-yet-with-503-status-but-the-service-is-running/245897 "2020-08-24T04:46:18Z")

</div>

I've installed the products version 6.8.4 both Kibana and Elasticsearch on Ubuntu 18.04 on two nodes (Kibana only installed on 1 node). However when I start the Kibana server, the errors are produce as log below {"type"…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1847)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1849)
