# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1166

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1167

---

## [Error "failed to update state in the registry"](https://discuss.elastic.co/t/error-failed-to-update-state-in-the-registry/289002)

<div class="topic-metadata">

**Author:** [@vladislav](https://discuss.elastic.co/u/vladislav)\
**Replies:** 1\
**Last updated:** [November 11, 2021, 5:21pm UTC](https://discuss.elastic.co/t/error-failed-to-update-state-in-the-registry/289002 "2021-11-11T17:21:52Z")

</div>

Hello! I have a strange error using httpjson-input plugin in filebeat. Everything works fine, I was getting data updates via cursor until now. Now in logs everytime request finished with \> 0 events published I get an er…

---

## [Missing authentication details for REST request](https://discuss.elastic.co/t/missing-authentication-details-for-rest-request/289000)

<div class="topic-metadata">

**Author:** [@Molly\_Fraser](https://discuss.elastic.co/u/Molly_Fraser)\
**Replies:** 1\
**Last updated:** [November 11, 2021, 5:09pm UTC](https://discuss.elastic.co/t/missing-authentication-details-for-rest-request/289000 "2021-11-11T17:09:31Z")

</div>

Hi all, I have been configuring minimal security of the Elastic Stack and unfortunately I am unable to run Kibana as it throws this error: log \[14:40:45.047\] \[error\]\[savedobjects-service\] Unable to retrieve version i…

---

## [How to configure file beat to send to data stream so that life policy settings can be made use of?](https://discuss.elastic.co/t/how-to-configure-file-beat-to-send-to-data-stream-so-that-life-policy-settings-can-be-made-use-of/288805)

<div class="topic-metadata">

**Author:** [@shi](https://discuss.elastic.co/u/shi)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 4:36pm UTC](https://discuss.elastic.co/t/how-to-configure-file-beat-to-send-to-data-stream-so-that-life-policy-settings-can-be-made-use-of/288805 "2021-11-11T16:36:39Z")

</div>

How to configure file beat to send to data stream so that life policy settings can be made use of? Also , is there any change to be made about the corresponding setting of ingest pipeline, if we use configuration of da…

---

## [How toi get Mainfram data to Logstash](https://discuss.elastic.co/t/how-toi-get-mainfram-data-to-logstash/288972)

<div class="topic-metadata">

**Author:** [@Shalinicts](https://discuss.elastic.co/u/Shalinicts)\
**Replies:** 1\
**Last updated:** [November 11, 2021, 4:29pm UTC](https://discuss.elastic.co/t/how-toi-get-mainfram-data-to-logstash/288972 "2021-11-11T16:29:36Z")

</div>

Read data files which are delivered in zipped EDCDIC format and get it into Elasticsearch via Logstash

---

## [Most Efficient way to fetch multiple records by their Id](https://discuss.elastic.co/t/most-efficient-way-to-fetch-multiple-records-by-their-id/288035)

<div class="topic-metadata">

**Author:** [@Spyros\_Giannopoulos](https://discuss.elastic.co/u/Spyros_Giannopoulos)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 4:16pm UTC](https://discuss.elastic.co/t/most-efficient-way-to-fetch-multiple-records-by-their-id/288035 "2021-11-11T16:16:21Z")

</div>

Hello, I have a case where I need to fetch a huge number of records but I know already their Id. I'm using c# Nest library. What would be the most efficient way to fetch them? The size of the records can vary from a few…

---

## [Read from the beginning filebeat](https://discuss.elastic.co/t/read-from-the-beginning-filebeat/288904)

<div class="topic-metadata">

**Author:** [@rodri.gz](https://discuss.elastic.co/u/rodri.gz)\
**Replies:** 4\
**Last updated:** [November 11, 2021, 3:37pm UTC](https://discuss.elastic.co/t/read-from-the-beginning-filebeat/288904 "2021-11-11T15:37:02Z")

</div>

hello! Is there any parameter to tell an input in filebeat to read from the beginning of the document? like the start\_position =\> beginnig of logstash Thank you!

---

## [Deploy elastic search saved objects into Elastic search cloud](https://discuss.elastic.co/t/deploy-elastic-search-saved-objects-into-elastic-search-cloud/288840)

<div class="topic-metadata">

**Author:** [@anjana1](https://discuss.elastic.co/u/anjana1)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 3:26pm UTC](https://discuss.elastic.co/t/deploy-elastic-search-saved-objects-into-elastic-search-cloud/288840 "2021-11-11T15:26:06Z")

</div>

Is there any automation, that we can do to move the saved objects over to Elasticsearch cloud , like through a jenkins pipeline. Or is it like the saved Objects can only be moved to Elasticsearch manually?

---

## [Elastic search-ui - not working](https://discuss.elastic.co/t/elastic-search-ui-not-working/289003)

<div class="topic-metadata">

**Author:** [@Baljeet](https://discuss.elastic.co/u/Baljeet)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 3:15pm UTC](https://discuss.elastic.co/t/elastic-search-ui-not-working/289003 "2021-11-11T15:15:47Z")

</div>

Hi Elastic team, I am evaluating Elasticsearch-ui for work. I am not able to run elastic “search-ui” @ search-ui/examples/elasticsearch at master · elastic/search-ui · GitHub iMac Elasticsearch running at localhost…

---

## [View Data from specific index over 24hr period](https://discuss.elastic.co/t/view-data-from-specific-index-over-24hr-period/288941)

<div class="topic-metadata">

**Author:** [@Wilks](https://discuss.elastic.co/u/Wilks)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 2:48pm UTC](https://discuss.elastic.co/t/view-data-from-specific-index-over-24hr-period/288941 "2021-11-11T14:48:51Z")

</div>

Hi, I am trying to come up with a way to view the data from a field within Elasticsearch index called "dns.highest\_registered\_domain" over a 24 hour period. I have come up with the following but I am not sure if it is …

---

## [Rsyslog logstash input](https://discuss.elastic.co/t/rsyslog-logstash-input/288664)

<div class="topic-metadata">

**Author:** [@duscha](https://discuss.elastic.co/u/duscha)\
**Replies:** 9\
**Last updated:** [November 11, 2021, 2:46pm UTC](https://discuss.elastic.co/t/rsyslog-logstash-input/288664 "2021-11-11T14:46:07Z")

</div>

I installed on CentOS-7 an ELK stack according to a tutorial. This worked all fine and I can see and search the logs of the localhost server itself in the Kibana interface. The purpose of the server is to act as a centr…

---

## [Import data failed document - Some documents could not be imported](https://discuss.elastic.co/t/import-data-failed-document-some-documents-could-not-be-imported/288572)

<div class="topic-metadata">

**Author:** [@corndog](https://discuss.elastic.co/u/corndog)\
**Replies:** 5\
**Last updated:** [November 11, 2021, 2:41pm UTC](https://discuss.elastic.co/t/import-data-failed-document-some-documents-could-not-be-imported/288572 "2021-11-11T14:41:27Z")

</div>

I am in the localhost:5601 GUI on the "Add data / Upload File" page. I am importing a ndjson file with 86 lines and the following mappings set in "Import data / Advanced" "mappings": { { "properties": { "si…

---

## [Creating links between kibana dashboards](https://discuss.elastic.co/t/creating-links-between-kibana-dashboards/288750)

<div class="topic-metadata">

**Author:** [@Nisha2297](https://discuss.elastic.co/u/Nisha2297)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 2:27pm UTC](https://discuss.elastic.co/t/creating-links-between-kibana-dashboards/288750 "2021-11-11T14:27:02Z")

</div>

Hi, Could you please let me know if the below given feature is available in Kibana's latest version. I am trying to create a Link between Kibana dashboards where the filter condition applied in the Search bar in dashbo…

---

## [Change color based on last value](https://discuss.elastic.co/t/change-color-based-on-last-value/287703)

<div class="topic-metadata">

**Author:** [@Raiu](https://discuss.elastic.co/u/Raiu)\
**Replies:** 5\
**Last updated:** [November 11, 2021, 2:08pm UTC](https://discuss.elastic.co/t/change-color-based-on-last-value/287703 "2021-11-11T14:08:33Z")

</div>

I'm using ELK to pull machine logs and visualize them on a dashboard so we can display how our shop is doing on a large tv. One of the things that I want to display is the current event of a machine. For readability, I w…

---

## [Winlogbeat.exe - Failed: 32bit on 64bit system](https://discuss.elastic.co/t/winlogbeat-exe-failed-32bit-on-64bit-system/288891)

<div class="topic-metadata">

**Author:** [@merida](https://discuss.elastic.co/u/merida)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 1:49pm UTC](https://discuss.elastic.co/t/winlogbeat-exe-failed-32bit-on-64bit-system/288891 "2021-11-11T13:49:34Z")

</div>

Hello, I downloaded winlogbeat-7.15.1-windows-x86 and installed it using "uninstall-service-winlogbeat.ps1" according to the documentation. (WindowsServer2019) PS C:\\program files\\Winlogbeat\> .\\install-service-winlo…

---

## ['illegal\_argument\_exception', 'reason': 'Unable to Tessellate shape 6.6.0](https://discuss.elastic.co/t/illegal-argument-exception-reason-unable-to-tessellate-shape-6-6-0/288859)

<div class="topic-metadata">

**Author:** [@Lemon\_C](https://discuss.elastic.co/u/Lemon_C)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 1:26pm UTC](https://discuss.elastic.co/t/illegal-argument-exception-reason-unable-to-tessellate-shape-6-6-0/288859 "2021-11-11T13:26:57Z")

</div>

dear all, I am trying to post data to es but failed for the reason as following: " 'caused\_by': {'type': 'illegal\_argument\_exception', 'reason': 'Unable to Tessellate shape" but its ok on geojson.io to make a polygon…

---

## [Problems with indexes.fielddata.cache.size and high I/O on HDD](https://discuss.elastic.co/t/problems-with-indexes-fielddata-cache-size-and-high-i-o-on-hdd/288915)

<div class="topic-metadata">

**Author:** [@KaZuKi\_Yashiro](https://discuss.elastic.co/u/KaZuKi_Yashiro)\
**Replies:** 0\
**Last updated:** [November 10, 2021, 4:44pm UTC](https://discuss.elastic.co/t/problems-with-indexes-fielddata-cache-size-and-high-i-o-on-hdd/288915 "2021-11-10T16:44:27Z")

</div>

Good evening. ES version 6.8.8 in docker "docker.elastic.co/elasticsearch/elasticsearch:6.8.8" heap\_size: 31g CPU Model on node 1: Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz CPU Model on node 2: Intel(R) Xeon(R) CPU E…

---

## [Elasticsearch docker container fails to start with provided environmet variable](https://discuss.elastic.co/t/elasticsearch-docker-container-fails-to-start-with-provided-environmet-variable/288990)

<div class="topic-metadata">

**Author:** [@michthom](https://discuss.elastic.co/u/michthom)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 12:09pm UTC](https://discuss.elastic.co/t/elasticsearch-docker-container-fails-to-start-with-provided-environmet-variable/288990 "2021-11-11T12:09:04Z")

</div>

Hi guys, new here and unsure if this is Elasticsearch or docker issue, I think the former. I'm trying to run Elasticsearch docker container but it fails to process supplied environment variable. docker run -e "discover…

---

## [Snapshots not showing in a timely manner](https://discuss.elastic.co/t/snapshots-not-showing-in-a-timely-manner/287778)

<div class="topic-metadata">

**Author:** [@chrisgg](https://discuss.elastic.co/u/chrisgg)\
**Replies:** 8\
**Last updated:** [November 11, 2021, 11:35am UTC](https://discuss.elastic.co/t/snapshots-not-showing-in-a-timely-manner/287778 "2021-11-11T11:35:26Z")

</div>

Hi all I will preface this by saying that I know that CCR would do what we want, but we requested a quote for this and the company said no way, the cost was just too high! We are only using ES very lightly and it is not…

---

## [Is it possible to record all the commands run in Mariadb to the elasticsearch?](https://discuss.elastic.co/t/is-it-possible-to-record-all-the-commands-run-in-mariadb-to-the-elasticsearch/288987)

<div class="topic-metadata">

**Author:** [@kennethcheung](https://discuss.elastic.co/u/kennethcheung)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 11:01am UTC](https://discuss.elastic.co/t/is-it-possible-to-record-all-the-commands-run-in-mariadb-to-the-elasticsearch/288987 "2021-11-11T11:01:34Z")

</div>

Let say someone in my team run a command "SELECT \* FORM TESTTABLE" in the Mariadb, and I hope the Elasticsearch can receive the command and record it down rather the output result. Can anyone show me how to do this in…

---

## [Specifying field weight during query time](https://discuss.elastic.co/t/specifying-field-weight-during-query-time/288982)

<div class="topic-metadata">

**Author:** [@Newbie111985](https://discuss.elastic.co/u/Newbie111985)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 10:45am UTC](https://discuss.elastic.co/t/specifying-field-weight-during-query-time/288982 "2021-11-11T10:45:48Z")

</div>

I have an index with below mapping. { "mappings" : { "\_doc" : { "properties" : { "author" : {"type" : "keyword"}, "title" : { "type" : "keyword" }, …

---

## [Scripting aggregation order](https://discuss.elastic.co/t/scripting-aggregation-order/288980)

<div class="topic-metadata">

**Author:** [@yen\_l\_ng\_th](https://discuss.elastic.co/u/yen_l_ng_th)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 10:29am UTC](https://discuss.elastic.co/t/scripting-aggregation-order/288980 "2021-11-11T10:29:44Z")

</div>

Would it be possible to script the sort order of aggregations? Let me explain with a contrived example: { "aggs": { "agg1": { "terms": { "field": "somefield", "order": { "avg1": "desc" }, "size" : 100 }, "agg…

---

## [Logstash not sending data to elastic search](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic-search/288903)

<div class="topic-metadata">

**Author:** [@Akhil\_Chandran](https://discuss.elastic.co/u/Akhil_Chandran)\
**Replies:** 4\
**Last updated:** [November 11, 2021, 10:02am UTC](https://discuss.elastic.co/t/logstash-not-sending-data-to-elastic-search/288903 "2021-11-11T10:02:06Z")

</div>

Trying to send data from logstash to an ES index, but the index is not created when logstash is run. Tried logginf the input lines and there is rows logged in the logstash log, but data not sent to ES index jdbc { …

---

## [Calculate the percentage in the table using already aggregated fields](https://discuss.elastic.co/t/calculate-the-percentage-in-the-table-using-already-aggregated-fields/288921)

<div class="topic-metadata">

**Author:** [@Michael\_Derevyanko](https://discuss.elastic.co/u/Michael_Derevyanko)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 9:26am UTC](https://discuss.elastic.co/t/calculate-the-percentage-in-the-table-using-already-aggregated-fields/288921 "2021-11-11T09:26:12Z")

</div>

Hi I have a question. Dose it possible to calculate the percentage using already aggregated fields. I have two columns aggregated and grouped by Buckets ( split rows was used): Sum of items (jmeter.count) Sum of item…

---

## [Discrepancy between elastic agent and metricbeat data](https://discuss.elastic.co/t/discrepancy-between-elastic-agent-and-metricbeat-data/288968)

<div class="topic-metadata">

**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 8:57am UTC](https://discuss.elastic.co/t/discrepancy-between-elastic-agent-and-metricbeat-data/288968 "2021-11-11T08:57:50Z")

</div>

I'm currently trying to decide to use metricbeat or elastic-agent for my system and I'm finding that there is quite a significant difference in the memory reported for each system. Here are the screenshots Here is w…

---

## [\_ilm/explain returns illegal\_argument\_exception: "duration cannot be negative, was given \[-1613792563\]"](https://discuss.elastic.co/t/ilm-explain-returns-illegal-argument-exception-duration-cannot-be-negative-was-given-1613792563/288868)

<div class="topic-metadata">

**Author:** [@fuphil](https://discuss.elastic.co/u/fuphil)\
**Replies:** 3\
**Last updated:** [November 11, 2021, 8:12am UTC](https://discuss.elastic.co/t/ilm-explain-returns-illegal-argument-exception-duration-cannot-be-negative-was-given-1613792563/288868 "2021-11-11T08:12:01Z")

</div>

Hi guys, I am running Kibana 7.15 and somehow the ilm information of each index got lost in the UI. Usually (still like this in my test and monitoring cluster) when loading all indices via "Stack Management -\> Index Ma…

---

## [Filebeat Configuration: How should be configured output.elasticsearch.index and setup.template](https://discuss.elastic.co/t/filebeat-configuration-how-should-be-configured-output-elasticsearch-index-and-setup-template/288960)

<div class="topic-metadata">

**Author:** [@happyinteger](https://discuss.elastic.co/u/happyinteger)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 7:53am UTC](https://discuss.elastic.co/t/filebeat-configuration-how-should-be-configured-output-elasticsearch-index-and-setup-template/288960 "2021-11-11T07:53:47Z")

</div>

Hello, Here is a section from my filebeat.yml I'm wondering how output.Elasticsearch.index and setup.template.pattern are related each other? Would such a configuration like this lead any problems (or confusion when…

---

## [Remove from \_source.fieldA if fieldA is zero](https://discuss.elastic.co/t/remove-from-source-fielda-if-fielda-is-zero/288961)

<div class="topic-metadata">

**Author:** [@anon17386273](https://discuss.elastic.co/u/anon17386273)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 7:55am UTC](https://discuss.elastic.co/t/remove-from-source-fielda-if-fielda-is-zero/288961 "2021-11-11T07:55:16Z")

</div>

Hi I am using ES 7.10.2 and wanted to remove from existing indices \_source fieldA if fieldA is zero. I tried to use update\_by\_query \> pipeline \> processor \> remove to remove a field if it's value is zero but when I ran…

---

## [Merge matching documents](https://discuss.elastic.co/t/merge-matching-documents/288959)

<div class="topic-metadata">

**Author:** [@samhagin](https://discuss.elastic.co/u/samhagin)\
**Replies:** 0\
**Last updated:** [November 11, 2021, 7:51am UTC](https://discuss.elastic.co/t/merge-matching-documents/288959 "2021-11-11T07:51:09Z")

</div>

I have two different indices with matching documents - the \_id field is the same. How can I copy documents from one index to another and overwrite the document at the destination, and also insert a document if it doesn't…

---

## [Exporting Kibana report to CSV in UTF-8](https://discuss.elastic.co/t/exporting-kibana-report-to-csv-in-utf-8/288593)

<div class="topic-metadata">

**Author:** [@nati](https://discuss.elastic.co/u/nati)\
**Replies:** 2\
**Last updated:** [November 11, 2021, 7:29am UTC](https://discuss.elastic.co/t/exporting-kibana-report-to-csv-in-utf-8/288593 "2021-11-11T07:29:27Z")

</div>

Hello, Is there any solution to exporting CSV in UTF-8? My client have problems with Hebrew characters. He can not use external converting tools, as I suggested to him. Is there a way to configure UTF-8 in the kibana.…

---

## [I need a ES Query equalent to sql count(if(somecondition))](https://discuss.elastic.co/t/i-need-a-es-query-equalent-to-sql-count-if-somecondition/288877)

<div class="topic-metadata">

**Author:** [@Brintha](https://discuss.elastic.co/u/Brintha)\
**Replies:** 4\
**Last updated:** [November 11, 2021, 7:23am UTC](https://discuss.elastic.co/t/i-need-a-es-query-equalent-to-sql-count-if-somecondition/288877 "2021-11-11T07:23:04Z")

</div>

Hello, My Question is How to frame Query for 'SELECT EMPLOYEE,COUNT(IF(COUNTRY IN US)) FROM ORG WHERE SOMECRITERIA'

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1165)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1167)
