# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1073

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1074

---

## [Elastic search(8.2) and Kibana Authentication Error](https://discuss.elastic.co/t/elastic-search-8-2-and-kibana-authentication-error/308170)

<div class="topic-metadata">

**Author:** [@soumilshah1995](https://discuss.elastic.co/u/soumilshah1995)\
**Replies:** 10\
**Last updated:** [June 26, 2022, 1:17pm UTC](https://discuss.elastic.co/t/elastic-search-8-2-and-kibana-authentication-error/308170 "2022-06-26T13:17:34Z")

</div>

Hello All hope you are doing well I am trying to get Kibana working with Elastic search Version 8.2 Here is an issue I am running into and looking fwd to seeking help and advice from a community ELastic search VErsion …

---

## [Unable to Connect Filebeat to Elasticsearch](https://discuss.elastic.co/t/unable-to-connect-filebeat-to-elasticsearch/308061)

<div class="topic-metadata">

**Author:** [@Nightshade](https://discuss.elastic.co/u/Nightshade)\
**Replies:** 5\
**Last updated:** [June 26, 2022, 12:09pm UTC](https://discuss.elastic.co/t/unable-to-connect-filebeat-to-elasticsearch/308061 "2022-06-26T12:09:58Z")

</div>

This is the error I am getting: Exiting: couldn't connect to any of the configured Elasticsearch hosts. Errors: \[error connecting to Elasticsearch at http://10.0.0.132:9200: Get "http://10.0.0.132:9200": EOF\] Full log w…

---

## [Elastic search parse a string](https://discuss.elastic.co/t/elastic-search-parse-a-string/308164)

<div class="topic-metadata">

**Author:** [@Dorian](https://discuss.elastic.co/u/Dorian)\
**Replies:** 8\
**Last updated:** [June 26, 2022, 10:57am UTC](https://discuss.elastic.co/t/elastic-search-parse-a-string/308164 "2022-06-26T10:57:46Z")

</div>

Hi, I search a way to find a string inside another string by parsing it. For example i index into elasticSearch a document that contain the text : "2000Newyork" in a field name "id" And now i want to find the indexed …

---

## [ILM Performance in search](https://discuss.elastic.co/t/ilm-performance-in-search/307951)

<div class="topic-metadata">

**Author:** [@Yariv\_Moshe](https://discuss.elastic.co/u/Yariv_Moshe)\
**Replies:** 6\
**Last updated:** [June 26, 2022, 7:48am UTC](https://discuss.elastic.co/t/ilm-performance-in-search/307951 "2022-06-26T07:48:55Z")

</div>

Hi, I want to use ILM to create a new index per day or month. my question is how it going to affect search performance if old indexes will move to the warm | cold stage with pure HW. let's say that I have a query rang…

---

## [Decoding json fields properly with filebeat](https://discuss.elastic.co/t/decoding-json-fields-properly-with-filebeat/307596)

<div class="topic-metadata">

**Author:** [@Blason](https://discuss.elastic.co/u/Blason)\
**Replies:** 3\
**Last updated:** [June 26, 2022, 3:57am UTC](https://discuss.elastic.co/t/decoding-json-fields-properly-with-filebeat/307596 "2022-06-26T03:57:40Z")

</div>

Hi Team, I am trying to parse modsec\_audit logs with filebeat in json format. However those are not being parsed correctly. Here is the original log. {"transaction":{"client\_ip":"66.249.66.154","time\_stamp":"Mon Jun 2…

---

## [Java client 8.2.2 Trouble loading keystore during setup](https://discuss.elastic.co/t/java-client-8-2-2-trouble-loading-keystore-during-setup/307577)

<div class="topic-metadata">

**Author:** [@Jack\_Park](https://discuss.elastic.co/u/Jack_Park)\
**Replies:** 20\
**Last updated:** [June 26, 2022, 12:52am UTC](https://discuss.elastic.co/t/java-client-8-2-2-trouble-loading-keystore-during-setup/307577 "2022-06-26T00:52:52Z")

</div>

I created a gist here When doing a keystore.load I get DerInputStream.getLength(): lengthTag=87, too big. Apparently that's a rich topic, as in Most of the issue seems to be on platforms other than ES. I'm hoping …

---

## [Aggregation over top hits](https://discuss.elastic.co/t/aggregation-over-top-hits/308169)

<div class="topic-metadata">

**Author:** [@Nowrin\_Hossain](https://discuss.elastic.co/u/Nowrin_Hossain)\
**Replies:** 0\
**Last updated:** [June 25, 2022, 9:33pm UTC](https://discuss.elastic.co/t/aggregation-over-top-hits/308169 "2022-06-25T21:33:23Z")

</div>

Hello, This is my query { "aggs": { "by\_agency\_id": { "terms": { "field": "agency\_id.keyword", "size": 1000 }, "aggs": { "by\_uuid": { "terms": { "fi…

---

## [Elasticsearch index on compressed string blob](https://discuss.elastic.co/t/elasticsearch-index-on-compressed-string-blob/308151)

<div class="topic-metadata">

**Author:** [@Harsh\_Agarwal](https://discuss.elastic.co/u/Harsh_Agarwal)\
**Replies:** 7\
**Last updated:** [June 25, 2022, 9:04pm UTC](https://discuss.elastic.co/t/elasticsearch-index-on-compressed-string-blob/308151 "2022-06-25T21:04:43Z")

</div>

I needed to index on compressed string blob.. I read that ingest attachment plugin could be the right tool for files.. and base64 strings.. ingest attachment plugin relies on appache tikka I read that Tika supports: "…

---

## [Instances Dashboard](https://discuss.elastic.co/t/instances-dashboard/308069)

<div class="topic-metadata">

**Author:** [@WeslleyFelizardo](https://discuss.elastic.co/u/WeslleyFelizardo)\
**Replies:** 7\
**Last updated:** [June 25, 2022, 4:55pm UTC](https://discuss.elastic.co/t/instances-dashboard/308069 "2022-06-25T16:55:45Z")

</div>

Hi guys. I am faced error message while the kibana try load data into instances dashboard. Anothers dashboard such as Transactions, Throughput, CPU usage and System memory usage, all them are loaded successfully, only t…

---

## [How to write remote hostname to output file with logstash](https://discuss.elastic.co/t/how-to-write-remote-hostname-to-output-file-with-logstash/308161)

<div class="topic-metadata">

**Author:** [@Yunus\_Dal](https://discuss.elastic.co/u/Yunus_Dal)\
**Replies:** 2\
**Last updated:** [June 25, 2022, 2:03pm UTC](https://discuss.elastic.co/t/how-to-write-remote-hostname-to-output-file-with-logstash/308161 "2022-06-25T14:03:32Z")

</div>

Hi, I have java application which is running at 2 instance and collect logs from these instances. I want to create output log file so far as remote hostname. my logstash config; input { tcp { codec =\> json …

---

## [XPOST Failing](https://discuss.elastic.co/t/xpost-failing/308153)

<div class="topic-metadata">

**Author:** [@chandramouli\_ravi](https://discuss.elastic.co/u/chandramouli_ravi)\
**Replies:** 5\
**Last updated:** [June 25, 2022, 2:50pm UTC](https://discuss.elastic.co/t/xpost-failing/308153 "2022-06-25T14:50:47Z")

</div>

Hi, I am running elasticsearch 8.2.3 from my laptop. Able to check health, create index but insert document is failing. Could you please help what's the problem here. C:\\Users\\ravich\>curl --insecure -H "Content-Type:…

---

## [How do I increase the number of logs per second processing by Elastic Agent and Ingest pipeline?](https://discuss.elastic.co/t/how-do-i-increase-the-number-of-logs-per-second-processing-by-elastic-agent-and-ingest-pipeline/306535)

<div class="topic-metadata">

**Author:** [@alah64](https://discuss.elastic.co/u/alah64)\
**Replies:** 1\
**Last updated:** [June 25, 2022, 12:45pm UTC](https://discuss.elastic.co/t/how-do-i-increase-the-number-of-logs-per-second-processing-by-elastic-agent-and-ingest-pipeline/306535 "2022-06-25T12:45:22Z")

</div>

Hi I came first and only received the Suricata log from the elastic agent, about 600 EPS processing is done. The amount of CPU that you can see in the following figure by htop command: Then I came and processed othe…

---

## [Filebeat use too many cpu times to gzip](https://discuss.elastic.co/t/filebeat-use-too-many-cpu-times-to-gzip/308163)

<div class="topic-metadata">

**Author:** [@MrLiukang](https://discuss.elastic.co/u/MrLiukang)\
**Replies:** 0\
**Last updated:** [June 25, 2022, 12:10pm UTC](https://discuss.elastic.co/t/filebeat-use-too-many-cpu-times-to-gzip/308163 "2022-06-25T12:10:24Z")

</div>

hey guys. I found my filebeat send msg too slow,so I use two commands to profile filebeat, perf record -a -g -p xxx perf report -n --stdio the result show the filebeat use lots of cpu times to gzip msg? can we red…

---

## [Changelog for Elastic Agent Integrations](https://discuss.elastic.co/t/changelog-for-elastic-agent-integrations/308159)

<div class="topic-metadata">

**Author:** [@zx8086](https://discuss.elastic.co/u/zx8086)\
**Replies:** 0\
**Last updated:** [June 25, 2022, 9:47am UTC](https://discuss.elastic.co/t/changelog-for-elastic-agent-integrations/308159 "2022-06-25T09:47:25Z")

</div>

The assumptions seems to be that we upgrade these integrations without easy access to know what we are upgrading or what potentially could break and what has been fixed. We have changelogs for all other components in a s…

---

## [Python 无法通过ssh使用Elasticsearch类和远程服务器建立连接](https://discuss.elastic.co/t/python-ssh-elasticsearch/308157)

<div class="topic-metadata">

**Author:** [@qigemingzihaonana](https://discuss.elastic.co/u/qigemingzihaonana)\
**Replies:** 2\
**Last updated:** [June 25, 2022, 8:11am UTC](https://discuss.elastic.co/t/python-ssh-elasticsearch/308157 "2022-06-25T08:11:45Z")

</div>

elasticsearch.exceptions.ConnectionError: ConnectionError(\<urllib3.connection.HTTPConnection object at 0x000001B539AC6C10\>: Failed to establish a new connection: \[WinError 10061\] 由于目标计算机积极拒绝，无法连接。) caused by: NewConnecti…

---

## [Removal of orphan indices / cleanup when removing Entreprise Search on Elastic Cloud](https://discuss.elastic.co/t/removal-of-orphan-indices-cleanup-when-removing-entreprise-search-on-elastic-cloud/303804)

<div class="topic-metadata">

**Author:** [@Damien\_Alexandre](https://discuss.elastic.co/u/Damien_Alexandre)\
**Replies:** 2\
**Last updated:** [June 25, 2022, 8:04am UTC](https://discuss.elastic.co/t/removal-of-orphan-indices-cleanup-when-removing-entreprise-search-on-elastic-cloud/303804 "2022-06-25T08:04:02Z")

</div>

I had a cluster running on Elastic Cloud and having A LOT of system / hidden / technical indices - multiple hundreds of them. That's something I already rant about here Is there a way to clean .kibana\* indices? I got 22…

---

## [How to take input from kafka avro consumer](https://discuss.elastic.co/t/how-to-take-input-from-kafka-avro-consumer/308150)

<div class="topic-metadata">

**Author:** [@saurabhlam](https://discuss.elastic.co/u/saurabhlam)\
**Replies:** 0\
**Last updated:** [June 25, 2022, 5:55am UTC](https://discuss.elastic.co/t/how-to-take-input-from-kafka-avro-consumer/308150 "2022-06-25T05:55:49Z")

</div>

Hi Currently I have defined kafka as input in logstash but I want to take input from kafka avro consumer (avro-console-consumer) . Below is my current config input { kafka { bootstrap\_servers =\> "kafka:9092" topics…

---

## [Set data view format in index template](https://discuss.elastic.co/t/set-data-view-format-in-index-template/307445)

<div class="topic-metadata">

**Author:** [@seanziee](https://discuss.elastic.co/u/seanziee)\
**Replies:** 10\
**Last updated:** [June 25, 2022, 1:40am UTC](https://discuss.elastic.co/t/set-data-view-format-in-index-template/307445 "2022-06-25T01:40:06Z")

</div>

Hi, I have multiple spaces that all reference the same index with an index pattern - metricbeat-\*./ Metricbeat comes with MANY \*.pct fields and I'd like to display them all as percentages rather than numbers. It would …

---

## [Use nodejs lambda layer, npm package, or both?](https://discuss.elastic.co/t/use-nodejs-lambda-layer-npm-package-or-both/308059)

<div class="topic-metadata">

**Author:** [@apoco](https://discuss.elastic.co/u/apoco)\
**Replies:** 10\
**Last updated:** [June 25, 2022, 1:18am UTC](https://discuss.elastic.co/t/use-nodejs-lambda-layer-npm-package-or-both/308059 "2022-06-25T01:18:08Z")

</div>

I've been seeing a lot of noisy logging from Elastic APM in the CloudWatch logs for my node.js Lambda, despite setting ELASTIC\_APM\_LOG\_LEVEL=error. Hoping that there are some bug fixes available, I was looking into updat…

---

## [Num\_reduce\_phases in query response](https://discuss.elastic.co/t/num-reduce-phases-in-query-response/308145)

<div class="topic-metadata">

**Author:** [@Akshay\_Pawar](https://discuss.elastic.co/u/Akshay_Pawar)\
**Replies:** 0\
**Last updated:** [June 25, 2022, 12:43am UTC](https://discuss.elastic.co/t/num-reduce-phases-in-query-response/308145 "2022-06-25T00:43:24Z")

</div>

Hello, we are using Elasticsearch's version 7.5.1 and noticed that sometimes (not always) Elasticsearch returns "num\_reduced\_phases" in query response for aggregate queries. Is there any specific query/scenario which can…

---

## [Canvas Charts Limiting Results](https://discuss.elastic.co/t/canvas-charts-limiting-results/304591)

<div class="topic-metadata">

**Author:** [@Tim\_Mobley](https://discuss.elastic.co/u/Tim_Mobley)\
**Replies:** 4\
**Last updated:** [June 24, 2022, 9:01pm UTC](https://discuss.elastic.co/t/canvas-charts-limiting-results/304591 "2022-06-24T21:01:59Z")

</div>

I am using an Elasticsearch SQL query in a horizontal bar chart in Kibana. At the end of my query I have LIMIT ALL, which should return all results that match the WHERE statement. Discover shows 292,589 hits for the same…

---

## [How to implement Keep alive in logstash using JDBC input](https://discuss.elastic.co/t/how-to-implement-keep-alive-in-logstash-using-jdbc-input/308140)

<div class="topic-metadata">

**Author:** [@Oskr](https://discuss.elastic.co/u/Oskr)\
**Replies:** 0\
**Last updated:** [June 24, 2022, 7:30pm UTC](https://discuss.elastic.co/t/how-to-implement-keep-alive-in-logstash-using-jdbc-input/308140 "2022-06-24T19:30:26Z")

</div>

Hello Team, I have a question about a bug in my environment, I am using logstash to extract data from the oracle database, our logstash is running on AWS the sql takes 100 sec to run on average, but at some times of the…

---

## [SunCertPathBuilderException in Logstash Running Elasticsearch in Docker](https://discuss.elastic.co/t/suncertpathbuilderexception-in-logstash-running-elasticsearch-in-docker/308054)

<div class="topic-metadata">

**Author:** [@jhop](https://discuss.elastic.co/u/jhop)\
**Replies:** 7\
**Last updated:** [June 24, 2022, 7:00pm UTC](https://discuss.elastic.co/t/suncertpathbuilderexception-in-logstash-running-elasticsearch-in-docker/308054 "2022-06-24T19:00:02Z")

</div>

I am running Elasticsearch in docker. I am trying to hit port 5044 from my browser (or from anywhere). My error is as follows: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certificat…

---

## [Changing node roles in an already existing ES environment](https://discuss.elastic.co/t/changing-node-roles-in-an-already-existing-es-environment/307013)

<div class="topic-metadata">

**Author:** [@Carlos\_T](https://discuss.elastic.co/u/Carlos_T)\
**Replies:** 3\
**Last updated:** [June 24, 2022, 6:17pm UTC](https://discuss.elastic.co/t/changing-node-roles-in-an-already-existing-es-environment/307013 "2022-06-24T18:17:10Z")

</div>

Good morning everybody. As, due to my job, I will have to get a Production ES environment in the future, I decided to create a testing ES environment at home. This environment has three multi-role node. The three of th…

---

## [Update to 8.2.2 showing error in keystore-init](https://discuss.elastic.co/t/update-to-8-2-2-showing-error-in-keystore-init/307076)

<div class="topic-metadata">

**Author:** [@Dxnium](https://discuss.elastic.co/u/Dxnium)\
**Replies:** 4\
**Last updated:** [June 24, 2022, 5:07pm UTC](https://discuss.elastic.co/t/update-to-8-2-2-showing-error-in-keystore-init/307076 "2022-06-24T17:07:09Z")

</div>

Currently testing to update elastic from 8.1.3 to 8.2.2, but when i tried to deploy with the latest version I'm getting this error. Also getting the same error with version 8.2.0 I'm using the same cofiguration from 8.…

---

## [Indentation error on filebeat conf](https://discuss.elastic.co/t/indentation-error-on-filebeat-conf/308033)

<div class="topic-metadata">

**Author:** [@Guillaume\_D](https://discuss.elastic.co/u/Guillaume_D)\
**Replies:** 4\
**Last updated:** [June 24, 2022, 4:58pm UTC](https://discuss.elastic.co/t/indentation-error-on-filebeat-conf/308033 "2022-06-24T16:58:55Z")

</div>

Hi, I want to do some basic process with filebeat on my logs but I have some indentations problemes I just don't know how to resolve. Here is the current stat of the conf file, input and output has been sensored but I a…

---

## [SNMP Input - Stop Table Polling at Specific Table OID](https://discuss.elastic.co/t/snmp-input-stop-table-polling-at-specific-table-oid/308134)

<div class="topic-metadata">

**Author:** [@bennrtc](https://discuss.elastic.co/u/bennrtc)\
**Replies:** 0\
**Last updated:** [June 24, 2022, 4:54pm UTC](https://discuss.elastic.co/t/snmp-input-stop-table-polling-at-specific-table-oid/308134 "2022-06-24T16:54:54Z")

</div>

I'm using Logstash to query a network device that has a large number of interfaces (nearly 1500). I'm interested in a variety of interface metrics that are stored in different tables. I only need the metrics from the f…

---

## [Elastic search service is getting stopped automatically version 7.12](https://discuss.elastic.co/t/elastic-search-service-is-getting-stopped-automatically-version-7-12/308132)

<div class="topic-metadata">

**Author:** [@Azhar\_Uddin1](https://discuss.elastic.co/u/Azhar_Uddin1)\
**Replies:** 0\
**Last updated:** [June 24, 2022, 4:10pm UTC](https://discuss.elastic.co/t/elastic-search-service-is-getting-stopped-automatically-version-7-12/308132 "2022-06-24T16:10:20Z")

</div>

I am getting a warning in the kibana service after that elastic service stopped automatically executing the below commands yarn es snapshot --oss yarn start --run-examples and also executes yarn start but in both ca…

---

## [How to add a 0 before a field, with a condicion?](https://discuss.elastic.co/t/how-to-add-a-0-before-a-field-with-a-condicion/308106)

<div class="topic-metadata">

**Author:** [@jvinacio](https://discuss.elastic.co/u/jvinacio)\
**Replies:** 1\
**Last updated:** [June 24, 2022, 3:52pm UTC](https://discuss.elastic.co/t/how-to-add-a-0-before-a-field-with-a-condicion/308106 "2022-06-24T15:52:34Z")

</div>

Hello! I have different docs with different hours from 0 to 23 like the following { "date" : "2022-06-23", "eventDate" : "2022", "StoreID" : 190, "hour" : 0, "PosID" : 12, "tempo" : 0.0 } { "date" : "2022-06-2…

---

## [Calculate a delta between two time slices](https://discuss.elastic.co/t/calculate-a-delta-between-two-time-slices/307411)

<div class="topic-metadata">

**Author:** [@Kohlman](https://discuss.elastic.co/u/Kohlman)\
**Replies:** 9\
**Last updated:** [June 24, 2022, 3:50pm UTC](https://discuss.elastic.co/t/calculate-a-delta-between-two-time-slices/307411 "2022-06-24T15:50:26Z")

</div>

Is there a visualization that can calculate a delta between to two most recent records or any two time slices for that matter. Specifically we have metricbeat data from SQL server. Many of the metrics we extract are cumu…

[Previous page](https://discuss.elastic.co/latest.md?page=1072)

[Next page](https://discuss.elastic.co/latest.md?page=1074)
