# Latest

**URL:** https://discuss.elastic.co/latest.md?page=1065

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1066

---

## [Ingest Pipeline update existing array](https://discuss.elastic.co/t/ingest-pipeline-update-existing-array/307085)

<div class="topic-metadata">

**Author:** [@jhershcopf](https://discuss.elastic.co/u/jhershcopf)\
**Replies:** 0\
**Last updated:** [June 14, 2022, 12:07am UTC](https://discuss.elastic.co/t/ingest-pipeline-update-existing-array/307085 "2022-06-14T00:07:54Z")

</div>

I have two indices, one contains event records that contain a timestamp, location, user id and country, the other contains a summary of all the event records. The summary includes last timestamp, last location and last c…

---

## [Change column names in search visualize on kibana dashboard](https://discuss.elastic.co/t/change-column-names-in-search-visualize-on-kibana-dashboard/307741)

<div class="topic-metadata">

**Author:** [@mangeshs](https://discuss.elastic.co/u/mangeshs)\
**Replies:** 1\
**Last updated:** [June 30, 2022, 3:49pm UTC](https://discuss.elastic.co/t/change-column-names-in-search-visualize-on-kibana-dashboard/307741 "2022-06-30T15:49:41Z")

</div>

I have create search from discover tab and added to dashboard. I have selected fields I want to show data. Fields names are as per logstash but I want to change those on dashboard. I have tried from saved objects but the…

---

## [Logstash grok multiline file](https://discuss.elastic.co/t/logstash-grok-multiline-file/308509)

<div class="topic-metadata">

**Author:** [@alex\_96](https://discuss.elastic.co/u/alex_96)\
**Replies:** 3\
**Last updated:** [June 29, 2022, 9:51pm UTC](https://discuss.elastic.co/t/logstash-grok-multiline-file/308509 "2022-06-29T21:51:53Z")

</div>

Hello, I read a lot of articles here, but I still don’t understand how to properly configure grok in logstash, here is an example file: # Time: 2021-02-17T15:19:22.121290Z # User@Host: app\[app\] @ \[192.168.100.1\] Id: 4…

---

## [How to redirect my application to a session of a certain index on Kibana](https://discuss.elastic.co/t/how-to-redirect-my-application-to-a-session-of-a-certain-index-on-kibana/308595)

<div class="topic-metadata">

**Author:** [@Vincent92](https://discuss.elastic.co/u/Vincent92)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 2:41pm UTC](https://discuss.elastic.co/t/how-to-redirect-my-application-to-a-session-of-a-certain-index-on-kibana/308595 "2022-06-30T14:41:05Z")

</div>

Hello, I am developing a javascript application that will complete my use of Kibana, the frontend is in React and I use NodeJS with the Express framework for the backend. In my application I display a table that shows …

---

## [Generating custom \_id when exporting from hadoop/spark to ES](https://discuss.elastic.co/t/generating-custom-id-when-exporting-from-hadoop-spark-to-es/308486)

<div class="topic-metadata">

**Author:** [@Oriol\_Lopez\_Massague](https://discuss.elastic.co/u/Oriol_Lopez_Massague)\
**Replies:** 1\
**Last updated:** [June 30, 2022, 2:17pm UTC](https://discuss.elastic.co/t/generating-custom-id-when-exporting-from-hadoop-spark-to-es/308486 "2022-06-30T14:17:25Z")

</div>

I want to insert data in ES using hadoop/spark but with a custom made \_id field (not the autogerated one). I have seen that there is method using RDDs "saveToEsWithMeta": Is there a way to do the same thing using the…

---

## [When I am registering a repository for snapshot, I have kept the path. repo at all my master and data nodes again am unable to get the repository at verifying repository it is showing not connected and this below error. I have no idea what to do further](https://discuss.elastic.co/t/when-i-am-registering-a-repository-for-snapshot-i-have-kept-the-path-repo-at-all-my-master-and-data-nodes-again-am-unable-to-get-the-repository-at-verifying-repository-it-is-showing-not-connected-and-this-below-error-i-have-no-idea-what-to-do-further/308561)

<div class="topic-metadata">

**Author:** [@balasani\_sri](https://discuss.elastic.co/u/balasani_sri)\
**Replies:** 3\
**Last updated:** [June 30, 2022, 2:13pm UTC](https://discuss.elastic.co/t/when-i-am-registering-a-repository-for-snapshot-i-have-kept-the-path-repo-at-all-my-master-and-data-nodes-again-am-unable-to-get-the-repository-at-verifying-repository-it-is-showing-not-connected-and-this-below-error-i-have-no-idea-what-to-do-further/308561 "2022-06-30T14:13:46Z")

</div>

"type": "repository\_verification\_exception", "reason": "\[newlocal\_repo\] a file written by master to the store \[/opt/elk/elasticsearch/backup\_repo\] cannot be accessed on the node \[{alab106}{mSm33eUCT2-gvtL…

---

## [Unique count by top status](https://discuss.elastic.co/t/unique-count-by-top-status/307262)

<div class="topic-metadata">

**Author:** [@talial](https://discuss.elastic.co/u/talial)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 1:52pm UTC](https://discuss.elastic.co/t/unique-count-by-top-status/307262 "2022-06-30T13:52:07Z")

</div>

Hello I have to build a visualize that count all event (id) with status "open" in a range of time. The problem is that I dont want to use the update option in the logstash so some events (id) can change their status to…

---

## [Logstash not using ingest pipeline with datastreams](https://discuss.elastic.co/t/logstash-not-using-ingest-pipeline-with-datastreams/308384)

<div class="topic-metadata">

**Author:** [@rzisk](https://discuss.elastic.co/u/rzisk)\
**Replies:** 2\
**Last updated:** [June 30, 2022, 1:24pm UTC](https://discuss.elastic.co/t/logstash-not-using-ingest-pipeline-with-datastreams/308384 "2022-06-30T13:24:59Z")

</div>

Hello, I recently got our Elasticsearch instances upgraded to the 8 branch am working on getting all of our Beats upgraded to 8 as well. So far there have been various gotchas with getting Logstash to play well with dat…

---

## [Combine Terms aggregation with Composite aggregation](https://discuss.elastic.co/t/combine-terms-aggregation-with-composite-aggregation/308573)

<div class="topic-metadata">

**Author:** [@mirokrastev](https://discuss.elastic.co/u/mirokrastev)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 12:29pm UTC](https://discuss.elastic.co/t/combine-terms-aggregation-with-composite-aggregation/308573 "2022-06-30T12:29:56Z")

</div>

I have the following ES Query GET logstash-\*/\_search { "size": 0, "aggs": { "table": { "composite": { "size": 10000, "sources": \[ { "stk1": { "terms": { …

---

## [PHP APM Agent log in json or save to file](https://discuss.elastic.co/t/php-apm-agent-log-in-json-or-save-to-file/308570)

<div class="topic-metadata">

**Author:** [@Jan\_Machacek](https://discuss.elastic.co/u/Jan_Machacek)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 12:14pm UTC](https://discuss.elastic.co/t/php-apm-agent-log-in-json-or-save-to-file/308570 "2022-06-30T12:14:07Z")

</div>

APM Agent language and version: PHP 1.5.2 Hi, We want to send log from PHP Apm agent to Kibana so It would be useful to save this output to file or convert it to json. If I understad correctly the documentation Confi…

---

## [Applying best compression on already force-merged indices](https://discuss.elastic.co/t/applying-best-compression-on-already-force-merged-indices/308552)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 12:08pm UTC](https://discuss.elastic.co/t/applying-best-compression-on-already-force-merged-indices/308552 "2022-06-30T12:08:42Z")

</div>

Hi All, Have a question related to applying best\_compression on indices that are already force-merged to 1 segment. My question is: Can i still apply best\_compression on them to save some disk space? I suppose I can c…

---

## [How does ES protect users' private information](https://discuss.elastic.co/t/how-does-es-protect-users-private-information/308544)

<div class="topic-metadata">

**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 11:34am UTC](https://discuss.elastic.co/t/how-does-es-protect-users-private-information/308544 "2022-06-30T11:34:24Z")

</div>

We have a user management system that stores some user information, such as email, telephone and so on. Now I want to protect this information from possible hacking attacks. Does ES have any good protection for fields? …

---

## [Use french steemer on java api](https://discuss.elastic.co/t/use-french-steemer-on-java-api/308563)

<div class="topic-metadata">

**Author:** [@Dorian](https://discuss.elastic.co/u/Dorian)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 11:20am UTC](https://discuss.elastic.co/t/use-french-steemer-on-java-api/308563 "2022-06-30T11:20:24Z")

</div>

Hi, from 1 week i try to index document using the french steemer. I'm totally stuck can someone give me an example ?

---

## [Azure connection with elastic search](https://discuss.elastic.co/t/azure-connection-with-elastic-search/308475)

<div class="topic-metadata">

**Author:** [@A\_j\_xx](https://discuss.elastic.co/u/A_j_xx)\
**Replies:** 2\
**Last updated:** [June 30, 2022, 10:07am UTC](https://discuss.elastic.co/t/azure-connection-with-elastic-search/308475 "2022-06-30T10:07:25Z")

</div>

Hi all , Is there a way to check if any azure account is added to my elasticsearch cluster already or not ? It's urgent , hope to get a response soon ! Thanks !

---

## [How to access Kibana with x-pack security disabled?](https://discuss.elastic.co/t/how-to-access-kibana-with-x-pack-security-disabled/308347)

<div class="topic-metadata">

**Author:** [@dendog](https://discuss.elastic.co/u/dendog)\
**Replies:** 6\
**Last updated:** [June 30, 2022, 10:32am UTC](https://discuss.elastic.co/t/how-to-access-kibana-with-x-pack-security-disabled/308347 "2022-06-30T10:32:02Z")

</div>

Hi! I starting es and kibana in a docker compose file, I have set xpack.security.enabled=false, but when accessing the kibana UI I am still asked for an enrollment token, which from my understanding would not be generat…

---

## [Create dashboard with multiple visualizations based on field value](https://discuss.elastic.co/t/create-dashboard-with-multiple-visualizations-based-on-field-value/308372)

<div class="topic-metadata">

**Author:** [@elni](https://discuss.elastic.co/u/elni)\
**Replies:** 5\
**Last updated:** [June 30, 2022, 10:27am UTC](https://discuss.elastic.co/t/create-dashboard-with-multiple-visualizations-based-on-field-value/308372 "2022-06-30T10:27:16Z")

</div>

I have a line chart which is split based on a specific id as below. What I would really like however is that each line will appear alone in a separate chart/visualization within a dashboard based on a term filter. Is t…

---

## [Codec Multiline is not working for Kafka input plugin as expected](https://discuss.elastic.co/t/codec-multiline-is-not-working-for-kafka-input-plugin-as-expected/308553)

<div class="topic-metadata">

**Author:** [@ashish.kumar2](https://discuss.elastic.co/u/ashish.kumar2)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 9:56am UTC](https://discuss.elastic.co/t/codec-multiline-is-not-working-for-kafka-input-plugin-as-expected/308553 "2022-06-30T09:56:43Z")

</div>

codec =\> multiline { pattern =\> "(^UL ingress)|(^DL ingress)|(^numOfActiveUe)|(^pdcpCurrentTime\_g)" what =\> "previous" max\_lines =\> 6 } Still we are getting indiv…

---

## [Pod is not running](https://discuss.elastic.co/t/pod-is-not-running/307245)

<div class="topic-metadata">

**Author:** [@gerardgorrion](https://discuss.elastic.co/u/gerardgorrion)\
**Replies:** 6\
**Last updated:** [June 30, 2022, 9:50am UTC](https://discuss.elastic.co/t/pod-is-not-running/307245 "2022-06-30T09:50:18Z")

</div>

Good morning, We try to update kubernetes version from 1.19 to 1.20, and when try to renew an Elasticsearch data pod, this data pod is not runnning, showing this error in logs: {"type": "server", "timestamp": "2022-06-…

---

## [Optimizing a single node ES instance for throughput](https://discuss.elastic.co/t/optimizing-a-single-node-es-instance-for-throughput/307808)

<div class="topic-metadata">

**Author:** [@dmh43](https://discuss.elastic.co/u/dmh43)\
**Replies:** 6\
**Last updated:** [June 30, 2022, 9:41am UTC](https://discuss.elastic.co/t/optimizing-a-single-node-es-instance-for-throughput/307808 "2022-06-30T09:41:50Z")

</div>

I have a single large (500GB ram and 128 cores) machine that I have indexed a corpus of around 1TB in size. The documents vary in length, from very short (~100 characters) to very long (a single documents that is \> 100 M…

---

## [Increase 255 character limit in analyzer](https://discuss.elastic.co/t/increase-255-character-limit-in-analyzer/308543)

<div class="topic-metadata">

**Author:** [@ansamHox](https://discuss.elastic.co/u/ansamHox)\
**Replies:** 0\
**Last updated:** [June 30, 2022, 8:51am UTC](https://discuss.elastic.co/t/increase-255-character-limit-in-analyzer/308543 "2022-06-30T08:51:59Z")

</div>

I want to use a whitespace tokenizer, but I have very long "tokens", and if it is longer than 255 characters, it will split it into 2 or more tokens. GET \_analyze { "tokenizer": "whitespace", "filter": \[ { …

---

## [Regarding Split filter in mutate](https://discuss.elastic.co/t/regarding-split-filter-in-mutate/308540)

<div class="topic-metadata">

**Author:** [@suresh\_u](https://discuss.elastic.co/u/suresh_u)\
**Replies:** 3\
**Last updated:** [June 30, 2022, 8:29am UTC](https://discuss.elastic.co/t/regarding-split-filter-in-mutate/308540 "2022-06-30T08:29:07Z")

</div>

Hi team, I have one roll number like 1071-P56790-345. First number is 1071. Remaining fields in future can be added. So I need to extract 1071 and P56790-345 into 2 seperate fields. I tried using filter by delimeter …

---

## [Elastic agent upgrade error](https://discuss.elastic.co/t/elastic-agent-upgrade-error/308250)

<div class="topic-metadata">

**Author:** [@Guncixx](https://discuss.elastic.co/u/Guncixx)\
**Replies:** 6\
**Last updated:** [June 30, 2022, 8:20am UTC](https://discuss.elastic.co/t/elastic-agent-upgrade-error/308250 "2022-06-30T08:20:06Z")

</div>

There are similar topics in forum but already closed so opening a new one. After upgrading stack from 8.1.1 to 8.2.3 we are unable to upgrade agents using fleet. When I trigger upgrade function it changes state to upgrad…

---

## [New elasticsearch-java client needs to initialize in springboot?](https://discuss.elastic.co/t/new-elasticsearch-java-client-needs-to-initialize-in-springboot/308451)

<div class="topic-metadata">

**Author:** [@the-worm](https://discuss.elastic.co/u/the-worm)\
**Replies:** 1\
**Last updated:** [June 30, 2022, 8:05am UTC](https://discuss.elastic.co/t/new-elasticsearch-java-client-needs-to-initialize-in-springboot/308451 "2022-06-30T08:05:47Z")

</div>

Do we always need to initialize elasticsearch-java to use port 9200 or other custom ports and other setings? Previous high level REST client(HLRC) does not need the initialization in springboot. You just declare it and …

---

## [Failed to download database GeoLite2-City.mmdb](https://discuss.elastic.co/t/failed-to-download-database-geolite2-city-mmdb/308491)

<div class="topic-metadata">

**Author:** [@Ravi\_S1](https://discuss.elastic.co/u/Ravi_S1)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 7:54am UTC](https://discuss.elastic.co/t/failed-to-download-database-geolite2-city-mmdb/308491 "2022-06-30T07:54:21Z")

</div>

{"type": "server", "timestamp": "2022-06-29T06:19:15,707Z", "level": "ERROR", "component": "o.e.i.g.DatabaseNodeService", "cluster.name": "elasticsearch-prod", "node.name": "elasticsearch-XXXXXXXXXXXXXXXXX", "message": "…

---

## [App Search UI: Get Limit](https://discuss.elastic.co/t/app-search-ui-get-limit/308354)

<div class="topic-metadata">

**Author:** [@matip](https://discuss.elastic.co/u/matip)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 7:43am UTC](https://discuss.elastic.co/t/app-search-ui-get-limit/308354 "2022-06-30T07:43:22Z")

</div>

Hi, I have a probably simple question. We are using app search search ui. But when we start a search with a text abstract we get a "Query is too long (maximum is 128 characters)" error. How and where can we increase th…

---

## [Parse date and time to timestamp using grok pattern](https://discuss.elastic.co/t/parse-date-and-time-to-timestamp-using-grok-pattern/308481)

<div class="topic-metadata">

**Author:** [@zain.jutt](https://discuss.elastic.co/u/zain.jutt)\
**Replies:** 5\
**Last updated:** [June 30, 2022, 7:42am UTC](https://discuss.elastic.co/t/parse-date-and-time-to-timestamp-using-grok-pattern/308481 "2022-06-30T07:42:39Z")

</div>

Hi, i am trying to extract the information to timestamp from the following log event for that I tried it as 20220628 11:44:29.887 - DEBUG - Trying to connect to the target: I created the pattern this way %{YEAR}%{MONT…

---

## [Blacklisting(restricting) fields from elasticsearch query to be search](https://discuss.elastic.co/t/blacklisting-restricting-fields-from-elasticsearch-query-to-be-search/308539)

<div class="topic-metadata">

**Author:** [@deepak\_prem](https://discuss.elastic.co/u/deepak_prem)\
**Replies:** 3\
**Last updated:** [June 30, 2022, 7:32am UTC](https://discuss.elastic.co/t/blacklisting-restricting-fields-from-elasticsearch-query-to-be-search/308539 "2022-06-30T07:32:00Z")

</div>

Hi, friends am new to Elasticsearch. I want to know if I can exclude certain fields from search from Elasticsearch. To elaborate I want to ignore it from my search. It should not search that field when we specify but sho…

---

## [My use case : Joining indices?](https://discuss.elastic.co/t/my-use-case-joining-indices/308476)

<div class="topic-metadata">

**Author:** [@Vincent\_Enjalbert](https://discuss.elastic.co/u/Vincent_Enjalbert)\
**Replies:** 4\
**Last updated:** [June 30, 2022, 7:21am UTC](https://discuss.elastic.co/t/my-use-case-joining-indices/308476 "2022-06-30T07:21:45Z")

</div>

Hi there, I have an issue, and I'm considering using ES to solve it. I will try to simplify the use case at maximum (context = ecommerce) : I have currently two tables in my mysql database. One is a product table. T…

---

## [Elastic APM Java Agent JMX](https://discuss.elastic.co/t/elastic-apm-java-agent-jmx/308527)

<div class="topic-metadata">

**Author:** [@aravind0910](https://discuss.elastic.co/u/aravind0910)\
**Replies:** 1\
**Last updated:** [June 30, 2022, 7:18am UTC](https://discuss.elastic.co/t/elastic-apm-java-agent-jmx/308527 "2022-06-30T07:18:52Z")

</div>

If you are asking about a problem you are experiencing, please use the following template, as it will help us help you. If you have a different problem, please delete all of this text :slight\_smile: TIP 1: select at lea…

---

## [Filebeat installation using tar and configurations](https://discuss.elastic.co/t/filebeat-installation-using-tar-and-configurations/308536)

<div class="topic-metadata">

**Author:** [@navin1093](https://discuss.elastic.co/u/navin1093)\
**Replies:** 1\
**Last updated:** [June 30, 2022, 7:00am UTC](https://discuss.elastic.co/t/filebeat-installation-using-tar-and-configurations/308536 "2022-06-30T07:00:51Z")

</div>

Hi all, I installed filebeat using tar. Can I know where it is configure for the registry and config files. For example the location of below fields --path.config -- path.data -- path.logs How should i start the file…

[Previous page](https://discuss.elastic.co/latest.md?page=1064)

[Next page](https://discuss.elastic.co/latest.md?page=1066)
