# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=367

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 368

---

## [How to Remove old value and replace it with new value in Kibana](https://discuss.elastic.co/t/how-to-remove-old-value-and-replace-it-with-new-value-in-kibana/315522)

<div class="topic-metadata">

**Author:** [@SayliKibana](https://discuss.elastic.co/u/SayliKibana)\
**Replies:** 0\
**Last updated:** [September 30, 2022, 6:29am UTC](https://discuss.elastic.co/t/how-to-remove-old-value-and-replace-it-with-new-value-in-kibana/315522 "2022-09-30T06:29:51Z")

</div>

We have an Automation process wherein we process Transaction Input as "ECO Number" and as it get processed ,the output of the ECO Number with Status is displayed on the Kibana Dashboard. According to our process we upda…

---

## [Find average aggregation of the top N buckets](https://discuss.elastic.co/t/find-average-aggregation-of-the-top-n-buckets/315515)

<div class="topic-metadata">

**Author:** [@bhavya](https://discuss.elastic.co/u/bhavya)\
**Replies:** 0\
**Last updated:** [September 30, 2022, 5:43am UTC](https://discuss.elastic.co/t/find-average-aggregation-of-the-top-n-buckets/315515 "2022-09-30T05:43:39Z")

</div>

I'm trying to determine the average value of the "count" column for the top 5 documents ordered by "timestamp" (in descending order). Sample Index data: {"index":{}} {"title": "foo", "count": 1, "timestamp":"2022-09-15…

---

## [Elasticsearch \[6.8\] small index query response time in seconds](https://discuss.elastic.co/t/elasticsearch-6-8-small-index-query-response-time-in-seconds/315512)

<div class="topic-metadata">

**Author:** [@srivatsa](https://discuss.elastic.co/u/srivatsa)\
**Replies:** 0\
**Last updated:** [September 30, 2022, 4:34am UTC](https://discuss.elastic.co/t/elasticsearch-6-8-small-index-query-response-time-in-seconds/315512 "2022-09-30T04:34:27Z")

</div>

Hi folks, Facing an issue involving a small index of the size 378kb taking around 10s for a read query. We had tried increasing the number of replicas assuming it would help with reads but did not see any noticeable dif…

---

## [Ingest Pipeline threads](https://discuss.elastic.co/t/ingest-pipeline-threads/315182)

<div class="topic-metadata">

**Author:** [@alah64](https://discuss.elastic.co/u/alah64)\
**Replies:** 1\
**Last updated:** [September 30, 2022, 3:57am UTC](https://discuss.elastic.co/t/ingest-pipeline-threads/315182 "2022-09-30T03:57:38Z")

</div>

In logstash, the pipeline.workers setting determines how many threads to run to process the filter and output. Do we have similar settings for elasticsearch ingest pipeline? It seems to work single-threaded and the more…

---

## [Does IndexRequest trigger ingest phase for a document already in the index?](https://discuss.elastic.co/t/does-indexrequest-trigger-ingest-phase-for-a-document-already-in-the-index/315215)

<div class="topic-metadata">

**Author:** [@fifthist](https://discuss.elastic.co/u/fifthist)\
**Replies:** 1\
**Last updated:** [September 30, 2022, 3:53am UTC](https://discuss.elastic.co/t/does-indexrequest-trigger-ingest-phase-for-a-document-already-in-the-index/315215 "2022-09-30T03:53:02Z")

</div>

When using index mode, does IndexRequest trigger the ingest phase for a document already stored in an index? I'd like to use an ingest pipeline on an index, and I want to use the set processor even for documents that al…

---

## [Is this ES config valid & how to address cluster](https://discuss.elastic.co/t/is-this-es-config-valid-how-to-address-cluster/315262)

<div class="topic-metadata">

**Author:** [@Bitdoctor](https://discuss.elastic.co/u/Bitdoctor)\
**Replies:** 1\
**Last updated:** [September 30, 2022, 3:52am UTC](https://discuss.elastic.co/t/is-this-es-config-valid-how-to-address-cluster/315262 "2022-09-30T03:52:21Z")

</div>

Even though there are amazing communities like this, it's still difficult to find good answers on some things. We have 1 x Kibana, 1 x LogStash, 3 x ES Cluster nodes. Is this a valid architecture; or do we have to have 1…

---

## [Banzai Cloud Fluentd filter is not working](https://discuss.elastic.co/t/banzai-cloud-fluentd-filter-is-not-working/315444)

<div class="topic-metadata">

**Author:** [@buulq90](https://discuss.elastic.co/u/buulq90)\
**Replies:** 1\
**Last updated:** [September 30, 2022, 3:41am UTC](https://discuss.elastic.co/t/banzai-cloud-fluentd-filter-is-not-working/315444 "2022-09-30T03:41:07Z")

</div>

Hi all, I'm trying to remove some field on Fluentd by using plugin record\_transformer but it does not works. I'm trying to delete 2 fields: "\_id" & "\_index". Below is my configuration file: apiVersion: logging.banzaic…

---

## [How to force mapper\_parsing\_exception? from ElasticSearch to prevent accepting different types for a specific field](https://discuss.elastic.co/t/how-to-force-mapper-parsing-exception-from-elasticsearch-to-prevent-accepting-different-types-for-a-specific-field/315485)

<div class="topic-metadata">

**Author:** [@Saeedeh\_Moghimi](https://discuss.elastic.co/u/Saeedeh_Moghimi)\
**Replies:** 1\
**Last updated:** [September 30, 2022, 3:38am UTC](https://discuss.elastic.co/t/how-to-force-mapper-parsing-exception-from-elasticsearch-to-prevent-accepting-different-types-for-a-specific-field/315485 "2022-09-30T03:38:52Z")

</div>

I have a production index with a date type field, which causes the error of Field \[tagSet.items.value\] of type \[text\] does not support custom formats in Kibana. I've created another index for test and whenever I want t…

---

## [New Elasticsearch client - Search response cannot be serialized because of null value on sort fields](https://discuss.elastic.co/t/new-elasticsearch-client-search-response-cannot-be-serialized-because-of-null-value-on-sort-fields/315326)

<div class="topic-metadata">

**Author:** [@ALX\_DM](https://discuss.elastic.co/u/ALX_DM)\
**Replies:** 9\
**Last updated:** [September 30, 2022, 1:31am UTC](https://discuss.elastic.co/t/new-elasticsearch-client-search-response-cannot-be-serialized-because-of-null-value-on-sort-fields/315326 "2022-09-30T01:31:28Z")

</div>

I am migrating elasticsearch from old to new elasticsearch java client. I encounter this problem wherein I issue a request query, then the response has null values. The code below is how I request: SearchRequest r…

---

## [Min\_score doesnt apply to aggregates](https://discuss.elastic.co/t/min-score-doesnt-apply-to-aggregates/315503)

<div class="topic-metadata">

**Author:** [@reisner](https://discuss.elastic.co/u/reisner)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 9:37pm UTC](https://discuss.elastic.co/t/min-score-doesnt-apply-to-aggregates/315503 "2022-09-29T21:37:06Z")

</div>

Hi there, I'm seeing some weird behaviour trying to fix an issue with a query. I was originally running this query: GET /coe\_td\_council\_report\_files\_test/\_search { "size": 0, "min\_score": 2.9, "query": { "b…

---

## [Combine normal and nested fields with query\_string](https://discuss.elastic.co/t/combine-normal-and-nested-fields-with-query-string/315502)

<div class="topic-metadata">

**Author:** [@Antonio\_Antovski](https://discuss.elastic.co/u/Antonio_Antovski)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 8:54pm UTC](https://discuss.elastic.co/t/combine-normal-and-nested-fields-with-query-string/315502 "2022-09-29T20:54:18Z")

</div>

I have a document which contains both normal and nested fields. I'm trying to find all the documents that contain all the words from a regex query in any of the fields of interest. Since I'm using a regex query and tryin…

---

## [My Elasticsearch wont start after java update](https://discuss.elastic.co/t/my-elasticsearch-wont-start-after-java-update/315454)

<div class="topic-metadata">

**Author:** [@Joe\_Li](https://discuss.elastic.co/u/Joe_Li)\
**Replies:** 4\
**Last updated:** [September 29, 2022, 6:13pm UTC](https://discuss.elastic.co/t/my-elasticsearch-wont-start-after-java-update/315454 "2022-09-29T18:13:28Z")

</div>

getting the below error and not sure where to start... can anyone assist? \[root@bh3elklpv01 jli\]# sudo systemctl status elasticsearch.service ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/lib/systemd/sy…

---

## [Document count by index name](https://discuss.elastic.co/t/document-count-by-index-name/315477)

<div class="topic-metadata">

**Author:** [@S-elk](https://discuss.elastic.co/u/S-elk)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 4:57pm UTC](https://discuss.elastic.co/t/document-count-by-index-name/315477 "2022-09-29T16:57:49Z")

</div>

Hello! Im trying to get the document count by index but I have only been able to get a total count or the count per index of a few. attempts: GET \*/\_search { "size": 0, "aggs": { "indices": { "terms": { …

---

## [How to view docs.deleted data](https://discuss.elastic.co/t/how-to-view-docs-deleted-data/315459)

<div class="topic-metadata">

**Author:** [@KrishnaCh](https://discuss.elastic.co/u/KrishnaCh)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 2:29pm UTC](https://discuss.elastic.co/t/how-to-view-docs-deleted-data/315459 "2022-09-29T14:29:41Z")

</div>

Hi All, In my elastic cluster, I see there are some records in docs.deleted for some of the indices, and I am not sure how to find out who deleted the docs? My 3 node elastic cluster version is 7.16.1 and it is Not an …

---

## [How to set Max\_analyzed\_offset setting for all searches in Discover](https://discuss.elastic.co/t/how-to-set-max-analyzed-offset-setting-for-all-searches-in-discover/315466)

<div class="topic-metadata">

**Author:** [@Quentin\_vk](https://discuss.elastic.co/u/Quentin_vk)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 2:14pm UTC](https://discuss.elastic.co/t/how-to-set-max-analyzed-offset-setting-for-all-searches-in-discover/315466 "2022-09-29T14:14:51Z")

</div>

Hi, we're having this very well known error "the length of field\[...\] index has exceed maximum allowed to be analyzed for highlighting". We're trying to use the max\_analyzed\_offset setting as a global search setting in …

---

## [I have a problem elasticsearch](https://discuss.elastic.co/t/i-have-a-problem-elasticsearch/315366)

<div class="topic-metadata">

**Author:** [@Marcelo\_F\_Costa](https://discuss.elastic.co/u/Marcelo_F_Costa)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 2:03pm UTC](https://discuss.elastic.co/t/i-have-a-problem-elasticsearch/315366 "2022-09-29T14:03:04Z")

</div>

I have this problem and I have no idea what it is. Can someone help me? Follow the log. \[2022-09-28T02:21:14,224\]\[WARN \]\[o.e.m.j.JvmGcMonitorService\] \[VM-Elasticsearch\] \[gc\]\[young\]\[365947\]\[70063\] duration \[1.5s\], coll…

---

## [Is java API Client 7.16 be used with Elasticsearch version 7.9.2?](https://discuss.elastic.co/t/is-java-api-client-7-16-be-used-with-elasticsearch-version-7-9-2/315465)

<div class="topic-metadata">

**Author:** [@Karthik\_Amar](https://discuss.elastic.co/u/Karthik_Amar)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 1:57pm UTC](https://discuss.elastic.co/t/is-java-api-client-7-16-be-used-with-elasticsearch-version-7-9-2/315465 "2022-09-29T13:57:26Z")

</div>

Hi all. Sorry if this very obvious question. As per documentation The Elasticsearch Java client is forward compatible; meaning that the client supports communicating with greater or equal minor versions of Elasticsearc…

---

## [Is Fuzzy sentence search in elasticsearch based on edit distance of words?](https://discuss.elastic.co/t/is-fuzzy-sentence-search-in-elasticsearch-based-on-edit-distance-of-words/315464)

<div class="topic-metadata">

**Author:** [@swapnil3597](https://discuss.elastic.co/u/swapnil3597)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:57pm UTC](https://discuss.elastic.co/t/is-fuzzy-sentence-search-in-elasticsearch-based-on-edit-distance-of-words/315464 "2022-09-29T13:57:19Z")

</div>

For a given index I have added documents like: \[ {"expression": "tell me something about elasticsearch"}, {"expression": "this is a new feature for elasticsearch"}, {"expression": "tell me something about kibana"}, # ..…

---

## [Heartbeat.config.monitors path to c:/program files](https://discuss.elastic.co/t/heartbeat-config-monitors-path-to-c-program-files/315458)

<div class="topic-metadata">

**Author:** [@miguelbatista](https://discuss.elastic.co/u/miguelbatista)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:35pm UTC](https://discuss.elastic.co/t/heartbeat-config-monitors-path-to-c-program-files/315458 "2022-09-29T13:35:59Z")

</div>

Hi, I've installed Heartbeat on a Windows server VM in here "C:\\Program Files\\Heartbeat" and can't get heartbeat.yml config.monitors path right to read the monitors.d files.

---

## [Elasticsearch "snapshot\_restore\_exception" "reason": snapshot does not exist" when snapshot status is SUCCESS](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-exception-reason-snapshot-does-not-exist-when-snapshot-status-is-success/315457)

<div class="topic-metadata">

**Author:** [@arozaki](https://discuss.elastic.co/u/arozaki)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 1:24pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot-restore-exception-reason-snapshot-does-not-exist-when-snapshot-status-is-success/315457 "2022-09-29T13:24:49Z")

</div>

I am using the Java/Groovy client for Elasticsearch and I am trying to restore an ES snapshot during an upgrade. I am using the Groovy code I have so far for setting up my old and new clients and making them create & res…

---

## [Query document array is a subset of search input](https://discuss.elastic.co/t/query-document-array-is-a-subset-of-search-input/315419)

<div class="topic-metadata">

**Author:** [@bwly](https://discuss.elastic.co/u/bwly)\
**Replies:** 1\
**Last updated:** [September 29, 2022, 1:03pm UTC](https://discuss.elastic.co/t/query-document-array-is-a-subset-of-search-input/315419 "2022-09-29T13:03:13Z")

</div>

I have document that has the this array attribute {array\_attr: \[ { id: "A", name: "A\_name" }, { id: "B", name: "B\_name" }, { id: "C", name: "B\_name" } \]} In my search query, I have…

---

## [Pyspark: from curl to correct settings](https://discuss.elastic.co/t/pyspark-from-curl-to-correct-settings/314999)

<div class="topic-metadata">

**Author:** [@obi134](https://discuss.elastic.co/u/obi134)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 12:58pm UTC](https://discuss.elastic.co/t/pyspark-from-curl-to-correct-settings/314999 "2022-09-29T12:58:17Z")

</div>

Hi there, I'm trying to push data from databricks/pyspark to elasticsearch following these instructions: ElasticSearch | Databricks on AWS Unfortunately I'm getting this error: org.elasticsearch.hadoop.EsHadoopIllega…

---

## [Issue with implement proxy in elasticsearch/kibana](https://discuss.elastic.co/t/issue-with-implement-proxy-in-elasticsearch-kibana/315452)

<div class="topic-metadata">

**Author:** [@lgriger](https://discuss.elastic.co/u/lgriger)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 12:41pm UTC](https://discuss.elastic.co/t/issue-with-implement-proxy-in-elasticsearch-kibana/315452 "2022-09-29T12:41:23Z")

</div>

elasticsearch config xpack.http.proxy.host: http:// xpack.http.proxy.port: 8080 xpack.http.proxy.scheme:http kibana config xpack.fleet.registryProxyUrl: http://\<user:password@url\> xpack.actions.proxyUrl: http://\<us…

---

## [Stemming and the near span query](https://discuss.elastic.co/t/stemming-and-the-near-span-query/315449)

<div class="topic-metadata">

**Author:** [@af1](https://discuss.elastic.co/u/af1)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 11:51am UTC](https://discuss.elastic.co/t/stemming-and-the-near-span-query/315449 "2022-09-29T11:51:59Z")

</div>

Hello community, hope to get your help on an issue we are having, we are using the english stemming and are running a near span query that basically searches for "buying near before" now if I search for a match phras…

---

## [Granular user-document level permissions](https://discuss.elastic.co/t/granular-user-document-level-permissions/315438)

<div class="topic-metadata">

**Author:** [@mattkallo](https://discuss.elastic.co/u/mattkallo)\
**Replies:** 5\
**Last updated:** [September 29, 2022, 10:33am UTC](https://discuss.elastic.co/t/granular-user-document-level-permissions/315438 "2022-09-29T10:33:54Z")

</div>

Hi, In our search index we want to specify access at very granular level. For eg. Say we have doc1, doc2, doc3 in index and user1 has access to doc1 and doc2, similarly user2 to doc2 and doc3, user3 to doc3 and doc1. T…

---

## [Search\_phase\_execution\_exception in partitioned terms aggregation](https://discuss.elastic.co/t/search-phase-execution-exception-in-partitioned-terms-aggregation/315443)

<div class="topic-metadata">

**Author:** [@Sederfo](https://discuss.elastic.co/u/Sederfo)\
**Replies:** 0\
**Last updated:** [September 29, 2022, 10:00am UTC](https://discuss.elastic.co/t/search-phase-execution-exception-in-partitioned-terms-aggregation/315443 "2022-09-29T10:00:04Z")

</div>

I have an index which contains millions of documents that I want to aggregate. This is the query I am using to obtain the aggregated results. aggs = { "0": { "terms": { …

---

## [Failed Reroute unassigned index](https://discuss.elastic.co/t/failed-reroute-unassigned-index/315437)

<div class="topic-metadata">

**Author:** [@GithubRyze](https://discuss.elastic.co/u/GithubRyze)\
**Replies:** 2\
**Last updated:** [September 29, 2022, 9:17am UTC](https://discuss.elastic.co/t/failed-reroute-unassigned-index/315437 "2022-09-29T09:17:58Z")

</div>

Elasticsearch Version docker image 8.1.3 Installed Plugins No response Java Version openJDK 8 OS Version linux Problem Description index shard prirep state node unassigned.r…

---

## [Convert es (Bucket aggregation) query to java](https://discuss.elastic.co/t/convert-es-bucket-aggregation-query-to-java/315321)

<div class="topic-metadata">

**Author:** [@Shubh](https://discuss.elastic.co/u/Shubh)\
**Replies:** 8\
**Last updated:** [September 29, 2022, 9:15am UTC](https://discuss.elastic.co/t/convert-es-bucket-aggregation-query-to-java/315321 "2022-09-29T09:15:05Z")

</div>

Hi, Can anyone help me convert this query in java program and how would i get only the aggreagtion result from query. The query is given below. GET /\_search { "size": 0, "query": { "bool": { "filter": \[ …

---

## [Deleting index suddenly](https://discuss.elastic.co/t/deleting-index-suddenly/315334)

<div class="topic-metadata">

**Author:** [@Emre\_Kurt](https://discuss.elastic.co/u/Emre_Kurt)\
**Replies:** 8\
**Last updated:** [September 29, 2022, 8:03am UTC](https://discuss.elastic.co/t/deleting-index-suddenly/315334 "2022-09-29T08:03:20Z")

</div>

Hi everyone, I've been having a very annoying problem lately. Something deleting my indexes suddenly. Here is my situations; 9200 port is closed to outside. Only server ip can access the port. There is a lot of docker…

---

## [ILM Pattern suffix reach max count](https://discuss.elastic.co/t/ilm-pattern-suffix-reach-max-count/315425)

<div class="topic-metadata">

**Author:** [@alfianaf](https://discuss.elastic.co/u/alfianaf)\
**Replies:** 4\
**Last updated:** [September 29, 2022, 7:54am UTC](https://discuss.elastic.co/t/ilm-pattern-suffix-reach-max-count/315425 "2022-09-29T07:54:17Z")

</div>

Hello, I want to ask about ILM pattern count, what will happen if the pattern reach 999999? lets give an example I have : index-000001 then what happen if someday my index reached : index-999999 does the number re…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=366)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=368)
