# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=504

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 505

---

## [ElasticSearch Read/Write performance issue on Peak Load](https://discuss.elastic.co/t/elasticsearch-read-write-performance-issue-on-peak-load/295216)

<div class="topic-metadata">

**Author:** [@sahil441](https://discuss.elastic.co/u/sahil441)\
**Replies:** 3\
**Last updated:** [January 26, 2022, 3:26pm UTC](https://discuss.elastic.co/t/elasticsearch-read-write-performance-issue-on-peak-load/295216 "2022-01-26T15:26:21Z")

</div>

Context: We are running ES Cluster (ES Version - "7.9.1") with 3 Master-Nodes & 8 data-nodes (AWS-"r5.2xlarge") We are using the default ES thread pool configuration There are 2 indices having 5 shards each (used by th…

---

## [Watcher - Use field data from input to condition script calc](https://discuss.elastic.co/t/watcher-use-field-data-from-input-to-condition-script-calc/295427)

<div class="topic-metadata">

**Author:** [@gerardgorrion](https://discuss.elastic.co/u/gerardgorrion)\
**Replies:** 1\
**Last updated:** [January 26, 2022, 2:49pm UTC](https://discuss.elastic.co/t/watcher-use-field-data-from-input-to-condition-script-calc/295427 "2022-01-26T14:49:55Z")

</div>

We are triying to deploy a watcher alert to compare values into a field of some logs The problem is: we need to compare 2 fields loaded in input: 1- metricbeat logs with some specific field 2- metricbeat logs with so…

---

## [Documentation issue for elastic version 8 breaking changes](https://discuss.elastic.co/t/documentation-issue-for-elastic-version-8-breaking-changes/294416)

<div class="topic-metadata">

**Author:** [@raulk89](https://discuss.elastic.co/u/raulk89)\
**Replies:** 1\
**Last updated:** [January 26, 2022, 2:48pm UTC](https://discuss.elastic.co/t/documentation-issue-for-elastic-version-8-breaking-changes/294416 "2022-01-26T14:48:53Z")

</div>

Hi https://www.elastic.co/guide/en/elasticsearch/reference/8.0/migrating-8.0.html#breaking-changes-8.0 How one should understand this, seems like contrary sentences..? Regards Raul

---

## [\[PLEASE\_HELP\] Consistent searching with search\_after](https://discuss.elastic.co/t/please-help-consistent-searching-with-search-after/294033)

<div class="topic-metadata">

**Author:** [@Juan\_Longo](https://discuss.elastic.co/u/Juan_Longo)\
**Replies:** 2\
**Last updated:** [January 26, 2022, 2:13pm UTC](https://discuss.elastic.co/t/please-help-consistent-searching-with-search-after/294033 "2022-01-26T14:13:50Z")

</div>

Hello, I need help making one of our queries consistent. We currently make a query that handles a big amount of documents. The problem I'm having is with an index that have documents that literally have the same properti…

---

## [Painless error](https://discuss.elastic.co/t/painless-error/295335)

<div class="topic-metadata">

**Author:** [@Tuckson](https://discuss.elastic.co/u/Tuckson)\
**Replies:** 3\
**Last updated:** [January 25, 2022, 4:24pm UTC](https://discuss.elastic.co/t/painless-error/295335 "2022-01-25T16:24:54Z")

</div>

Question is easy (and yes I am new to this painfull stuff), what am I doing wrong? { "docs": \[ { "error": { "root\_cause": \[ { "type": "script\_exception", "reason": "…

---

## [org.elasticsearch.ElasticsearchException: Failed to parse info response. Check logs for detailed information - Unsupported Content-Type: text/html](https://discuss.elastic.co/t/org-elasticsearch-elasticsearchexception-failed-to-parse-info-response-check-logs-for-detailed-information-unsupported-content-type-text-html/295417)

<div class="topic-metadata">

**Author:** [@Sumit\_Jha1](https://discuss.elastic.co/u/Sumit_Jha1)\
**Replies:** 5\
**Last updated:** [January 26, 2022, 11:22am UTC](https://discuss.elastic.co/t/org-elasticsearch-elasticsearchexception-failed-to-parse-info-response-check-logs-for-detailed-information-unsupported-content-type-text-html/295417 "2022-01-26T11:22:58Z")

</div>

I am using Elastic Search High Level REST API 7.15.0 (Java) and the version of ES deployed on elastic.co is 7.15.2 When making any request using the client, in the logs I can see, the client first makes call to cluster …

---

## [New installation - unable to start Elastic search on our harden RHEL8 image](https://discuss.elastic.co/t/new-installation-unable-to-start-elastic-search-on-our-harden-rhel8-image/295440)

<div class="topic-metadata">

**Author:** [@jokem48](https://discuss.elastic.co/u/jokem48)\
**Replies:** 0\
**Last updated:** [January 26, 2022, 9:38am UTC](https://discuss.elastic.co/t/new-installation-unable-to-start-elastic-search-on-our-harden-rhel8-image/295440 "2022-01-26T09:38:53Z")

</div>

Fresh install in our newly created RHEL8 vm. When we download and try to start Elasticsearch for the first time, we encounter an error. systemctl status ● elasticsearch.service - Elasticsearch Loaded: loaded (/usr/l…

---

## [Elastic driver](https://discuss.elastic.co/t/elastic-driver/295425)

<div class="topic-metadata">

**Author:** [@bertvervaele](https://discuss.elastic.co/u/bertvervaele)\
**Replies:** 0\
**Last updated:** [January 26, 2022, 7:13am UTC](https://discuss.elastic.co/t/elastic-driver/295425 "2022-01-26T07:13:26Z")

</div>

Hi everyone, I encountered a wierd issue with the http encoding of the Elastic driver. In some of my projects it translates the '/' to '%2f' as it should and in others it doesn't. Any ideas are welcome :slight\_smile: …

---

## [Use global field](https://discuss.elastic.co/t/use-global-field/295420)

<div class="topic-metadata">

**Author:** [@ratseba](https://discuss.elastic.co/u/ratseba)\
**Replies:** 0\
**Last updated:** [January 26, 2022, 6:40am UTC](https://discuss.elastic.co/t/use-global-field/295420 "2022-01-26T06:40:07Z")

</div>

Hi, I have several environments with beats and logstash who write to one Elasticsearch. Each of them have properties like: customer, environmnet type ( production, test) and type (depending on what they are for). In ea…

---

## [How to increase query speed on search engine?](https://discuss.elastic.co/t/how-to-increase-query-speed-on-search-engine/295361)

<div class="topic-metadata">

**Author:** [@can.ozdemir](https://discuss.elastic.co/u/can.ozdemir)\
**Replies:** 3\
**Last updated:** [January 26, 2022, 5:36am UTC](https://discuss.elastic.co/t/how-to-increase-query-speed-on-search-engine/295361 "2022-01-26T05:36:35Z")

</div>

Hello there, We would like to improve the query response time of a search query on the cluster, you may ask what kind of query but I cannot share that information. The query does some full-text searches, then function\_…

---

## [Date histogram error](https://discuss.elastic.co/t/date-histogram-error/295155)

<div class="topic-metadata">

**Author:** [@EnJay](https://discuss.elastic.co/u/EnJay)\
**Replies:** 11\
**Last updated:** [January 26, 2022, 1:11am UTC](https://discuss.elastic.co/t/date-histogram-error/295155 "2022-01-26T01:11:54Z")

</div>

Hello, dear community. Have an error with date histogram. I have a cryptocurrency price base with a 5 minute interval (4 million records). Fields: { "\_source": { "time":…

---

## [Differences in PUT requests in ES versions](https://discuss.elastic.co/t/differences-in-put-requests-in-es-versions/295171)

<div class="topic-metadata">

**Author:** [@EnJay](https://discuss.elastic.co/u/EnJay)\
**Replies:** 10\
**Last updated:** [January 25, 2022, 9:53pm UTC](https://discuss.elastic.co/t/differences-in-put-requests-in-es-versions/295171 "2022-01-25T21:53:50Z")

</div>

Hello everyone :hatched\_chick: I actively study Elasticsearch. I had to update my version ES to the latest from 5. But here I ran into a problem, the answer to which I could not find in the documentation. I used ES 5 …

---

## [Search templates {{#toJson}} with arrays: unexpected character](https://discuss.elastic.co/t/search-templates-tojson-with-arrays-unexpected-character/295398)

<div class="topic-metadata">

**Author:** [@Tristan2](https://discuss.elastic.co/u/Tristan2)\
**Replies:** 0\
**Last updated:** [January 25, 2022, 8:58pm UTC](https://discuss.elastic.co/t/search-templates-tojson-with-arrays-unexpected-character/295398 "2022-01-25T20:58:29Z")

</div>

I'm trying to parameterize \_source in a search template but I'm encountering an error. This is my template: PUT \_scripts/stored-script { "script": { "lang": "mustache", "source": { "\_source": "{{#toJson…

---

## [CPU usage metric via CAT API misbehaving after upgrading to 7.16.3 (running in LXD)](https://discuss.elastic.co/t/cpu-usage-metric-via-cat-api-misbehaving-after-upgrading-to-7-16-3-running-in-lxd/294620)

<div class="topic-metadata">

**Author:** [@juan.domenech](https://discuss.elastic.co/u/juan.domenech)\
**Replies:** 9\
**Last updated:** [January 25, 2022, 8:43pm UTC](https://discuss.elastic.co/t/cpu-usage-metric-via-cat-api-misbehaving-after-upgrading-to-7-16-3-running-in-lxd/294620 "2022-01-25T20:43:01Z")

</div>

Problem: In a 10 core CPU, 64GB RAM system, Centos 7.9 under LXD container virtualisation Elasticsearch reports wrong CPU usage after upgrading to 7.16.3 This issue wasn't present on 7.15.1 We use this metric to track …

---

## [Ingest Pipeline for Message Field](https://discuss.elastic.co/t/ingest-pipeline-for-message-field/295393)

<div class="topic-metadata">

**Author:** [@bm11100](https://discuss.elastic.co/u/bm11100)\
**Replies:** 0\
**Last updated:** [January 25, 2022, 7:38pm UTC](https://discuss.elastic.co/t/ingest-pipeline-for-message-field/295393 "2022-01-25T19:38:33Z")

</div>

We are using the Custom UDP Integration within Fleet. When it collects logs, it throws all the log data into a message field. I'm not very familiar with ingest pipelines and whether or not Grok or Json would be the best …

---

## [Start over with snapshots](https://discuss.elastic.co/t/start-over-with-snapshots/295376)

<div class="topic-metadata">

**Author:** [@mwise29](https://discuss.elastic.co/u/mwise29)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 6:12pm UTC](https://discuss.elastic.co/t/start-over-with-snapshots/295376 "2022-01-25T18:12:47Z")

</div>

We experienced some failed snapshots in one of our non-prod environments and now the snapshots aren't being fired on the configured schedule. We'd like to completely start over with the snapshots in this environment (de…

---

## [Missing documents in scroll when there is GC on server](https://discuss.elastic.co/t/missing-documents-in-scroll-when-there-is-gc-on-server/295073)

<div class="topic-metadata">

**Author:** [@EtienneMiret](https://discuss.elastic.co/u/EtienneMiret)\
**Replies:** 4\
**Last updated:** [January 25, 2022, 4:52pm UTC](https://discuss.elastic.co/t/missing-documents-in-scroll-when-there-is-gc-on-server/295073 "2022-01-25T16:52:45Z")

</div>

When using the scroll API to retrieve large number of documents for batch processing, there are sometimes a number of documents missing. Usually a full page (exactly 10k). When looking at the timestamps of those failing …

---

## [How to paas null in bulk action when updating using helpers in python](https://discuss.elastic.co/t/how-to-paas-null-in-bulk-action-when-updating-using-helpers-in-python/294526)

<div class="topic-metadata">

**Author:** [@bipin\_kumar2](https://discuss.elastic.co/u/bipin_kumar2)\
**Replies:** 2\
**Last updated:** [January 25, 2022, 4:49pm UTC](https://discuss.elastic.co/t/how-to-paas-null-in-bulk-action-when-updating-using-helpers-in-python/294526 "2022-01-25T16:49:57Z")

</div>

how to paas null in bulk action when updating using helpers in python , i am passing assing in helpers to update a field as null nut it throws error . action is as below actions = \[ { '\_op\_type': 'update', '\_index':…

---

## [Curator is not deleting ES snapshots](https://discuss.elastic.co/t/curator-is-not-deleting-es-snapshots/293774)

<div class="topic-metadata">

**Author:** [@hudar01](https://discuss.elastic.co/u/hudar01)\
**Replies:** 5\
**Last updated:** [January 25, 2022, 4:27pm UTC](https://discuss.elastic.co/t/curator-is-not-deleting-es-snapshots/293774 "2022-01-25T16:27:00Z")

</div>

Hello, Curator is not deleting 7 day old snapshots, even though they're there. I'm using python virtual environment where I've the following installed: (es-curator) \[ec2-user@im es-curator\]$ pip list Package …

---

## [Tried to override GC log settings, doubled the logging instead](https://discuss.elastic.co/t/tried-to-override-gc-log-settings-doubled-the-logging-instead/294277)

<div class="topic-metadata">

**Author:** [@OrangeDog](https://discuss.elastic.co/u/OrangeDog)\
**Replies:** 2\
**Last updated:** [January 25, 2022, 4:14pm UTC](https://discuss.elastic.co/t/tried-to-override-gc-log-settings-doubled-the-logging-instead/294277 "2022-01-25T16:14:36Z")

</div>

I used to edit /etc/elasticsearch/jvm.options in order to reduce the amount of GC logging. As directed in a recent update, I've now moved my changes to /etc/elasticsearch/jvm.options.d/gc.options. However, instead of o…

---

## [Why some boolean settings has two different suffix one is "enable" and another is "enabled"](https://discuss.elastic.co/t/why-some-boolean-settings-has-two-different-suffix-one-is-enable-and-another-is-enabled/294906)

<div class="topic-metadata">

**Author:** [@GrandFisher](https://discuss.elastic.co/u/GrandFisher)\
**Replies:** 3\
**Last updated:** [January 25, 2022, 4:09pm UTC](https://discuss.elastic.co/t/why-some-boolean-settings-has-two-different-suffix-one-is-enable-and-another-is-enabled/294906 "2022-01-25T16:09:43Z")

</div>

I want to know why the class EnableAllocationDecider has a setting called cluster.routing.allocation.enable which end with "enable", while class IndicesService has setting indices.id\_field\_data.enabled which end with "e…

---

## [Query Against Minhash Field](https://discuss.elastic.co/t/query-against-minhash-field/295370)

<div class="topic-metadata">

**Author:** [@Nutchapol\_Dendumrong](https://discuss.elastic.co/u/Nutchapol_Dendumrong)\
**Replies:** 0\
**Last updated:** [January 25, 2022, 4:08pm UTC](https://discuss.elastic.co/t/query-against-minhash-field/295370 "2022-01-25T16:08:45Z")

</div>

I have been following this tutorial to create minhash signature. However, it is unclear to me how to perform searching using minhash properly. I have attempted the following query, which I quickly learned that it is v…

---

## [Rank Feature Query as multiplier](https://discuss.elastic.co/t/rank-feature-query-as-multiplier/294022)

<div class="topic-metadata">

**Author:** [@ajay\_15](https://discuss.elastic.co/u/ajay_15)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 4:05pm UTC](https://discuss.elastic.co/t/rank-feature-query-as-multiplier/294022 "2022-01-25T16:05:11Z")

</div>

I am looking to multiply score from Rank feature query(Rank feature query | Elasticsearch Guide \[7.16\] | Elastic) to relevancy score calculated from my query. I know we can do something similar using rescore query and f…

---

## [Run aggregation separately on time based indices](https://discuss.elastic.co/t/run-aggregation-separately-on-time-based-indices/293981)

<div class="topic-metadata">

**Author:** [@Nowrin\_Hossain](https://discuss.elastic.co/u/Nowrin_Hossain)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 3:57pm UTC](https://discuss.elastic.co/t/run-aggregation-separately-on-time-based-indices/293981 "2022-01-25T15:57:46Z")

</div>

I have time based indices in Elasticsearch of an index and I want to run aggregation separately for every index. Is it possible ? There is any way to tell Elasticsearch not to run aggregation on whole data of all time in…

---

## [Use script in suggestion](https://discuss.elastic.co/t/use-script-in-suggestion/294069)

<div class="topic-metadata">

**Author:** [@Amir\_Faramarzi](https://discuss.elastic.co/u/Amir_Faramarzi)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 3:54pm UTC](https://discuss.elastic.co/t/use-script-in-suggestion/294069 "2022-01-25T15:54:47Z")

</div>

hello how to use script(painless) in suggestion??

---

## [Local index replication to support terms query lookups](https://discuss.elastic.co/t/local-index-replication-to-support-terms-query-lookups/295325)

<div class="topic-metadata">

**Author:** [@rhart](https://discuss.elastic.co/u/rhart)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 3:43pm UTC](https://discuss.elastic.co/t/local-index-replication-to-support-terms-query-lookups/295325 "2022-01-25T15:43:12Z")

</div>

The documentation in ES version 6.8 (Terms Query | Elasticsearch Guide \[6.8\] | Elastic) eluded to an approach to improve performance for terms lookups by searching for terms on a local node that has a fully replicated in…

---

## [How to retrieve results with certain amount of hits](https://discuss.elastic.co/t/how-to-retrieve-results-with-certain-amount-of-hits/295360)

<div class="topic-metadata">

**Author:** [@Almog\_Wertzberger](https://discuss.elastic.co/u/Almog_Wertzberger)\
**Replies:** 0\
**Last updated:** [January 25, 2022, 2:37pm UTC](https://discuss.elastic.co/t/how-to-retrieve-results-with-certain-amount-of-hits/295360 "2022-01-25T14:37:39Z")

</div>

Hi, Having this query for example: GET person\_group/\_search { "query": { "bool": { "filter": \[ { "exists": { "field": "educations" } …

---

## [Nested Composite Aggregations with ElasticSearch](https://discuss.elastic.co/t/nested-composite-aggregations-with-elasticsearch/295282)

<div class="topic-metadata">

**Author:** [@TomTom](https://discuss.elastic.co/u/TomTom)\
**Replies:** 2\
**Last updated:** [January 25, 2022, 1:48pm UTC](https://discuss.elastic.co/t/nested-composite-aggregations-with-elasticsearch/295282 "2022-01-25T13:48:54Z")

</div>

I have an index that stores sales by salesperson, and each sale has a service rating. Using composite I get these separate ratings within an object by duplicating the seller ID. Is it possible to nest within a single obj…

---

## [Faceted Search Query](https://discuss.elastic.co/t/faceted-search-query/295351)

<div class="topic-metadata">

**Author:** [@andrew\_1555](https://discuss.elastic.co/u/andrew_1555)\
**Replies:** 0\
**Last updated:** [January 25, 2022, 1:31pm UTC](https://discuss.elastic.co/t/faceted-search-query/295351 "2022-01-25T13:31:38Z")

</div>

So I am trying to write a query which returns aggregations of facets. So for example (Red: 12, Green: 8, XL : 4 etc) where the numbers are the document counts. I have been following this article which explains what I am…

---

## [Configure ElasticSearch ingest pipeline at startup?](https://discuss.elastic.co/t/configure-elasticsearch-ingest-pipeline-at-startup/295087)

<div class="topic-metadata">

**Author:** [@tlc](https://discuss.elastic.co/u/tlc)\
**Replies:** 1\
**Last updated:** [January 25, 2022, 12:54pm UTC](https://discuss.elastic.co/t/configure-elasticsearch-ingest-pipeline-at-startup/295087 "2022-01-25T12:54:11Z")

</div>

I've ported a logstash pipeline to an ES ingest pipeline, because I found out that some of our deployments use filebeat-\>logstash-\>ES, but others use Elastic Agent-\>ES. (I know nothing about Agent, I know a little about…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=503)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=505)
