# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=541 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 542 --- ## [Sort search results when sorted by double\_range or float\_range field return array\_index\_out\_of\_bounds\_exception](https://discuss.elastic.co/t/sort-search-results-when-sorted-by-double-range-or-float-range-field-return-array-index-out-of-bounds-exception/287753)
**Author:** [@carpeDiem](https://discuss.elastic.co/u/carpeDiem)\ **Replies:** 1\ **Last updated:** [November 16, 2021, 10:05am UTC](https://discuss.elastic.co/t/sort-search-results-when-sorted-by-double-range-or-float-range-field-return-array-index-out-of-bounds-exception/287753 "2021-11-16T10:05:15Z")
Hello experts, I'm currently trying to sort search results by double\_range or float\_range field,but return a server error:array\_index\_out\_of\_bounds\_exception,I've included the query and the error output, is this support… --- ## [Nest CleanupRepositoryAsync return body error](https://discuss.elastic.co/t/nest-cleanuprepositoryasync-return-body-error/288796)
**Author:** [@michel.st-louis](https://discuss.elastic.co/u/michel.st-louis)\ **Replies:** 1\ **Last updated:** [November 16, 2021, 9:08am UTC](https://discuss.elastic.co/t/nest-cleanuprepositoryasync-return-body-error/288796 "2021-11-16T09:08:10Z")
I am using nest with c# and when I use the query: Blockquote var response = await IndexClient.Snapshot.CleanupRepositoryAsync(respositoryName); Blockquote it return \`\`\` illegal\_argument\_exception Reason: "reques… --- ## [Elastic search takes up a lot of virtual memory under Linux](https://discuss.elastic.co/t/elastic-search-takes-up-a-lot-of-virtual-memory-under-linux/289279)
**Author:** [@zekaifeng](https://discuss.elastic.co/u/zekaifeng)\ **Replies:** 2\ **Last updated:** [November 16, 2021, 8:37am UTC](https://discuss.elastic.co/t/elastic-search-takes-up-a-lot-of-virtual-memory-under-linux/289279 "2021-11-16T08:37:05Z")
Our Elasticsearch version is 7.10.2. It runs on Linux system. The JVM memory allocation is about 3G, and the node memory is about 8G. It is a three node cluster system. The cluster has eight shard, each of which is about… --- ## [Aggregation with large data set using bucket aggregation](https://discuss.elastic.co/t/aggregation-with-large-data-set-using-bucket-aggregation/288141)
**Author:** [@RAVI\_GOPALANI](https://discuss.elastic.co/u/RAVI_GOPALANI)\ **Replies:** 1\ **Last updated:** [November 16, 2021, 8:01am UTC](https://discuss.elastic.co/t/aggregation-with-large-data-set-using-bucket-aggregation/288141 "2021-11-16T08:01:34Z")
Hi , We are using Elasticsearch to get the top hits based on large volumes of data using bucket aggregation. But we see there is default limit in max\_result\_window attribute of initial 10000 records which will be proce… --- ## [Elastic Agent output to Kafka](https://discuss.elastic.co/t/elastic-agent-output-to-kafka/289068)
**Author:** [@marti1](https://discuss.elastic.co/u/marti1)\ **Replies:** 2\ **Last updated:** [November 16, 2021, 7:32am UTC](https://discuss.elastic.co/t/elastic-agent-output-to-kafka/289068 "2021-11-16T07:32:25Z")
Hi, I would like to know if it's possible to connect Elastic Agents to Logstash through Kafka. Elastic Agent -\> Kafka \<- Logstash -\> Elasticsearch I have already read the documentation and I don't understant what mean… --- ## [Setting \[index.lifecycle.rollover\_alias\] for index \[y\] is empty or not defined](https://discuss.elastic.co/t/setting-index-lifecycle-rollover-alias-for-index-y-is-empty-or-not-defined/289053)
**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\ **Replies:** 1\ **Last updated:** [November 16, 2021, 7:13am UTC](https://discuss.elastic.co/t/setting-index-lifecycle-rollover-alias-for-index-y-is-empty-or-not-defined/289053 "2021-11-16T07:13:12Z")
I have read the documentation, and the solution to this error is that I need to set an alias for the index. But this index is at the system level, that is, I did not build it. Why do I need to manually set aliases? Sett… --- ## [Elasticsearch thread count leak - threads not closed on index delete](https://discuss.elastic.co/t/elasticsearch-thread-count-leak-threads-not-closed-on-index-delete/289250)
**Author:** [@NelsonBurton](https://discuss.elastic.co/u/NelsonBurton)\ **Replies:** 2\ **Last updated:** [November 16, 2021, 6:38am UTC](https://discuss.elastic.co/t/elasticsearch-thread-count-leak-threads-not-closed-on-index-delete/289250 "2021-11-16T06:38:18Z")
Hi Elasticsearch community, does Elasticsearch cleanly close the per-index threads after deleting an index? ES Version: 7.6.1 I have encountered an issue with my Elasticsearch set up, where the thread count slowly grow… --- ## [How to Resolve In\_flight\_request Data too Large Errors](https://discuss.elastic.co/t/how-to-resolve-in-flight-request-data-too-large-errors/289193)
**Author:** [@mertkaant](https://discuss.elastic.co/u/mertkaant)\ **Replies:** 2\ **Last updated:** [November 16, 2021, 6:33am UTC](https://discuss.elastic.co/t/how-to-resolve-in-flight-request-data-too-large-errors/289193 "2021-11-16T06:33:54Z")
Hello, dear community, We are constantly getting this OutOfMemory error with our master-1 machine. \[in\_flight\_requests\] New used memory 4567112664 \[4.2gb\] for data of \[\\] would be larger than configured br… --- ## [Synced Snapshots in S3 don't show up as available in the Repository](https://discuss.elastic.co/t/synced-snapshots-in-s3-dont-show-up-as-available-in-the-repository/289226)
**Author:** [@mattph](https://discuss.elastic.co/u/mattph)\ **Replies:** 3\ **Last updated:** [November 16, 2021, 6:23am UTC](https://discuss.elastic.co/t/synced-snapshots-in-s3-dont-show-up-as-available-in-the-repository/289226 "2021-11-16T06:23:07Z")
I'm new to Elasticsearch and trying to copy an index from a Dev environment to a Test environment. I've installed the S3 Repository plugin in both Dev and Test and configured the repository in Kibana. I setup a policy i… --- ## [The load of ES cluster CPU is high, but the utilization rate is not high](https://discuss.elastic.co/t/the-load-of-es-cluster-cpu-is-high-but-the-utilization-rate-is-not-high/289246)
**Author:** [@ktpktr0](https://discuss.elastic.co/u/ktpktr0)\ **Replies:** 6\ **Last updated:** [November 16, 2021, 3:37am UTC](https://discuss.elastic.co/t/the-load-of-es-cluster-cpu-is-high-but-the-utilization-rate-is-not-high/289246 "2021-11-16T03:37:54Z")
I have an elk cluster with 3 master nodes, 4 hot data nodes and 4 cold data nodes, and the disks are SSDs. Recently, it was found that the CPU load of the ES cluster is high, but the utilization rate is not high. The fol… --- ## [Expand limit of chars in field (truncated to 100,000 chars)](https://discuss.elastic.co/t/expand-limit-of-chars-in-field-truncated-to-100-000-chars/289209)
**Author:** [@christiancj](https://discuss.elastic.co/u/christiancj)\ **Replies:** 2\ **Last updated:** [November 16, 2021, 1:22am UTC](https://discuss.elastic.co/t/expand-limit-of-chars-in-field-truncated-to-100-000-chars/289209 "2021-11-16T01:22:18Z")
Hi, I'm facing an issue with one of our fields in Elasticsearch, I'm using FSCrawler to extract content and then ingest in Elasticsearch, however we've few large size files where the content extracted exceed 100,000 c… --- ## [Create track using datastreams](https://discuss.elastic.co/t/create-track-using-datastreams/289097)
**Author:** [@kvmuralidhar](https://discuss.elastic.co/u/kvmuralidhar)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 11:33pm UTC](https://discuss.elastic.co/t/create-track-using-datastreams/289097 "2021-11-15T23:33:05Z")
Hi, I am trying to create a custom track using an data stream index and it's failing because of the datastream is an hidden index. What's the work around to create this custom track ? Thanks Murali --- ## [Effectively partial update array field in ElasticSearch](https://discuss.elastic.co/t/effectively-partial-update-array-field-in-elasticsearch/288984)
**Author:** [@fatcloud](https://discuss.elastic.co/u/fatcloud)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 11:22pm UTC](https://discuss.elastic.co/t/effectively-partial-update-array-field-in-elasticsearch/288984 "2021-11-15T23:22:40Z")
Hi elastic experts, I'm wondering if there is a way to effectively partial update an element in an array field? For example, a document has a commands field like this: "commands": \[ { "id": 1000, "content": "a… --- ## [Is it ok to delete data (by query) on an index that was force merged to a single segment?](https://discuss.elastic.co/t/is-it-ok-to-delete-data-by-query-on-an-index-that-was-force-merged-to-a-single-segment/289221)
**Author:** [@kirk1](https://discuss.elastic.co/u/kirk1)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 10:23pm UTC](https://discuss.elastic.co/t/is-it-ok-to-delete-data-by-query-on-an-index-that-was-force-merged-to-a-single-segment/289221 "2021-11-15T22:23:32Z")
When our indices are no longer receiving new documents we run a force-merge down to a single segment. We now find ourselves needing to delete a very small percentage of the docs in several of these these single-segment i… --- ## [Set geopoint field from string field correctly for map visualization](https://discuss.elastic.co/t/set-geopoint-field-from-string-field-correctly-for-map-visualization/288513)
**Author:** [@ccfc1986](https://discuss.elastic.co/u/ccfc1986)\ **Replies:** 10\ **Last updated:** [November 15, 2021, 10:01pm UTC](https://discuss.elastic.co/t/set-geopoint-field-from-string-field-correctly-for-map-visualization/288513 "2021-11-15T22:01:34Z")
I have the following field in my documents: "COORDINATES" : "-11.661306;-47.506833" I have created a update\_by\_query that takes this field, extracts the lat/lon and sets to my actual geopoint defined field 'GeoLocation… --- ## [Custom analyzer with token replacement](https://discuss.elastic.co/t/custom-analyzer-with-token-replacement/289236)
**Author:** [@pistocop](https://discuss.elastic.co/u/pistocop)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 9:33pm UTC](https://discuss.elastic.co/t/custom-analyzer-with-token-replacement/289236 "2021-11-15T21:33:23Z")
2021-11-14T23:00:00Z (UTC) Hi to everyone, I was playing with custom analyzers and I had trouble with the following example. Basically, I want to index a document with a field named "user\_opinion" in two ways: with… --- ## [Connecting to Elasticsearch node in Elastic cloud through python promt](https://discuss.elastic.co/t/connecting-to-elasticsearch-node-in-elastic-cloud-through-python-promt/289028)
**Author:** [@Sentel\_AI](https://discuss.elastic.co/u/Sentel_AI)\ **Replies:** 6\ **Last updated:** [November 15, 2021, 8:54pm UTC](https://discuss.elastic.co/t/connecting-to-elasticsearch-node-in-elastic-cloud-through-python-promt/289028 "2021-11-15T20:54:35Z")
Hi, In order to create an ingestion pipeline into the Elasticsearch node running in Elastic Cloud, I'm using the following code (API authentication): # API authentication config = configparser.ConfigParser() config.read… --- ## [Rally-eventdata-track with custom parameter\_sources](https://discuss.elastic.co/t/rally-eventdata-track-with-custom-parameter-sources/289098)
**Author:** [@BlueLegend](https://discuss.elastic.co/u/BlueLegend)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 6:43pm UTC](https://discuss.elastic.co/t/rally-eventdata-track-with-custom-parameter-sources/289098 "2021-11-15T18:43:53Z")
I am run rally-eventdata-track but want to change to my own mapping. I am curious as to how the data in parameter\_sources was generated so I can create my own from my data. Are there any docs on how I can do this? --- ## [How to set indices.lifecycle.poll\_interval?](https://discuss.elastic.co/t/how-to-set-indices-lifecycle-poll-interval/289143)
**Author:** [@shi](https://discuss.elastic.co/u/shi)\ **Replies:** 4\ **Last updated:** [November 15, 2021, 6:13pm UTC](https://discuss.elastic.co/t/how-to-set-indices-lifecycle-poll-interval/289143 "2021-11-15T18:13:36Z")
How to set indices.lifecycle.poll\_interval? Read that it a cluster level setting. Thanks and regards shini --- ## [Calling on elasticsearch API endpoint directly](https://discuss.elastic.co/t/calling-on-elasticsearch-api-endpoint-directly/289207)
**Author:** [@tleduong](https://discuss.elastic.co/u/tleduong)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 5:26pm UTC](https://discuss.elastic.co/t/calling-on-elasticsearch-api-endpoint-directly/289207 "2021-11-15T17:26:49Z")
I'm using NEST client to talk to Elasticsearch and it is working fine. However, I have one endpoint where I couldn't figure out how to use NEST client and call on this API. Essentially I'd like to call on "GET my-inde… --- ## [Shard Failed- The data you are seeing might be incomplete or wrong](https://discuss.elastic.co/t/shard-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/288670)
**Author:** [@ptanguturi](https://discuss.elastic.co/u/ptanguturi)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 5:08pm UTC](https://discuss.elastic.co/t/shard-failed-the-data-you-are-seeing-might-be-incomplete-or-wrong/288670 "2021-11-15T17:08:17Z")
I am getting below error message. not sure what when wrong and didn't make any changes to index. script\_exception at shard 0index default-2021.11node weAPTkoJTm6njIweWotMLw Type script\_exception Reason runtime error … --- ## [Elastic query scipting issue using painless ( Too many dynamic script compilations )](https://discuss.elastic.co/t/elastic-query-scipting-issue-using-painless-too-many-dynamic-script-compilations/288693)
**Author:** [@Agnivesh\_Sharma](https://discuss.elastic.co/u/Agnivesh_Sharma)\ **Replies:** 3\ **Last updated:** [November 15, 2021, 4:53pm UTC](https://discuss.elastic.co/t/elastic-query-scipting-issue-using-painless-too-many-dynamic-script-compilations/288693 "2021-11-15T16:53:32Z")
A functional script query is working fine when i dont add certain scripts to it but it fails and returns \> \[script\] Too many dynamic script compilations within, max: \[75/5m\]; please use indexed, or scripts with parameter… --- ## [Elasticsearch is recreating indexes after they were deleted](https://discuss.elastic.co/t/elasticsearch-is-recreating-indexes-after-they-were-deleted/288039)
**Author:** [@kamillacrozara](https://discuss.elastic.co/u/kamillacrozara)\ **Replies:** 5\ **Last updated:** [November 15, 2021, 2:27pm UTC](https://discuss.elastic.co/t/elasticsearch-is-recreating-indexes-after-they-were-deleted/288039 "2021-11-15T14:27:34Z")
I am trying to sync relational data with Elasticsearch using Logstash. To do that I have crated a pipeline to Logstash like this: input { jdbc { tags =\> \["vehicles"\] jdbc\_driver\_library =\> "/usr/share/logstash… --- ## [Master not discovered yet, this node has not previously joined a bootstrapped](https://discuss.elastic.co/t/master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped/289075)
**Author:** [@Maks\_7v](https://discuss.elastic.co/u/Maks_7v)\ **Replies:** 15\ **Last updated:** [November 15, 2021, 2:29pm UTC](https://discuss.elastic.co/t/master-not-discovered-yet-this-node-has-not-previously-joined-a-bootstrapped/289075 "2021-11-15T14:29:59Z")
Hi there. I'm trying to deploy 3 masters, 2 data, and 2 ingest nodes to GCP k8s. There is a problem that masters struggle to discover each other. Here are the logs I get: "master not discovered yet, this node has not… --- ## [Strange Issue : Logs not getting indexed and error shows nothing](https://discuss.elastic.co/t/strange-issue-logs-not-getting-indexed-and-error-shows-nothing/289166)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 2\ **Last updated:** [November 15, 2021, 2:11pm UTC](https://discuss.elastic.co/t/strange-issue-logs-not-getting-indexed-and-error-shows-nothing/289166 "2021-11-15T14:11:22Z")
Facing a strange issue, I am using filebeat module to fetch AWS and Azure logs. Since few days I saw some logs are getting indexed properly and some are not. I saw error logs of Elasticsearch and logstash both but nothin… --- ## [Watcher detect number of ip blocked and generate alert by email](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198)
**Author:** [@Xor44](https://discuss.elastic.co/u/Xor44)\ **Replies:** 0\ **Last updated:** [November 15, 2021, 12:56pm UTC](https://discuss.elastic.co/t/watcher-detect-number-of-ip-blocked-and-generate-alert-by-email/289198 "2021-11-15T12:56:50Z")
i'm trying to create a Watcher alert , every time an IP is blocked by a security device . The alert must be based on the number of the logs generated by this device . If there is more than 10 logs per minute on a speci… --- ## [Nest Client not allowing default Boolean Queries](https://discuss.elastic.co/t/nest-client-not-allowing-default-boolean-queries/286871)
**Author:** [@jimmymacGA](https://discuss.elastic.co/u/jimmymacGA)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:54am UTC](https://discuss.elastic.co/t/nest-client-not-allowing-default-boolean-queries/286871 "2021-11-15T08:54:05Z")
I am trying to use the Nest client to create a custom class that can be instantiated with a default request. I am using the following code to create a boolean query that will become part of a default SearchRequest objec… --- ## [Bulk Insert from datatable using c#.net](https://discuss.elastic.co/t/bulk-insert-from-datatable-using-c-net/287516)
**Author:** [@balupad14](https://discuss.elastic.co/u/balupad14)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:50am UTC](https://discuss.elastic.co/t/bulk-insert-from-datatable-using-c-net/287516 "2021-11-15T08:50:28Z")
Hi All, I have a situation that I have to use the bulk insert using c#.net. The thing is the source is from the data table (dynamic data). Can you please someone help me to solve this ? Advance wishes. Thank you --- ## [Get Array FieldValues ElasticSearch NEST](https://discuss.elastic.co/t/get-array-fieldvalues-elasticsearch-nest/288911)
**Author:** [@Mr\_X](https://discuss.elastic.co/u/Mr_X)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:46am UTC](https://discuss.elastic.co/t/get-array-fieldvalues-elasticsearch-nest/288911 "2021-11-15T08:46:31Z")
Is there a way to get Arrays returned in FieldValues using NEST. Consider the following query var searchResponse = client.Search\(s =\> s .Index("specs") .Source(… --- ## [How to specify Refresh.WaitFor with an IndexMany request?](https://discuss.elastic.co/t/how-to-specify-refresh-waitfor-with-an-indexmany-request/287934)
**Author:** [@astanton1978](https://discuss.elastic.co/u/astanton1978)\ **Replies:** 1\ **Last updated:** [November 15, 2021, 8:43am UTC](https://discuss.elastic.co/t/how-to-specify-refresh-waitfor-with-an-indexmany-request/287934 "2021-11-15T08:43:30Z")
For the .net clients I dont see the option to wait for indexing to complete before returning the response when performing an IndexMany or IndexManyAsync. Its present for Index and IndexAsync. Is there a way to specify… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=540) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=542)