# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=766 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 767 --- ## [Painless Script Convert to JSON not HasMap string](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162)
**Author:** [@rajat\_j](https://discuss.elastic.co/u/rajat_j)\ **Replies:** 0\ **Last updated:** [November 12, 2020, 8:01am UTC](https://discuss.elastic.co/t/painless-script-convert-to-json-not-hasmap-string/255162 "2020-11-12T08:01:24Z")
I am trying to fetch an array using aggregation. The array is a nested array that contains a list of its own type. example : public class Attribute { public long Id { get; se… --- ## [It seems that require\_field\_match highlight option does not work](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051)
**Author:** [@zdeseb](https://discuss.elastic.co/u/zdeseb)\ **Replies:** 6\ **Last updated:** [November 12, 2020, 7:58am UTC](https://discuss.elastic.co/t/it-seems-that-require-field-match-highlight-option-does-not-work/255051 "2020-11-12T07:58:59Z")
Maybe I've missed something but it seems to me that highlight option require\_field\_match does not work correctly (ES 7.9.3 but I tested it with older versions also). Very simple example follows: Let's have following in… --- ## [ARM support in the age of MAC ARM](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118)
**Author:** [@frankshad](https://discuss.elastic.co/u/frankshad)\ **Replies:** 2\ **Last updated:** [November 12, 2020, 6:25am UTC](https://discuss.elastic.co/t/arm-support-in-the-age-of-mac-arm/255118 "2020-11-12T06:25:20Z")
Now that Mac ARM machines are a thing, is it possible that ElasticSearch can be made to run on ARM architectures without jumping through hoops. It used to work in v6, and it can be made to work on v7 but it takes a signi… --- ## [What is the probable release date for version 7.10?](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007)
**Author:** [@Nikit\_Singh](https://discuss.elastic.co/u/Nikit_Singh)\ **Replies:** 4\ **Last updated:** [November 12, 2020, 5:19am UTC](https://discuss.elastic.co/t/what-is-the-probable-release-date-for-version-7-10/255007 "2020-11-12T05:19:03Z")
Hi I wanted to use the new Observability feature of capturing web-vitals logs. It's only available in 7.10 so wanted to know when will it be released? Thanks. --- ## [What are the minimum permissions for an application-defined user to ingest data into Elasticsearch?](https://discuss.elastic.co/t/what-are-the-minimum-permissions-for-an-application-defined-user-to-ingest-data-into-elasticsearch/254994)
**Author:** [@deaugur](https://discuss.elastic.co/u/deaugur)\ **Replies:** 3\ **Last updated:** [November 12, 2020, 5:05am UTC](https://discuss.elastic.co/t/what-are-the-minimum-permissions-for-an-application-defined-user-to-ingest-data-into-elasticsearch/254994 "2020-11-12T05:05:55Z")
I'm new to Elastic and am currently enabling SSL/TLS across our cluster. I've currently configured applications that ingest to Elasticsearch to use the built-in superuser 'elastic' for authentication. This is less than i… --- ## [Remote clusters authentication](https://discuss.elastic.co/t/remote-clusters-authentication/254988)
**Author:** [@kyle\_che](https://discuss.elastic.co/u/kyle_che)\ **Replies:** 22\ **Last updated:** [November 11, 2020, 11:42pm UTC](https://discuss.elastic.co/t/remote-clusters-authentication/254988 "2020-11-11T23:42:36Z")
I am trying to test out remote clusters and then cross cluster replication. When inputting information about the other cluster under "Remote Clusters", Connection is saying "Not connected". I'm guessing this is due to my… --- ## [Unable to find valid certification path to requested target](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/254829)
**Author:** [@drivera](https://discuss.elastic.co/u/drivera)\ **Replies:** 4\ **Last updated:** [November 11, 2020, 10:12pm UTC](https://discuss.elastic.co/t/unable-to-find-valid-certification-path-to-requested-target/254829 "2020-11-11T22:12:47Z")
Hello, I'm trying to authenticate users via AD with no success. Running ES 7.9.2. with TLS encryption in the cluster. Below you can see the excerpt of the yml file where I'm setting up xpack security, and the error I am… --- ## [Receive from Webhook](https://discuss.elastic.co/t/receive-from-webhook/255128)
**Author:** [@GavinBeattie](https://discuss.elastic.co/u/GavinBeattie)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:14pm UTC](https://discuss.elastic.co/t/receive-from-webhook/255128 "2020-11-11T21:14:37Z")
OnePageCRM has the ability to output changes via a webhook. What I would like to know is how can I setup Elasticsearch to receive the post (or more importantly transform it) from the OnePageCRM format to the ES post form… --- ## [Snapshot Search vs Cold Nodes](https://discuss.elastic.co/t/snapshot-search-vs-cold-nodes/255121)
**Author:** [@rverchere](https://discuss.elastic.co/u/rverchere)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 8:17pm UTC](https://discuss.elastic.co/t/snapshot-search-vs-cold-nodes/255121 "2020-11-11T20:17:28Z")
Hi! I've just seen that Elastic will release snapshot search release for 7.10: https://www.elastic.co/fr/blog/whats-new-elastic-7-10-0-searchable-snapshots-lens-user-experience-monitoring https://www.elastic.co/guide/… --- ## [Elasticsearch Snapshot](https://discuss.elastic.co/t/elasticsearch-snapshot/254907)
**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\ **Replies:** 13\ **Last updated:** [November 11, 2020, 6:43pm UTC](https://discuss.elastic.co/t/elasticsearch-snapshot/254907 "2020-11-11T18:43:23Z")
Im using Snapshot Lifecycle Mgmt to create nightly snapshots. My questions are I saw this comes under Basic license. But I got confused when I saw XPACK tag in SLM page. Please clarify Since this will be daily snap… --- ## [Cosine-Distance of reduced dense vectors](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114)
**Author:** [@christiana](https://discuss.elastic.co/u/christiana)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:40pm UTC](https://discuss.elastic.co/t/cosine-distance-of-reduced-dense-vectors/255114 "2020-11-11T18:40:40Z")
Hi, i have set up a database containing documents which are having dense vectors for the features and for a binary \[1,0\] mask. I would like to use the script query to the database with a feature vector at runtime. For … --- ## [Running out of heap memory Elasticsearch](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848)
**Author:** [@yasir\_khatri](https://discuss.elastic.co/u/yasir_khatri)\ **Replies:** 14\ **Last updated:** [November 11, 2020, 6:28pm UTC](https://discuss.elastic.co/t/running-out-of-heap-memory-elasticsearch/254848 "2020-11-11T18:28:16Z")
We are using single node of elasticsearch with 24 gb of heap memory. The rollover size is 75gb with 2 shards per index therefore single shard size is roughly 37.5 gb. We need to archive 8 Tb of data out of which 2 Tb ha… --- ## [Exception when highlighting](https://discuss.elastic.co/t/exception-when-highlighting/255108)
**Author:** [@yansplichal](https://discuss.elastic.co/u/yansplichal)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 6:11pm UTC](https://discuss.elastic.co/t/exception-when-highlighting/255108 "2020-11-11T18:11:24Z")
Hi, In elasticsearch 7.9.2 - when a lot of documents are highlighted by unified highlighter - I am getting an exception. The query used to work in elasticsearch 7.1.0. I try to highlight everything: "highlight": { … --- ## [Setting custom index for two data sources in filebeat 7.x](https://discuss.elastic.co/t/setting-custom-index-for-two-data-sources-in-filebeat-7-x/254400)
**Author:** [@Atul\_Chadha](https://discuss.elastic.co/u/Atul_Chadha)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 5:33pm UTC](https://discuss.elastic.co/t/setting-custom-index-for-two-data-sources-in-filebeat-7-x/254400 "2020-11-11T17:33:57Z")
I am trying to add two index types based on the different log sources in filebeat 7.6.2, i have managed to get custom name running for one of the source however cant seem to find how this can be done for different data s… --- ## [Can not connect to Elasticsearch using Spark and elasticsearch-hadoop](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-using-spark-and-elasticsearch-hadoop/255077)
**Author:** [@swafa](https://discuss.elastic.co/u/swafa)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 2:01pm UTC](https://discuss.elastic.co/t/can-not-connect-to-elasticsearch-using-spark-and-elasticsearch-hadoop/255077 "2020-11-11T14:01:04Z")
We are trying to index our Elasticsearch cluster (version: 7.6.1) from Databricks using the elasticsearch-hadoop library (version: 7.9.3). Due to corporate compliance reasons, our Elasticsearch cluster can only be acces… --- ## [ILM policy does not get applied to newly created/rolled over indexes](https://discuss.elastic.co/t/ilm-policy-does-not-get-applied-to-newly-created-rolled-over-indexes/255096)
**Author:** [@Anirbaan\_Chowdhury](https://discuss.elastic.co/u/Anirbaan_Chowdhury)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 3:59pm UTC](https://discuss.elastic.co/t/ilm-policy-does-not-get-applied-to-newly-created-rolled-over-indexes/255096 "2020-11-11T15:59:06Z")
Hi Experts, I am using the default index, index template and ilm policy created by filebeat. Although the ilm policy is assigned to the index template, it does not automatically get assigned to the newly created/rolled… --- ## [Increase insert and search rate in elastic search](https://discuss.elastic.co/t/increase-insert-and-search-rate-in-elastic-search/254963)
**Author:** [@Sherrie](https://discuss.elastic.co/u/Sherrie)\ **Replies:** 3\ **Last updated:** [November 11, 2020, 3:29pm UTC](https://discuss.elastic.co/t/increase-insert-and-search-rate-in-elastic-search/254963 "2020-11-11T15:29:10Z")
Hi, We are using a JAVA API to insert 100k records from a kafka topic to elastic search endpoints to a particular index. The insert rate for 100k records takes upto 30 minutes. Whereas the same 100k records can be inser… --- ## [Intermittent slowness in queries](https://discuss.elastic.co/t/intermittent-slowness-in-queries/255087)
**Author:** [@dcamozzato](https://discuss.elastic.co/u/dcamozzato)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 2:37pm UTC](https://discuss.elastic.co/t/intermittent-slowness-in-queries/255087 "2020-11-11T14:37:25Z")
Hi, I am trying to understand some intermittent slowness in my stack. The symptom is this: I go into Kibana and run a query filtering only by time - "last 24 hours", for example - and I get results in 2 seconds. Ten m… --- ## [Best practice to delete old Snapshots on Elasticsearch 2.4](https://discuss.elastic.co/t/best-practice-to-delete-old-snapshots-on-elasticsearch-2-4/255063)
**Author:** [@Silas-91](https://discuss.elastic.co/u/Silas-91)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 1:28pm UTC](https://discuss.elastic.co/t/best-practice-to-delete-old-snapshots-on-elasticsearch-2-4/255063 "2020-11-11T13:28:54Z")
Hi all, does anyone know the best way to delete the old snapshots at elasticsearch 2.4. And what will happen if I delete a snapshot from 5 days ago? These are incremental snapshots. How do they behave when restoring? T… --- ## [Data stream rollover exceeded max\_size](https://discuss.elastic.co/t/data-stream-rollover-exceeded-max-size/255069)
**Author:** [@kin122](https://discuss.elastic.co/u/kin122)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 1:25pm UTC](https://discuss.elastic.co/t/data-stream-rollover-exceeded-max-size/255069 "2020-11-11T13:25:16Z")
hi i defined "test-log" data stream,add the ilm as follow "hot": { "min\_age": "0ms", "actions": { "rollover": { "max\_size": "10mb" }, "set\_priority": { "p… --- ## [Elasticsearch S3 repository creation - Reload secure settings](https://discuss.elastic.co/t/elasticsearch-s3-repository-creation-reload-secure-settings/255035)
**Author:** [@Tanex](https://discuss.elastic.co/u/Tanex)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 1:01pm UTC](https://discuss.elastic.co/t/elasticsearch-s3-repository-creation-reload-secure-settings/255035 "2020-11-11T13:01:54Z")
Hi All, I am using elasticsearch docker . The elasticsearch version Version: 6.2.1 I set my s3 credentials in elasticsearch-keystore . Now, i want to reload the secure settings. But i am getting the below errors. Plea… --- ## [How to add date format in \_delete\_by\_query](https://discuss.elastic.co/t/how-to-add-date-format-in-delete-by-query/254600)
**Author:** [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\ **Replies:** 15\ **Last updated:** [November 11, 2020, 12:56pm UTC](https://discuss.elastic.co/t/how-to-add-date-format-in-delete-by-query/254600 "2020-11-11T12:56:30Z")
Hello Team Could you please help me how to add a format while performing operation of "\_delete\_by\_query" on Index were condition of deletion is based on range --\> on a field having type as "epoch" and i can pass the da… --- ## [Fetching data from 3 index based on one unique field](https://discuss.elastic.co/t/fetching-data-from-3-index-based-on-one-unique-field/255047)
**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 12:48pm UTC](https://discuss.elastic.co/t/fetching-data-from-3-index-based-on-one-unique-field/255047 "2020-11-11T12:48:00Z")
Hi All, I have a requirement where I have three indexes In my first index there are three fields (id,name,age) In my second index, there are three fields(id, experience,company code) In my third index , there are thre… --- ## [What happens to copy\_to field when one of the origins values modified/deleted](https://discuss.elastic.co/t/what-happens-to-copy-to-field-when-one-of-the-origins-values-modified-deleted/255060)
**Author:** [@jac1241](https://discuss.elastic.co/u/jac1241)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 12:44pm UTC](https://discuss.elastic.co/t/what-happens-to-copy-to-field-when-one-of-the-origins-values-modified-deleted/255060 "2020-11-11T12:44:58Z")
Hello, I didn't find any reference in docs for this question. I want to use copy\_to to copy multiple fields to a signle field, when one of the original fields might be modified. For example: I have 2 fields: user\_ta… --- ## [Sort and Stats Aggregation](https://discuss.elastic.co/t/sort-and-stats-aggregation/254426)
**Author:** [@abhinav\_elk](https://discuss.elastic.co/u/abhinav_elk)\ **Replies:** 1\ **Last updated:** [November 11, 2020, 11:28am UTC](https://discuss.elastic.co/t/sort-and-stats-aggregation/254426 "2020-11-11T11:28:11Z")
I have a mapping of type { "properties":{ "Costs":{ "type":"nested", "properties":{ "price":{ "type":"integer" } … --- ## [Auto interval date histogram illegal argument exception, buckets must be less than 333](https://discuss.elastic.co/t/auto-interval-date-histogram-illegal-argument-exception-buckets-must-be-less-than-333/255042)
**Author:** [@dyegoe](https://discuss.elastic.co/u/dyegoe)\ **Replies:** 2\ **Last updated:** [November 11, 2020, 11:14am UTC](https://discuss.elastic.co/t/auto-interval-date-histogram-illegal-argument-exception-buckets-must-be-less-than-333/255042 "2020-11-11T11:14:38Z")
I tried to create an auto\_date\_histogram to generate some graphs in our application and I would like to keep the length of this graph as 360 points (buckets). I'm trying to achieve at least for the last 6h a graph per m… --- ## [Search Request are Getting Socket Timeout](https://discuss.elastic.co/t/search-request-are-getting-socket-timeout/255014)
**Author:** [@dillibabu.mekala](https://discuss.elastic.co/u/dillibabu.mekala)\ **Replies:** 6\ **Last updated:** [November 11, 2020, 10:02am UTC](https://discuss.elastic.co/t/search-request-are-getting-socket-timeout/255014 "2020-11-11T10:02:57Z")
Hi Team, We have an index containing 365 days data. We have started reprocessing existing 1-Day data (i.e reprocessing includes-\> Insert New Data + then delete the Old data), we observed that while reprocessing is goin… --- ## [Elasticsearch 6.8.10 memory leak](https://discuss.elastic.co/t/elasticsearch-6-8-10-memory-leak/253972)
**Author:** [@zcola](https://discuss.elastic.co/u/zcola)\ **Replies:** 6\ **Last updated:** [November 11, 2020, 9:33am UTC](https://discuss.elastic.co/t/elasticsearch-6-8-10-memory-leak/253972 "2020-11-11T09:33:01Z")
100+ node es cluster , hot/warm arch The stale node heap is 31gb, and multiple nodes occupy 90% of the heap irregularly. It will appear again one week after restarting. segment memory(14g), query cache(2.6g), single st… --- ## [Elasticsearch Datasheet Documentation](https://discuss.elastic.co/t/elasticsearch-datasheet-documentation/255028)
**Author:** [@syafeera](https://discuss.elastic.co/u/syafeera)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 9:05am UTC](https://discuss.elastic.co/t/elasticsearch-datasheet-documentation/255028 "2020-11-11T09:05:51Z")
Hi, Is anyone here have elastic-search datasheet documentation? --- ## [Integer instead of Float](https://discuss.elastic.co/t/integer-instead-of-float/255025)
**Author:** [@M2M](https://discuss.elastic.co/u/M2M)\ **Replies:** 0\ **Last updated:** [November 11, 2020, 8:59am UTC](https://discuss.elastic.co/t/integer-instead-of-float/255025 "2020-11-11T08:59:53Z")
Hi I have problem when trying to display a value as float. kindly note that I can displayed properly in Discover but not the case for any type of visualisation for more details please refer to the below snapshots from… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=765) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=767)