# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=589 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 590 --- ## [Use azure active directory with NEST/Elasticsearch.net](https://discuss.elastic.co/t/use-azure-active-directory-with-nest-elasticsearch-net/280893)
**Author:** [@Abhishek\_Tripathi](https://discuss.elastic.co/u/Abhishek_Tripathi)\ **Replies:** 5\ **Last updated:** [August 19, 2021, 6:23pm UTC](https://discuss.elastic.co/t/use-azure-active-directory-with-nest-elasticsearch-net/280893 "2021-08-19T18:23:52Z")
We are working on a project where we are authenticating users with Azure Active Directory. Upon the successful authentication, the user's browsers receive an Id and Access token, and then we use the same access token to … --- ## [This site can’t provide a secure connection (URGENT)](https://discuss.elastic.co/t/this-site-can-t-provide-a-secure-connection-urgent/281988)
**Author:** [@shenzam](https://discuss.elastic.co/u/shenzam)\ **Replies:** 1\ **Last updated:** [August 19, 2021, 3:47pm UTC](https://discuss.elastic.co/t/this-site-can-t-provide-a-secure-connection-urgent/281988 "2021-08-19T15:47:08Z")
Hi firend, earlier, i am able to access elasticsearch with port 9200. However in my docker compose i change the port mappong. After change i am hitting below error 192.168.1.108 didn’t accept your login certificate, or … --- ## [Collapse within top hit aggregation results](https://discuss.elastic.co/t/collapse-within-top-hit-aggregation-results/281977)
**Author:** [@bhimawan](https://discuss.elastic.co/u/bhimawan)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 2:03pm UTC](https://discuss.elastic.co/t/collapse-within-top-hit-aggregation-results/281977 "2021-08-19T14:03:33Z")
I'm trying to do this (two level collapse) but with top\_hits aggregation. Essentially I want to be able to have a collapse inside of the top\_hits aggregation but it's not supported. Is there any way to make this w… --- ## [Custom transactions in checkout process](https://discuss.elastic.co/t/custom-transactions-in-checkout-process/281970)
**Author:** [@anjaneyulu\_nagineni](https://discuss.elastic.co/u/anjaneyulu_nagineni)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 1:20pm UTC](https://discuss.elastic.co/t/custom-transactions-in-checkout-process/281970 "2021-08-19T13:20:15Z")
I have a checkout with different steps, each step i want to send some custom data to apm server which we can do with transactions, spans and add additional data using add labels to the span but the question is when shoul… --- ## [Fleet Synthetics 7.14 - pipeline with id \[synthetics-http-0.2.1\] does not exist](https://discuss.elastic.co/t/fleet-synthetics-7-14-pipeline-with-id-synthetics-http-0-2-1-does-not-exist/281036)
**Author:** [@zx8086](https://discuss.elastic.co/u/zx8086)\ **Replies:** 6\ **Last updated:** [August 19, 2021, 1:27pm UTC](https://discuss.elastic.co/t/fleet-synthetics-7-14-pipeline-with-id-synthetics-http-0-2-1-does-not-exist/281036 "2021-08-19T13:27:36Z")
Using Fleet 7.14 and after upgrading the Integration - Elastic Synthetics, i cannot see any http Monitors and when i look at the Elastic-Agent logs, i get the following message that it cannot index the document because a… --- ## [Is it possible to Upgrade the elastic-operator without the downtime](https://discuss.elastic.co/t/is-it-possible-to-upgrade-the-elastic-operator-without-the-downtime/281960)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 12:44pm UTC](https://discuss.elastic.co/t/is-it-possible-to-upgrade-the-elastic-operator-without-the-downtime/281960 "2021-08-19T12:44:11Z")
We are trying to upgrade from elastic-operator-1.1.0 to 1.3.0,.Is there any way to upgrade the operator without any rolling restarts for existing elasticsearch pods. --- ## [Elastic sinc with serilog](https://discuss.elastic.co/t/elastic-sinc-with-serilog/281950)
**Author:** [@Shakila\_Jayarathna](https://discuss.elastic.co/u/Shakila_Jayarathna)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 11:55am UTC](https://discuss.elastic.co/t/elastic-sinc-with-serilog/281950 "2021-08-19T11:55:15Z")
Hello, here is my code sample using serilog to log details for elastic search. And i dont get any error. But my log is not working. Any help --- ## [Search query does not return expected records](https://discuss.elastic.co/t/search-query-does-not-return-expected-records/281941)
**Author:** [@Rammi22](https://discuss.elastic.co/u/Rammi22)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 9:56am UTC](https://discuss.elastic.co/t/search-query-does-not-return-expected-records/281941 "2021-08-19T09:56:15Z")
Hello, i have documents with following structure: ... // doc 1 "\_source": { ..., "data": { "main": { ... "refAccount1": 1, "refAccount2": 1, "refAccount3": 1 "refType": 1, }, … --- ## [Can I pass two sets of values to the reduce script?](https://discuss.elastic.co/t/can-i-pass-two-sets-of-values-to-the-reduce-script/281665)
**Author:** [@InesCM](https://discuss.elastic.co/u/InesCM)\ **Replies:** 1\ **Last updated:** [August 19, 2021, 10:13am UTC](https://discuss.elastic.co/t/can-i-pass-two-sets-of-values-to-the-reduce-script/281665 "2021-08-19T10:13:06Z")
Hi all, I'm preparing an scripted metric in order to perform the division of two sums and display it in a Scripted Metric in Kibana (average viewing hours per user). The problem I'm facing is that I need to perform the… --- ## [How to use new elasticsearch typescript types](https://discuss.elastic.co/t/how-to-use-new-elasticsearch-typescript-types/281924)
**Author:** [@voldemort02](https://discuss.elastic.co/u/voldemort02)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 8:06am UTC](https://discuss.elastic.co/t/how-to-use-new-elasticsearch-typescript-types/281924 "2021-08-19T08:06:00Z")
I want to use new elastic search types as per this TypeScript support | Elasticsearch Node.js client \[7.x\] | Elastic document but if I do // try the new code completion when building a query! const response = await clie… --- ## [ILM Retry API not honoring timeouts](https://discuss.elastic.co/t/ilm-retry-api-not-honoring-timeouts/281772)
**Author:** [@Himanshu\_Mishra](https://discuss.elastic.co/u/Himanshu_Mishra)\ **Replies:** 5\ **Last updated:** [August 19, 2021, 7:10am UTC](https://discuss.elastic.co/t/ilm-retry-api-not-honoring-timeouts/281772 "2021-08-19T07:10:57Z")
I'm try to retry ILM steps for all indexes, using following command, however POST \*/\_ilm/retry { "timeout": "30m", "master\_timeout": "30m" } Still following error is thrown. Is there another param to override proce… --- ## [Range Aggregation is not working properly for float fields](https://discuss.elastic.co/t/range-aggregation-is-not-working-properly-for-float-fields/281908)
**Author:** [@Ofir\_Edi](https://discuss.elastic.co/u/Ofir_Edi)\ **Replies:** 0\ **Last updated:** [August 19, 2021, 6:41am UTC](https://discuss.elastic.co/t/range-aggregation-is-not-working-properly-for-float-fields/281908 "2021-08-19T06:41:57Z")
Hi, According to the documentation range aggreagation creates buckets where from in inclusive and to is exclusive. when working with float fields Elasticsearch seem to work vise versa and classify to the wrong bucket. I… --- ## [How to listen for index change events](https://discuss.elastic.co/t/how-to-listen-for-index-change-events/281893)
**Author:** [@zhyp](https://discuss.elastic.co/u/zhyp)\ **Replies:** 1\ **Last updated:** [August 19, 2021, 2:47am UTC](https://discuss.elastic.co/t/how-to-listen-for-index-change-events/281893 "2021-08-19T02:47:59Z")
Hi My demand is real-time statistics. Can I listen for changes in an index? For example, if the value of a field changes, I can monitor it and make statistics again. :slightly\_smiling\_face: --- ## [Corrupt index due to missing file](https://discuss.elastic.co/t/corrupt-index-due-to-missing-file/281867)
**Author:** [@RonJenningsFTI](https://discuss.elastic.co/u/RonJenningsFTI)\ **Replies:** 3\ **Last updated:** [August 18, 2021, 9:46pm UTC](https://discuss.elastic.co/t/corrupt-index-due-to-missing-file/281867 "2021-08-18T21:46:54Z")
Greetings, people who know way more about ElasticSearch than I do! I'm very new to Elastic administration, as our organization has only recently started using it, so please pardon my lack of knowledge. We have a 4-node … --- ## [Reduce Bulk rejections](https://discuss.elastic.co/t/reduce-bulk-rejections/281782)
**Author:** [@Praveen\_Atluri](https://discuss.elastic.co/u/Praveen_Atluri)\ **Replies:** 4\ **Last updated:** [August 18, 2021, 9:39pm UTC](https://discuss.elastic.co/t/reduce-bulk-rejections/281782 "2021-08-18T21:39:31Z")
Hi, I am performing load testing on a 150 data node elasticsearch cluster (i3.2x AWS instances) so the write thread pool size is 8 and queue size is 200. I am indexing into ES using 20 ecs tasks and each ecs task is us… --- ## [Rollover index at a particular time (UTC ) instead of index creation date](https://discuss.elastic.co/t/rollover-index-at-a-particular-time-utc-instead-of-index-creation-date/281777)
**Author:** [@Madhumitha\_Murali](https://discuss.elastic.co/u/Madhumitha_Murali)\ **Replies:** 1\ **Last updated:** [August 18, 2021, 9:38pm UTC](https://discuss.elastic.co/t/rollover-index-at-a-particular-time-utc-instead-of-index-creation-date/281777 "2021-08-18T21:38:47Z")
Hi All, Need your help with rollover index. I rollover index with conditions max\_age=1d and max\_size=50GB. The max\_age is calculated from the index creation time rather than the date field in the index name. Is there … --- ## [Not able to create delete policy for index](https://discuss.elastic.co/t/not-able-to-create-delete-policy-for-index/281844)
**Author:** [@pratik\_jain163](https://discuss.elastic.co/u/pratik_jain163)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 9:34pm UTC](https://discuss.elastic.co/t/not-able-to-create-delete-policy-for-index/281844 "2021-08-18T21:34:25Z")
I am trying to create a policy from AWS ES kibana dev tool and got this message {"Message":"Your request: '/\_ilm/policy/my\_policy' is not allowed."} PUT \_ilm/policy/my\_policy { "policy": { "phases": { … --- ## [EQL sequence query returns strange result](https://discuss.elastic.co/t/eql-sequence-query-returns-strange-result/280082)
**Author:** [@aryon](https://discuss.elastic.co/u/aryon)\ **Replies:** 3\ **Last updated:** [August 18, 2021, 8:09pm UTC](https://discuss.elastic.co/t/eql-sequence-query-returns-strange-result/280082 "2021-08-18T20:09:17Z")
Hello, I have an EQL sequence query in ElasticSearch 7.11.1 that returns strange results: the join\_keys value is different from the user.email that is in the results. Here is the query: GET /my\_index/\_eql/search?filte… --- ## [ILM, shrink index and aliases](https://discuss.elastic.co/t/ilm-shrink-index-and-aliases/281755)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 4\ **Last updated:** [August 18, 2021, 8:07pm UTC](https://discuss.elastic.co/t/ilm-shrink-index-and-aliases/281755 "2021-08-18T20:07:56Z")
Is there a way to get ES to retain aliases of indexes after the index has been shrunk during an ILM rollover. I use the aliases in the kibana discover indexes rather than index name patterns but the new shrunk indexes … --- ## [\[2021-08-18T14:40:31,056\]\[WARhttp client did not trust this server's certificate, closing connection Netty4HttpChannel](https://discuss.elastic.co/t/2021-08-18t1431-056-warhttp-client-did-not-trust-this-servers-certificate-closing-connection-netty4httpchannel/281869)
**Author:** [@mlo](https://discuss.elastic.co/u/mlo)\ **Replies:** 0\ **Last updated:** [August 18, 2021, 7:11pm UTC](https://discuss.elastic.co/t/2021-08-18t1431-056-warhttp-client-did-not-trust-this-servers-certificate-closing-connection-netty4httpchannel/281869 "2021-08-18T19:11:02Z")
Hi, I am working in databricks and had this working and now it stopped without any changes to my code. I am connecting to Elastic with the es-hadoop client via pyspark. Here are my settings .format("org.elasticsearch.… --- ## [How to restore an external snapshot](https://discuss.elastic.co/t/how-to-restore-an-external-snapshot/281868)
**Author:** [@yrtqz](https://discuss.elastic.co/u/yrtqz)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 7:02pm UTC](https://discuss.elastic.co/t/how-to-restore-an-external-snapshot/281868 "2021-08-18T19:02:18Z")
Hello, The use case I'm trying to do is as follows: on elasticsearch instance A inside a docker container, a snapshot is taken, and all the relevant snapshot files are copied out of the container and sent in a zip to be… --- ## [Adding numeric values of multiple fields into one field](https://discuss.elastic.co/t/adding-numeric-values-of-multiple-fields-into-one-field/281856)
**Author:** [@pkward](https://discuss.elastic.co/u/pkward)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 5:46pm UTC](https://discuss.elastic.co/t/adding-numeric-values-of-multiple-fields-into-one-field/281856 "2021-08-18T17:46:53Z")
Hi, Is there a way to add multiple numeric values of multiple fields and create a "total" field? ''' "Object": { field1: 3 field2: 4 field3: 5 field4: 1 field5: 2 "total": 15 } ''' --- ## ["Cannot copy field \[ \] to fields \[ \]. Copy-to currently only works for value-type fields, not objects](https://discuss.elastic.co/t/cannot-copy-field-to-fields-copy-to-currently-only-works-for-value-type-fields-not-objects/280429)
**Author:** [@moziada](https://discuss.elastic.co/u/moziada)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 11:28am UTC](https://discuss.elastic.co/t/cannot-copy-field-to-fields-copy-to-currently-only-works-for-value-type-fields-not-objects/280429 "2021-08-18T11:28:51Z")
ES = ver 7.14 Linux , mysql 8 The error happens after upgrade to 7.14 from 7.13 the issue : I use Logstash to input to ES from MySQL U used to add null (nil) value to copy\_to field, after upgrade it is not accepte… --- ## [Dedicated voting-only master nodes and repository access](https://discuss.elastic.co/t/dedicated-voting-only-master-nodes-and-repository-access/281787)
**Author:** [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Replies:** 1\ **Last updated:** [August 18, 2021, 5:07pm UTC](https://discuss.elastic.co/t/dedicated-voting-only-master-nodes-and-repository-access/281787 "2021-08-18T17:07:58Z")
If I am deploying an Elasticsearch cluster across 2 on-premise data centres and want to place a dedicated voting-only master node in the cloud as an arbiter, would the dedicated voting-only master node still need access … --- ## [How to convert hot induce to cold/warm/hot plus hardware profile change?](https://discuss.elastic.co/t/how-to-convert-hot-induce-to-cold-warm-hot-plus-hardware-profile-change/281809)
**Author:** [@M\_Gibbs](https://discuss.elastic.co/u/M_Gibbs)\ **Replies:** 1\ **Last updated:** [August 18, 2021, 4:34pm UTC](https://discuss.elastic.co/t/how-to-convert-hot-induce-to-cold-warm-hot-plus-hardware-profile-change/281809 "2021-08-18T16:34:09Z")
Hey all, I’m using Elastic Cloud. We have a large data (900+GB)set that we’ve indexed as hot storage on IO hardware profile. This is naturally expensive. What id like to do is two fold: Change the IO profile to Comp… --- ## [ML partition by two fields](https://discuss.elastic.co/t/ml-partition-by-two-fields/281831)
**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 4:32pm UTC](https://discuss.elastic.co/t/ml-partition-by-two-fields/281831 "2021-08-18T16:32:14Z")
Hi, ES v 7.13.2 I'm trying to create the following ML job and not sure if I'm doing it correctly. indices: user\_events\* every document looks something like: { "date\_time": "2021-07-16T01:00:00.000Z", "client… --- ## [Getting rid of the null value from Lens Table](https://discuss.elastic.co/t/getting-rid-of-the-null-value-from-lens-table/281854)
**Author:** [@bailarch](https://discuss.elastic.co/u/bailarch)\ **Replies:** 0\ **Last updated:** [August 18, 2021, 3:51pm UTC](https://discuss.elastic.co/t/getting-rid-of-the-null-value-from-lens-table/281854 "2021-08-18T15:51:50Z")
Hello everyone, I have a list of projects in the column and a list of users for the rows. I eventually want to make a table where it shows 'who are working on each project' This is my starting point but not sure how t… --- ## [Elasticsearch python client compatibility](https://discuss.elastic.co/t/elasticsearch-python-client-compatibility/281829)
**Author:** [@bruce289](https://discuss.elastic.co/u/bruce289)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 3:50pm UTC](https://discuss.elastic.co/t/elasticsearch-python-client-compatibility/281829 "2021-08-18T15:50:34Z")
Hi, I need to write a python script that can be run against both elasticsearch 6 and elasticsearch 7 clusters. Which version of the python elasticsearch client would be recommended for this purpose? Thanks, Bruce --- ## [Best practice in elasticsearch idnex](https://discuss.elastic.co/t/best-practice-in-elasticsearch-idnex/281815)
**Author:** [@naaviin](https://discuss.elastic.co/u/naaviin)\ **Replies:** 5\ **Last updated:** [August 18, 2021, 3:20pm UTC](https://discuss.elastic.co/t/best-practice-in-elasticsearch-idnex/281815 "2021-08-18T15:20:52Z")
I have few log with some same patter and some different patterh. Log name (same pattern) a.log b.log Log name (different pattern) c.log d.log Environment name env1 env2 env3 Is this good practice for index --MMYY… --- ## [Upgrade From 7.3.1 to 7.13.2 causing circuit breaker exceptions / slow performance](https://discuss.elastic.co/t/upgrade-from-7-3-1-to-7-13-2-causing-circuit-breaker-exceptions-slow-performance/281090)
**Author:** [@Justin\_Cross1](https://discuss.elastic.co/u/Justin_Cross1)\ **Replies:** 2\ **Last updated:** [August 18, 2021, 2:48pm UTC](https://discuss.elastic.co/t/upgrade-from-7-3-1-to-7-13-2-causing-circuit-breaker-exceptions-slow-performance/281090 "2021-08-18T14:48:30Z")
We upgraded from 7.3.1 to 7.13.2 using rolling upgrade and performance took a major hit. For example, a search on 7.3.1 that might take 100-200ms is taking 5000ms in 7.13.2. We had to backout the upgrade so we are on 7… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=588) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=590)