# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=363 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 364 --- ## [Enrich data using ingest pipeline and enrich policy override data](https://discuss.elastic.co/t/enrich-data-using-ingest-pipeline-and-enrich-policy-override-data/316049)
**Author:** [@Fariddev](https://discuss.elastic.co/u/Fariddev)\ **Replies:** 0\ **Last updated:** [October 7, 2022, 9:07am UTC](https://discuss.elastic.co/t/enrich-data-using-ingest-pipeline-and-enrich-policy-override-data/316049 "2022-10-07T09:07:34Z")
Hi, I want to enrich data in an index (add nationality of authors in books index) using data in another index (authors). I use an ingest pipeline with an enrich policy. Here is a simple example : Indices PUT books { … --- ## [Unable to create token getting below error as Failed to determine the health of the cluster](https://discuss.elastic.co/t/unable-to-create-token-getting-below-error-as-failed-to-determine-the-health-of-the-cluster/316039)
**Author:** [@RChan](https://discuss.elastic.co/u/RChan)\ **Replies:** 0\ **Last updated:** [October 7, 2022, 7:10am UTC](https://discuss.elastic.co/t/unable-to-create-token-getting-below-error-as-failed-to-determine-the-health-of-the-cluster/316039 "2022-10-07T07:10:53Z")
WARN org.elasticsearch.common.ssl.DiagnosticTrustManager - failed to establish trust with server at \[x.x.x.x\]; the server provided a certificate with subject name, fingerprint \[629616647bf0e539b0ca8f616b516df4a356f5af… --- ## [Painless script for the average aggregation based on date difference and one of the date is from params maps](https://discuss.elastic.co/t/painless-script-for-the-average-aggregation-based-on-date-difference-and-one-of-the-date-is-from-params-maps/316036)
**Author:** [@rushikeshsabde](https://discuss.elastic.co/u/rushikeshsabde)\ **Replies:** 0\ **Last updated:** [October 7, 2022, 6:45am UTC](https://discuss.elastic.co/t/painless-script-for-the-average-aggregation-based-on-date-difference-and-one-of-the-date-is-from-params-maps/316036 "2022-10-07T06:45:37Z")
I am trying to calculate the average aggregation based on date difference. Earlier both the date were in the same index, so tired this for the average index: "avg": { "script": { … --- ## [Geography failed](https://discuss.elastic.co/t/geography-failed/315944)
**Author:** [@Jimmy\_Escrich](https://discuss.elastic.co/u/Jimmy_Escrich)\ **Replies:** 7\ **Last updated:** [October 7, 2022, 5:46am UTC](https://discuss.elastic.co/t/geography-failed/315944 "2022-10-07T05:46:01Z")
Hi there, I have an issue with GeometricCollection. I have a field location\_geography configured at geo\_shape. I want to update my document and I have this error : failed to parse field \[location\_geography\] of type \[geo… --- ## [String comparison inside a update\_by\_query api script](https://discuss.elastic.co/t/string-comparison-inside-a-update-by-query-api-script/316024)
**Author:** [@djoobbani](https://discuss.elastic.co/u/djoobbani)\ **Replies:** 0\ **Last updated:** [October 7, 2022, 12:51am UTC](https://discuss.elastic.co/t/string-comparison-inside-a-update-by-query-api-script/316024 "2022-10-07T00:51:35Z")
I am performing a Update\_by\_query api and inside its script i need to do string comparison of two different parameteres, similar to how u would do it with intgers: So, i need to do something like this with string: str… --- ## [COMPOSITE NESTED AGGREGATIONS](https://discuss.elastic.co/t/composite-nested-aggregations/316013)
**Author:** [@Vinicius\_Serafim](https://discuss.elastic.co/u/Vinicius_Serafim)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 9:42pm UTC](https://discuss.elastic.co/t/composite-nested-aggregations/316013 "2022-10-06T21:42:12Z")
Hi, i hope that someone can help me. Supose that i have the following mapping to my index: PUT test-index { "mappings": { "properties": { "nestedOBJField": { "type": "nested", "index": true… --- ## [Uptades to template not being applied](https://discuss.elastic.co/t/uptades-to-template-not-being-applied/315606)
**Author:** [@somatusjn](https://discuss.elastic.co/u/somatusjn)\ **Replies:** 9\ **Last updated:** [October 6, 2022, 6:25pm UTC](https://discuss.elastic.co/t/uptades-to-template-not-being-applied/315606 "2022-10-06T18:25:41Z")
I'm getting an error when trying to post a document. The error I think is that the format I used for a date property is incorrect. I initially used YYYY-MM-DD'T'hh:mm:ssZ, but since then I have made like 10 calls to upda… --- ## [Invalid version of beats protocol integration with spring boot](https://discuss.elastic.co/t/invalid-version-of-beats-protocol-integration-with-spring-boot/315997)
**Author:** [@Nikolas1306](https://discuss.elastic.co/u/Nikolas1306)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 5:31pm UTC](https://discuss.elastic.co/t/invalid-version-of-beats-protocol-integration-with-spring-boot/315997 "2022-10-06T17:31:09Z")
i used a test with integrated log with spring-boot and logstash this is xml configuration \ \ \ **Author:** [@MaVa](https://discuss.elastic.co/u/MaVa)\ **Replies:** 1\ **Last updated:** [October 6, 2022, 4:23pm UTC](https://discuss.elastic.co/t/structure-of-document-affect-speed/315897 "2022-10-06T16:23:10Z") I have a question out of curiosity. Does the structure of the document have any effect on the indexing and searching speed in an index? Would e.g. "user": { "id":"123", "first\_name":"John", "last\_n… --- ## [Restoring snapshot from 5.0 into 6.8 for upgrades](https://discuss.elastic.co/t/restoring-snapshot-from-5-0-into-6-8-for-upgrades/315818)
**Author:** [@jayp-glb](https://discuss.elastic.co/u/jayp-glb)\ **Replies:** 3\ **Last updated:** [October 6, 2022, 4:18pm UTC](https://discuss.elastic.co/t/restoring-snapshot-from-5-0-into-6-8-for-upgrades/315818 "2022-10-06T16:18:07Z")
Hi community, and thanks for all the help you've given everyone for years and years. Today, I'm facing a very interesting situation. I'm finally going around on upgrading a quite old Elasticsearch 5.0 cluster hosted in… --- ## [Is there a way to merge two indices](https://discuss.elastic.co/t/is-there-a-way-to-merge-two-indices/315980)
**Author:** [@Dedsec0](https://discuss.elastic.co/u/Dedsec0)\ **Replies:** 1\ **Last updated:** [October 6, 2022, 4:17pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-merge-two-indices/315980 "2022-10-06T16:17:50Z")
Hi, I want to merge two indices( index 1, index 2) and make as one index( index 3), For instance : let say, I have index 1 and index 2 have matching fields like ... index 1 :(doc count 1) { "operation": "add", "ti… --- ## [Best structure for easy/efficient searching of complex data](https://discuss.elastic.co/t/best-structure-for-easy-efficient-searching-of-complex-data/315990)
**Author:** [@EmaysHRT](https://discuss.elastic.co/u/EmaysHRT)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 2:39pm UTC](https://discuss.elastic.co/t/best-structure-for-easy-efficient-searching-of-complex-data/315990 "2022-10-06T14:39:52Z")
I'm working on exporting result data from our configuration management system into Elasticsearch, so we can more easily understand failures across our fleet. Each run is composed of many "states" that are applied to a ma… --- ## [Can't connect to Elasticsearch at \:9200 - Logs don't show any errors](https://discuss.elastic.co/t/cant-connect-to-elasticsearch-at-publicip-9200-logs-dont-show-any-errors/315920)
**Author:** [@Chma](https://discuss.elastic.co/u/Chma)\ **Replies:** 12\ **Last updated:** [October 6, 2022, 1:53pm UTC](https://discuss.elastic.co/t/cant-connect-to-elasticsearch-at-publicip-9200-logs-dont-show-any-errors/315920 "2022-10-06T13:53:02Z")
This worked, thanks. I am running into a different issue. Elasticsearch status says it's active, but I can't connect at http://:9200. My elasticsearch logs doesn't show any issue. This is the yaml file which was working… --- ## [Watcher Aggregation returning null](https://discuss.elastic.co/t/watcher-aggregation-returning-null/315914)
**Author:** [@serena-skilljar](https://discuss.elastic.co/u/serena-skilljar)\ **Replies:** 1\ **Last updated:** [October 6, 2022, 2:20pm UTC](https://discuss.elastic.co/t/watcher-aggregation-returning-null/315914 "2022-10-06T14:20:40Z")
Hi there - We have a few watchers that were running successfully and suddenly started to error out. Can confirm that nothing was changed on our end. Watch (actions and transform ommited): { "trigger": { "schedul… --- ## [Elasticsearch Upgrade JVM Error](https://discuss.elastic.co/t/elasticsearch-upgrade-jvm-error/315928)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 3:31am UTC](https://discuss.elastic.co/t/elasticsearch-upgrade-jvm-error/315928 "2022-10-06T03:31:38Z")
Trying to upgrade Elasticsearch from 8.2 to 8.4.3 running on Windows. I copied the config folder from the old version to the new one, adjusted file paths in elasticsearch.yml, deleted the old service, then ran elasticse… --- ## [Snapshots with a shard failure](https://discuss.elastic.co/t/snapshots-with-a-shard-failure/315838)
**Author:** [@Nicolaegis](https://discuss.elastic.co/u/Nicolaegis)\ **Replies:** 4\ **Last updated:** [October 6, 2022, 12:33pm UTC](https://discuss.elastic.co/t/snapshots-with-a-shard-failure/315838 "2022-10-06T12:33:15Z")
Hello, I would like to know if a snapshot with a failed shard can be retried without restarting the whole process. Thank you --- ## [ElasticSearch 2-out-of-4 Master Replica goes down](https://discuss.elastic.co/t/elasticsearch-2-out-of-4-master-replica-goes-down/315840)
**Author:** [@roybalderama](https://discuss.elastic.co/u/roybalderama)\ **Replies:** 7\ **Last updated:** [October 6, 2022, 12:18pm UTC](https://discuss.elastic.co/t/elasticsearch-2-out-of-4-master-replica-goes-down/315840 "2022-10-06T12:18:52Z")
Hi, We bootstraped ELK Stack (in kubernetes using helm) to collect all the audit and application logs of the system. This has been running for almost a year now, and we were able to achieve the high-availability using t… --- ## [How to pass pagination to java scroll api](https://discuss.elastic.co/t/how-to-pass-pagination-to-java-scroll-api/315965)
**Author:** [@mahfuj\_asif](https://discuss.elastic.co/u/mahfuj_asif)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 12:10pm UTC](https://discuss.elastic.co/t/how-to-pass-pagination-to-java-scroll-api/315965 "2022-10-06T12:10:40Z")
I am trying to fetch all data from elastic index with scroll id. SearchQuery searchQuery = new NativeSearchQueryBuilder() .withIndices(ELASTIC\_INDEX) .withTypes(DOC\_TYPE) … --- ## [Delete indices with 50 gb or older than](https://discuss.elastic.co/t/delete-indices-with-50-gb-or-older-than/315884)
**Author:** [@anon90868141](https://discuss.elastic.co/u/anon90868141)\ **Replies:** 7\ **Last updated:** [October 6, 2022, 6:14am UTC](https://discuss.elastic.co/t/delete-indices-with-50-gb-or-older-than/315884 "2022-10-06T06:14:34Z")
Hello, I'm currently trying to delete indices which are either greater than 50 GB or older than 31 days, but it seems like this is not possible with ILM. ILM uses, if anything defined in the hot stage, the days since r… --- ## [Get a mapping/schema of flattened field](https://discuss.elastic.co/t/get-a-mapping-schema-of-flattened-field/315919)
**Author:** [@getorca](https://discuss.elastic.co/u/getorca)\ **Replies:** 2\ **Last updated:** [October 6, 2022, 4:10am UTC](https://discuss.elastic.co/t/get-a-mapping-schema-of-flattened-field/315919 "2022-10-06T04:10:46Z")
Is there a way to get a mapping or schema of all the sub-fields that exist in my flattened field? --- ## [Constant\_scores w/ boost upon matching properties within nested](https://discuss.elastic.co/t/constant-scores-w-boost-upon-matching-properties-within-nested/315930)
**Author:** [@Paul\_Kim](https://discuss.elastic.co/u/Paul_Kim)\ **Replies:** 0\ **Last updated:** [October 6, 2022, 4:14am UTC](https://discuss.elastic.co/t/constant-scores-w-boost-upon-matching-properties-within-nested/315930 "2022-10-06T04:14:17Z")
I have below as my mapping for some\_index. { "some\_index": "properties": { "people": { "type": "nested", "properties": { "name": { "type": "keyword" … --- ## [Trouble with reindexing and ingest pipeline](https://discuss.elastic.co/t/trouble-with-reindexing-and-ingest-pipeline/315536)
**Author:** [@lubosvr](https://discuss.elastic.co/u/lubosvr)\ **Replies:** 3\ **Last updated:** [October 6, 2022, 3:07am UTC](https://discuss.elastic.co/t/trouble-with-reindexing-and-ingest-pipeline/315536 "2022-10-06T03:07:15Z")
I have problem with reindexing with ingest pipeline. Basically it seems to be working in most cases, but in some it is not and I have no clue how to debug or find a root cause. Here is my scenario: I have two indices … --- ## ['create' vs. 'create\_doc' privilege for beats\_system](https://discuss.elastic.co/t/create-vs-create-doc-privilege-for-beats-system/315752)
**Author:** [@NominaSumpta](https://discuss.elastic.co/u/NominaSumpta)\ **Replies:** 1\ **Last updated:** [October 6, 2022, 1:16am UTC](https://discuss.elastic.co/t/create-vs-create-doc-privilege-for-beats-system/315752 "2022-10-06T01:16:12Z")
On my Elasticsearch 7.x cluster, the beats\_system role has the index privileges create\_index and create. According to Security privileges | Elasticsearch Guide \[7.17\] | Elastic, roles with the the index create privilege… --- ## ["match-boolean-query doesn't return the "exact match word" of the query](https://discuss.elastic.co/t/match-boolean-query-doesnt-return-the-exact-match-word-of-the-query/315918)
**Author:** [@paris1](https://discuss.elastic.co/u/paris1)\ **Replies:** 0\ **Last updated:** [October 5, 2022, 11:54pm UTC](https://discuss.elastic.co/t/match-boolean-query-doesnt-return-the-exact-match-word-of-the-query/315918 "2022-10-05T23:54:18Z")
I'm using "match-Boolean-prefix query but I can't get the exact match of the query.I can't use prefix queries because I also need "not exact match" results and I also need the fuzziness and word completion.I get every th… --- ## [Unable to view winlogbeat log data](https://discuss.elastic.co/t/unable-to-view-winlogbeat-log-data/315910)
**Author:** [@tyc-4](https://discuss.elastic.co/u/tyc-4)\ **Replies:** 0\ **Last updated:** [October 5, 2022, 7:58pm UTC](https://discuss.elastic.co/t/unable-to-view-winlogbeat-log-data/315910 "2022-10-05T19:58:26Z")
I tried to send logs using winlogbeat to a self hosted ELK stack but I am unable to view any information other than the \_id and \_index. How do I fix this? --- ## [Vert High Latencies For GeoDistance query for 10k documents](https://discuss.elastic.co/t/vert-high-latencies-for-geodistance-query-for-10k-documents/315631)
**Author:** [@Parth\_Narang](https://discuss.elastic.co/u/Parth_Narang)\ **Replies:** 10\ **Last updated:** [October 5, 2022, 5:32pm UTC](https://discuss.elastic.co/t/vert-high-latencies-for-geodistance-query-for-10k-documents/315631 "2022-10-05T17:32:08Z")
I have a requirement to fetch 10k documents around a lat long in 10km radius while below query works fine but take around 350 ms to fetch all the documents. is there any other way to improve on this was expecting latenci… --- ## [ES 7.11 How to debug search\_failures for rollup jobs](https://discuss.elastic.co/t/es-7-11-how-to-debug-search-failures-for-rollup-jobs/314896)
**Author:** [@ld\_pvl](https://discuss.elastic.co/u/ld_pvl)\ **Replies:** 1\ **Last updated:** [October 5, 2022, 4:05pm UTC](https://discuss.elastic.co/t/es-7-11-how-to-debug-search-failures-for-rollup-jobs/314896 "2022-10-05T16:05:23Z")
My new rollup job is showing search\_failures and not indexing anything. Where can I go to see the details as to why the search failures are occuring? I looked at the rollup job details and the capabilities but there are… --- ## [Mapping: how to disable array of string?](https://discuss.elastic.co/t/mapping-how-to-disable-array-of-string/315782)
**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\ **Replies:** 10\ **Last updated:** [October 5, 2022, 3:42pm UTC](https://discuss.elastic.co/t/mapping-how-to-disable-array-of-string/315782 "2022-10-05T15:42:56Z")
We want to apply a real strict mapping , but arrays are still accepted and mess around our data pipeline (because after we use Apache Spark to read data). We (at our team level) have no control on the incoming data. Ho… --- ## [Mockito Test for Elastic Java api client](https://discuss.elastic.co/t/mockito-test-for-elastic-java-api-client/315773)
**Author:** [@painless\_elastic](https://discuss.elastic.co/u/painless_elastic)\ **Replies:** 0\ **Last updated:** [October 4, 2022, 12:23pm UTC](https://discuss.elastic.co/t/mockito-test-for-elastic-java-api-client/315773 "2022-10-04T12:23:56Z")
I have tried to mock the response for the below method, but it's not working. Not able to mock the search.hits().hits() method. SearchResponse\ search = client.search(s -\> s .index("products") .query(q -\>… --- ## [Index routing allocation require does not work and throws confusing explain](https://discuss.elastic.co/t/index-routing-allocation-require-does-not-work-and-throws-confusing-explain/315873)
**Author:** [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\ **Replies:** 0\ **Last updated:** [October 5, 2022, 12:18pm UTC](https://discuss.elastic.co/t/index-routing-allocation-require-does-not-work-and-throws-confusing-explain/315873 "2022-10-05T12:18:24Z")
Hello, I have a cluster on version 7.17 where I'm using a node attribute called node\_type with the values hot and warm to allocate shards and move between node type with ILM, all indices have an index.routing.allocatio… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=362) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=364)