# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=919 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 920 --- ## [Why does ES need Java 14 to build?](https://discuss.elastic.co/t/why-does-es-need-java-14-to-build/232915)
**Author:** [@Niels\_Basjes](https://discuss.elastic.co/u/Niels_Basjes)\ **Replies:** 5\ **Last updated:** [May 17, 2020, 10:25am UTC](https://discuss.elastic.co/t/why-does-es-need-java-14-to-build/232915 "2020-05-17T10:25:21Z")
Hi, I want to create a custom processing plugin for ES and I ran into the problem that apparently building anything for ES 7.7.0 requires Java 14 ( see https://github.com/elastic/elasticsearch/pull/54696 ). Yet the htt… --- ## [Elasticsearch - a scale problem? master timeout?](https://discuss.elastic.co/t/elasticsearch-a-scale-problem-master-timeout/232973)
**Author:** [@Rysiu](https://discuss.elastic.co/u/Rysiu)\ **Replies:** 3\ **Last updated:** [May 17, 2020, 10:14am UTC](https://discuss.elastic.co/t/elasticsearch-a-scale-problem-master-timeout/232973 "2020-05-17T10:14:37Z")
I noticed a new problem. This problem started when I have 40 data nodes and more in the elasticsearch cluster. When on a cluster you are doing a larger scale, e.g. recovery shards (let's assume you are doing some rerou… --- ## [Removing a message from SQS after BulkProcessor completion](https://discuss.elastic.co/t/removing-a-message-from-sqs-after-bulkprocessor-completion/232983)
**Author:** [@jerrymj](https://discuss.elastic.co/u/jerrymj)\ **Replies:** 0\ **Last updated:** [May 17, 2020, 10:06am UTC](https://discuss.elastic.co/t/removing-a-message-from-sqs-after-bulkprocessor-completion/232983 "2020-05-17T10:06:05Z")
Hi, I am using the java RestHighLevelClient (6.3) for indexing. I intend to read the data from an SQS and would delete that message from SQS once successfully indexed. I was planning to use the async BulkProcessor for … --- ## [Recomendations on Managing Storage Size](https://discuss.elastic.co/t/recomendations-on-managing-storage-size/232905)
**Author:** [@rukmalf](https://discuss.elastic.co/u/rukmalf)\ **Replies:** 5\ **Last updated:** [May 17, 2020, 9:01am UTC](https://discuss.elastic.co/t/recomendations-on-managing-storage-size/232905 "2020-05-17T09:01:15Z")
Hi, I am new to Elasticsearch. I have noticed that Elasticsearch is very generous when it comes to consuming storage. This makes it a challenge when the storage requirements start growing and the type of storage become… --- ## [Migrating from old elastic stack cluster to higher subscription of new Elastic stack cluster](https://discuss.elastic.co/t/migrating-from-old-elastic-stack-cluster-to-higher-subscription-of-new-elastic-stack-cluster/232877)
**Author:** [@bharat1](https://discuss.elastic.co/u/bharat1)\ **Replies:** 1\ **Last updated:** [May 15, 2020, 7:35pm UTC](https://discuss.elastic.co/t/migrating-from-old-elastic-stack-cluster-to-higher-subscription-of-new-elastic-stack-cluster/232877 "2020-05-15T19:35:32Z")
Dear Team, I am tasked to do a migration from an existing Elastic Stack cluster to a new latest version of new Elastic stack cluster. I did went through the theoretical documents https://www.elastic.co/guide/en/cloud/cu… --- ## [Illegal\_argument\_exception: source alias \[server\] does not point to a write index](https://discuss.elastic.co/t/illegal-argument-exception-source-alias-server-does-not-point-to-a-write-index/231458)
**Author:** [@darkwingzero](https://discuss.elastic.co/u/darkwingzero)\ **Replies:** 1\ **Last updated:** [May 17, 2020, 3:21am UTC](https://discuss.elastic.co/t/illegal-argument-exception-source-alias-server-does-not-point-to-a-write-index/231458 "2020-05-17T03:21:40Z")
Hi, May i request your help, i'm facing error on ILM, request for fix please. Thank you! --- ## [Find which index has \_all fields](https://discuss.elastic.co/t/find-which-index-has-all-fields/232967)
**Author:** [@Russell\_Fulton](https://discuss.elastic.co/u/Russell_Fulton)\ **Replies:** 0\ **Last updated:** [May 17, 2020, 12:57am UTC](https://discuss.elastic.co/t/find-which-index-has-all-fields/232967 "2020-05-17T00:57:37Z")
I am preparing to move from version 6.8.8 to 7.x but I still have references to \_all fields in the depreciation logs. The problem is that I can't find any indexes with \_all in the mappings. Is there some way I can find… --- ## [Discovery.zen.minimum\_master\_nodes is set to -1 by default](https://discuss.elastic.co/t/discovery-zen-minimum-master-nodes-is-set-to-1-by-default/232950)
**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\ **Replies:** 1\ **Last updated:** [May 16, 2020, 10:12pm UTC](https://discuss.elastic.co/t/discovery-zen-minimum-master-nodes-is-set-to-1-by-default/232950 "2020-05-16T22:12:39Z")
We missed a very important configuration in our elasticsearch.yml discovery.zen.minimum\_master\_nodes and the default for it seems to be -1 according to \_cluster/settings What would be the right steps to update our… --- ## [Ingest node conditional and max script compilations](https://discuss.elastic.co/t/ingest-node-conditional-and-max-script-compilations/232953)
**Author:** [@tterranigma](https://discuss.elastic.co/u/tterranigma)\ **Replies:** 0\ **Last updated:** [May 16, 2020, 9:32pm UTC](https://discuss.elastic.co/t/ingest-node-conditional-and-max-script-compilations/232953 "2020-05-16T21:32:01Z")
I have an ingest node that contains: - date: field: "event.start" formats: - "ISO8601" if: "ctx.event?.start != null && ctx.agent.type == 'packetbeat'" ignore\_fa… --- ## [See which of the nested objects matched the nested filter?](https://discuss.elastic.co/t/see-which-of-the-nested-objects-matched-the-nested-filter/232663)
**Author:** [@johnc1](https://discuss.elastic.co/u/johnc1)\ **Replies:** 1\ **Last updated:** [May 16, 2020, 6:57pm UTC](https://discuss.elastic.co/t/see-which-of-the-nested-objects-matched-the-nested-filter/232663 "2020-05-16T18:57:45Z")
When I use "nested" query, is it possible to somehow see which specific nested objects matched the query? E.g., suppose I have Streets nested under City, and I run a query: { "query": { "nested": { "path": "… --- ## [Silence deprecation log without restarting the cluster](https://discuss.elastic.co/t/silence-deprecation-log-without-restarting-the-cluster/232715)
**Author:** [@Khoa\_Le](https://discuss.elastic.co/u/Khoa_Le)\ **Replies:** 7\ **Last updated:** [May 16, 2020, 6:09pm UTC](https://discuss.elastic.co/t/silence-deprecation-log-without-restarting-the-cluster/232715 "2020-05-16T18:09:06Z")
Hi, We had a log4j settings that has set the logging level of org.elasticsearch.deprecation to ERROR that we set from the \_cluster/settings endpoint. Ever since we upgraded to 6.8.6, that settings stopped working and th… --- ## [Hosted Elastic: Basic answers that are hard to find](https://discuss.elastic.co/t/hosted-elastic-basic-answers-that-are-hard-to-find/232939)
**Author:** [@marc-at-qventus](https://discuss.elastic.co/u/marc-at-qventus)\ **Replies:** 0\ **Last updated:** [May 16, 2020, 5:27pm UTC](https://discuss.elastic.co/t/hosted-elastic-basic-answers-that-are-hard-to-find/232939 "2020-05-16T17:27:25Z")
Hi all -- I'm a new elastic user who is bootstrapping a moderate-to-large cluster using hosted Elastic. Several questions have come up for which it is difficult to find answers, given the noise from unrelated questions… --- ## [DateHistogramAggregation with Composite sub-aggregation](https://discuss.elastic.co/t/datehistogramaggregation-with-composite-sub-aggregation/232751)
**Author:** [@plm](https://discuss.elastic.co/u/plm)\ **Replies:** 4\ **Last updated:** [May 16, 2020, 4:57pm UTC](https://discuss.elastic.co/t/datehistogramaggregation-with-composite-sub-aggregation/232751 "2020-05-16T16:57:20Z")
Hi, I got the following exception when trying to execute a DateHistogramAggregation with a sub-aggregation of type CompositeAggregation. Any reason why this wouldn't be supported? Also would this be supported with a reg… --- ## [How to search for duplicates](https://discuss.elastic.co/t/how-to-search-for-duplicates/232203)
**Author:** [@howz](https://discuss.elastic.co/u/howz)\ **Replies:** 2\ **Last updated:** [May 16, 2020, 3:55pm UTC](https://discuss.elastic.co/t/how-to-search-for-duplicates/232203 "2020-05-16T15:55:50Z")
Trying to find duplicate MAC addresses in customer records, what am I doing wrong? GET /\_search { "query": { "match\_all": {} }, "aggs": { "device\_mac": { "terms": { "field": "device\_mac", … --- ## [ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.elasticsearch.spark.sql.DefaultSource15 could not be instantiated](https://discuss.elastic.co/t/serviceconfigurationerror-org-apache-spark-sql-sources-datasourceregister-provider-org-elasticsearch-spark-sql-defaultsource15-could-not-be-instantiated/232933)
**Author:** [@Adi\_Ti](https://discuss.elastic.co/u/Adi_Ti)\ **Replies:** 0\ **Last updated:** [May 16, 2020, 2:17pm UTC](https://discuss.elastic.co/t/serviceconfigurationerror-org-apache-spark-sql-sources-datasourceregister-provider-org-elasticsearch-spark-sql-defaultsource15-could-not-be-instantiated/232933 "2020-05-16T14:17:04Z")
I am trying to index using spark on Amazon EMR cluster. I am facing this issue on the cluster. pom.xml for Elastic org.elasticsearch elasticsearch 6.4.3 org.slf4j slf4j-log4j12 log4j log4j \ **Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\ **Replies:** 24\ **Last updated:** [May 16, 2020, 12:24pm UTC](https://discuss.elastic.co/t/shards-getting-marked-as-stale-frequently-causing-cluster-to-go-yellow/231835 "2020-05-16T12:24:44Z") We use elasticsearch 7.2. It's a 11 node cluster with around 2TB of data sharded across 30 shards We use G1GC & have fixed this https://github.com/elastic/elasticsearch/pull/46169 Lately we've been seeing unnecessary c… --- ## [Multi Fields Diadvantage](https://discuss.elastic.co/t/multi-fields-diadvantage/232699)
**Author:** [@saket\_gupta](https://discuss.elastic.co/u/saket_gupta)\ **Replies:** 6\ **Last updated:** [May 16, 2020, 10:41am UTC](https://discuss.elastic.co/t/multi-fields-diadvantage/232699 "2020-05-16T10:41:29Z")
Hi Team, I am parsing (in logstash using dissect filter) and indexing about 17 fields from a single log message (filebeat -\> logstash -\>ElasticSearch) . Logstash template by default places the parsed string fields as b… --- ## [Roblem connecting elasticsech from a different Vlan](https://discuss.elastic.co/t/roblem-connecting-elasticsech-from-a-different-vlan/232898)
**Author:** [@Krizar\_Ashiel](https://discuss.elastic.co/u/Krizar_Ashiel)\ **Replies:** 0\ **Last updated:** [May 16, 2020, 3:08am UTC](https://discuss.elastic.co/t/roblem-connecting-elasticsech-from-a-different-vlan/232898 "2020-05-16T03:08:59Z")
I have a problem, the Elasticsech server is in Vlan 5 with ips 192.168.100.5 and two servers that must report are in Vlan12 with ips 192.168.100.150 and 192.168.100.150 whenever I try to connect even if it is by telnet i… --- ## [Security is disabled but enabled in elasticsearch.yml](https://discuss.elastic.co/t/security-is-disabled-but-enabled-in-elasticsearch-yml/232875)
**Author:** [@Amine\_Maalfi](https://discuss.elastic.co/u/Amine_Maalfi)\ **Replies:** 3\ **Last updated:** [May 15, 2020, 10:02pm UTC](https://discuss.elastic.co/t/security-is-disabled-but-enabled-in-elasticsearch-yml/232875 "2020-05-15T22:02:09Z")
when i run elasticsearch in the console it shows that the security is disabled while i'm setting it to true in the elasticsearch.yml i'm also getting cors errors, so i'm starting to doubt that elasticsearch doesn't read … --- ## [Return field alias name instead of the actual field name in search api](https://discuss.elastic.co/t/return-field-alias-name-instead-of-the-actual-field-name-in-search-api/232880)
**Author:** [@max\_chen](https://discuss.elastic.co/u/max_chen)\ **Replies:** 1\ **Last updated:** [May 15, 2020, 9:02pm UTC](https://discuss.elastic.co/t/return-field-alias-name-instead-of-the-actual-field-name-in-search-api/232880 "2020-05-15T21:02:00Z")
I have "field\_b" which is alias to "field\_a". When I search it using GET method in the dev console, it return the data with "field\_a" : 'some data" instead of "field\_b" : "some data". Is it possible to get it to return d… --- ## [How to configure SSL in elastic search ( http to https )](https://discuss.elastic.co/t/how-to-configure-ssl-in-elastic-search-http-to-https/232860)
**Author:** [@jinalptl1993](https://discuss.elastic.co/u/jinalptl1993)\ **Replies:** 0\ **Last updated:** [May 15, 2020, 5:27pm UTC](https://discuss.elastic.co/t/how-to-configure-ssl-in-elastic-search-http-to-https/232860 "2020-05-15T17:27:03Z")
I have launched elastic search server in azure using elastic search marketplace. Now, I want to configure SSL into elasticsearch. I want each request to go through https. I can't see any option in elastic load balancer… --- ## [Geo context not working with completion suggester with precision in "mi"](https://discuss.elastic.co/t/geo-context-not-working-with-completion-suggester-with-precision-in-mi/232882)
**Author:** [@Douglas\_Leister](https://discuss.elastic.co/u/Douglas_Leister)\ **Replies:** 0\ **Last updated:** [May 15, 2020, 8:38pm UTC](https://discuss.elastic.co/t/geo-context-not-working-with-completion-suggester-with-precision-in-mi/232882 "2020-05-15T20:38:39Z")
I'm using ES v.7.6 and am trying to setup an autocomplete to search for businesses and filter out those which lie a variable distance away from the center of the search area. When specifying precision on the query in te… --- ## [Should GatewayAllocator force allocate replicas for node/process restart cases?](https://discuss.elastic.co/t/should-gatewayallocator-force-allocate-replicas-for-node-process-restart-cases/232876)
**Author:** [@vigyas](https://discuss.elastic.co/u/vigyas)\ **Replies:** 0\ **Last updated:** [May 15, 2020, 7:32pm UTC](https://discuss.elastic.co/t/should-gatewayallocator-force-allocate-replicas-for-node-process-restart-cases/232876 "2020-05-15T19:32:09Z")
Today, we can exclude certain nodes from allocation using FilterDecider settings, which is a way to decommission nodes on a rack, or with an attribute. If ES process restarts on such a node, the primaries get assigned b… --- ## [Exclude array items in cardinality aggregation](https://discuss.elastic.co/t/exclude-array-items-in-cardinality-aggregation/232331)
**Author:** [@Ninan\_Zhang](https://discuss.elastic.co/u/Ninan_Zhang)\ **Replies:** 2\ **Last updated:** [May 15, 2020, 6:57pm UTC](https://discuss.elastic.co/t/exclude-array-items-in-cardinality-aggregation/232331 "2020-05-15T18:57:26Z")
The field mapping is like this: \[ { "type": 1, "document\_id": \[4, 5\] }, { "type": 1, "document\_id": \[4\] }, { "typ… --- ## [Regexp for ES](https://discuss.elastic.co/t/regexp-for-es/232868)
**Author:** [@ebdavison](https://discuss.elastic.co/u/ebdavison)\ **Replies:** 0\ **Last updated:** [May 15, 2020, 6:49pm UTC](https://discuss.elastic.co/t/regexp-for-es/232868 "2020-05-15T18:49:56Z")
I have a regex that I have been using outside of elasticsearch and am needing to convert to a query: (\\sprivilege::|\\ssekurlsa::|\\scrypto::|\\skerberos::|\\slsadump::|\\sprocess::) I know from the documentation that the \\… --- ## [Refresh index from database](https://discuss.elastic.co/t/refresh-index-from-database/232823)
**Author:** [@mnasim](https://discuss.elastic.co/u/mnasim)\ **Replies:** 1\ **Last updated:** [May 15, 2020, 6:36pm UTC](https://discuss.elastic.co/t/refresh-index-from-database/232823 "2020-05-15T18:36:12Z")
Hi Support, We have an existing database index created from Logstash process using JDBC input plugin. Now database is continuously modifying. So that without dropping existing index it append all database entries in th… --- ## [Snapshot and restore to move indexes](https://discuss.elastic.co/t/snapshot-and-restore-to-move-indexes/232854)
**Author:** [@chiara](https://discuss.elastic.co/u/chiara)\ **Replies:** 0\ **Last updated:** [May 15, 2020, 4:56pm UTC](https://discuss.elastic.co/t/snapshot-and-restore-to-move-indexes/232854 "2020-05-15T16:56:41Z")
I have 2 ELK cluster. Every x days I would like to take a snapshot of some indexes (based on date, for example indexes of previous month) in first cluster and restore them in second remote cluster. Can I dynamically sele… --- ## [Regular expression has redundant nested repeat operator messages](https://discuss.elastic.co/t/regular-expression-has-redundant-nested-repeat-operator-messages/232482)
**Author:** [@realyn\_elastic](https://discuss.elastic.co/u/realyn_elastic)\ **Replies:** 1\ **Last updated:** [May 15, 2020, 4:50pm UTC](https://discuss.elastic.co/t/regular-expression-has-redundant-nested-repeat-operator-messages/232482 "2020-05-15T16:50:52Z")
I am seeing this lot of errors inside my /var/log/messages. Could someone help me to enlighten and fix this regular expression has redundant nested repeat operator \* /(?:(?:(?:(?\(?:(?\>\\d\\d){… --- ## [ES Support Nested Docs Deletion](https://discuss.elastic.co/t/es-support-nested-docs-deletion/232709)
**Author:** [@kjain14](https://discuss.elastic.co/u/kjain14)\ **Replies:** 2\ **Last updated:** [May 15, 2020, 4:45pm UTC](https://discuss.elastic.co/t/es-support-nested-docs-deletion/232709 "2020-05-15T16:45:00Z")
Hi Folks, I have been using Elastic Search server of version 7.2.0. When I deleted parent document in ES by ID, it did not delete its child document. Can you please confirm over that? If yes, do you know another way to… --- ## [Sorting nested documents with inner\_hits not returning desired results. ES7.x](https://discuss.elastic.co/t/sorting-nested-documents-with-inner-hits-not-returning-desired-results-es7-x/232762)
**Author:** [@hkhan](https://discuss.elastic.co/u/hkhan)\ **Replies:** 1\ **Last updated:** [May 15, 2020, 2:28pm UTC](https://discuss.elastic.co/t/sorting-nested-documents-with-inner-hits-not-returning-desired-results-es7-x/232762 "2020-05-15T14:28:16Z")
Hi, I am trying to implement a proof of concept for using Elasticsearch in our application. I am, however, stuck at sorting the nested documents with nested field and will greatly appreciate help in finding answer to my … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=918) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=920)