# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1030 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1031 --- ## [Difference between should clause with minimum\_should\_match and should clause inside a must clause](https://discuss.elastic.co/t/difference-between-should-clause-with-minimum-should-match-and-should-clause-inside-a-must-clause/217183)
**Author:** [@pilo](https://discuss.elastic.co/u/pilo)\ **Replies:** 1\ **Last updated:** [January 31, 2020, 11:00am UTC](https://discuss.elastic.co/t/difference-between-should-clause-with-minimum-should-match-and-should-clause-inside-a-must-clause/217183 "2020-01-31T11:00:39Z")
Hello everyone, I'm doing a request using should and filter clauses like this GET case/\_search { "\_source": false, "query": { "bool": { "should": \[ { "multi\_match": { "query"… --- ## [Sql access query not working via curl](https://discuss.elastic.co/t/sql-access-query-not-working-via-curl/216195)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 8\ **Last updated:** [January 31, 2020, 10:55am UTC](https://discuss.elastic.co/t/sql-access-query-not-working-via-curl/216195 "2020-01-31T10:55:24Z")
we have 6.5 elk . and in dev tools following query works fine POST /\_xpack/sql?format=txt { "query": "select "@timestamp" from "mbeat-2020.01.23" where "@timestamp" \>CAST('2020-01-23T05:00:00Z' AS TIMESTAMP)" } but… --- ## [Unable to read flattened type field using pyspark connector](https://discuss.elastic.co/t/unable-to-read-flattened-type-field-using-pyspark-connector/217349)
**Author:** [@amendhe](https://discuss.elastic.co/u/amendhe)\ **Replies:** 0\ **Last updated:** [January 31, 2020, 10:22am UTC](https://discuss.elastic.co/t/unable-to-read-flattened-type-field-using-pyspark-connector/217349 "2020-01-31T10:22:05Z")
After reading index from elasticsearch using pyspark in databricks - All fields appeared but only one field which is a type of 'flattened' type not appeared in dataframe schema. Is there any option that i need to include… --- ## [Have I found a documentation error about auto\_generate\_phrase\_queries in query stings?](https://discuss.elastic.co/t/have-i-found-a-documentation-error-about-auto-generate-phrase-queries-in-query-stings/217339)
**Author:** [@ErikWarming](https://discuss.elastic.co/u/ErikWarming)\ **Replies:** 1\ **Last updated:** [January 31, 2020, 10:03am UTC](https://discuss.elastic.co/t/have-i-found-a-documentation-error-about-auto-generate-phrase-queries-in-query-stings/217339 "2020-01-31T10:03:02Z")
When following the documentation about query\_sting and auto\_generate\_phrase\_queries, Query string query | Elasticsearch Guide \[8.11\] | Elastic, is suggest that elastic 7.5 does indeed support auto\_generate\_phrase\_querie… --- ## [Composite aggregation - When to page](https://discuss.elastic.co/t/composite-aggregation-when-to-page/217342)
**Author:** [@wiouser](https://discuss.elastic.co/u/wiouser)\ **Replies:** 0\ **Last updated:** [January 31, 2020, 10:01am UTC](https://discuss.elastic.co/t/composite-aggregation-when-to-page/217342 "2020-01-31T10:01:57Z")
Hi, I tried using composite aggregation and using terms value source. For me it looks like all the responses contain the after\_key How to identify from the response to decide when to send the request for next page? I… --- ## [java.lang.IllegalArgumentException Error using Bulk Update API](https://discuss.elastic.co/t/java-lang-illegalargumentexception-error-using-bulk-update-api/217306)
**Author:** [@Toshif](https://discuss.elastic.co/u/Toshif)\ **Replies:** 4\ **Last updated:** [January 31, 2020, 9:50am UTC](https://discuss.elastic.co/t/java-lang-illegalargumentexception-error-using-bulk-update-api/217306 "2020-01-31T09:50:37Z")
Hello people, I am trying to bulk update in elasticSearch using java. I have a JSON list and I'm passing that list in bulk request to update, but its throwing an error as below : Exception in thread "main" java.lang.I… --- ## [Reindex causes mapper\_parsing\_exception](https://discuss.elastic.co/t/reindex-causes-mapper-parsing-exception/217328)
**Author:** [@Gavin\_Hardy](https://discuss.elastic.co/u/Gavin_Hardy)\ **Replies:** 7\ **Last updated:** [January 31, 2020, 9:50am UTC](https://discuss.elastic.co/t/reindex-causes-mapper-parsing-exception/217328 "2020-01-31T09:50:05Z")
Hello, We are currently using Functionbeat to create our templates, and yesterday we started seeing errors. Looking at the index's that were affected, it appears someone had create a custom template, which caused the er… --- ## [So many Error in my cluster](https://discuss.elastic.co/t/so-many-error-in-my-cluster/217333)
**Author:** [@Medidou](https://discuss.elastic.co/u/Medidou)\ **Replies:** 2\ **Last updated:** [January 31, 2020, 9:42am UTC](https://discuss.elastic.co/t/so-many-error-in-my-cluster/217333 "2020-01-31T09:42:32Z")
Hello, (sorry my english) i got so many error, \[2020-01-31T09:18:19,720\]\[WARN \]\[o.e.c.r.a.AllocationService\] \[node-name-01\] \[.monitoring-kibana-6-2020.01.31\]\[0\] marking unavailable shards as stale: \[w\_kcv7S8u9\_B8w\] \[2… --- ## [ElasticsearchOutput::RecoverableRequestFailure error="could not push logs to Elasticsearch cluster](https://discuss.elastic.co/t/elasticsearchoutput-recoverablerequestfailure-error-could-not-push-logs-to-elasticsearch-cluster/217326)
**Author:** [@Tania\_Saez](https://discuss.elastic.co/u/Tania_Saez)\ **Replies:** 1\ **Last updated:** [January 31, 2020, 9:11am UTC](https://discuss.elastic.co/t/elasticsearchoutput-recoverablerequestfailure-error-could-not-push-logs-to-elasticsearch-cluster/217326 "2020-01-31T09:11:35Z")
Ingesting traffic from td-agent to elasticsearch index created, I see the process fails in the ingestion after some days working fine. This is the error I got and the index stop ingresing traffic: 2020-01-20 05:38:44 +… --- ## [Get All Data Through Elasticsearch](https://discuss.elastic.co/t/get-all-data-through-elasticsearch/217323)
**Author:** [@rickyooi](https://discuss.elastic.co/u/rickyooi)\ **Replies:** 1\ **Last updated:** [January 31, 2020, 9:10am UTC](https://discuss.elastic.co/t/get-all-data-through-elasticsearch/217323 "2020-01-31T09:10:19Z")
Hi, How to write an elastic query to return all data instead of putting size in the query? As I try a query without putting size, it just return 10 sets of data. --- ## [How to get a developer license for Elastic](https://discuss.elastic.co/t/how-to-get-a-developer-license-for-elastic/217324)
**Author:** [@Ayush2810](https://discuss.elastic.co/u/Ayush2810)\ **Replies:** 1\ **Last updated:** [January 31, 2020, 9:09am UTC](https://discuss.elastic.co/t/how-to-get-a-developer-license-for-elastic/217324 "2020-01-31T09:09:02Z")
How can I get a elastic license for development purposes only. --- ## [Substring not returning consistent result](https://discuss.elastic.co/t/substring-not-returning-consistent-result/217330)
**Author:** [@Laxmi\_Barthwal](https://discuss.elastic.co/u/Laxmi_Barthwal)\ **Replies:** 0\ **Last updated:** [January 31, 2020, 9:04am UTC](https://discuss.elastic.co/t/substring-not-returning-consistent-result/217330 "2020-01-31T09:04:20Z")
When using scripted fields to extract date from \_source field ( log.keyword) , then getting date as january1 1970 in some case and in some case getting correct date. My script is for test2 : returns Date if (doc\['… --- ## [Sorting on field which in text data type but integer will be store](https://discuss.elastic.co/t/sorting-on-field-which-in-text-data-type-but-integer-will-be-store/217046)
**Author:** [@Gopal\_Chauhan](https://discuss.elastic.co/u/Gopal_Chauhan)\ **Replies:** 3\ **Last updated:** [January 31, 2020, 9:05am UTC](https://discuss.elastic.co/t/sorting-on-field-which-in-text-data-type-but-integer-will-be-store/217046 "2020-01-31T09:05:32Z")
Hi, We have a field in index - TempNo which has to be text type but all values in this field are number (integer) When i am doing sorting (desc) on this field , sort does not happen correctly. I am not getting result i… --- ## [Unequal shard allocaiton](https://discuss.elastic.co/t/unequal-shard-allocaiton/217284)
**Author:** [@vijay\_kaali](https://discuss.elastic.co/u/vijay_kaali)\ **Replies:** 4\ **Last updated:** [January 31, 2020, 8:18am UTC](https://discuss.elastic.co/t/unequal-shard-allocaiton/217284 "2020-01-31T08:18:12Z")
i have 8 data node elk and metricbeat configured with shard 2 replica 1. most of the times all of the shard is maximum spread in 3 node . in order to max performance i trying to create index with 5 shard replica 1 and … --- ## [Add aws profile arn in elastic keystore](https://discuss.elastic.co/t/add-aws-profile-arn-in-elastic-keystore/217316)
**Author:** [@Sudharshan\_K\_S](https://discuss.elastic.co/u/Sudharshan_K_S)\ **Replies:** 0\ **Last updated:** [January 31, 2020, 8:09am UTC](https://discuss.elastic.co/t/add-aws-profile-arn-in-elastic-keystore/217316 "2020-01-31T08:09:45Z")
How can I add the profile arn into the elastic keystore since there is already a way to add the s3 access key and secret key. This is regarding the snapshots with s3 repositry. I have followed the steps as given here h… --- ## [X-pack setup procedure for 3 node architecture](https://discuss.elastic.co/t/x-pack-setup-procedure-for-3-node-architecture/217061)
**Author:** [@RaV\_Theja\_sharma](https://discuss.elastic.co/u/RaV_Theja_sharma)\ **Replies:** 2\ **Last updated:** [January 31, 2020, 7:00am UTC](https://discuss.elastic.co/t/x-pack-setup-procedure-for-3-node-architecture/217061 "2020-01-31T07:00:59Z")
Hi, We are planing to buy x-pack gold, we are not aware of the entire process from buying to the implementation in our 3 ES node environments, Please suggest us the process. Thanks in advance. --- ## [Elasticsearch index read only](https://discuss.elastic.co/t/elasticsearch-index-read-only/217304)
**Author:** [@rj23495](https://discuss.elastic.co/u/rj23495)\ **Replies:** 0\ **Last updated:** [January 31, 2020, 6:42am UTC](https://discuss.elastic.co/t/elasticsearch-index-read-only/217304 "2020-01-31T06:42:50Z")
I have 1.7tb of disk space available for my indices but when the indices occupy around 1.2tb, indices state is changed to read only. This is a managed elasticsearch service. Need to understand the reason because normally… --- ## [Setting up an coordinating node](https://discuss.elastic.co/t/setting-up-an-coordinating-node/217277)
**Author:** [@jnpetty](https://discuss.elastic.co/u/jnpetty)\ **Replies:** 0\ **Last updated:** [January 30, 2020, 9:35pm UTC](https://discuss.elastic.co/t/setting-up-an-coordinating-node/217277 "2020-01-30T21:35:37Z")
Currently we have a 4 node ES cluster and separate LS and Kibana nodes. I am thinking about setting up a coordinating node alongside Kibana. My goal if to make Kibana a little more resilient and functional when I am doin… --- ## [Exact Match with Synonyms](https://discuss.elastic.co/t/exact-match-with-synonyms/216735)
**Author:** [@plawler92](https://discuss.elastic.co/u/plawler92)\ **Replies:** 1\ **Last updated:** [January 30, 2020, 9:24pm UTC](https://discuss.elastic.co/t/exact-match-with-synonyms/216735 "2020-01-30T21:24:45Z")
Hi, I have a field containing city names that I would like to get the exact city name out of while still utilizing synonyms. So If I searched for either "St Louis" or "Saint Louis" I would get back "Saint Louis" but no… --- ## [Use azure fileshare as data storage for Multiple ES Clusters running on K8s](https://discuss.elastic.co/t/use-azure-fileshare-as-data-storage-for-multiple-es-clusters-running-on-k8s/217155)
**Author:** [@biswarup1290dass](https://discuss.elastic.co/u/biswarup1290dass)\ **Replies:** 5\ **Last updated:** [January 30, 2020, 8:24pm UTC](https://discuss.elastic.co/t/use-azure-fileshare-as-data-storage-for-multiple-es-clusters-running-on-k8s/217155 "2020-01-30T20:24:20Z")
Is it possible to use an Azure File Share(similar to NFS) for data storage of multiple ES Clusters running on K8s? So that both the clusters can write/read from a common location. Can think of it as a cross-geo HA soluti… --- ## [Encryption at rest support for Platinum subscriptions](https://discuss.elastic.co/t/encryption-at-rest-support-for-platinum-subscriptions/217268)
**Author:** [@mstephenson](https://discuss.elastic.co/u/mstephenson)\ **Replies:** 0\ **Last updated:** [January 30, 2020, 8:19pm UTC](https://discuss.elastic.co/t/encryption-at-rest-support-for-platinum-subscriptions/217268 "2020-01-30T20:19:27Z")
As I understand it encryption at rest for Elasticsearch is done at the OS level. Does the Platinum subscription “Encryption at rest support” include running Elasticsearch on Windows Server 2016 using either Encrypting F… --- ## [Can we link documents (parent) to the documents (child)?](https://discuss.elastic.co/t/can-we-link-documents-parent-to-the-documents-child/217089)
**Author:** [@deepak643](https://discuss.elastic.co/u/deepak643)\ **Replies:** 5\ **Last updated:** [January 30, 2020, 8:01pm UTC](https://discuss.elastic.co/t/can-we-link-documents-parent-to-the-documents-child/217089 "2020-01-30T20:01:44Z")
I would like to know if two documents can be linked to get the search benefits? For example: I have a child document which is formed from parent document. I do not want to copy the complete document metadata to child s… --- ## [Percolate performance in ES 2.x vs 6.x/7.x](https://discuss.elastic.co/t/percolate-performance-in-es-2-x-vs-6-x-7-x/217262)
**Author:** [@Nikolay\_Klimchuk](https://discuss.elastic.co/u/Nikolay_Klimchuk)\ **Replies:** 0\ **Last updated:** [January 30, 2020, 7:07pm UTC](https://discuss.elastic.co/t/percolate-performance-in-es-2-x-vs-6-x-7-x/217262 "2020-01-30T19:07:39Z")
We're implementing use case that relies on percolate and found that on same EC2 instance type ES 2.x \_percolate latency is 10-30 times better than percolate in ES 6.x give us! Even worse with 7.x.. Is there any chance t… --- ## [How to define custom terms inside of condition section of watcher](https://discuss.elastic.co/t/how-to-define-custom-terms-inside-of-condition-section-of-watcher/216914)
**Author:** [@Elliy](https://discuss.elastic.co/u/Elliy)\ **Replies:** 2\ **Last updated:** [January 30, 2020, 7:06pm UTC](https://discuss.elastic.co/t/how-to-define-custom-terms-inside-of-condition-section-of-watcher/216914 "2020-01-30T19:06:35Z")
I have a working watch script with trigger, input, condition, and action. The input section has significant logic and the condition is hard coded to true. I would like to change that. The input section has a transform w… --- ## [java.lang.NoSuchMethodError: org.elasticsearch.search.SearchHits.getTotalHits()](https://discuss.elastic.co/t/java-lang-nosuchmethoderror-org-elasticsearch-search-searchhits-gettotalhits/215484)
**Author:** [@SachaMaiornikoff](https://discuss.elastic.co/u/SachaMaiornikoff)\ **Replies:** 4\ **Last updated:** [January 30, 2020, 5:39pm UTC](https://discuss.elastic.co/t/java-lang-nosuchmethoderror-org-elasticsearch-search-searchhits-gettotalhits/215484 "2020-01-30T17:39:18Z")
Hello guys, I know there is a topic with the same issue but the answer doesn't solve my issue. I got a really basic spring boot 2.2.0 app which is supposed to connect to a ES 7.2.0. but when i try to search anything i… --- ## [Index cleanup](https://discuss.elastic.co/t/index-cleanup/215476)
**Author:** [@andymcinnes](https://discuss.elastic.co/u/andymcinnes)\ **Replies:** 19\ **Last updated:** [January 30, 2020, 5:28pm UTC](https://discuss.elastic.co/t/index-cleanup/215476 "2020-01-30T17:28:55Z")
Hi, I've got Serilog pumping logs in to elastic search from various applications, using the Serilog ElasticSearch Sink. I use a daily indexing pattern per environment and serilog manages the initial creation of these in… --- ## [Unable to create a snapshot](https://discuss.elastic.co/t/unable-to-create-a-snapshot/217115)
**Author:** [@Shubham\_Mittal](https://discuss.elastic.co/u/Shubham_Mittal)\ **Replies:** 1\ **Last updated:** [January 30, 2020, 4:17pm UTC](https://discuss.elastic.co/t/unable-to-create-a-snapshot/217115 "2020-01-30T16:17:13Z")
D:\\EasySearch10.1\\elasticsearch-curator-5.8.1-amd64\\curator-5.8.1-amd64\>curator\_cli --host 192.168.38.115 snapshot --repository repo1 --name snapshot30jan indices --filter\_list '{"filtertype":"none"}' Usage: curator\_cli… --- ## [Monitoring history not being deleted](https://discuss.elastic.co/t/monitoring-history-not-being-deleted/217239)
**Author:** [@Ronin](https://discuss.elastic.co/u/Ronin)\ **Replies:** 0\ **Last updated:** [January 30, 2020, 4:05pm UTC](https://discuss.elastic.co/t/monitoring-history-not-being-deleted/217239 "2020-01-30T16:05:49Z")
We have a monitoring cluster that is set up to monitor 3 other clusters and the beats for those clusters. The monitoring cluster is being filled up with indices such as .monitoring-es-7-2019.12.28. Looking at documentati… --- ## [Docker log through Fluent Bit](https://discuss.elastic.co/t/docker-log-through-fluent-bit/217223)
**Author:** [@pvalois](https://discuss.elastic.co/u/pvalois)\ **Replies:** 0\ **Last updated:** [January 30, 2020, 3:23pm UTC](https://discuss.elastic.co/t/docker-log-through-fluent-bit/217223 "2020-01-30T15:23:22Z")
Hello We use docker, configurer to send logs through Fluent Bit to Elastic Search. When the log get out from FluentBit to ElasticSearch, the field Log who contain a JSON is encapsulated in quotes, making it parsed as a… --- ## [Does deleting and creating indexes over time kill index performance?](https://discuss.elastic.co/t/does-deleting-and-creating-indexes-over-time-kill-index-performance/217041)
**Author:** [@Wa\_ed\_AL-Sawarieh](https://discuss.elastic.co/u/Wa_ed_AL-Sawarieh)\ **Replies:** 2\ **Last updated:** [January 30, 2020, 3:20pm UTC](https://discuss.elastic.co/t/does-deleting-and-creating-indexes-over-time-kill-index-performance/217041 "2020-01-30T15:20:55Z")
Hello, I have question about elastic search index, Does delete and creating indexes over time kill index performance? Thanks [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1029) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1031)