# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=752 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 753 --- ## [Sub partition in Machine Learning](https://discuss.elastic.co/t/sub-partition-in-machine-learning/257220)
**Author:** [@OmarDacca](https://discuss.elastic.co/u/OmarDacca)\ **Replies:** 1\ **Last updated:** [December 1, 2020, 11:50pm UTC](https://discuss.elastic.co/t/sub-partition-in-machine-learning/257220 "2020-12-01T23:50:32Z")
Hi, Is it possible to make sub partitions in Machine Learning ? domain and event are fields in every document. I created a categorization ml job, with partition\_field = domain, but this is not enough, I must split it … --- ## [Missing \_scroll\_id in search response when using Python library](https://discuss.elastic.co/t/missing-scroll-id-in-search-response-when-using-python-library/257288)
**Author:** [@bbunderson](https://discuss.elastic.co/u/bbunderson)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 11:22pm UTC](https://discuss.elastic.co/t/missing-scroll-id-in-search-response-when-using-python-library/257288 "2020-12-01T23:22:17Z")
The \_scroll\_id is missing from the search response when using the Python library version 7.9.0 but the response does contain the \_scroll\_id when I query the API using curl. For example, the following Python code: respo… --- ## [Python3 Elastic Query returns large amount of results.. am i doing this right?](https://discuss.elastic.co/t/python3-elastic-query-returns-large-amount-of-results-am-i-doing-this-right/257283)
**Author:** [@stcdarrell](https://discuss.elastic.co/u/stcdarrell)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 10:30pm UTC](https://discuss.elastic.co/t/python3-elastic-query-returns-large-amount-of-results-am-i-doing-this-right/257283 "2020-12-01T22:30:30Z")
hi, i'm still not sure i'm doing this right.. so any suggestions would be appreciated.. i have a LARGE data index of log data containing IP addresses.. ports.. and other network traffic info. its millions of entries a m… --- ## [ES 5.6 : stop spark indexing if active shard is not 100](https://discuss.elastic.co/t/es-5-6-stop-spark-indexing-if-active-shard-is-not-100/257206)
**Author:** [@Beuhlet\_Reseau](https://discuss.elastic.co/u/Beuhlet_Reseau)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 1:20pm UTC](https://discuss.elastic.co/t/es-5-6-stop-spark-indexing-if-active-shard-is-not-100/257206 "2020-12-01T13:20:16Z")
Hello, When we restart a node in ES 5.6, active shard percent is about 96% We have noticed that spark jobs stop indexing in cluster as long as the value of active shard percent does not exceed 98%. have you heard of t… --- ## [Median aggregation and routing](https://discuss.elastic.co/t/median-aggregation-and-routing/257276)
**Author:** [@pcb](https://discuss.elastic.co/u/pcb)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 9:01pm UTC](https://discuss.elastic.co/t/median-aggregation-and-routing/257276 "2020-12-01T21:01:06Z")
Hi ya, I'm working on spec'ing out a new datastore for aggregate calculations for near-real time dashboards and I'm evaluating Elasticsearch. I've read here that median is usually approximated: https://www.elastic.co/gu… --- ## [Get all documents matching a list of values for a field](https://discuss.elastic.co/t/get-all-documents-matching-a-list-of-values-for-a-field/257274)
**Author:** [@jmaharjan](https://discuss.elastic.co/u/jmaharjan)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 8:19pm UTC](https://discuss.elastic.co/t/get-all-documents-matching-a-list-of-values-for-a-field/257274 "2020-12-01T20:19:48Z")
I am using multisearch (msearch from elasticsearch-py) to search for all documents using a list of document ids from a list of indices. The id's are explicitly assigned. The goal is to look for existing documents (using … --- ## [Query\_string with datetime](https://discuss.elastic.co/t/query-string-with-datetime/257271)
**Author:** [@spreet](https://discuss.elastic.co/u/spreet)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 8:10pm UTC](https://discuss.elastic.co/t/query-string-with-datetime/257271 "2020-12-01T20:10:07Z")
We recently migrated to ES 7.1 from 5.8. In the previous version query\_string with a datetime used to work. Query with date and time { "query": { "query\_string": { "query": "data.lastUpdateTime:\[\* TO 2018-1… --- ## [Keystore does not update azure client secrets when changed - secrets seems to be persistent somehow](https://discuss.elastic.co/t/keystore-does-not-update-azure-client-secrets-when-changed-secrets-seems-to-be-persistent-somehow/257257)
**Author:** [@johanhaugland](https://discuss.elastic.co/u/johanhaugland)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 6:13pm UTC](https://discuss.elastic.co/t/keystore-does-not-update-azure-client-secrets-when-changed-secrets-seems-to-be-persistent-somehow/257257 "2020-12-01T18:13:59Z")
Short version: Unable to load new values into keystore secrets for azure plugin: azure.client.default.account azure.client.default.key They seem to be persistent - how do I purge the old values completely from the clu… --- ## [Nested Field can't access the nested field array using script query](https://discuss.elastic.co/t/nested-field-cant-access-the-nested-field-array-using-script-query/257256)
**Author:** [@khalilw1](https://discuss.elastic.co/u/khalilw1)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 6:12pm UTC](https://discuss.elastic.co/t/nested-field-cant-access-the-nested-field-array-using-script-query/257256 "2020-12-01T18:12:27Z")
Hello Guys, I have the following mapping PUT products/\_mapping { "properties": { "discounts": { "properties": { "KW": { "type": "nested" }, "SA": { "type": "neste… --- ## [Field value factor based on matched term](https://discuss.elastic.co/t/field-value-factor-based-on-matched-term/257241)
**Author:** [@Tianyi\_Mao](https://discuss.elastic.co/u/Tianyi_Mao)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 4:44pm UTC](https://discuss.elastic.co/t/field-value-factor-based-on-matched-term/257241 "2020-12-01T16:44:18Z")
In https://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-function-score-query.html#function-field-value-factor it is mentioned that one can use a numeric field in the document to influence scoring. C… --- ## [Inner hits in a double nested query fine in ES 7.7, but not working in 7.10](https://discuss.elastic.co/t/inner-hits-in-a-double-nested-query-fine-in-es-7-7-but-not-working-in-7-10/257239)
**Author:** [@timarkh](https://discuss.elastic.co/u/timarkh)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 4:25pm UTC](https://discuss.elastic.co/t/inner-hits-in-a-double-nested-query-fine-in-es-7-7-but-not-working-in-7-10/257239 "2020-12-01T16:25:46Z")
I have an index (sentences) where documents contain two kinds of nested objects, one (ana) inside the other (words). In my queries, I use two inner\_hits keys to highlight the matches. This worked fine in 5.6 and still wo… --- ## [Ingest pipeline not working but working in the simulate API](https://discuss.elastic.co/t/ingest-pipeline-not-working-but-working-in-the-simulate-api/205322)
**Author:** [@themarcusaurelius](https://discuss.elastic.co/u/themarcusaurelius)\ **Replies:** 6\ **Last updated:** [December 1, 2020, 3:42pm UTC](https://discuss.elastic.co/t/ingest-pipeline-not-working-but-working-in-the-simulate-api/205322 "2020-12-01T15:42:41Z")
I have a pipeline that is filtering Palo Alto logs through Grok patterns and other processors. Testing with the simulate API shows that it works but when I try to ingest into elasticsearch none of the documents go throug… --- ## [How to solve AWS elasticsearch CircuitBreakingException error without elasticsearch.yml file?](https://discuss.elastic.co/t/how-to-solve-aws-elasticsearch-circuitbreakingexception-error-without-elasticsearch-yml-file/257226)
**Author:** [@I\_Hathout](https://discuss.elastic.co/u/I_Hathout)\ **Replies:** 1\ **Last updated:** [December 1, 2020, 3:31pm UTC](https://discuss.elastic.co/t/how-to-solve-aws-elasticsearch-circuitbreakingexception-error-without-elasticsearch-yml-file/257226 "2020-12-01T15:31:18Z")
I have the CircuitBreakingException issue and I found a solution in another topic, by setting the elasticsearch.yml real memory breaker variable to false, but in my case AWS Elasticsearch has no .yml file. so how to sol… --- ## [Pushing data from one elastic search to another elastic search](https://discuss.elastic.co/t/pushing-data-from-one-elastic-search-to-another-elastic-search/257214)
**Author:** [@Nkrb](https://discuss.elastic.co/u/Nkrb)\ **Replies:** 1\ **Last updated:** [December 1, 2020, 2:20pm UTC](https://discuss.elastic.co/t/pushing-data-from-one-elastic-search-to-another-elastic-search/257214 "2020-12-01T14:20:05Z")
Hi, We have a need to pull Elasticsearch data from our environment and push the same to another Elasticsearch database, which is on another environment. Our indices are of time-based pattern, hence data push should be i… --- ## [Elasticsearch stores plain text](https://discuss.elastic.co/t/elasticsearch-stores-plain-text/257212)
**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\ **Replies:** 1\ **Last updated:** [December 1, 2020, 2:18pm UTC](https://discuss.elastic.co/t/elasticsearch-stores-plain-text/257212 "2020-12-01T14:18:39Z")
Did elasticsearch allows only to store data in json format? or is to possible to pass plain text to store in elasticsearch? --- ## [Wildcard queries return responses in ES 6.8.0, but not in ES 7.9.3,](https://discuss.elastic.co/t/wildcard-queries-return-responses-in-es-6-8-0-but-not-in-es-7-9-3/257207)
**Author:** [@Tamil\_Selvan](https://discuss.elastic.co/u/Tamil_Selvan)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 1:26pm UTC](https://discuss.elastic.co/t/wildcard-queries-return-responses-in-es-6-8-0-but-not-in-es-7-9-3/257207 "2020-12-01T13:26:21Z")
{ "\_source": \[ "\_id" \], "query": { "bool": { "filter": { "bool": { "must": \[ { "query\_string": { "\_name": "0", "d… --- ## [Auto balancer not working in the midst of disk space crisis](https://discuss.elastic.co/t/auto-balancer-not-working-in-the-midst-of-disk-space-crisis/257173)
**Author:** [@test\_tester](https://discuss.elastic.co/u/test_tester)\ **Replies:** 8\ **Last updated:** [December 1, 2020, 11:07am UTC](https://discuss.elastic.co/t/auto-balancer-not-working-in-the-midst-of-disk-space-crisis/257173 "2020-12-01T11:07:08Z")
Hello everyone, So in my cluster, i have 3 nodes, with 70%, 88% and 65% disk space usage. As you might expect, my autobalancer is not working despite my configuration being set as 'enabled:all'. Afraid that my 2nd nod… --- ## [Watcher triggers when it shouldn't](https://discuss.elastic.co/t/watcher-triggers-when-it-shouldnt/256351)
**Author:** [@Jeroen2](https://discuss.elastic.co/u/Jeroen2)\ **Replies:** 3\ **Last updated:** [December 1, 2020, 10:36am UTC](https://discuss.elastic.co/t/watcher-triggers-when-it-shouldnt/256351 "2020-12-01T10:36:09Z")
I've created some watchers to check if all communications are working in our company. This watcher should trigger when there's no hits in the pas hour. The problem is it fires sometimes, when I run the exact same query … --- ## [Cross cluster replication in different regions in aws elasticsearch](https://discuss.elastic.co/t/cross-cluster-replication-in-different-regions-in-aws-elasticsearch/257067)
**Author:** [@guest123](https://discuss.elastic.co/u/guest123)\ **Replies:** 8\ **Last updated:** [December 1, 2020, 9:18am UTC](https://discuss.elastic.co/t/cross-cluster-replication-in-different-regions-in-aws-elasticsearch/257067 "2020-12-01T09:18:42Z")
Hi .. i am migrating to aws managed elasticsearch from self hosted es.. as part of migration facing an issue with backup(snapshot) and restore. we have 2 distinct clusters preferably us-east and us-west , snapshot repos… --- ## [Elasticsearch available on internal and public ip](https://discuss.elastic.co/t/elasticsearch-available-on-internal-and-public-ip/257170)
**Author:** [@Bertram\_van\_de\_Ven](https://discuss.elastic.co/u/Bertram_van_de_Ven)\ **Replies:** 1\ **Last updated:** [December 1, 2020, 8:32am UTC](https://discuss.elastic.co/t/elasticsearch-available-on-internal-and-public-ip/257170 "2020-12-01T08:32:57Z")
We have an ElasticSearch cluster running, it's local (company network) available and everything works. And I also made each node available on an external ip by configuring the network.bind\_host on localhost, local and pu… --- ## [Problem with ILM](https://discuss.elastic.co/t/problem-with-ilm/255946)
**Author:** [@BoKu](https://discuss.elastic.co/u/BoKu)\ **Replies:** 4\ **Last updated:** [December 1, 2020, 7:10am UTC](https://discuss.elastic.co/t/problem-with-ilm/255946 "2020-12-01T07:10:48Z")
Hello, i have a problem understanding ILM with index alias on an custom created index. I have an custom index oracle-logs, which is feeded by logstash (which gets the documents from filebeat), it then sends the document… --- ## [Data node constantly dropping out of the cluster](https://discuss.elastic.co/t/data-node-constantly-dropping-out-of-the-cluster/257163)
**Author:** [@RusseL](https://discuss.elastic.co/u/RusseL)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 7:05am UTC](https://discuss.elastic.co/t/data-node-constantly-dropping-out-of-the-cluster/257163 "2020-12-01T07:05:04Z")
The data node is constantly falling from the cluster, I don't understand why.Can you please help me? I'm too new to find out why myself. I shared it all here --- ## [How to build Elasticsearch from source without xpack](https://discuss.elastic.co/t/how-to-build-elasticsearch-from-source-without-xpack/256299)
**Author:** [@kayshu](https://discuss.elastic.co/u/kayshu)\ **Replies:** 6\ **Last updated:** [December 1, 2020, 6:13am UTC](https://discuss.elastic.co/t/how-to-build-elasticsearch-from-source-without-xpack/256299 "2020-12-01T06:13:04Z")
Hi, i am trying to build a non-snapshot build of elasticsearch from source using gradle assemble -Dbuild.snapshot=false But I am getting the following exception Property license.key must be set for release build I th… --- ## [Cannot allocate because a previous copy of the primary shard existed but can no longer be found on the nodes in the cluster](https://discuss.elastic.co/t/cannot-allocate-because-a-previous-copy-of-the-primary-shard-existed-but-can-no-longer-be-found-on-the-nodes-in-the-cluster/257148)
**Author:** [@wfeng888](https://discuss.elastic.co/u/wfeng888)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 4:03am UTC](https://discuss.elastic.co/t/cannot-allocate-because-a-previous-copy-of-the-primary-shard-existed-but-can-no-longer-be-found-on-the-nodes-in-the-cluster/257148 "2020-12-01T04:03:07Z")
I have a cluster with two nodes , version es5.4.3. About 26 shards unassigned after machine down. I get these message GET /\_cluster/allocation/explain { "index": "dcvs\_nonmotorvehicle", "shard": 3, "primary":… --- ## [Reindex from a remote cluster](https://discuss.elastic.co/t/reindex-from-a-remote-cluster/256922)
**Author:** [@twang](https://discuss.elastic.co/u/twang)\ **Replies:** 4\ **Last updated:** [December 1, 2020, 1:44am UTC](https://discuss.elastic.co/t/reindex-from-a-remote-cluster/256922 "2020-12-01T01:44:44Z")
Hi, I am trying to copy my index from one source to another source from a remote cluster. to follow this link I got an error: my cluster is not on reindex.remote.whitelist. I were using - Elasticsearch (Self-Manage… --- ## [Looking for suggestions about mapping](https://discuss.elastic.co/t/looking-for-suggestions-about-mapping/257140)
**Author:** [@MassimoIvaldi](https://discuss.elastic.co/u/MassimoIvaldi)\ **Replies:** 0\ **Last updated:** [December 1, 2020, 12:54am UTC](https://discuss.elastic.co/t/looking-for-suggestions-about-mapping/257140 "2020-12-01T00:54:27Z")
Hello, I am an Italian developer, newbye of Elasticsearch, actually in training. I would experiment as exercice a parser of articles in some French newspaper in order to analyze the text usin Natural Language Processin… --- ## [Filebeat: Ingest logs to Datastream](https://discuss.elastic.co/t/filebeat-ingest-logs-to-datastream/256164)
**Author:** [@vishakh](https://discuss.elastic.co/u/vishakh)\ **Replies:** 1\ **Last updated:** [November 30, 2020, 10:06pm UTC](https://discuss.elastic.co/t/filebeat-ingest-logs-to-datastream/256164 "2020-11-30T22:06:56Z")
ELK-stack: 7.10 Currently, I'm using filebeat to ingest logs to elasticsearch directly to an index (example: useract-\*) Since 7.9.1, I see a new feature called data-stream. Question: How can we specify and make filebe… --- ## [Best Possible way to implement two words search](https://discuss.elastic.co/t/best-possible-way-to-implement-two-words-search/256837)
**Author:** [@Vipul\_Sharma](https://discuss.elastic.co/u/Vipul_Sharma)\ **Replies:** 0\ **Last updated:** [November 27, 2020, 5:37am UTC](https://discuss.elastic.co/t/best-possible-way-to-implement-two-words-search/256837 "2020-11-27T05:37:39Z")
Hi, I was wondering what would be the best possible way to write a ES query to fetch the documents in a way that if the search query is like: 'elastic search' Then on the top it will show all the documents with 'elast… --- ## [Change section type?](https://discuss.elastic.co/t/change-section-type/256570)
**Author:** [@Matias\_Gerstner](https://discuss.elastic.co/u/Matias_Gerstner)\ **Replies:** 5\ **Last updated:** [November 30, 2020, 7:37pm UTC](https://discuss.elastic.co/t/change-section-type/256570 "2020-11-30T19:37:45Z")
Hello, my English is not very good, but I want to ask you a question, to see if it is possible what I am trying to do or not. I need to change the NAME of the "type" section, in several indices already created and wit… --- ## [Can we override the way data gets stored in elasticsearch](https://discuss.elastic.co/t/can-we-override-the-way-data-gets-stored-in-elasticsearch/257106)
**Author:** [@Vivek\_Sagar](https://discuss.elastic.co/u/Vivek_Sagar)\ **Replies:** 4\ **Last updated:** [November 30, 2020, 7:27pm UTC](https://discuss.elastic.co/t/can-we-override-the-way-data-gets-stored-in-elasticsearch/257106 "2020-11-30T19:27:20Z")
Is there a way to override how the data is stored in elasticsearch? I want to encrypt the data just before elasticsearch writes it to file system and just before sending the search query to file-system send the encrypted… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=751) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=753)