# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=734 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 735 --- ## [Search\_after throws an exception using sort on nested filtered field containing date typed data](https://discuss.elastic.co/t/search-after-throws-an-exception-using-sort-on-nested-filtered-field-containing-date-typed-data/259783)
**Author:** [@kaore](https://discuss.elastic.co/u/kaore)\ **Replies:** 0\ **Last updated:** [December 29, 2020, 8:50am UTC](https://discuss.elastic.co/t/search-after-throws-an-exception-using-sort-on-nested-filtered-field-containing-date-typed-data/259783 "2020-12-29T08:50:38Z")
Given a mapping describing an event which contains the following nested field: ... "timings": { "type": "nested", "properties": { "begin": { "type": "date" }, "end": { "type": "date" } … --- ## [Syntax to use max\_snapshot\_bytes\_per\_sec in snapshot api](https://discuss.elastic.co/t/syntax-to-use-max-snapshot-bytes-per-sec-in-snapshot-api/259778)
**Author:** [@dhina](https://discuss.elastic.co/u/dhina)\ **Replies:** 0\ **Last updated:** [December 29, 2020, 8:11am UTC](https://discuss.elastic.co/t/syntax-to-use-max-snapshot-bytes-per-sec-in-snapshot-api/259778 "2020-12-29T08:11:42Z")
I want to use the max\_snapshot\_bytes\_per\_sec to throttle the speed of the Elastic search snapshot. Checked the documentation, could not find an example on how to specify the limit. Which one of the below value is correc… --- ## [Multitenancy](https://discuss.elastic.co/t/multitenancy/259737)
**Author:** [@ArifAlili](https://discuss.elastic.co/u/ArifAlili)\ **Replies:** 6\ **Last updated:** [December 29, 2020, 7:13am UTC](https://discuss.elastic.co/t/multitenancy/259737 "2020-12-29T07:13:33Z")
Hi all, We are using Elasticsearch for our e-commerce platform, we are indexing products only. We have multiple shops under our platform, each shop is using different catalogue (produtcs). Currently we are investigatin… --- ## [Increase shard count in elastic search kubernetes](https://discuss.elastic.co/t/increase-shard-count-in-elastic-search-kubernetes/258269)
**Author:** [@rajkumar\_25](https://discuss.elastic.co/u/rajkumar_25)\ **Replies:** 4\ **Last updated:** [December 29, 2020, 6:17am UTC](https://discuss.elastic.co/t/increase-shard-count-in-elastic-search-kubernetes/258269 "2020-12-29T06:17:34Z")
I have deployed an Elastic search in GKE. ECK has 3 master and 2 data nodes. When creating an index with 1 shard and 1 replica getting 400 error response when the shard count reached 1000. Is it possible to increase the… --- ## [Is it possible to install ccr on a older version of elasticsearch, eg:5.x？](https://discuss.elastic.co/t/is-it-possible-to-install-ccr-on-a-older-version-of-elasticsearch-eg-5-x/259446)
**Author:** [@Jia\_Liu](https://discuss.elastic.co/u/Jia_Liu)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 6:09am UTC](https://discuss.elastic.co/t/is-it-possible-to-install-ccr-on-a-older-version-of-elasticsearch-eg-5-x/259446 "2020-12-29T06:09:26Z")
I have two elasticsearch cluster with verison 5.6.8. I want to copy index data across them, but as far as I know, cross-cluster-replication is enabled after 6.5. Is it possible to install ccr on an older version of ela… --- ## [Accessing Elasticsearch System indices via API](https://discuss.elastic.co/t/accessing-elasticsearch-system-indices-via-api/259581)
**Author:** [@bjur](https://discuss.elastic.co/u/bjur)\ **Replies:** 0\ **Last updated:** [December 24, 2020, 10:35am UTC](https://discuss.elastic.co/t/accessing-elasticsearch-system-indices-via-api/259581 "2020-12-24T10:35:00Z")
We have a custom setup in place, where Kibana dashboard is accessed via Elasticsearch API, by querying the .kibana index. From the results the Dashboard queries are extracted and used onward. While testing the upgrade t… --- ## [Watch-history-ilm-policy - out of the box ILM incorrectly set up?](https://discuss.elastic.co/t/watch-history-ilm-policy-out-of-the-box-ilm-incorrectly-set-up/259606)
**Author:** [@mgevans](https://discuss.elastic.co/u/mgevans)\ **Replies:** 0\ **Last updated:** [December 24, 2020, 8:00pm UTC](https://discuss.elastic.co/t/watch-history-ilm-policy-out-of-the-box-ilm-incorrectly-set-up/259606 "2020-12-24T20:00:37Z")
Hi there we're going through our own ILM components and noticed there are a number of built-in ILMs. One of these is for the watcher history indexes such as ".watcher-history-12-2020.12.23". I'm thinking these are mis… --- ## [Why cluster UUID is different](https://discuss.elastic.co/t/why-cluster-uuid-is-different/259660)
**Author:** [@sagittar](https://discuss.elastic.co/u/sagittar)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 5:58am UTC](https://discuss.elastic.co/t/why-cluster-uuid-is-different/259660 "2020-12-29T05:58:38Z")
node1 \[node\_2409:8086:8110:3f0::2d\] node2 \[node\_2409:8086:8110:3f0::2e\] node3 \[node\_2409:8086:8110:3f0::2f\] here is node1 log \[2020-12-23T02:38:57,563\]\[INFO \]\[o.e.c.c.JoinHelper \] \[node\_2409:8086:8110:3f0::2… --- ## [Grok an Elasticsearch problem](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259671)
**Author:** [@mesutalf](https://discuss.elastic.co/u/mesutalf)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 5:57am UTC](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259671 "2020-12-29T05:57:41Z")
Hi eveyone; I have ELK locally. I trying to send my mini log to Elasticsearch. My pattern is: 2020-11-30 05:52:33,018 \[9344\] INFO Dile.ServiceProvider.ServiceThread \[\] - Thread \[Core\[3u43s3-c403-4fe4-ab87-9bea0c0ab44… --- ## [How can I halt the process of movement of indices from hot nodes to warm nodes in elastic?](https://discuss.elastic.co/t/how-can-i-halt-the-process-of-movement-of-indices-from-hot-nodes-to-warm-nodes-in-elastic/259717)
**Author:** [@prajwalgmpp](https://discuss.elastic.co/u/prajwalgmpp)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 5:56am UTC](https://discuss.elastic.co/t/how-can-i-halt-the-process-of-movement-of-indices-from-hot-nodes-to-warm-nodes-in-elastic/259717 "2020-12-29T05:56:31Z")
I have initiated the process of movement of week 49 indices from our designated hot nodes to warm nodes using the API: PUT \*2020.49/\_settings { "index.routing.allocation.require.data": "warm" } Now how can I halt… --- ## [Is there a way to show shard data path on a node?](https://discuss.elastic.co/t/is-there-a-way-to-show-shard-data-path-on-a-node/259759)
**Author:** [@linkerc](https://discuss.elastic.co/u/linkerc)\ **Replies:** 1\ **Last updated:** [December 29, 2020, 5:52am UTC](https://discuss.elastic.co/t/is-there-a-way-to-show-shard-data-path-on-a-node/259759 "2020-12-29T05:52:00Z")
I am in the process of validating using nodes with multiple disks. I need an easy way to have a high level idea where the shards are located. I typically use "GET /\_cat/allocation?v" to show the overall disk usage. Th… --- ## [Python index CSV into ES date issue](https://discuss.elastic.co/t/python-index-csv-into-es-date-issue/259764)
**Author:** [@nameisnotimportant](https://discuss.elastic.co/u/nameisnotimportant)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 5:49am UTC](https://discuss.elastic.co/t/python-index-csv-into-es-date-issue/259764 "2020-12-29T05:49:41Z")
Hi, I use Python csv.DictReader to bulk insert CSV data into ES, i found that the date column was read as string. I tried two methods to deal with the date column data type: pre-define the index template to set the c… --- ## [How to fetch multiple return values by performing queries on multiple indices](https://discuss.elastic.co/t/how-to-fetch-multiple-return-values-by-performing-queries-on-multiple-indices/259716)
**Author:** [@sharpshooter](https://discuss.elastic.co/u/sharpshooter)\ **Replies:** 2\ **Last updated:** [December 29, 2020, 4:31am UTC](https://discuss.elastic.co/t/how-to-fetch-multiple-return-values-by-performing-queries-on-multiple-indices/259716 "2020-12-29T04:31:43Z")
Hii i am searching on multiple indices at a time on objects like Mail , Calender , Attachment and want return values of multiple types e.g :- (Mail , Calender , Attachment) but i am not able to get it please help. Thank … --- ## [High load, but lower cpu,lower IO](https://discuss.elastic.co/t/high-load-but-lower-cpu-lower-io/259047)
**Author:** [@111421](https://discuss.elastic.co/u/111421)\ **Replies:** 5\ **Last updated:** [December 29, 2020, 3:49am UTC](https://discuss.elastic.co/t/high-load-but-lower-cpu-lower-io/259047 "2020-12-29T03:49:33Z")
Hello, eyeryone I checked the es single node load through cerebor and found that the load is very high, but the cpu utilization rate is very low. Why? ES is deployed through docker, version: 6.8 cerebro: kibana: … --- ## [Data too large, data for \[\\]](https://discuss.elastic.co/t/data-too-large-data-for-transport-request/258676)
**Author:** [@myamor163](https://discuss.elastic.co/u/myamor163)\ **Replies:** 16\ **Last updated:** [December 28, 2020, 9:14am UTC](https://discuss.elastic.co/t/data-too-large-data-for-transport-request/258676 "2020-12-28T09:14:05Z")
Do not open replicas, index write normal, open replicas, write the following error: type":"circuit\_breaking\_exception","reason":"\[parent\] Data too large, data for \[\\] would be \[30770989726/28.6gb\], whi… --- ## [Apply condition on value (count) greater than some value in aggregation](https://discuss.elastic.co/t/apply-condition-on-value-count-greater-than-some-value-in-aggregation/259750)
**Author:** [@hariskhalique](https://discuss.elastic.co/u/hariskhalique)\ **Replies:** 3\ **Last updated:** [December 28, 2020, 6:54pm UTC](https://discuss.elastic.co/t/apply-condition-on-value-count-greater-than-some-value-in-aggregation/259750 "2020-12-28T18:54:05Z")
I am looking a way where I can apply condition on value return in result. Here is my query. { "size": 0, "aggs": { "by\_brand": { "terms": { "field": "brand\_name.keyword", "size": 10… --- ## [\[Error\]tried to parse field \[TLSv1\] as object, but found a concrete value](https://discuss.elastic.co/t/error-tried-to-parse-field-tlsv1-as-object-but-found-a-concrete-value/259753)
**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\ **Replies:** 0\ **Last updated:** [December 28, 2020, 6:43pm UTC](https://discuss.elastic.co/t/error-tried-to-parse-field-tlsv1-as-object-but-found-a-concrete-value/259753 "2020-12-28T18:43:20Z")
I am trying to ingest json data into Elasticsearch vai http\_poller and facing following error. elasticsearch - Could not index event to Elasticsearch. {:status=\>400, :action=\>\["index", {:\_id=\>nil, :\_index=\>"cloudflare",… --- ## [Elasticsearch-exporter connection failure](https://discuss.elastic.co/t/elasticsearch-exporter-connection-failure/259128)
**Author:** [@Patrick\_Lieberg1](https://discuss.elastic.co/u/Patrick_Lieberg1)\ **Replies:** 2\ **Last updated:** [December 28, 2020, 6:31pm UTC](https://discuss.elastic.co/t/elasticsearch-exporter-connection-failure/259128 "2020-12-28T18:31:47Z")
Any idea why an elasticsearch-exporter pod's logs report an error connecting to the coordinating pod, but if I exec into the pod and curl the same address, it works? Exporter version: 1.1.0-debian-10-r303 Error from lo… --- ## [Configure HTTP-server elasticsearch](https://discuss.elastic.co/t/configure-http-server-elasticsearch/259723)
**Author:** [@wmr84](https://discuss.elastic.co/u/wmr84)\ **Replies:** 1\ **Last updated:** [December 28, 2020, 1:02pm UTC](https://discuss.elastic.co/t/configure-http-server-elasticsearch/259723 "2020-12-28T13:02:03Z")
Hi everybody! I have configured the following parameters on my elasticsearch server http.host: elasticsearch.company.com http.publish\_host: elasticsearch.company.com http.bind\_host: elasticsearch.company.com I thoug… --- ## [Optimize corpus before training](https://discuss.elastic.co/t/optimize-corpus-before-training/259732)
**Author:** [@Alder](https://discuss.elastic.co/u/Alder)\ **Replies:** 0\ **Last updated:** [December 28, 2020, 12:51pm UTC](https://discuss.elastic.co/t/optimize-corpus-before-training/259732 "2020-12-28T12:51:01Z")
Hi all from elastic team. I am building a pipiline to optimize a corpus before submitting to opennlp training. remove stopwords apply lemmatizer or stemmer The elastic has some functionality that I pass a text and re… --- ## [Multi match bool query returning 0 hits on large number of documents](https://discuss.elastic.co/t/multi-match-bool-query-returning-0-hits-on-large-number-of-documents/259523)
**Author:** [@Finley](https://discuss.elastic.co/u/Finley)\ **Replies:** 2\ **Last updated:** [December 28, 2020, 10:46am UTC](https://discuss.elastic.co/t/multi-match-bool-query-returning-0-hits-on-large-number-of-documents/259523 "2020-12-28T10:46:31Z")
Hi, I have 2 elk cluster in 7.10. A -\> 70 documents per hour B -\> 100 - 300 documents per second (825k on 1 hour) When I am doing a KQL search in kibana (discover) with just typing "POST", on the cluster A, it's retu… --- ## [Snapshot size limits](https://discuss.elastic.co/t/snapshot-size-limits/259703)
**Author:** [@noob1](https://discuss.elastic.co/u/noob1)\ **Replies:** 4\ **Last updated:** [December 28, 2020, 10:34am UTC](https://discuss.elastic.co/t/snapshot-size-limits/259703 "2020-12-28T10:34:12Z")
Hey All, I'm trying to understand if there is any size limit on how much size snapshot can be written to repository. Say, is it possible to write 200 GB of snapshot to repository? If yes which backend repository should … --- ## [How to sort results based on another field's value or weightage](https://discuss.elastic.co/t/how-to-sort-results-based-on-another-fields-value-or-weightage/259713)
**Author:** [@pushanbhattacharya](https://discuss.elastic.co/u/pushanbhattacharya)\ **Replies:** 1\ **Last updated:** [December 28, 2020, 10:03am UTC](https://discuss.elastic.co/t/how-to-sort-results-based-on-another-fields-value-or-weightage/259713 "2020-12-28T10:03:26Z")
Hi, Let's take an example. Say the index has 2 fields, viz., name and weightage. Values- name: Black Bus, weightage: 1 name: Blue Bus, weightage: 2 name: Black Car, weightage: 2 name: Blue Car, weightage: 1 Now, … --- ## [Error: Your CLT does not support macOS 11](https://discuss.elastic.co/t/error-your-clt-does-not-support-macos-11/259680)
**Author:** [@yhoiseth](https://discuss.elastic.co/u/yhoiseth)\ **Replies:** 1\ **Last updated:** [December 27, 2020, 10:17pm UTC](https://discuss.elastic.co/t/error-your-clt-does-not-support-macos-11/259680 "2020-12-27T22:17:22Z")
After upgrading to macOS Big Sur 11.1 (20C69), I can’t upgrade Elasticsearch to 7.10.1. For background, I previously installed Elasticsearch using these instructions. I have since upgraded the Elasticsearch version many… --- ## [Parse PostgreSQL CSV log](https://discuss.elastic.co/t/parse-postgresql-csv-log/259688)
**Author:** [@azlev](https://discuss.elastic.co/u/azlev)\ **Replies:** 3\ **Last updated:** [December 27, 2020, 5:52pm UTC](https://discuss.elastic.co/t/parse-postgresql-csv-log/259688 "2020-12-27T17:52:33Z")
Hello. At work we are consuming the PostgreSQL CSV log instead of plain log. This poses some advantages, like a better formatted input file, stable format, and easy to turn it on. To achieve it, we are using the filebe… --- ## [ES - Spark tuning for bulk writes](https://discuss.elastic.co/t/es-spark-tuning-for-bulk-writes/259167)
**Author:** [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\ **Replies:** 16\ **Last updated:** [December 27, 2020, 3:32pm UTC](https://discuss.elastic.co/t/es-spark-tuning-for-bulk-writes/259167 "2020-12-27T15:32:05Z")
I;m using Spark 3 with ES 7.10 , ECK 1.3 I have following settings |es.batch.size.bytes|6000000| |es.batch.size.entries|10000| |es.batch.write.refresh|false| |es.batch.write.retry.count|6| Would like to know how can … --- ## [Grok an Elasticsearch problem](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259675)
**Author:** [@mesutalf](https://discuss.elastic.co/u/mesutalf)\ **Replies:** 1\ **Last updated:** [December 27, 2020, 2:14pm UTC](https://discuss.elastic.co/t/grok-an-elasticsearch-problem/259675 "2020-12-27T14:14:19Z")
Hi, I use ELK (7.2.x) my localhost and I have problem. I have log file like this; 2020-11-30 05:52:33,018 \[9344\] INFO Zdk.ServiceProvider.ServiceThread \[\] - Thread \[Core\[8047e7a3-c403-4fe4-ab87-9bea0c0ab449\]:0\]: idle … --- ## [Search for docs that are parents](https://discuss.elastic.co/t/search-for-docs-that-are-parents/259684)
**Author:** [@Luca\_Frost](https://discuss.elastic.co/u/Luca_Frost)\ **Replies:** 0\ **Last updated:** [December 27, 2020, 1:03pm UTC](https://discuss.elastic.co/t/search-for-docs-that-are-parents/259684 "2020-12-27T13:03:19Z")
Hi There, I'm looking for a way to search for documents where the join field specifies that they are a parent, that way I can still search for parents without children? Here's my very crude attempt which fails... POST… --- ## [Time filtered aggregations with very high cardinality](https://discuss.elastic.co/t/time-filtered-aggregations-with-very-high-cardinality/259673)
**Author:** [@Metheny](https://discuss.elastic.co/u/Metheny)\ **Replies:** 0\ **Last updated:** [December 27, 2020, 6:49am UTC](https://discuss.elastic.co/t/time-filtered-aggregations-with-very-high-cardinality/259673 "2020-12-27T06:49:29Z")
We have an index with a large amount of user reports (millions / 10s of millions). Assuming most users have reports, we need to calculate some statistics per-user with an input time range. For example, how many users ha… --- ## [Elasticsearch 7.10.1 new test cluster - cannot bring up - state not recovered](https://discuss.elastic.co/t/elasticsearch-7-10-1-new-test-cluster-cannot-bring-up-state-not-recovered/259520)
**Author:** [@lakshmi-github](https://discuss.elastic.co/u/lakshmi-github)\ **Replies:** 1\ **Last updated:** [December 26, 2020, 11:36pm UTC](https://discuss.elastic.co/t/elasticsearch-7-10-1-new-test-cluster-cannot-bring-up-state-not-recovered/259520 "2020-12-26T23:36:53Z")
Hello, I am trying to bring up a new ES 7.10.1 cluster for testing as follows: node1 - master (node.roles: \[ 'master'\]) node2 - master (node.roles: \[ 'master'\]) node3 - master (node.roles: \[ 'master'\]) node4 - data (n… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=733) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=735)