# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=691 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 692 --- ## [Can ES do a complex aggregation with WHERE and GROUP BY + ORDER BY like in MySQL](https://discuss.elastic.co/t/can-es-do-a-complex-aggregation-with-where-and-group-by-order-by-like-in-mysql/265559)
**Author:** [@Long\_Quanzheng](https://discuss.elastic.co/u/Long_Quanzheng)\ **Replies:** 7\ **Last updated:** [March 2, 2021, 12:45pm UTC](https://discuss.elastic.co/t/can-es-do-a-complex-aggregation-with-where-and-group-by-order-by-like-in-mysql/265559 "2021-03-02T12:45:13Z")
Hi, I have a query like this in MySQL that I am thinking to migrate to ElasticSearch for scalability: SELELCT userID,sum(countA) as sumA,sum(countB) as sumB FROM data\_table WHERE groupID=? AND date BETWEEN ? AND ?… --- ## [Sum aggregation precision](https://discuss.elastic.co/t/sum-aggregation-precision/265946)
**Author:** [@DawidS](https://discuss.elastic.co/u/DawidS)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 12:13pm UTC](https://discuss.elastic.co/t/sum-aggregation-precision/265946 "2021-03-02T12:13:33Z")
Hello, I have a problem with sum fields with 3 decimal places. The Sum of all values is zero, but elastic sum aggregations return a very small number(like -2.837623469531536E-10). I have created a test index and put th… --- ## [What will happen if elasticsearch all node goes down? Did we loose all data In this case?](https://discuss.elastic.co/t/what-will-happen-if-elasticsearch-all-node-goes-down-did-we-loose-all-data-in-this-case/265923)
**Author:** [@Mangesh\_Mandavgane](https://discuss.elastic.co/u/Mangesh_Mandavgane)\ **Replies:** 4\ **Last updated:** [March 2, 2021, 10:28am UTC](https://discuss.elastic.co/t/what-will-happen-if-elasticsearch-all-node-goes-down-did-we-loose-all-data-in-this-case/265923 "2021-03-02T10:28:14Z")
While reading about Elasticsearch I understood that Nodes have Shards. And we can make configuration for Primary and Replica Shards. If one of node goes down it retrieve data from replica shards which is in another node. … --- ## [License not available](https://discuss.elastic.co/t/license-not-available/265931)
**Author:** [@hayo](https://discuss.elastic.co/u/hayo)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 10:17am UTC](https://discuss.elastic.co/t/license-not-available/265931 "2021-03-02T10:17:33Z")
Hello, I just updated from 7.10.2 to 7.11.1, however when we try to access kibana, we get back: {"statusCode":503,"error":"Service Unavailable","message":"License is not available."} We host the whole ELK stack on the… --- ## [Invitation to participate in a survey about Elasticsearch](https://discuss.elastic.co/t/invitation-to-participate-in-a-survey-about-elasticsearch/265933)
**Author:** [@JieTan](https://discuss.elastic.co/u/JieTan)\ **Replies:** 0\ **Last updated:** [March 2, 2021, 9:57am UTC](https://discuss.elastic.co/t/invitation-to-participate-in-a-survey-about-elasticsearch/265933 "2021-03-02T09:57:03Z")
Dear Elasticsearch contributor, We are doing research on understanding how developers manage a special kind of Technical Debt in Java. We kindly ask 15-20 minutes of your time to fill out our survey. To help you decide… --- ## [How to backup on-prem Elasticsearch cluster to S3 bucket and restore reverse way](https://discuss.elastic.co/t/how-to-backup-on-prem-elasticsearch-cluster-to-s3-bucket-and-restore-reverse-way/265320)
**Author:** [@rafiqul](https://discuss.elastic.co/u/rafiqul)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 9:19am UTC](https://discuss.elastic.co/t/how-to-backup-on-prem-elasticsearch-cluster-to-s3-bucket-and-restore-reverse-way/265320 "2021-03-02T09:19:05Z")
Hello I have a Elasticsearch cluster installed in my on-premise infrastructure. Also installed repository plug-in by running bin/elasticsearch-plugin install repository-s3 ''' curl -X PUT "localhost:9200/\_snapshot/te… --- ## [ELK fails after enabling : readOnlyRootFilesystem in psp:restricted](https://discuss.elastic.co/t/elk-fails-after-enabling-readonlyrootfilesystem-in-psp-restricted/265711)
**Author:** [@Mayank\_Srivastava](https://discuss.elastic.co/u/Mayank_Srivastava)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 9:07am UTC](https://discuss.elastic.co/t/elk-fails-after-enabling-readonlyrootfilesystem-in-psp-restricted/265711 "2021-03-02T09:07:58Z")
Hi , We are running elasticsearch container in k8s environment with root filesystems in read-only mode (readOnlyRootFilesystem: true). So we tried to enable this and we observed all the three pods of elk fails. we are … --- ## [NFS4 best practice fstab/exports options for fs repository](https://discuss.elastic.co/t/nfs4-best-practice-fstab-exports-options-for-fs-repository/265920)
**Author:** [@ArturGrzella](https://discuss.elastic.co/u/ArturGrzella)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 8:34am UTC](https://discuss.elastic.co/t/nfs4-best-practice-fstab-exports-options-for-fs-repository/265920 "2021-03-02T08:34:06Z")
Hello, what are the best practice configurations for NFS server and NFS client in the context of snapshot and restore into fs/NFS4 repos? So, how to configure /etc/exports and /etc/fstab, for example? Thanks in advance … --- ## [How to query array of objects with multiple filters](https://discuss.elastic.co/t/how-to-query-array-of-objects-with-multiple-filters/265921)
**Author:** [@111417](https://discuss.elastic.co/u/111417)\ **Replies:** 0\ **Last updated:** [March 2, 2021, 8:21am UTC](https://discuss.elastic.co/t/how-to-query-array-of-objects-with-multiple-filters/265921 "2021-03-02T08:21:21Z")
As title, The file is roughly as follows: doc01 \[ { "product": "apple", "price": 12 } , { "product": "grave", "price": 18 } \] doc02 \[ { "product": "apple", "price": 15 } , { "product": "banana", "price": 15 } \] doc03… --- ## [Snapshots on NFS4 intermittently reporting PARTIAL](https://discuss.elastic.co/t/snapshots-on-nfs4-intermittently-reporting-partial/265800)
**Author:** [@ArturGrzella](https://discuss.elastic.co/u/ArturGrzella)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 8:16am UTC](https://discuss.elastic.co/t/snapshots-on-nfs4-intermittently-reporting-partial/265800 "2021-03-02T08:16:11Z")
Hi, we have an intermittent issue with snapshots via fs on NFS4. Once a day we close the repository for a backup to tape. After this backup has been taken we delete the data and create a new repository and an initial sn… --- ## [Elasticsearch Cross-Cluster Search with OpenDistro](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-with-opendistro/265916)
**Author:** [@Yustas](https://discuss.elastic.co/u/Yustas)\ **Replies:** 3\ **Last updated:** [March 2, 2021, 8:14am UTC](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-with-opendistro/265916 "2021-03-02T08:14:36Z")
Hello. I have one old cluster based on opendistro And new with ELK I try configure Cross Cluster Search. But then try run search from elk to od, get error: \[2021-03-02T07:05:27,713\]\[ERROR\]\[com.amazon.opendistroforel… --- ## [Encrypt Communication b/w kibana and elasticsearch](https://discuss.elastic.co/t/encrypt-communication-b-w-kibana-and-elasticsearch/265527)
**Author:** [@Aniket\_Pant](https://discuss.elastic.co/u/Aniket_Pant)\ **Replies:** 13\ **Last updated:** [March 2, 2021, 7:55am UTC](https://discuss.elastic.co/t/encrypt-communication-b-w-kibana-and-elasticsearch/265527 "2021-03-02T07:55:59Z")
I have 8 node of elasticsearch cluster 3 master 3 hot node and 2 warm node.All these node is running on https://ip:9200 i have set following parameter in elasticsearch.yml xpack.security.enabled: true #xpack.security.a… --- ## [Customise score based on Search Results Pagination](https://discuss.elastic.co/t/customise-score-based-on-search-results-pagination/265915)
**Author:** [@Venkata\_Naresh](https://discuss.elastic.co/u/Venkata_Naresh)\ **Replies:** 0\ **Last updated:** [March 2, 2021, 7:38am UTC](https://discuss.elastic.co/t/customise-score-based-on-search-results-pagination/265915 "2021-03-02T07:38:30Z")
Hi Team, I have some documents in ES and I want results in pagination and for that I'm using From/Offset. But lets suppose I want 5 documents in every page and in each page I want some documents should be at the bottom … --- ## [Is the maximum shard that a single node can bear, is 1000?](https://discuss.elastic.co/t/is-the-maximum-shard-that-a-single-node-can-bear-is-1000/265910)
**Author:** [@haipeng.zhao](https://discuss.elastic.co/u/haipeng.zhao)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 7:31am UTC](https://discuss.elastic.co/t/is-the-maximum-shard-that-a-single-node-can-bear-is-1000/265910 "2021-03-02T07:31:13Z")
Can this value be resized? When the shard of a single node in our cluster reaches 1000, this node cannot write --- ## [When parsing data I am getting this error](https://discuss.elastic.co/t/when-parsing-data-i-am-getting-this-error/265796)
**Author:** [@padamrai](https://discuss.elastic.co/u/padamrai)\ **Replies:** 3\ **Last updated:** [March 2, 2021, 7:30am UTC](https://discuss.elastic.co/t/when-parsing-data-i-am-getting-this-error/265796 "2021-03-02T07:30:57Z")
I have a data without columns name and I am giving name of the columns in conf file. I don't know giving this way columns name is correct or not? \[2021-03-01T17:33:34,741\]\[WARN \]\[logstash.filters.csv \]\[main\]\[7c8e4b1… --- ## [Transport response handler not found of id \[1\]](https://discuss.elastic.co/t/transport-response-handler-not-found-of-id-1/264418)
**Author:** [@admin\_labs](https://discuss.elastic.co/u/admin_labs)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 7:26am UTC](https://discuss.elastic.co/t/transport-response-handler-not-found-of-id-1/264418 "2021-03-02T07:26:20Z")
Hey there, We are being haunted by this Warning/error " Transport response handler not found of id \[1\]" from the past week., can someone please help us explain and resolve this issue. we are running elasticsearch as a … --- ## [Blocked in Pushing flush onto pipeline](https://discuss.elastic.co/t/blocked-in-pushing-flush-onto-pipeline/265911)
**Author:** [@syrine\_chelly](https://discuss.elastic.co/u/syrine_chelly)\ **Replies:** 0\ **Last updated:** [March 2, 2021, 7:25am UTC](https://discuss.elastic.co/t/blocked-in-pushing-flush-onto-pipeline/265911 "2021-03-02T07:25:58Z")
this my logstash.conf i want to drop all lines that begin with "(" into message but logstash is not showing the data in the console and is not sending it to logstash. input { beats { port =\> … --- ## [Disable logging and metrics in elastic cloud](https://discuss.elastic.co/t/disable-logging-and-metrics-in-elastic-cloud/265906)
**Author:** [@cbernet](https://discuss.elastic.co/u/cbernet)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 7:17am UTC](https://discuss.elastic.co/t/disable-logging-and-metrics-in-elastic-cloud/265906 "2021-03-02T07:17:11Z")
Hello, I've enabled logging and metrics on elastic cloud, and now I would like to disable it entirely. But I can't find a way to do this. If I uncheck the shipment of both logs and metrics, the save button gets greyed ou… --- ## [Rally does not finish a race (only prepare)](https://discuss.elastic.co/t/rally-does-not-finish-a-race-only-prepare/265530)
**Author:** [@LuisSchaefer](https://discuss.elastic.co/u/LuisSchaefer)\ **Replies:** 6\ **Last updated:** [March 2, 2021, 6:47am UTC](https://discuss.elastic.co/t/rally-does-not-finish-a-race-only-prepare/265530 "2021-03-02T06:47:16Z")
Hi guys, I am using Rally 1.4.1, Linux RHEL 7.9, offline. If I start a race it prepares the race and that is it. My Input: esrally --target-hosts=localhost:9200 --client-options="basic\_auth\_user:'elastic',basic\_auth\_p… --- ## [Building Elasticsearch Project](https://discuss.elastic.co/t/building-elasticsearch-project/265794)
**Author:** [@duck](https://discuss.elastic.co/u/duck)\ **Replies:** 3\ **Last updated:** [March 2, 2021, 6:42am UTC](https://discuss.elastic.co/t/building-elasticsearch-project/265794 "2021-03-02T06:42:29Z")
Hi, I'm building a metrics and logging user actions system for my project(an online game). I've just started to learning Elasticsearch. Therefore, there are some questions in my mind. I'm planning to use logging almost e… --- ## [Curator not deleting indices with multiple domain](https://discuss.elastic.co/t/curator-not-deleting-indices-with-multiple-domain/264295)
**Author:** [@Pawan](https://discuss.elastic.co/u/Pawan)\ **Replies:** 2\ **Last updated:** [March 2, 2021, 5:06am UTC](https://discuss.elastic.co/t/curator-not-deleting-indices-with-multiple-domain/264295 "2021-03-02T05:06:22Z")
Hi, I have created curator and deleting indices on multi-domain but it getting failed. Error: curator --config curator.yml delete\_indices.yml 2021-02-15 15:41:16,450 INFO Preparing Action ID: 1, "delete\_indic… --- ## [Query specific fields and field value must contains a value in nodejs](https://discuss.elastic.co/t/query-specific-fields-and-field-value-must-contains-a-value-in-nodejs/265896)
**Author:** [@pakwai122](https://discuss.elastic.co/u/pakwai122)\ **Replies:** 0\ **Last updated:** [March 2, 2021, 4:16am UTC](https://discuss.elastic.co/t/query-specific-fields-and-field-value-must-contains-a-value-in-nodejs/265896 "2021-03-02T04:16:42Z")
I'm using nodejs as the client slide to build a simple search engine with Elasticsearch my index has the following fields "id": "75199", "FoodID": "123", "FoodCode": "F123", "FoodNumber": "F567", "DisplayName": "food f… --- ## [Issue while restoring elasticsearch data](https://discuss.elastic.co/t/issue-while-restoring-elasticsearch-data/265780)
**Author:** [@tiwariak1992](https://discuss.elastic.co/u/tiwariak1992)\ **Replies:** 10\ **Last updated:** [March 2, 2021, 4:32am UTC](https://discuss.elastic.co/t/issue-while-restoring-elasticsearch-data/265780 "2021-03-02T04:32:29Z")
Hi Everyone, I am having issue while restoring the ES snapshot. I am facing snapshot restore exception error. But I have my snapshots while I do the backup. Not able to find out why it is happening. I am using ES 6.8. … --- ## [Limit the max document size after ingest pipeline](https://discuss.elastic.co/t/limit-the-max-document-size-after-ingest-pipeline/265892)
**Author:** [@Crazedpeanut](https://discuss.elastic.co/u/Crazedpeanut)\ **Replies:** 6\ **Last updated:** [March 2, 2021, 4:32am UTC](https://discuss.elastic.co/t/limit-the-max-document-size-after-ingest-pipeline/265892 "2021-03-02T04:32:05Z")
Is there way way to limit the size of a document after an ingest pipeline has processed it? For example, I want to limit the size of indexed documents to 1mb. A 4mb PDF might be uploaded, the attachment processor extrac… --- ## [Index is getting deleted automatically with-out deletion policy or command](https://discuss.elastic.co/t/index-is-getting-deleted-automatically-with-out-deletion-policy-or-command/264988)
**Author:** [@Rinku\_Gulia](https://discuss.elastic.co/u/Rinku_Gulia)\ **Replies:** 15\ **Last updated:** [March 2, 2021, 3:30am UTC](https://discuss.elastic.co/t/index-is-getting-deleted-automatically-with-out-deletion-policy-or-command/264988 "2021-03-02T03:30:48Z")
We are adding data to our 2 indexes( interaction-open\_read\_model\_12 and interaction-closed\_read\_model\_12) with aliases(list\_open\_interactions\_12 && list\_closed\_interactions\_1). we have 3 node system. Almost in one day,… --- ## [Deleting ElasticSearch Data Directory](https://discuss.elastic.co/t/deleting-elasticsearch-data-directory/265820)
**Author:** [@Andrew\_Tillotson](https://discuss.elastic.co/u/Andrew_Tillotson)\ **Replies:** 6\ **Last updated:** [March 2, 2021, 3:04am UTC](https://discuss.elastic.co/t/deleting-elasticsearch-data-directory/265820 "2021-03-02T03:04:16Z")
If I just delete the directory in which the data is stored, restart Elasticsearch, it should recreate that directory and populate it with new data according to the config, correct? I have unassigned shards, but would ju… --- ## [Working with logs](https://discuss.elastic.co/t/working-with-logs/265764)
**Author:** [@duck](https://discuss.elastic.co/u/duck)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 2:19am UTC](https://discuss.elastic.co/t/working-with-logs/265764 "2021-03-02T02:19:04Z")
We're building a logging system for our project. We want to see almost everything as a log like Docker, application console etc. Since we're growing up, we do not want to make mistake about logs(wrong scheme, indexing, q… --- ## [Elasticsearch service wont stop when OIDC is enabled](https://discuss.elastic.co/t/elasticsearch-service-wont-stop-when-oidc-is-enabled/265864)
**Author:** [@froxxen](https://discuss.elastic.co/u/froxxen)\ **Replies:** 0\ **Last updated:** [March 1, 2021, 8:23pm UTC](https://discuss.elastic.co/t/elasticsearch-service-wont-stop-when-oidc-is-enabled/265864 "2021-03-01T20:23:25Z")
I'm running the entire stack on Windows and will integrate SSO into the environment. It works as expected except one thing, when the Elasticsearch service needs to be stopped it hangs for some reason. If I remove below… --- ## [Exception: java.lang.OutOfMemoryError: Java heap space](https://discuss.elastic.co/t/exception-java-lang-outofmemoryerror-java-heap-space/265880)
**Author:** [@ifernand](https://discuss.elastic.co/u/ifernand)\ **Replies:** 1\ **Last updated:** [March 2, 2021, 2:03am UTC](https://discuss.elastic.co/t/exception-java-lang-outofmemoryerror-java-heap-space/265880 "2021-03-02T02:03:57Z")
Hi. I am running ElasticSearch 6.1.3 in a Liferay Installation and I am facing an Exception "java.lang.OutOfMemoryError: Java heap space" that is causing malfunction in Liferay portal. That's the information I have col… --- ## [Bad Request when using scroll API](https://discuss.elastic.co/t/bad-request-when-using-scroll-api/265702)
**Author:** [@nara1](https://discuss.elastic.co/u/nara1)\ **Replies:** 6\ **Last updated:** [March 1, 2021, 10:19pm UTC](https://discuss.elastic.co/t/bad-request-when-using-scroll-api/265702 "2021-03-01T22:19:33Z")
I'm using JestClient to execute scrolling in my service (I know JestClient is outdated but for various reasons we are stuck with it for now). In my initial request, I do receive a scroll ID and my results successfully. … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=690) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=692)