# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1151 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1152 --- ## [Create daily index](https://discuss.elastic.co/t/create-daily-index/200053)
**Author:** [@Yoav\_Ben\_Moha](https://discuss.elastic.co/u/Yoav_Ben_Moha)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 10:32am UTC](https://discuss.elastic.co/t/create-daily-index/200053 "2019-09-19T10:32:29Z")
I would like to create a daily index in elastic 7 Somthing like the one in the example bellow: \[elasticsearch@elk7-lab ~\]$ curl -X GET 'http://172.xx.xxx.xx:9200/\_cat/indices?v' health status index … --- ## [Shards allocation across nodes](https://discuss.elastic.co/t/shards-allocation-across-nodes/200138)
**Author:** [@ravi\_gajareddy](https://discuss.elastic.co/u/ravi_gajareddy)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 9:33am UTC](https://discuss.elastic.co/t/shards-allocation-across-nodes/200138 "2019-09-19T09:33:47Z")
How shards are allocated across nodes.If I have 2 nodes where index contains primary shards : 3 and Replica shards : 2. My index is showing yellow color. Is it allocates all primary shards in 1st node and all replica sha… --- ## [What are the options to control logs limit per day](https://discuss.elastic.co/t/what-are-the-options-to-control-logs-limit-per-day/199964)
**Author:** [@O\_K](https://discuss.elastic.co/u/O_K)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 9:27am UTC](https://discuss.elastic.co/t/what-are-the-options-to-control-logs-limit-per-day/199964 "2019-09-19T09:27:01Z")
This is a kind of tricky question. We would like to control traffic and indices size amount, so wonder what are the options here and there to ensure traffic for logs hasn't reached e.g. 10Gb/per or index size hasn't reac… --- ## [Discovery-ec2 plugin cannot connect to AWS API - 403 Forbidden](https://discuss.elastic.co/t/discovery-ec2-plugin-cannot-connect-to-aws-api-403-forbidden/200153)
**Author:** [@cknoell](https://discuss.elastic.co/u/cknoell)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 8:49am UTC](https://discuss.elastic.co/t/discovery-ec2-plugin-cannot-connect-to-aws-api-403-forbidden/200153 "2019-09-19T08:49:18Z")
Hi, I'm trying to setup an elastic cluster (Using version 7.3.2) across three different AZs in one region. EC2 instances are able to communicate with each other, as routing and security-groups are configured to so. AWS … --- ## [General hardware recommendations](https://discuss.elastic.co/t/general-hardware-recommendations/200151)
**Author:** [@paulcarey](https://discuss.elastic.co/u/paulcarey)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 8:40am UTC](https://discuss.elastic.co/t/general-hardware-recommendations/200151 "2019-09-19T08:40:14Z")
Hi I'm extending an existing ES cluster and am looking for general hardware recommendations e.g. of the form listed here. That document is now a few years old and I assume some of the guidance has been updated, but I h… --- ## [Optimizing using sample aggregation](https://discuss.elastic.co/t/optimizing-using-sample-aggregation/199934)
**Author:** [@Yonatan\_Omer](https://discuss.elastic.co/u/Yonatan_Omer)\ **Replies:** 8\ **Last updated:** [September 19, 2019, 8:37am UTC](https://discuss.elastic.co/t/optimizing-using-sample-aggregation/199934 "2019-09-19T08:37:05Z")
I have an index where each doc contains all user's-weekly events. each event has messages.txt , which contain whole line strings, some very long (mapping bellow). The following query takes 15 seconds to return, the "sa… --- ## [Changing mapping during the restore](https://discuss.elastic.co/t/changing-mapping-during-the-restore/200022)
**Author:** [@skouame](https://discuss.elastic.co/u/skouame)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 7:33am UTC](https://discuss.elastic.co/t/changing-mapping-during-the-restore/200022 "2019-09-19T07:33:12Z")
Hello i would like to retore the my index asset\_item\_index\_1 to another another index asset\_pp\_item\_index\_1 index save with mapping { "asset\_item\_index\_1": { "aliases": { "asset\_pp\_item": { "is\_write\_index": true … --- ## [Nothing happend after defining a rollup index](https://discuss.elastic.co/t/nothing-happend-after-defining-a-rollup-index/199079)
**Author:** [@Franco](https://discuss.elastic.co/u/Franco)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 7:02am UTC](https://discuss.elastic.co/t/nothing-happend-after-defining-a-rollup-index/199079 "2019-09-19T07:02:23Z")
Hi all, I've created a rollup job like this: the rollup index is created but there are no documents processed in it. What I'm doing wrong? :thinking: Any help appreciated. Best regards Franco --- ## [X-pack error while running elasticsearch](https://discuss.elastic.co/t/x-pack-error-while-running-elasticsearch/200105)
**Author:** [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)\ **Replies:** 5\ **Last updated:** [September 19, 2019, 6:50am UTC](https://discuss.elastic.co/t/x-pack-error-while-running-elasticsearch/200105 "2019-09-19T06:50:20Z")
I am seeing some issues with my elasticsearch cluster. I have not installed xpack and i have verified it using elasticsearch plugins list command. Am i doing something wrong here? I 6.3.1.jar:6.3.1\] at java.… --- ## [Re-Index the corrupted index (i.e. status in RED )in Elastic Search and turn into GREEN](https://discuss.elastic.co/t/re-index-the-corrupted-index-i-e-status-in-red-in-elastic-search-and-turn-into-green/200119)
**Author:** [@Joseph\_Raj](https://discuss.elastic.co/u/Joseph_Raj)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 6:12am UTC](https://discuss.elastic.co/t/re-index-the-corrupted-index-i-e-status-in-red-in-elastic-search-and-turn-into-green/200119 "2019-09-19T06:12:15Z")
As per the attached screenshot, we could see 2 indices are in red status. So we checked what is the exact error for those 2 indices, as we see error is - "Cannot allocate as the primary shards is corrupted" However, we… --- ## [Filter by Dense or Sparse Vector](https://discuss.elastic.co/t/filter-by-dense-or-sparse-vector/199484)
**Author:** [@seperman](https://discuss.elastic.co/u/seperman)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 6:08am UTC](https://discuss.elastic.co/t/filter-by-dense-or-sparse-vector/199484 "2019-09-19T06:08:00Z")
Hello, According to https://github.com/elastic/elasticsearch/issues/31615 we can sort by cosine similarity of vectors. But how can we filter by vector values? For example I want to filter all docs that index number 10 … --- ## [Java to implement auto completion using elastic search](https://discuss.elastic.co/t/java-to-implement-auto-completion-using-elastic-search/200117)
**Author:** [@Velliyangiri](https://discuss.elastic.co/u/Velliyangiri)\ **Replies:** 1\ **Last updated:** [September 19, 2019, 5:55am UTC](https://discuss.elastic.co/t/java-to-implement-auto-completion-using-elastic-search/200117 "2019-09-19T05:55:57Z")
How to implement auto completion ,Give me any code snippet related with java auto completion --- ## [Can we control server memeroy (RAM) for Elastic search?](https://discuss.elastic.co/t/can-we-control-server-memeroy-ram-for-elastic-search/200111)
**Author:** [@jignesh.panchal](https://discuss.elastic.co/u/jignesh.panchal)\ **Replies:** 2\ **Last updated:** [September 19, 2019, 5:52am UTC](https://discuss.elastic.co/t/can-we-control-server-memeroy-ram-for-elastic-search/200111 "2019-09-19T05:52:06Z")
If I have 8GB RAM serave & I want to give only 4 GB to elastic is it posiile --- ## [Analyse list for common domains](https://discuss.elastic.co/t/analyse-list-for-common-domains/200116)
**Author:** [@pjanzen](https://discuss.elastic.co/u/pjanzen)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 5:47am UTC](https://discuss.elastic.co/t/analyse-list-for-common-domains/200116 "2019-09-19T05:47:51Z")
Hi all, I am parsing mail logs and from those events (amongst other fields) I extract the sender and recipient field. The receipient field hold n+1 email adres. Would it be possible to classify the majority of the same … --- ## [Vulnerabilities on Elastic Search 6.7.1](https://discuss.elastic.co/t/vulnerabilities-on-elastic-search-6-7-1/200104)
**Author:** [@JasonWu](https://discuss.elastic.co/u/JasonWu)\ **Replies:** 0\ **Last updated:** [September 19, 2019, 2:10am UTC](https://discuss.elastic.co/t/vulnerabilities-on-elastic-search-6-7-1/200104 "2019-09-19T02:10:12Z")
Hi, Would need some advice on how to resolve the following vulnerabilities for Elastic Search 6.7.1 self-managed on basic subscription. The Web application is vulnerable to cross-site scripting (XSS), which allows at… --- ## [Nested query with multiple conditions](https://discuss.elastic.co/t/nested-query-with-multiple-conditions/199981)
**Author:** [@Mudboyzh](https://discuss.elastic.co/u/Mudboyzh)\ **Replies:** 2\ **Last updated:** [September 18, 2019, 11:33pm UTC](https://discuss.elastic.co/t/nested-query-with-multiple-conditions/199981 "2019-09-18T23:33:31Z")
Hi, I look the document and it works when a pair of match and range query. The problem is I try to make multi pair of match and range query, it won't return any document. Here is my index mapping PUT master { "mapp… --- ## [Inner hits returned in reversed order in ES7 as compared to ES6](https://discuss.elastic.co/t/inner-hits-returned-in-reversed-order-in-es7-as-compared-to-es6/200093)
**Author:** [@sarthakn](https://discuss.elastic.co/u/sarthakn)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 10:41pm UTC](https://discuss.elastic.co/t/inner-hits-returned-in-reversed-order-in-es7-as-compared-to-es6/200093 "2019-09-18T22:41:23Z")
Hello, while migrating to ES7 we noticed that the inner hits are returned in a different order as compared to ES6. For e.g., consider a document that contains a nested field with 4 entries say 1,2,3 and 4. The nested fie… --- ## [Sentence vector comparisons. Without titles / less direct responses](https://discuss.elastic.co/t/sentence-vector-comparisons-without-titles-less-direct-responses/198563)
**Author:** [@abeerunscore96](https://discuss.elastic.co/u/abeerunscore96)\ **Replies:** 1\ **Last updated:** [September 18, 2019, 8:38pm UTC](https://discuss.elastic.co/t/sentence-vector-comparisons-without-titles-less-direct-responses/198563 "2019-09-18T20:38:55Z")
I had a few questions after reading this article https://www.elastic.co/blog/text-similarity-search-with-vectors-in-elasticsearch This seems to assume the documents in the corpus have been summarized by virtue of having… --- ## [Painless scripts: "else if" and ternary conditionals checking field existence don't work properly](https://discuss.elastic.co/t/painless-scripts-else-if-and-ternary-conditionals-checking-field-existence-dont-work-properly/200021)
**Author:** [@Thomas\_Doman](https://discuss.elastic.co/u/Thomas_Doman)\ **Replies:** 1\ **Last updated:** [September 18, 2019, 7:18pm UTC](https://discuss.elastic.co/t/painless-scripts-else-if-and-ternary-conditionals-checking-field-existence-dont-work-properly/200021 "2019-09-18T19:18:10Z")
ES: 6.1.1 NEST: 6.1 As I've researched, I've tried two different methods of conditionally populating a "date" variable using both containsKey and doc\['field'\].value != null with the same outcome. I've used both "else … --- ## [Which query builder is used to update the multiple documents in elastic search](https://discuss.elastic.co/t/which-query-builder-is-used-to-update-the-multiple-documents-in-elastic-search/200074)
**Author:** [@Velliyangiri](https://discuss.elastic.co/u/Velliyangiri)\ **Replies:** 6\ **Last updated:** [September 18, 2019, 8:04pm UTC](https://discuss.elastic.co/t/which-query-builder-is-used-to-update-the-multiple-documents-in-elastic-search/200074 "2019-09-18T20:04:51Z")
In java which query builder used to update multiple documents in elastic search RestHighLevelClient 7.3.0.Thanks in advance. --- ## [Filter by with missing doc/fields in nested docs](https://discuss.elastic.co/t/filter-by-with-missing-doc-fields-in-nested-docs/199449)
**Author:** [@antonkallenberg](https://discuss.elastic.co/u/antonkallenberg)\ **Replies:** 6\ **Last updated:** [September 18, 2019, 6:57pm UTC](https://discuss.elastic.co/t/filter-by-with-missing-doc-fields-in-nested-docs/199449 "2019-09-18T18:57:37Z")
Hi guys, Is it possible to filter documents on missing docs/fields in nested documents? Example I have documents which looks like this (lastSessions is nested): \[{ "id": "41853", "lastSessions": \[{ "guid": "0278A… --- ## [Type of actions tracked in .tasks index](https://discuss.elastic.co/t/type-of-actions-tracked-in-tasks-index/200065)
**Author:** [@jay224](https://discuss.elastic.co/u/jay224)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 5:53pm UTC](https://discuss.elastic.co/t/type-of-actions-tracked-in-tasks-index/200065 "2019-09-18T17:53:23Z")
What type of running actions are tracked using .tasks index? I have failed to find any search/aggregation actions. The only actions I can see are cluster monitoring and reindex. Sometimes we have log running aggregation… --- ## [Elasticsearch nodes OOM at pseudo-random intervals](https://discuss.elastic.co/t/elasticsearch-nodes-oom-at-pseudo-random-intervals/200058)
**Author:** [@nokkloom](https://discuss.elastic.co/u/nokkloom)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 5:21pm UTC](https://discuss.elastic.co/t/elasticsearch-nodes-oom-at-pseudo-random-intervals/200058 "2019-09-18T17:21:02Z")
First some setup information: 3 dedicated master nodes, 2 nodata (load balancing) nodes, several data boxes, which hold 6 ES nodes per box (30G heap per node, 4TB nvme disk per node, boxes have 386 or 512GB of RAM). Ela… --- ## [What are the options for elastic search to connect to HDFS/Hive? Which is most efficient for batch and near real time?](https://discuss.elastic.co/t/what-are-the-options-for-elastic-search-to-connect-to-hdfs-hive-which-is-most-efficient-for-batch-and-near-real-time/200024)
**Author:** [@damanaulakh88](https://discuss.elastic.co/u/damanaulakh88)\ **Replies:** 3\ **Last updated:** [September 18, 2019, 4:34pm UTC](https://discuss.elastic.co/t/what-are-the-options-for-elastic-search-to-connect-to-hdfs-hive-which-is-most-efficient-for-batch-and-near-real-time/200024 "2019-09-18T16:34:42Z")
What are the options for elastic search to connect to HDFS/Hive? Which is most efficient for batch and near real time? --- ## [Avoid adding some naughty node to the cluster](https://discuss.elastic.co/t/avoid-adding-some-naughty-node-to-the-cluster/199528)
**Author:** [@vasek](https://discuss.elastic.co/u/vasek)\ **Replies:** 2\ **Last updated:** [September 15, 2019, 10:24am UTC](https://discuss.elastic.co/t/avoid-adding-some-naughty-node-to-the-cluster/199528 "2019-09-15T10:24:19Z")
Hello, is there in ES 7.x a way how to avoid to join some naughty node to the cluster? Regards, Vašek --- ## [Request rejected exception while using get high level rest client](https://discuss.elastic.co/t/request-rejected-exception-while-using-get-high-level-rest-client/199980)
**Author:** [@annad](https://discuss.elastic.co/u/annad)\ **Replies:** 2\ **Last updated:** [September 18, 2019, 3:22pm UTC](https://discuss.elastic.co/t/request-rejected-exception-while-using-get-high-level-rest-client/199980 "2019-09-18T15:22:59Z")
Hi Team, I am using synchronous get with high level rest client. My application is having 40 threads, but after running for some time, I am able to see request rejected exception because queue size limit is 1000 for get… --- ## [Is there a way to install ealsticsearch in object storage env?](https://discuss.elastic.co/t/is-there-a-way-to-install-ealsticsearch-in-object-storage-env/199993)
**Author:** [@yishain11](https://discuss.elastic.co/u/yishain11)\ **Replies:** 3\ **Last updated:** [September 18, 2019, 3:11pm UTC](https://discuss.elastic.co/t/is-there-a-way-to-install-ealsticsearch-in-object-storage-env/199993 "2019-09-18T15:11:43Z")
Hi elastic wizards! I have a question. One of our costumers wants me to install an elastic cluster in his system, but the neccessary space is to big for regular file system storage on disks, so he wants to store elastic… --- ## [Can Elastic be used as Semantic layer for any BI Tool reporting](https://discuss.elastic.co/t/can-elastic-be-used-as-semantic-layer-for-any-bi-tool-reporting/200030)
**Author:** [@damanaulakh88](https://discuss.elastic.co/u/damanaulakh88)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 2:24pm UTC](https://discuss.elastic.co/t/can-elastic-be-used-as-semantic-layer-for-any-bi-tool-reporting/200030 "2019-09-18T14:24:33Z")
For Example like Data Lake -\> Elastic -\> BI Tool ? --- ## [No rollover info found for \[filebeat-7.1.1\] with alias \[filebeat-alias\], the index has not yet rolled over with that alias](https://discuss.elastic.co/t/no-rollover-info-found-for-filebeat-7-1-1-with-alias-filebeat-alias-the-index-has-not-yet-rolled-over-with-that-alias/200029)
**Author:** [@krish2](https://discuss.elastic.co/u/krish2)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 2:23pm UTC](https://discuss.elastic.co/t/no-rollover-info-found-for-filebeat-7-1-1-with-alias-filebeat-alias-the-index-has-not-yet-rolled-over-with-that-alias/200029 "2019-09-18T14:23:33Z")
GET filebeat-7.1.1/\_ilm/explain Output: { "indices" : { "filebeat-7.1.1" : { "index" : "filebeat-7.1.1", "managed" : true, "policy" : "new\_policy\_1", "lifecycle\_date\_millis" : 1566224013121, "phase" : "hot", "pha… --- ## [Is it better to connect elastic search to Hadoop or Hive directly? Will Any library or plugin help?](https://discuss.elastic.co/t/is-it-better-to-connect-elastic-search-to-hadoop-or-hive-directly-will-any-library-or-plugin-help/200026)
**Author:** [@damanaulakh88](https://discuss.elastic.co/u/damanaulakh88)\ **Replies:** 0\ **Last updated:** [September 18, 2019, 2:21pm UTC](https://discuss.elastic.co/t/is-it-better-to-connect-elastic-search-to-hadoop-or-hive-directly-will-any-library-or-plugin-help/200026 "2019-09-18T14:21:21Z")
Is it better to connect elastic search to Hadoop or Hive directly? Any library or plug ins will help? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1150) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1152)