# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1155 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1156 --- ## [ES Cluster Capacity Planning - Storage Limit](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915)
**Author:** [@moni15moni](https://discuss.elastic.co/u/moni15moni)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 11:11am UTC](https://discuss.elastic.co/t/es-cluster-capacity-planning-storage-limit/198915 "2019-09-16T11:11:55Z")
In elasticsearch documentation for capacity planning, I read Per GB Heap will handle the 20 shards, with avg shard size of 20 - 40 GB. In ES Cluster it has 10 data nodes with the following config, 64 GB Heap (30 GB hea… --- ## [Is it possible to disable alias wildcarding for specific index?](https://discuss.elastic.co/t/is-it-possible-to-disable-alias-wildcarding-for-specific-index/199638)
**Author:** [@Illidan](https://discuss.elastic.co/u/Illidan)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 10:58am UTC](https://discuss.elastic.co/t/is-it-possible-to-disable-alias-wildcarding-for-specific-index/199638 "2019-09-16T10:58:46Z")
Our multitenancy model based on index aliases (e.g. one index for all, alias per tenant). We noticed that using \* as alias retrieves data from whole index (e.g. effectively ignoring tenant boundaries). Is it possible, … --- ## [Not able to index content of images](https://discuss.elastic.co/t/not-able-to-index-content-of-images/199575)
**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\ **Replies:** 6\ **Last updated:** [September 16, 2019, 10:53am UTC](https://discuss.elastic.co/t/not-able-to-index-content-of-images/199575 "2019-09-16T10:53:29Z")
Hello @dadoonet, When i am trying to run FSCrawler job for Images, It is showing me below error: 07:05:40,428 DEBUG \[f.p.e.c.f.t.TikaInstance\] OCR is activated. 07:05:40,428 DEBUG \[f.p.e.c.f.t.TikaInstance\] But Tessera… --- ## [How to change ElasticSearch response to Nested Values](https://discuss.elastic.co/t/how-to-change-elasticsearch-response-to-nested-values/199633)
**Author:** [@May](https://discuss.elastic.co/u/May)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 10:33am UTC](https://discuss.elastic.co/t/how-to-change-elasticsearch-response-to-nested-values/199633 "2019-09-16T10:33:33Z")
Hi there, I am using ES as the backend data warehouse for my web app. I want to have a dropdown list that updated based on what is previously selected like this : http://benalexkeen.com/auto-updating-dropdown-fields-in-j… --- ## [Duplicate value in a fileds](https://discuss.elastic.co/t/duplicate-value-in-a-fileds/198936)
**Author:** [@Reb](https://discuss.elastic.co/u/Reb)\ **Replies:** 7\ **Last updated:** [September 16, 2019, 10:30am UTC](https://discuss.elastic.co/t/duplicate-value-in-a-fileds/198936 "2019-09-16T10:30:09Z")
due to a bad log treatment, the value of some fields is duplicated like : fields\_duration : 373, 373. How can i use query (update\_by\_query) to keep just the first value ? Thank you --- ## [Documents missing in index | Elastic 2.3](https://discuss.elastic.co/t/documents-missing-in-index-elastic-2-3/199264)
**Author:** [@Ravi\_Manik](https://discuss.elastic.co/u/Ravi_Manik)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 9:58am UTC](https://discuss.elastic.co/t/documents-missing-in-index-elastic-2-3/199264 "2019-09-16T09:58:18Z")
Hi, I'm trying to find the root cause of an issue in my elasticsearch cluster. Recently my Elasticsearch went Red and from that day onwards I see that there are around 100M records missing from the index. I don't find a… --- ## [A question about search threadpool size](https://discuss.elastic.co/t/a-question-about-search-threadpool-size/197745)
**Author:** [@rpgmakervx](https://discuss.elastic.co/u/rpgmakervx)\ **Replies:** 10\ **Last updated:** [September 16, 2019, 9:52am UTC](https://discuss.elastic.co/t/a-question-about-search-threadpool-size/197745 "2019-09-16T09:52:12Z")
As org.elasticsearch.threadpool. ExecutorBuilder#applyHardSizeLimit method shown that write threadpool holds a controllable core thread count, default could not over 32. but search will return an unlimit max size … --- ## [Elasticsearch 6.7.0 not working on windows 2008](https://discuss.elastic.co/t/elasticsearch-6-7-0-not-working-on-windows-2008/198616)
**Author:** [@amol\_sonawane1](https://discuss.elastic.co/u/amol_sonawane1)\ **Replies:** 7\ **Last updated:** [September 16, 2019, 9:21am UTC](https://discuss.elastic.co/t/elasticsearch-6-7-0-not-working-on-windows-2008/198616 "2019-09-16T09:21:00Z")
Hi, I have upgraded Elasticsearch from 5.2.2 to 6.7.0 version. After upgrading successfully, I am not able to start Elasticsearch on W2008 box. Giving below error. Caused by: java.io.IOException: Cannot run program "\\?… --- ## [Can Fscrawler access Elasticsearch cluster behind load balancer](https://discuss.elastic.co/t/can-fscrawler-access-elasticsearch-cluster-behind-load-balancer/199591)
**Author:** [@rkmohapatra](https://discuss.elastic.co/u/rkmohapatra)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 7:48am UTC](https://discuss.elastic.co/t/can-fscrawler-access-elasticsearch-cluster-behind-load-balancer/199591 "2019-09-16T07:48:39Z")
We have Elasticsearch cluster setup on Kubernetes in cloud environment. We also have kubernetes ingress controller setup to access the cluster using the loadbalancer external IP. e.g. http://LB\_IP\_ADDRESS//ES\_SERVICE I… --- ## [How can we implement painless query search condition for multi fields](https://discuss.elastic.co/t/how-can-we-implement-painless-query-search-condition-for-multi-fields/198883)
**Author:** [@rameshkr1994](https://discuss.elastic.co/u/rameshkr1994)\ **Replies:** 3\ **Last updated:** [September 16, 2019, 7:31am UTC](https://discuss.elastic.co/t/how-can-we-implement-painless-query-search-condition-for-multi-fields/198883 "2019-09-16T07:31:46Z")
Dear All . I have 8-fields in index and we want to search all fields but condition here is : some time we want to search only 3,4 fields only but result should be come based on accurate match fields : value . but pain… --- ## [How to get parent with child data in single query in elastic search(C#)](https://discuss.elastic.co/t/how-to-get-parent-with-child-data-in-single-query-in-elastic-search-c/199587)
**Author:** [@navnathkharat](https://discuss.elastic.co/u/navnathkharat)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 7:09am UTC](https://discuss.elastic.co/t/how-to-get-parent-with-child-data-in-single-query-in-elastic-search-c/199587 "2019-09-16T07:09:29Z")
public abstract class MyDocument { public int Id { get; set; } public JoinField MyJoinField { get; set; } } public class MyParent : MyDocument { \[Text\] public string Name{ get; set; } public DateTime DOB { get; … --- ## [Getting exception Process ClusterEvent Timeout Exception after 5 minutes](https://discuss.elastic.co/t/getting-exception-process-clusterevent-timeout-exception-after-5-minutes/198244)
**Author:** [@Jayakrishnan\_Nair](https://discuss.elastic.co/u/Jayakrishnan_Nair)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 7:05am UTC](https://discuss.elastic.co/t/getting-exception-process-clusterevent-timeout-exception-after-5-minutes/198244 "2019-09-16T07:05:33Z")
Hi All, I have cluster with 16 data node and 3 master nodes. With total of 22500 shard distributed across 16 nodes. The put-mapping event fails even after 5 minutes after configuring the timeout value. We are using el… --- ## [ILM Rotate on Midnight](https://discuss.elastic.co/t/ilm-rotate-on-midnight/196279)
**Author:** [@gruselglatz](https://discuss.elastic.co/u/gruselglatz)\ **Replies:** 5\ **Last updated:** [September 16, 2019, 7:01am UTC](https://discuss.elastic.co/t/ilm-rotate-on-midnight/196279 "2019-09-16T07:01:34Z")
Hi ES-Team! Is there now a possability to rotate on a specific time of the day. The most ideal would be that my indices rotate on a dayli basis on MIDNIGHT. ref to Lifecycle Management rotate on a daily basis Thx --- ## [How to use search\_as\_you\_type datatype to get substring(infix) completion](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-to-get-substring-infix-completion/199570)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 6:22am UTC](https://discuss.elastic.co/t/how-to-use-search-as-you-type-datatype-to-get-substring-infix-completion/199570 "2019-09-16T06:22:29Z")
Hi, The new search\_as\_you\_type feature should provide both infix and prefix completion, but i am seeing only prefix completion. { "mappings":{ "properties":{ "mail":{"type":"search\_as\_you\_type"} }}} and the query whic… --- ## [Warning can not be imported as a dangling index, as index with same name already exists in cluster metadata](https://discuss.elastic.co/t/warning-can-not-be-imported-as-a-dangling-index-as-index-with-same-name-already-exists-in-cluster-metadata/199577)
**Author:** [@Nikhil\_Pillai](https://discuss.elastic.co/u/Nikhil_Pillai)\ **Replies:** 6\ **Last updated:** [September 16, 2019, 6:13am UTC](https://discuss.elastic.co/t/warning-can-not-be-imported-as-a-dangling-index-as-index-with-same-name-already-exists-in-cluster-metadata/199577 "2019-09-16T06:13:05Z")
I am running ELK 6.5.4 with 3 node cluster. Cluster health is GREEN I see below error in one of the node. \[2019-09-16T11:05:49,832\]\[WARN \]\[o.e.g.DanglingIndicesState\] \[node-3\] \[\[.watcher-history-9-2019.07.12/1fkhSke8S7… --- ## [What are the common situations in which primary shard goes down](https://discuss.elastic.co/t/what-are-the-common-situations-in-which-primary-shard-goes-down/199576)
**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\ **Replies:** 1\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/what-are-the-common-situations-in-which-primary-shard-goes-down/199576 "2019-09-16T06:08:30Z")
Hi, I am doing a case study, and i would want to know the situations in which primary shard goes down, which can cause data loss and how to avoid them. Thanks --- ## [Slow Aggregation over Time based indices. Each index has around ~10M records](https://discuss.elastic.co/t/slow-aggregation-over-time-based-indices-each-index-has-around-10m-records/199566)
**Author:** [@durgaharish1993](https://discuss.elastic.co/u/durgaharish1993)\ **Replies:** 5\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/slow-aggregation-over-time-based-indices-each-index-has-around-10m-records/199566 "2019-09-16T06:08:16Z")
I am using a monthly time based indexes ( Eg - prefix-01-2019, prefix-02-2019 .. so on ) for storing the time based data. Each index has ~10 Million documents with 13 fields in each document. I am trying to perform … --- ## [Not able to figure out number of shards in my cluster](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436)
**Author:** [@adarshzphin](https://discuss.elastic.co/u/adarshzphin)\ **Replies:** 4\ **Last updated:** [September 16, 2019, 6:08am UTC](https://discuss.elastic.co/t/not-able-to-figure-out-number-of-shards-in-my-cluster/199436 "2019-09-16T06:08:12Z")
I have 5 node cluster. 1 dedicated master node ( 16 GB/4 core ) and 4 data nodes (32 GB/8 cores/ 5 TB SSD )on each data node . I am having around 10 TB of data to store in one index(as of now not doing time base indexing… --- ## [Elasticsearch “AND in query\_string” vs. “default\_operator AND”](https://discuss.elastic.co/t/elasticsearch-and-in-query-string-vs-default-operator-and/199578)
**Author:** [@spotlight2001](https://discuss.elastic.co/u/spotlight2001)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 5:42am UTC](https://discuss.elastic.co/t/elasticsearch-and-in-query-string-vs-default-operator-and/199578 "2019-09-16T05:42:10Z")
elasticsearch v7.1.1 I dont understand the difference between a query\_string containing "AND" vs. "default\_operator AND" I thought it should yield the same result, but doesnt: Data: HTTP POST http://localhost:9200/\_b… --- ## [Elastic Cloud on Azure](https://discuss.elastic.co/t/elastic-cloud-on-azure/199419)
**Author:** [@RichardH](https://discuss.elastic.co/u/RichardH)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 5:03am UTC](https://discuss.elastic.co/t/elastic-cloud-on-azure/199419 "2019-09-16T05:03:40Z")
We will be rolling out our first production elastic cluster. At this stage we are looking at pros and cons of on prem vs cloud, however even when to comes to cloud we need to decide between provisioning on cloud.elastic… --- ## [Can we have set type field behaviour in elasticsearch..?](https://discuss.elastic.co/t/can-we-have-set-type-field-behaviour-in-elasticsearch/199572)
**Author:** [@yash.tandon](https://discuss.elastic.co/u/yash.tandon)\ **Replies:** 0\ **Last updated:** [September 16, 2019, 4:54am UTC](https://discuss.elastic.co/t/can-we-have-set-type-field-behaviour-in-elasticsearch/199572 "2019-09-16T04:54:40Z")
--- ## [Feed lost data to ELK](https://discuss.elastic.co/t/feed-lost-data-to-elk/198997)
**Author:** [@Rajith\_konara](https://discuss.elastic.co/u/Rajith_konara)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 3:44am UTC](https://discuss.elastic.co/t/feed-lost-data-to-elk/198997 "2019-09-16T03:44:10Z")
Hi all, I' am having an production incident, we loss 12 hours of data due to some incident, now the service is back to normal and elastic is serving the data, but we need to fill the loss data gap. We have the relevant … --- ## [Elasticsearch sometimes bulk update fail?](https://discuss.elastic.co/t/elasticsearch-sometimes-bulk-update-fail/199199)
**Author:** [@ElvisLin](https://discuss.elastic.co/u/ElvisLin)\ **Replies:** 3\ **Last updated:** [September 16, 2019, 2:54am UTC](https://discuss.elastic.co/t/elasticsearch-sometimes-bulk-update-fail/199199 "2019-09-16T02:54:22Z")
Elasticsearch version: 7.0.0 I can not reproduce the problem. My system is frequently sync db data to Elasticsearch server through bulk method. The proccess will do update/create/delete in bulk body. I'm using client… --- ## [Local Setup Elasticsearch 7.2 and Kibana with Security](https://discuss.elastic.co/t/local-setup-elasticsearch-7-2-and-kibana-with-security/199526)
**Author:** [@dinesh.gupta](https://discuss.elastic.co/u/dinesh.gupta)\ **Replies:** 2\ **Last updated:** [September 16, 2019, 1:50am UTC](https://discuss.elastic.co/t/local-setup-elasticsearch-7-2-and-kibana-with-security/199526 "2019-09-16T01:50:47Z")
I installed few days back Elastic & Kibana version 7.2 on my local laptop virtual machine( vmware with Centos 7.6). I want to enable the security for elastic & kibana but unable to do. In Elasticsearch '/etc/elasticsea… --- ## [How to add new fields on document on ingestion based on value of other fields](https://discuss.elastic.co/t/how-to-add-new-fields-on-document-on-ingestion-based-on-value-of-other-fields/199519)
**Author:** [@opsuthar](https://discuss.elastic.co/u/opsuthar)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 10:16pm UTC](https://discuss.elastic.co/t/how-to-add-new-fields-on-document-on-ingestion-based-on-value-of-other-fields/199519 "2019-09-15T22:16:23Z")
I have a scenario where different applications are sending different fields for the same purpose which is making getting the aggregates/query data difficult and resulting in Big query. Here is one of the field which spe… --- ## [Get aggregations on nested array of objects](https://discuss.elastic.co/t/get-aggregations-on-nested-array-of-objects/199554)
**Author:** [@hassanAwanAlvi](https://discuss.elastic.co/u/hassanAwanAlvi)\ **Replies:** 0\ **Last updated:** [September 15, 2019, 8:10pm UTC](https://discuss.elastic.co/t/get-aggregations-on-nested-array-of-objects/199554 "2019-09-15T20:10:06Z")
Hi there, I have a complex situation. Let me define my context. I am working on a project related to YouTube videos. I have data of videos. A typical document looks like. { "\_index": "tubecvideos", "\_type": "\_doc",… --- ## [Unable to connect Elasticsearch with Spark](https://discuss.elastic.co/t/unable-to-connect-elasticsearch-with-spark/199543)
**Author:** [@Manel\_Serrano](https://discuss.elastic.co/u/Manel_Serrano)\ **Replies:** 0\ **Last updated:** [September 15, 2019, 4:26pm UTC](https://discuss.elastic.co/t/unable-to-connect-elasticsearch-with-spark/199543 "2019-09-15T16:26:12Z")
Hi all, I get this error when I try to connect Elasticsearch (running in a cluster) with Spark (running locally): 19/09/14 20:17:32 INFO HttpMethodDirector: I/O exception (java.net.ConnectException) caught when process… --- ## [Is that a good practice to query ES during a Restore process?](https://discuss.elastic.co/t/is-that-a-good-practice-to-query-es-during-a-restore-process/199522)
**Author:** [@Yotam\_Levy](https://discuss.elastic.co/u/Yotam_Levy)\ **Replies:** 3\ **Last updated:** [September 15, 2019, 1:47pm UTC](https://discuss.elastic.co/t/is-that-a-good-practice-to-query-es-during-a-restore-process/199522 "2019-09-15T13:47:52Z")
hello, I'm trying to measure the Restore process while it happens by querying ES (a simple get index request, then take the index size from it) basically I want to know how much data is there in my restoring index every… --- ## [How to aggregate nested fields with null values?](https://discuss.elastic.co/t/how-to-aggregate-nested-fields-with-null-values/199536)
**Author:** [@Doronpt](https://discuss.elastic.co/u/Doronpt)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 1:12pm UTC](https://discuss.elastic.co/t/how-to-aggregate-nested-fields-with-null-values/199536 "2019-09-15T13:12:21Z")
Hi, I'm having trouble aggregating my nested data, maybe you can help. I'll simplify the problem, I've a nested field that looks like: PUT test/doc/\_mapping { "properties": { "fields": { "type" : "n… --- ## [Is it possible to download the entire current Elasticsearch Reference as a pdf?](https://discuss.elastic.co/t/is-it-possible-to-download-the-entire-current-elasticsearch-reference-as-a-pdf/199516)
**Author:** [@neergttocsdivad](https://discuss.elastic.co/u/neergttocsdivad)\ **Replies:** 1\ **Last updated:** [September 15, 2019, 9:37am UTC](https://discuss.elastic.co/t/is-it-possible-to-download-the-entire-current-elasticsearch-reference-as-a-pdf/199516 "2019-09-15T09:37:43Z")
is it possible to download the entire Elasticsearch Reference as a pdf ? https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1154) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1156)