# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=984

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 985

---

## [Fsccrawler Document ID](https://discuss.elastic.co/t/fsccrawler-document-id/224021)

<div class="topic-metadata">

**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\
**Replies:** 1\
**Last updated:** [March 18, 2020, 5:39am UTC](https://discuss.elastic.co/t/fsccrawler-document-id/224021 "2020-03-18T05:39:53Z")

</div>

Hello, Can anyone help me in this? I wanted to check that, when we index any folder using FSCrawler, for each file in he folder separate document id is generated or for all the files or attachments in the folder only o…

---

## [Aggregation date using RestHighLevelClient](https://discuss.elastic.co/t/aggregation-date-using-resthighlevelclient/223871)

<div class="topic-metadata">

**Author:** [@zhonghuafy](https://discuss.elastic.co/u/zhonghuafy)\
**Replies:** 1\
**Last updated:** [March 18, 2020, 5:26am UTC](https://discuss.elastic.co/t/aggregation-date-using-resthighlevelclient/223871 "2020-03-18T05:26:14Z")

</div>

I'm trying to implement sql below: select format(date,'yyyy-MM-dd'), count(\*) group by format(date,'yyyy-MM-dd') using RestHighLevelClient java code: SearchSourceBuilder sourceBuilder = new SearchSourceBuilder();…

---

## [How to move old index in another location?](https://discuss.elastic.co/t/how-to-move-old-index-in-another-location/223879)

<div class="topic-metadata">

**Author:** [@kastu707](https://discuss.elastic.co/u/kastu707)\
**Replies:** 3\
**Last updated:** [March 18, 2020, 4:34am UTC](https://discuss.elastic.co/t/how-to-move-old-index-in-another-location/223879 "2020-03-18T04:34:04Z")

</div>

Hi everyone, The local FS where elasticseach is installed is full about 93%. My client gave me 1TO on a NFS that I already mounted. I create daily index thanks to Logstash, is that any way to move older index only on t…

---

## [Alert based on a document over time](https://discuss.elastic.co/t/alert-based-on-a-document-over-time/224022)

<div class="topic-metadata">

**Author:** [@martin\_edge](https://discuss.elastic.co/u/martin_edge)\
**Replies:** 0\
**Last updated:** [March 18, 2020, 3:56am UTC](https://discuss.elastic.co/t/alert-based-on-a-document-over-time/224022 "2020-03-18T03:56:36Z")

</div>

Hello, We'd like to have alerts based on the evolution of the data of a specific document over time. Here is our use case: Every day we index documents which represent financial instruments with their metrics (e.g. vo…

---

## [Aggregation with multiple condition returning False values](https://discuss.elastic.co/t/aggregation-with-multiple-condition-returning-false-values/224020)

<div class="topic-metadata">

**Author:** [@BIRENDRA](https://discuss.elastic.co/u/BIRENDRA)\
**Replies:** 0\
**Last updated:** [March 18, 2020, 3:39am UTC](https://discuss.elastic.co/t/aggregation-with-multiple-condition-returning-false-values/224020 "2020-03-18T03:39:39Z")

</div>

Hi Team, I tried 2 ways to do this. In one solution I am using 2 filter terms inside filter bool. That is shown below: GET experiment\_air/\_search { "size": 5, "aggs": { "creations": { "filter": { "bool": { "fil…

---

## [Why do you write cluster.initial\_master\_node 3 or higher node when setting up a cluster?](https://discuss.elastic.co/t/why-do-you-write-cluster-initial-master-node-3-or-higher-node-when-setting-up-a-cluster/223884)

<div class="topic-metadata">

**Author:** [@cybang](https://discuss.elastic.co/u/cybang)\
**Replies:** 4\
**Last updated:** [March 18, 2020, 12:12am UTC](https://discuss.elastic.co/t/why-do-you-write-cluster-initial-master-node-3-or-higher-node-when-setting-up-a-cluster/223884 "2020-03-18T00:12:42Z")

</div>

hi. i have a question.. I apologize first if there is something I said rudely because I cant well english. Assuming that I wrote cluster.initial\_master\_node: master1,master2,master3 I need only two masters alive to m…

---

## [Migrating Elastic Data into a new server](https://discuss.elastic.co/t/migrating-elastic-data-into-a-new-server/223865)

<div class="topic-metadata">

**Author:** [@IAmGreg](https://discuss.elastic.co/u/IAmGreg)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 9:05pm UTC](https://discuss.elastic.co/t/migrating-elastic-data-into-a-new-server/223865 "2020-03-17T21:05:32Z")

</div>

Hi everyone! Can you please help me migrate the elastic data from one server to another? The two servers are in different locations and can't be connected to each other due to security policies. Thank you very much.

---

## [Data Obfuscation while Migrating](https://discuss.elastic.co/t/data-obfuscation-while-migrating/223899)

<div class="topic-metadata">

**Author:** [@LED](https://discuss.elastic.co/u/LED)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 9:04pm UTC](https://discuss.elastic.co/t/data-obfuscation-while-migrating/223899 "2020-03-17T21:04:15Z")

</div>

Hi Everyone, Our use case is that we have a 6.4 cluster which has recently passed over EOL. We would like to move to a new cluster which is running 7.6. We have looked at many different options for migrating; one of t…

---

## [I/O scheduler for ES 7.0](https://discuss.elastic.co/t/i-o-scheduler-for-es-7-0/223981)

<div class="topic-metadata">

**Author:** [@pinakinab](https://discuss.elastic.co/u/pinakinab)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 8:29pm UTC](https://discuss.elastic.co/t/i-o-scheduler-for-es-7-0/223981 "2020-03-17T20:29:22Z")

</div>

We are using ES 7.5.0 As per the documentation, selecting the correct i/o scheduler should optimize the ES performance. In our system when I checked in /sys/block/sdb/queue/scheduler, I could see 3 scheduler options no…

---

## [Adding Elasticsearch Node to ES Cluster](https://discuss.elastic.co/t/adding-elasticsearch-node-to-es-cluster/223969)

<div class="topic-metadata">

**Author:** [@heywoodlh](https://discuss.elastic.co/u/heywoodlh)\
**Replies:** 5\
**Last updated:** [March 17, 2020, 6:58pm UTC](https://discuss.elastic.co/t/adding-elasticsearch-node-to-es-cluster/223969 "2020-03-17T18:58:00Z")

</div>

Attempting to add an Elasticsearch node to my current single node cluster. However, I am running into issues adding the new node. I'm using Ansible to deploy the Elasticsearch Docker container so I'll just post the port…

---

## [Certificate details of Curator](https://discuss.elastic.co/t/certificate-details-of-curator/223731)

<div class="topic-metadata">

**Author:** [@kasim123](https://discuss.elastic.co/u/kasim123)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 6:42pm UTC](https://discuss.elastic.co/t/certificate-details-of-curator/223731 "2020-03-17T18:42:13Z")

</div>

I have configured ELK stack with X-pack enabled. Now I am trying to configured elasticsearch curator. Which certificates should I define for SSL communication between Curator and ElasticSearch. I have only certificates …

---

## [Rollup Jobs are gone](https://discuss.elastic.co/t/rollup-jobs-are-gone/223980)

<div class="topic-metadata">

**Author:** [@mcguacon](https://discuss.elastic.co/u/mcguacon)\
**Replies:** 0\
**Last updated:** [March 17, 2020, 6:13pm UTC](https://discuss.elastic.co/t/rollup-jobs-are-gone/223980 "2020-03-17T18:13:48Z")

</div>

I had 11 rollup jobs running with no problems for a few months. Just checking on the actual jobs, there were all gone! I do not believe this was malice, but it certainly could have been an accident by someone. Are the…

---

## [Requests that lead to too many 404](https://discuss.elastic.co/t/requests-that-lead-to-too-many-404/223942)

<div class="topic-metadata">

**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\
**Replies:** 3\
**Last updated:** [March 17, 2020, 5:36pm UTC](https://discuss.elastic.co/t/requests-that-lead-to-too-many-404/223942 "2020-03-17T17:36:43Z")

</div>

Is it possible that update requests that I know will lead to 404's (because doc with that id does not exist) can destabilize an ES cluster? I'm talking about quite a lot of update requests and a big enough index (2TB) W…

---

## [Can you reindex to the same index](https://discuss.elastic.co/t/can-you-reindex-to-the-same-index/223911)

<div class="topic-metadata">

**Author:** [@guibvieira](https://discuss.elastic.co/u/guibvieira)\
**Replies:** 3\
**Last updated:** [March 17, 2020, 5:35pm UTC](https://discuss.elastic.co/t/can-you-reindex-to-the-same-index/223911 "2020-03-17T17:35:38Z")

</div>

I have an existing indice and want to multiply this data with a small modification to it, simply increment a few fields, but the rest of the data can remain the same. Hence, I am not looking to actually change the mappin…

---

## [Term Query fails with special charcters](https://discuss.elastic.co/t/term-query-fails-with-special-charcters/223813)

<div class="topic-metadata">

**Author:** [@smandalika](https://discuss.elastic.co/u/smandalika)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 5:33pm UTC](https://discuss.elastic.co/t/term-query-fails-with-special-charcters/223813 "2020-03-17T17:33:09Z")

</div>

Term query fails with special characters. Input: --header 'Content-Type: application/json' \\ -d '{ "id": "6a974e5c18b7408db76dfc11212f6d9d", "authId": "9900732910", "offeringId": "97…

---

## [Stemmer class not found for light\_bengali](https://discuss.elastic.co/t/stemmer-class-not-found-for-light-bengali/223810)

<div class="topic-metadata">

**Author:** [@void](https://discuss.elastic.co/u/void)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 5:31pm UTC](https://discuss.elastic.co/t/stemmer-class-not-found-for-light-bengali/223810 "2020-03-17T17:31:37Z")

</div>

I am getting an error while creating an index contains light\_bengali stemmer which is supported by es. Stemmer token filteredit es version: 7.2.0, I tried 7.6.1 too but got the same error mapping { "…

---

## [HJSON Support](https://discuss.elastic.co/t/hjson-support/223939)

<div class="topic-metadata">

**Author:** [@billmn](https://discuss.elastic.co/u/billmn)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 5:29pm UTC](https://discuss.elastic.co/t/hjson-support/223939 "2020-03-17T17:29:04Z")

</div>

Greetings, Wondering if it would be a viable request to have things like watcher and pipeline definitions use HJSON format ? It seems we humans need to work directly with json to define these tings and so something tha…

---

## [Proportionally mix results from two different searches on same index](https://discuss.elastic.co/t/proportionally-mix-results-from-two-different-searches-on-same-index/223976)

<div class="topic-metadata">

**Author:** [@germangorodnev](https://discuss.elastic.co/u/germangorodnev)\
**Replies:** 0\
**Last updated:** [March 17, 2020, 5:05pm UTC](https://discuss.elastic.co/t/proportionally-mix-results-from-two-different-searches-on-same-index/223976 "2020-03-17T17:05:37Z")

</div>

I have dating app where users can like\\dislike each other. I use filters provided by user to search profiles, let's call these general results. I'd like to mix these with users who liked requesting user ( liked ) in som…

---

## [No handler for type \[dense\_vector\] for version 7.4.2](https://discuss.elastic.co/t/no-handler-for-type-dense-vector-for-version-7-4-2/223819)

<div class="topic-metadata">

**Author:** [@Vitalik](https://discuss.elastic.co/u/Vitalik)\
**Replies:** 3\
**Last updated:** [March 17, 2020, 5:03pm UTC](https://discuss.elastic.co/t/no-handler-for-type-dense-vector-for-version-7-4-2/223819 "2020-03-17T17:03:49Z")

</div>

Hi, I'm trying to load the data stored in index with a 6.7.0 version to the new index with a 7.4.2 version adding field with 'dense\_vector' type. But got the next error: RequestError(400, 'mapper\_parsing\_exception', 'No…

---

## [Template keep adding itself in loop](https://discuss.elastic.co/t/template-keep-adding-itself-in-loop/222125)

<div class="topic-metadata">

**Author:** [@stack](https://discuss.elastic.co/u/stack)\
**Replies:** 5\
**Last updated:** [March 17, 2020, 4:00pm UTC](https://discuss.elastic.co/t/template-keep-adding-itself-in-loop/222125 "2020-03-17T16:00:21Z")

</div>

Hello, I have setup a template trough my winlogbeat file and i wanted to update it on Kibana by adding an alias. Everytime i added the alias i noticed that the change would apply, but 5 seconds later it would disappeir. …

---

## [Watcher for Disk Space](https://discuss.elastic.co/t/watcher-for-disk-space/222817)

<div class="topic-metadata">

**Author:** [@sroseman](https://discuss.elastic.co/u/sroseman)\
**Replies:** 14\
**Last updated:** [March 17, 2020, 3:31pm UTC](https://discuss.elastic.co/t/watcher-for-disk-space/222817 "2020-03-17T15:31:18Z")

</div>

How would I create a watcher for disk space for my hosts? I am using the UI, but I think I will need to do a custom JSON watcher. I want to be notified when system.filesystem.used.pct is over a certain percentage for eac…

---

## [Request volume management](https://discuss.elastic.co/t/request-volume-management/223919)

<div class="topic-metadata">

**Author:** [@lzambarda](https://discuss.elastic.co/u/lzambarda)\
**Replies:** 6\
**Last updated:** [March 17, 2020, 3:20pm UTC](https://discuss.elastic.co/t/request-volume-management/223919 "2020-03-17T15:20:20Z")

</div>

Hello, I am running an ES 7.6.0 cluster and once in a while I need to perform a full index rebuild. Currently I need to index 15 million documents and my indexer currently is able to be fine tuned on request size, maxim…

---

## [Snapshot restore failure elasticsearch 6.8.7](https://discuss.elastic.co/t/snapshot-restore-failure-elasticsearch-6-8-7/223946)

<div class="topic-metadata">

**Author:** [@noabeuh](https://discuss.elastic.co/u/noabeuh)\
**Replies:** 2\
**Last updated:** [March 17, 2020, 3:03pm UTC](https://discuss.elastic.co/t/snapshot-restore-failure-elasticsearch-6-8-7/223946 "2020-03-17T15:03:55Z")

</div>

hello everyone, I'm using elasticsearch 6.8.7. with 3 node. I want to backup my indices, that's ok. it's done now. But when i want to restore this snapshot on another cluster with same parameter, there is an error on …

---

## [Deploying a premium version of the ELK stack Locally](https://discuss.elastic.co/t/deploying-a-premium-version-of-the-elk-stack-locally/223947)

<div class="topic-metadata">

**Author:** [@Hyperion0](https://discuss.elastic.co/u/Hyperion0)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 2:54pm UTC](https://discuss.elastic.co/t/deploying-a-premium-version-of-the-elk-stack-locally/223947 "2020-03-17T14:54:32Z")

</div>

Please forgive my ignorance. This is a more general and (probably stupid) question: If you have a premium subscription for the ELK stack can the entire thing be deployed on a local host or do you have to use a cloud se…

---

## [Cannot recover index - store.found: false](https://discuss.elastic.co/t/cannot-recover-index-store-found-false/223827)

<div class="topic-metadata">

**Author:** [@hunsw](https://discuss.elastic.co/u/hunsw)\
**Replies:** 13\
**Last updated:** [March 17, 2020, 2:33pm UTC](https://discuss.elastic.co/t/cannot-recover-index-store-found-false/223827 "2020-03-17T14:33:24Z")

</div>

After a full cluster restart, some of my indices remained red. Among them a few had replicas... Cluster allocation explain API informs me that a pri 3 rep 1 index is missing its primary shard 0, on every node I get: …

---

## [Aggregation for number of days since X](https://discuss.elastic.co/t/aggregation-for-number-of-days-since-x/223945)

<div class="topic-metadata">

**Author:** [@Keef\_Baker](https://discuss.elastic.co/u/Keef_Baker)\
**Replies:** 0\
**Last updated:** [March 17, 2020, 2:05pm UTC](https://discuss.elastic.co/t/aggregation-for-number-of-days-since-x/223945 "2020-03-17T14:05:43Z")

</div>

Hi, I have a bunch of data and each element has a timestamp field. What I'm wanting to do is get the median for the number of days since that datestamp for all that data (preferably in days) I can get the data out fine…

---

## [Heepoutofmemory erroe xms and xmx set to 3g but problem not solved](https://discuss.elastic.co/t/heepoutofmemory-erroe-xms-and-xmx-set-to-3g-but-problem-not-solved/223676)

<div class="topic-metadata">

**Author:** [@eakam](https://discuss.elastic.co/u/eakam)\
**Replies:** 4\
**Last updated:** [March 17, 2020, 1:56pm UTC](https://discuss.elastic.co/t/heepoutofmemory-erroe-xms-and-xmx-set-to-3g-but-problem-not-solved/223676 "2020-03-17T13:56:44Z")

</div>

heepoutofmemory erroe xms and xmx set to 3g but problem not solved cat /var/log/elasticsearch/elasticsearch.log | grep -i -E "error|warn" output of this command: \[2020-03-16T03:59:12,934\]\[INFO \]\[o.e.n.Node …

---

## [Elastic - SAML (Azure) integration issue](https://discuss.elastic.co/t/elastic-saml-azure-integration-issue/223934)

<div class="topic-metadata">

**Author:** [@AjitR](https://discuss.elastic.co/u/AjitR)\
**Replies:** 1\
**Last updated:** [March 17, 2020, 1:46pm UTC](https://discuss.elastic.co/t/elastic-saml-azure-integration-issue/223934 "2020-03-17T13:46:41Z")

</div>

Hi All, Below are my SAML configuration for Elasticsearch and Kibana, but getting Warning as \[WARN \]\[o.e.x.s.a.AuthenticationService\] \[SA145\] Authentication to realm saml1 failed - Provided SAML response is not valid f…

---

## [How to get Average from AvgAggregationBuilder elastic search for spesific keys](https://discuss.elastic.co/t/how-to-get-average-from-avgaggregationbuilder-elastic-search-for-spesific-keys/223921)

<div class="topic-metadata">

**Author:** [@Barak\_Kedem](https://discuss.elastic.co/u/Barak_Kedem)\
**Replies:** 0\
**Last updated:** [March 17, 2020, 12:30pm UTC](https://discuss.elastic.co/t/how-to-get-average-from-avgaggregationbuilder-elastic-search-for-spesific-keys/223921 "2020-03-17T12:30:09Z")

</div>

I'm am trying to get results from Elastic search with spesic keys example: average salary, by city, gender so i check at metrics\_aggregations and I was able AvgAggregationBuilder totalDuration = AggregationBuilder…

---

## [Issues with starting elasticsearch](https://discuss.elastic.co/t/issues-with-starting-elasticsearch/223913)

<div class="topic-metadata">

**Author:** [@ankitagarwal10k](https://discuss.elastic.co/u/ankitagarwal10k)\
**Replies:** 14\
**Last updated:** [March 17, 2020, 12:30pm UTC](https://discuss.elastic.co/t/issues-with-starting-elasticsearch/223913 "2020-03-17T12:30:57Z")

</div>

When I am trying to start the elasticsearch, i am getting the below logs: \[2020-03-17T16:41:33,633\]\[WARN \]\[i.n.u.i.MacAddressUtil \] \[elasticsearch-node-1\] Failed to find a usable hardware address from the network int…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=983)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=985)
