# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=788

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 789

---

## [Action\_snapshot error](https://discuss.elastic.co/t/action-snapshot-error/251820)

<div class="topic-metadata">

**Author:** [@ANILL\_KUMAR](https://discuss.elastic.co/u/ANILL_KUMAR)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 10:36pm UTC](https://discuss.elastic.co/t/action-snapshot-error/251820 "2020-10-12T22:36:48Z")

</div>

Hi, I'm configuring curator to take snapshot, but failing to do so. ending up with a PARTIAL error. our cluster is with 5 master nodes, 18 data nodes. sharing nfs data domain. curator log is below 2020-10-12 22:20:2…

---

## [Rollover not happening after ilm policy set](https://discuss.elastic.co/t/rollover-not-happening-after-ilm-policy-set/251812)

<div class="topic-metadata">

**Author:** [@venku](https://discuss.elastic.co/u/venku)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 8:47pm UTC](https://discuss.elastic.co/t/rollover-not-happening-after-ilm-policy-set/251812 "2020-10-12T20:47:28Z")

</div>

Hi, I am trying to setup an ilm policy for the index. I created the policy and attached it to the template. Used the same template in the logstash output. But I don't see the rollover happening. For testing purpose I ha…

---

## [Manually do an ILM poll during development and tests](https://discuss.elastic.co/t/manually-do-an-ilm-poll-during-development-and-tests/251421)

<div class="topic-metadata">

**Author:** [@Sravan\_Reddy](https://discuss.elastic.co/u/Sravan_Reddy)\
**Replies:** 1\
**Last updated:** [October 12, 2020, 8:15pm UTC](https://discuss.elastic.co/t/manually-do-an-ilm-poll-during-development-and-tests/251421 "2020-10-12T20:15:49Z")

</div>

Hello, When using ILM, on indices.lifecycle.poll\_interval there is a lower bound of 1 second. Our current test setup involves waiting one second after every doc insertion to let ILM do its job. This makes our tests ve…

---

## [The repository 'https://artifacts.elastic.co/packages/6.x/apt stable Release' does not have a Release file](https://discuss.elastic.co/t/the-repository-https-artifacts-elastic-co-packages-6-x-apt-stable-release-does-not-have-a-release-file/251810)

<div class="topic-metadata">

**Author:** [@Ion\_Drugalea](https://discuss.elastic.co/u/Ion_Drugalea)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 7:58pm UTC](https://discuss.elastic.co/t/the-repository-https-artifacts-elastic-co-packages-6-x-apt-stable-release-does-not-have-a-release-file/251810 "2020-10-12T19:58:36Z")

</div>

I still have this issue, any solutions? this is my content of /etc/apt/source.list.d/elasticsearch.list deb https://artifacts.elastic.co/packages/6.x/apt stable main apt-get update -o Debug::pkgProblemResolver=true -o…

---

## [Heap Size in Stack monitoring does not match jvm.options setting](https://discuss.elastic.co/t/heap-size-in-stack-monitoring-does-not-match-jvm-options-setting/251709)

<div class="topic-metadata">

**Author:** [@ratnakarn](https://discuss.elastic.co/u/ratnakarn)\
**Replies:** 4\
**Last updated:** [October 12, 2020, 4:32pm UTC](https://discuss.elastic.co/t/heap-size-in-stack-monitoring-does-not-match-jvm-options-setting/251709 "2020-10-12T16:32:26Z")

</div>

Hello, We have Prod/QA/Test identical clusters - 3 nodes (centos / 8core / 64g / 2tb ssd each). Jvm.options Heap size (-Xmx) is not set in prod & qa. Its set to -Xmx32g in test cluster. However, Kibana shows differen…

---

## [Unable to get Source filter while doing elastic search with spring boot class org.elasticsearch.search.builder.SearchSourceBuilder](https://discuss.elastic.co/t/unable-to-get-source-filter-while-doing-elastic-search-with-spring-boot-class-org-elasticsearch-search-builder-searchsourcebuilder/250640)

<div class="topic-metadata">

**Author:** [@Rajan\_Gupta](https://discuss.elastic.co/u/Rajan_Gupta)\
**Replies:** 11\
**Last updated:** [October 12, 2020, 4:26pm UTC](https://discuss.elastic.co/t/unable-to-get-source-filter-while-doing-elastic-search-with-spring-boot-class-org-elasticsearch-search-builder-searchsourcebuilder/250640 "2020-10-12T16:26:03Z")

</div>

This is the code Sample which i m using to get the result:- SearchRequest searchRequest = new SearchRequest(); searchRequest.indices("contentsearch"); SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();…

---

## [ElasticSearch Bulk Indexing Azure VM](https://discuss.elastic.co/t/elasticsearch-bulk-indexing-azure-vm/249846)

<div class="topic-metadata">

**Author:** [@irtzasuhail](https://discuss.elastic.co/u/irtzasuhail)\
**Replies:** 2\
**Last updated:** [October 12, 2020, 3:42pm UTC](https://discuss.elastic.co/t/elasticsearch-bulk-indexing-azure-vm/249846 "2020-10-12T15:42:24Z")

</div>

We are using a VM in Azure to run ElasticSearch to do some bulk indexing on our data. The biggest input JSON we've tested with so far is around 70 MB in size, and each time it fails with the node error 134 which translat…

---

## [Help Transforming Data and Combining Fields](https://discuss.elastic.co/t/help-transforming-data-and-combining-fields/251608)

<div class="topic-metadata">

**Author:** [@amorrow](https://discuss.elastic.co/u/amorrow)\
**Replies:** 4\
**Last updated:** [October 12, 2020, 3:41pm UTC](https://discuss.elastic.co/t/help-transforming-data-and-combining-fields/251608 "2020-10-12T15:41:41Z")

</div>

Hi everyone, I'm hoping someone can help me with transforming some data. Every 5 minutes I have a script capture wireless client information from my wireless controller and ship it into ElasticSearch. This information i…

---

## [Trying to update documents using NEST in C#](https://discuss.elastic.co/t/trying-to-update-documents-using-nest-in-c/250626)

<div class="topic-metadata">

**Author:** [@adiksl](https://discuss.elastic.co/u/adiksl)\
**Replies:** 1\
**Last updated:** [October 12, 2020, 3:08pm UTC](https://discuss.elastic.co/t/trying-to-update-documents-using-nest-in-c/250626 "2020-10-12T15:08:52Z")

</div>

From within a C# winform application I am writing to elasticsearch which is working successfully. This is fine for my audit process but there is a requirement to write notes data to elasticsearch to enable text searching…

---

## [Change Field Data Type from Primitive to Object](https://discuss.elastic.co/t/change-field-data-type-from-primitive-to-object/251778)

<div class="topic-metadata">

**Author:** [@sab20](https://discuss.elastic.co/u/sab20)\
**Replies:** 1\
**Last updated:** [October 12, 2020, 2:41pm UTC](https://discuss.elastic.co/t/change-field-data-type-from-primitive-to-object/251778 "2020-10-12T14:41:55Z")

</div>

Hello All, I am looking for a solution for scenario where need to change data type of field. We configure index using index mapping template and reindexing is done whenever there is any change in index mapping. We are…

---

## [Elasticsearch node error](https://discuss.elastic.co/t/elasticsearch-node-error/251762)

<div class="topic-metadata">

**Author:** [@Bhavin\_Varsur](https://discuss.elastic.co/u/Bhavin_Varsur)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 12:15pm UTC](https://discuss.elastic.co/t/elasticsearch-node-error/251762 "2020-10-12T12:15:23Z")

</div>

(topic withdrawn by author, will be automatically deleted in 24 hours unless flagged)

---

## [Elasticsearch Bootstrap check failed](https://discuss.elastic.co/t/elasticsearch-bootstrap-check-failed/251702)

<div class="topic-metadata">

**Author:** [@RAM\_NATHAN](https://discuss.elastic.co/u/RAM_NATHAN)\
**Replies:** 1\
**Last updated:** [October 12, 2020, 12:25pm UTC](https://discuss.elastic.co/t/elasticsearch-bootstrap-check-failed/251702 "2020-10-12T12:25:45Z")

</div>

Im getting below error during elasticsearch start node validation exception \[1\] bootstrap checks failed \[1\]: max virtual memory areas vm.max\_map\_count \[65530\] is too low, increase to at least \[262144\] Im having /etc/…

---

## [Shards failed caused by index.max\_docvalue\_fields\_search](https://discuss.elastic.co/t/shards-failed-caused-by-index-max-docvalue-fields-search/251587)

<div class="topic-metadata">

**Author:** [@cctk](https://discuss.elastic.co/u/cctk)\
**Replies:** 2\
**Last updated:** [October 12, 2020, 12:19pm UTC](https://discuss.elastic.co/t/shards-failed-caused-by-index-max-docvalue-fields-search/251587 "2020-10-12T12:19:24Z")

</div>

I have a problem with filebeat indexes , a new index is made everyday and each time I get a shard failed error. The reason behind it is shown as the index.max\_docvalue\_fields\_search is too low. I run this in dev tools …

---

## [Reindex task stopped running but still shows up](https://discuss.elastic.co/t/reindex-task-stopped-running-but-still-shows-up/251763)

<div class="topic-metadata">

**Author:** [@hugohendriks](https://discuss.elastic.co/u/hugohendriks)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 12:15pm UTC](https://discuss.elastic.co/t/reindex-task-stopped-running-but-still-shows-up/251763 "2020-10-12T12:15:57Z")

</div>

Hi, I have an instance on AWS from which I wanted to move the data to my new Azure instance. I whitelisted the servers and user the reindex command to start moving index data. This seemed to work oke. I needed to move q…

---

## [Learn to rank](https://discuss.elastic.co/t/learn-to-rank/251761)

<div class="topic-metadata">

**Author:** [@Parampreet\_Singh1](https://discuss.elastic.co/u/Parampreet_Singh1)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 12:01pm UTC](https://discuss.elastic.co/t/learn-to-rank/251761 "2020-10-12T12:01:43Z")

</div>

Hi, i am using elastic search 6.5.4 and now i want to use learn to rank and installing the plugin of learn to rank "./bin/elasticsearch-plugin install http://es-learn-to-rank.labs.o19s.com/ltr-1.1.0-es6.8.0.zip" & ltr…

---

## [Can we use Elasticsearch as a database for data science](https://discuss.elastic.co/t/can-we-use-elasticsearch-as-a-database-for-data-science/251743)

<div class="topic-metadata">

**Author:** [@vero](https://discuss.elastic.co/u/vero)\
**Replies:** 2\
**Last updated:** [October 12, 2020, 10:58am UTC](https://discuss.elastic.co/t/can-we-use-elasticsearch-as-a-database-for-data-science/251743 "2020-10-12T10:58:14Z")

</div>

Hi, Can we use Elasticsearch as a Database for data science and data visualization projects ? Thanks,

---

## [Slow terms aggregations after use of eager\_global\_ordinals](https://discuss.elastic.co/t/slow-terms-aggregations-after-use-of-eager-global-ordinals/250976)

<div class="topic-metadata">

**Author:** [@tarunpvss](https://discuss.elastic.co/u/tarunpvss)\
**Replies:** 5\
**Last updated:** [October 12, 2020, 9:39am UTC](https://discuss.elastic.co/t/slow-terms-aggregations-after-use-of-eager-global-ordinals/250976 "2020-10-12T09:39:31Z")

</div>

Hi team, I have a use case where I need to perform aggregations on a keyword field which has high cardinality. As per the blog https://www.elastic.co/blog/improving-the-performance-of-high-cardinality-terms-aggregations…

---

## [Aggregate geo data without hardcode an origin](https://discuss.elastic.co/t/aggregate-geo-data-without-hardcode-an-origin/251738)

<div class="topic-metadata">

**Author:** [@ErikvdVen](https://discuss.elastic.co/u/ErikvdVen)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 9:27am UTC](https://discuss.elastic.co/t/aggregate-geo-data-without-hardcode-an-origin/251738 "2020-10-12T09:27:50Z")

</div>

I have indexed geodata from multiple people who visited different places. Now I only want to show places where 2 or more people were close to each other (max 100 meter apart from each other). I need to do this without h…

---

## [Elasticsearch nested object based filter and count operation](https://discuss.elastic.co/t/elasticsearch-nested-object-based-filter-and-count-operation/251733)

<div class="topic-metadata">

**Author:** [@bl4cksta](https://discuss.elastic.co/u/bl4cksta)\
**Replies:** 0\
**Last updated:** [October 12, 2020, 8:45am UTC](https://discuss.elastic.co/t/elasticsearch-nested-object-based-filter-and-count-operation/251733 "2020-10-12T08:45:24Z")

</div>

I am new on elasticsearch. trying to use it on analytics calculations. I don't know, does it possible to do that but, I am trying to find customers who has 0 purchases. I stored, orders as nested object arrays for each c…

---

## [Node is not added to the cluster](https://discuss.elastic.co/t/node-is-not-added-to-the-cluster/251579)

<div class="topic-metadata">

**Author:** [@djuwa4](https://discuss.elastic.co/u/djuwa4)\
**Replies:** 7\
**Last updated:** [October 12, 2020, 8:38am UTC](https://discuss.elastic.co/t/node-is-not-added-to-the-cluster/251579 "2020-10-12T08:38:39Z")

</div>

I created a cluster for five nodes. However, one of the nodes does not see the rest and creates a cluster where this node is the only participant. I do everything in the same way on all nodes. Here is its config: cluste…

---

## [Elasticsearch change primary shards number](https://discuss.elastic.co/t/elasticsearch-change-primary-shards-number/251716)

<div class="topic-metadata">

**Author:** [@vodka\_pivo](https://discuss.elastic.co/u/vodka_pivo)\
**Replies:** 2\
**Last updated:** [October 12, 2020, 7:47am UTC](https://discuss.elastic.co/t/elasticsearch-change-primary-shards-number/251716 "2020-10-12T07:47:58Z")

</div>

Hello! i have 3 node elasticsearch cluster and i have index with 1 primary and 1 replica shards so i want to change the primary shard number from 1 to 2 using this method Split index API | Elasticsearch Guide \[7.9\] | E…

---

## [Elastic Search Node deleted](https://discuss.elastic.co/t/elastic-search-node-deleted/251707)

<div class="topic-metadata">

**Author:** [@prakash1243](https://discuss.elastic.co/u/prakash1243)\
**Replies:** 1\
**Last updated:** [October 12, 2020, 6:27am UTC](https://discuss.elastic.co/t/elastic-search-node-deleted/251707 "2020-10-12T06:27:24Z")

</div>

We had an unfortunate incident that one of the node (ubuntu server) has corrupted and couldn't recover the data on the node. We also had single shards with no replicas. Now the Cluster is still in Red color. What would t…

---

## [GeoPoint in Java not mapping geo\_point](https://discuss.elastic.co/t/geopoint-in-java-not-mapping-geo-point/251682)

<div class="topic-metadata">

**Author:** [@aatif26](https://discuss.elastic.co/u/aatif26)\
**Replies:** 5\
**Last updated:** [October 12, 2020, 5:58am UTC](https://discuss.elastic.co/t/geopoint-in-java-not-mapping-geo-point/251682 "2020-10-12T05:58:04Z")

</div>

I am using ElasticSearch and JAVA REST High Level Client v7.9 Following is my agent class public class Agent { private GeoPoint location; private long timestamp; private long available; public Agent(G…

---

## [Complex regexp](https://discuss.elastic.co/t/complex-regexp/251673)

<div class="topic-metadata">

**Author:** [@sphawk](https://discuss.elastic.co/u/sphawk)\
**Replies:** 6\
**Last updated:** [October 12, 2020, 4:17am UTC](https://discuss.elastic.co/t/complex-regexp/251673 "2020-10-12T04:17:44Z")

</div>

hello everybody, i'm new in elasticsearch and i'm creating an internal search engine for my company. i'm try to make a query that must returns only files contained in some paths. here is my PHP code: $params\['body'\]\[…

---

## [Response of asynchronous bulk request when a node dies](https://discuss.elastic.co/t/response-of-asynchronous-bulk-request-when-a-node-dies/251422)

<div class="topic-metadata">

**Author:** [@harisk](https://discuss.elastic.co/u/harisk)\
**Replies:** 3\
**Last updated:** [October 12, 2020, 3:32am UTC](https://discuss.elastic.co/t/response-of-asynchronous-bulk-request-when-a-node-dies/251422 "2020-10-12T03:32:07Z")

</div>

I have trouble with the response of asynchronous bulk request when a node dies. For example, I run 1 master node, 2 data nodes, and 2 client nodes (coordinating nodes). I test on the index with 2 primary shards without…

---

## [How to Validate elasticsearch queries](https://discuss.elastic.co/t/how-to-validate-elasticsearch-queries/251672)

<div class="topic-metadata">

**Author:** [@dipack-v](https://discuss.elastic.co/u/dipack-v)\
**Replies:** 2\
**Last updated:** [October 12, 2020, 1:30am UTC](https://discuss.elastic.co/t/how-to-validate-elasticsearch-queries/251672 "2020-10-12T01:30:37Z")

</div>

Hi, Is there any way to validate the queries created with QueryBuilders, For instance if we are using RDBMS, we can Embedded lightweight db to test the data layer. Is there anything similar in elasticsearch ?

---

## [Curl against an encrypted Elasticsearch instance with certificate verification](https://discuss.elastic.co/t/curl-against-an-encrypted-elasticsearch-instance-with-certificate-verification/251503)

<div class="topic-metadata">

**Author:** [@Fabio-sama](https://discuss.elastic.co/u/Fabio-sama)\
**Replies:** 1\
**Last updated:** [October 11, 2020, 11:27am UTC](https://discuss.elastic.co/t/curl-against-an-encrypted-elasticsearch-instance-with-certificate-verification/251503 "2020-10-11T11:27:10Z")

</div>

Hi there! SHORT QUESTION: How can I make a curl request to a local ES cluster (3 nodes running on localhost) in the form of curl -XGET "https://localhost:9200" -u elastic --cacert elasticsearch-ca.pem, verifying the ce…

---

## [Want to fetch last one day filebeat data as CSV format and to store into S3](https://discuss.elastic.co/t/want-to-fetch-last-one-day-filebeat-data-as-csv-format-and-to-store-into-s3/251675)

<div class="topic-metadata">

**Author:** [@Ayush\_Agrahari](https://discuss.elastic.co/u/Ayush_Agrahari)\
**Replies:** 0\
**Last updated:** [October 11, 2020, 10:38am UTC](https://discuss.elastic.co/t/want-to-fetch-last-one-day-filebeat-data-as-csv-format-and-to-store-into-s3/251675 "2020-10-11T10:38:59Z")

</div>

We have filebeat running (filebeat -\> logstash -\> Elasticsearch \<- kafka) in ELK Setup. We are looking for some mechanism which store last 1 day data of filebeat-\* index as CSV format into S3 as night cron job. Is there…

---

## [Logging Queries in Elasticsearch 7.x](https://discuss.elastic.co/t/logging-queries-in-elasticsearch-7-x/251591)

<div class="topic-metadata">

**Author:** [@Michael\_Woodham](https://discuss.elastic.co/u/Michael_Woodham)\
**Replies:** 1\
**Last updated:** [October 11, 2020, 7:40am UTC](https://discuss.elastic.co/t/logging-queries-in-elasticsearch-7-x/251591 "2020-10-11T07:40:39Z")

</div>

Is there an option to log queries made to Elasticsearch. I see that there was a slowlog option in elasticsearch 5 to log these by setting the thresholds to 1ms, but this appears to be gone in elasticsearch 7.x I am curr…

---

## [Too many vCPUs for the underlying hardware?](https://discuss.elastic.co/t/too-many-vcpus-for-the-underlying-hardware/251620)

<div class="topic-metadata">

**Author:** [@djh47](https://discuss.elastic.co/u/djh47)\
**Replies:** 1\
**Last updated:** [October 11, 2020, 12:58am UTC](https://discuss.elastic.co/t/too-many-vcpus-for-the-underlying-hardware/251620 "2020-10-11T00:58:47Z")

</div>

I have a 64-core dedicated machine which in order to use, I must allocate a virtualized instance. I have the option to virtualize with anything from 1 to 240 vCPUs. Perhaps naively, I decide to allocate the maximum of 2…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=787)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=789)
