# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=748

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 749

---

## [ILM not deleting indices in data\_stream](https://discuss.elastic.co/t/ilm-not-deleting-indices-in-data-stream/257811)

<div class="topic-metadata">

**Author:** [@Zerobot](https://discuss.elastic.co/u/Zerobot)\
**Replies:** 1\
**Last updated:** [December 7, 2020, 5:50pm UTC](https://discuss.elastic.co/t/ilm-not-deleting-indices-in-data-stream/257811 "2020-12-07T17:50:44Z")

</div>

Hello! So I've been checking out new features of ELK stack - created a template for data stream and connected a basic ILM policy to it. ILM policy is basically: { "policy": { "phases": { "hot": { …

---

## [The Elasticsearch server could not be reached. Further data is therefore unavailable](https://discuss.elastic.co/t/the-elasticsearch-server-could-not-be-reached-further-data-is-therefore-unavailable/257701)

<div class="topic-metadata">

**Author:** [@webapps](https://discuss.elastic.co/u/webapps)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 3:28pm UTC](https://discuss.elastic.co/t/the-elasticsearch-server-could-not-be-reached-further-data-is-therefore-unavailable/257701 "2020-12-07T15:28:11Z")

</div>

Hey, I'm trying to setup the Elasticsearch server in the search-api drupal 8. But I'm getting the above message when I save the server. In parallel with that I accessed the Elasticsearch server URI in the postman, but …

---

## [Mapping the query to the highlight using FVH](https://discuss.elastic.co/t/mapping-the-query-to-the-highlight-using-fvh/257836)

<div class="topic-metadata">

**Author:** [@jackhodkinson](https://discuss.elastic.co/u/jackhodkinson)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 2:35pm UTC](https://discuss.elastic.co/t/mapping-the-query-to-the-highlight-using-fvh/257836 "2020-12-07T14:35:03Z")

</div>

The highlighters are great because they help you figure out why your query matched a document. Unfortunately when they are used in conjuncture with any kind of analyzer that stems the words in the query, it is difficult …

---

## [Help: Create multi metric machine learning job](https://discuss.elastic.co/t/help-create-multi-metric-machine-learning-job/257670)

<div class="topic-metadata">

**Author:** [@Abdelhalim](https://discuss.elastic.co/u/Abdelhalim)\
**Replies:** 4\
**Last updated:** [December 7, 2020, 2:29pm UTC](https://discuss.elastic.co/t/help-create-multi-metric-machine-learning-job/257670 "2020-12-07T14:29:46Z")

</div>

Hello everybody, I need help to create a multi metric job. The idea is that I want to detect users that connect from different countries, for example if a user used to connect from Germany, if one day he connects from …

---

## [Elastic plugin with pyton/spaCy](https://discuss.elastic.co/t/elastic-plugin-with-pyton-spacy/257852)

<div class="topic-metadata">

**Author:** [@Alder](https://discuss.elastic.co/u/Alder)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 1:53pm UTC](https://discuss.elastic.co/t/elastic-plugin-with-pyton-spacy/257852 "2020-12-07T13:53:46Z")

</div>

Hello everyone at Elastic. With the help of this forum I developed an ingest pipline plugin with opennlp to process NER (named entity recognition). Now I'm doing tests with python/spaCy. Is it possible to write a pyth…

---

## [Disable replica shard on cold data node?](https://discuss.elastic.co/t/disable-replica-shard-on-cold-data-node/257844)

<div class="topic-metadata">

**Author:** [@diecode](https://discuss.elastic.co/u/diecode)\
**Replies:** 1\
**Last updated:** [December 7, 2020, 1:42pm UTC](https://discuss.elastic.co/t/disable-replica-shard-on-cold-data-node/257844 "2020-12-07T13:42:38Z")

</div>

Hey, I have 3 elasticsearch nodes (2 hot and 1 cold\_data at the moment). I receive logs from logstash and store them in hot nodes. I would like move "old" logs with ILM to cold\_data nodes, but when I start cold\_data nod…

---

## [How to set up looging level in Elasticsearch](https://discuss.elastic.co/t/how-to-set-up-looging-level-in-elasticsearch/257843)

<div class="topic-metadata">

**Author:** [@grynhtjnyuk](https://discuss.elastic.co/u/grynhtjnyuk)\
**Replies:** 3\
**Last updated:** [December 7, 2020, 1:25pm UTC](https://discuss.elastic.co/t/how-to-set-up-looging-level-in-elasticsearch/257843 "2020-12-07T13:25:15Z")

</div>

hi, could you tell me how to set up explicitly logging level in Elasticsearch as INFO? I would like to do that in the file: elasticsearch. yaml

---

## [Elasticsearch: Encrypting HTTP client communications - AccessControlException](https://discuss.elastic.co/t/elasticsearch-encrypting-http-client-communications-accesscontrolexception/257049)

<div class="topic-metadata">

**Author:** [@Jurilz](https://discuss.elastic.co/u/Jurilz)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 12:46pm UTC](https://discuss.elastic.co/t/elasticsearch-encrypting-http-client-communications-accesscontrolexception/257049 "2020-12-07T12:46:18Z")

</div>

Good day, I'm trying to set up Encrypting HTTP client communications and followed 'https://www.elastic.co/guide/en/elasticsearch/reference/7.10/configuring-tls.html#tls-http': My Elasticsearch Docker Container failes w…

---

## [non-AWS S3 snapshot repository on Elastic Cloud](https://discuss.elastic.co/t/non-aws-s3-snapshot-repository-on-elastic-cloud/257833)

<div class="topic-metadata">

**Author:** [@yoannma](https://discuss.elastic.co/u/yoannma)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 11:49am UTC](https://discuss.elastic.co/t/non-aws-s3-snapshot-repository-on-elastic-cloud/257833 "2020-12-07T11:49:00Z")

</div>

Hello, I am trying to set up a S3 snapshot repository on my Elastic Cloud cluster using an S3 service from Scaleway. Following the documentation https://www.elastic.co/guide/en/elasticsearch/plugins/7.10/repository-s3-…

---

## [Elasticsearch service fails in my machine](https://discuss.elastic.co/t/elasticsearch-service-fails-in-my-machine/257029)

<div class="topic-metadata">

**Author:** [@Sandeep\_Raju](https://discuss.elastic.co/u/Sandeep_Raju)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 10:31am UTC](https://discuss.elastic.co/t/elasticsearch-service-fails-in-my-machine/257029 "2020-12-07T10:31:59Z")

</div>

Hi all, Kibana is active in my system. Elasticsearch was also running fine. But i wanted it to start on boot and i made some changes in java files. I made some changes in jvm files,but don't remember. Now elasticsea…

---

## [Search using floating point](https://discuss.elastic.co/t/search-using-floating-point/257826)

<div class="topic-metadata">

**Author:** [@jkanti](https://discuss.elastic.co/u/jkanti)\
**Replies:** 0\
**Last updated:** [December 7, 2020, 9:54am UTC](https://discuss.elastic.co/t/search-using-floating-point/257826 "2020-12-07T09:54:40Z")

</div>

I am new to Kibana. I am doing some search in 'Discover' and plotting them in 'Visualize'. For a task I need to filter out a field which is floating point. However, when I search using the floating point in discover, kib…

---

## [Elasticsearch can not be started by service](https://discuss.elastic.co/t/elasticsearch-can-not-be-started-by-service/257773)

<div class="topic-metadata">

**Author:** [@mkkang66](https://discuss.elastic.co/u/mkkang66)\
**Replies:** 4\
**Last updated:** [December 7, 2020, 9:52am UTC](https://discuss.elastic.co/t/elasticsearch-can-not-be-started-by-service/257773 "2020-12-07T09:52:07Z")

</div>

I installed an elasticsearch 7.10.0 by tar.gz archives because my network is a closed network. I can run it as a deamon with ' ../bin/elasticsearch -d -p es.pid' but systemctl command can not be run. The followings are …

---

## [Adding two nodes not displaying the number of nodes as 2](https://discuss.elastic.co/t/adding-two-nodes-not-displaying-the-number-of-nodes-as-2/257738)

<div class="topic-metadata">

**Author:** [@Shilpa\_S\_Shetty](https://discuss.elastic.co/u/Shilpa_S_Shetty)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 8:02am UTC](https://discuss.elastic.co/t/adding-two-nodes-not-displaying-the-number-of-nodes-as-2/257738 "2020-12-07T08:02:38Z")

</div>

Hi Team, Here is my task wherein add new node to exisiting es cluster. Followed below steps ;; Add instance where in es\_java\_heap\_size\_gb: 20 Added es and restarted .PFA text file for elasticsearch.yml When I run ch…

---

## [How to search for values from JSON formatted content?](https://discuss.elastic.co/t/how-to-search-for-values-from-json-formatted-content/257809)

<div class="topic-metadata">

**Author:** [@wajika](https://discuss.elastic.co/u/wajika)\
**Replies:** 0\
**Last updated:** [December 7, 2020, 7:33am UTC](https://discuss.elastic.co/t/how-to-search-for-values-from-json-formatted-content/257809 "2020-12-07T07:33:26Z")

</div>

There is such a field in my data. I want to search for a string, such as '1612011230036'. How can I search ? { "\_source": { "http": { "request": { "body": { "original": "{\\"productSN\\":\\"1612011230036\\",…

---

## [Error in logs of master and data-ingest nodes](https://discuss.elastic.co/t/error-in-logs-of-master-and-data-ingest-nodes/257777)

<div class="topic-metadata">

**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\
**Replies:** 5\
**Last updated:** [December 7, 2020, 6:06am UTC](https://discuss.elastic.co/t/error-in-logs-of-master-and-data-ingest-nodes/257777 "2020-12-07T06:06:17Z")

</div>

I deployed Elasticsearch cluster in GCP. Using ECK: 1.3.0 and elasticsearch and kibana as 7.9.0. All pods are running fine. But when I checked the logs of data-ingest and master nodes. I can see below error. {"type": …

---

## [Unable to flow kuberbenetes logs to elasticsearch](https://discuss.elastic.co/t/unable-to-flow-kuberbenetes-logs-to-elasticsearch/253459)

<div class="topic-metadata">

**Author:** [@arunreddy00](https://discuss.elastic.co/u/arunreddy00)\
**Replies:** 13\
**Last updated:** [December 7, 2020, 5:51am UTC](https://discuss.elastic.co/t/unable-to-flow-kuberbenetes-logs-to-elasticsearch/253459 "2020-12-07T05:51:56Z")

</div>

Hello Elastic, Really need your help struggling to get logs to ElasticSearch Created EKS cluster in AWS with two nodes Later integrated VPN (site to site connection) from EKS cluster's VPC to connect to Office network…

---

## [Elastic Search Load Testing with Java Client](https://discuss.elastic.co/t/elastic-search-load-testing-with-java-client/257796)

<div class="topic-metadata">

**Author:** [@vasimsaiyad2000](https://discuss.elastic.co/u/vasimsaiyad2000)\
**Replies:** 3\
**Last updated:** [December 7, 2020, 5:45am UTC](https://discuss.elastic.co/t/elastic-search-load-testing-with-java-client/257796 "2020-12-07T05:45:40Z")

</div>

Hi, I have used elastic search 7.X to index my database data. I have writtend geo spatial query using Java High Rest client to search from elastic search. The Java client works fine with fewer request but When I perfor…

---

## [Elasticsearch Basic Authentication](https://discuss.elastic.co/t/elasticsearch-basic-authentication/257792)

<div class="topic-metadata">

**Author:** [@ravi\_ch](https://discuss.elastic.co/u/ravi_ch)\
**Replies:** 1\
**Last updated:** [December 7, 2020, 4:47am UTC](https://discuss.elastic.co/t/elasticsearch-basic-authentication/257792 "2020-12-07T04:47:09Z")

</div>

I have installed Elasticsearch via helm chart unable to enable basic authentication. Need help with that.

---

## [ES Thread pool how to update](https://discuss.elastic.co/t/es-thread-pool-how-to-update/257779)

<div class="topic-metadata">

**Author:** [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\
**Replies:** 3\
**Last updated:** [December 7, 2020, 4:33am UTC](https://discuss.elastic.co/t/es-thread-pool-how-to-update/257779 "2020-12-07T04:33:54Z")

</div>

How to udpate the thread pool size for elasticsearch in elastic cloud4 { "persistent" : { "thread\_pool.write.queue\_size" : 1000 } } Above Put call is resulting in a failure { "error": { "ro…

---

## [Update partial fields leads to other fields missing that are excluded in the \_source](https://discuss.elastic.co/t/update-partial-fields-leads-to-other-fields-missing-that-are-excluded-in-the-source/257790)

<div class="topic-metadata">

**Author:** [@chemboking](https://discuss.elastic.co/u/chemboking)\
**Replies:** 1\
**Last updated:** [December 7, 2020, 3:10am UTC](https://discuss.elastic.co/t/update-partial-fields-leads-to-other-fields-missing-that-are-excluded-in-the-source/257790 "2020-12-07T03:10:55Z")

</div>

For example, i have a mapping as followed: { "mappings": { "\_source": { "includes": \[ "gender" \] }, "properties": { "…

---

## [Able to list system indices in elasticsearch 7.9.0](https://discuss.elastic.co/t/able-to-list-system-indices-in-elasticsearch-7-9-0/257479)

<div class="topic-metadata">

**Author:** [@knagasri](https://discuss.elastic.co/u/knagasri)\
**Replies:** 8\
**Last updated:** [December 7, 2020, 2:45am UTC](https://discuss.elastic.co/t/able-to-list-system-indices-in-elasticsearch-7-9-0/257479 "2020-12-07T02:45:49Z")

</div>

I deployed elasticsearch cluster with operator 1.3.0 and es version: 7.9.0. When I am trying to list the indices, not able to see any system indices. Attaching the screenshot Able to see only created indices. Is that…

---

## [ES 1.4 google cloud storage plugin](https://discuss.elastic.co/t/es-1-4-google-cloud-storage-plugin/257627)

<div class="topic-metadata">

**Author:** [@Adithya\_S](https://discuss.elastic.co/u/Adithya_S)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 2:31am UTC](https://discuss.elastic.co/t/es-1-4-google-cloud-storage-plugin/257627 "2020-12-07T02:31:16Z")

</div>

Hi, We have a few ES v1.4 clusters for which we need to setup snapshots to Google's cloud storage. Could anyone please point me to the plugin which would allow me to do this on ES v1 clusters? TIA

---

## [Error after upgrading to 7.10](https://discuss.elastic.co/t/error-after-upgrading-to-7-10/257741)

<div class="topic-metadata">

**Author:** [@wpearson4](https://discuss.elastic.co/u/wpearson4)\
**Replies:** 1\
**Last updated:** [December 7, 2020, 2:18am UTC](https://discuss.elastic.co/t/error-after-upgrading-to-7-10/257741 "2020-12-07T02:18:17Z")

</div>

I recently upgraded my Elastic infrastructure from 7.9 - 7.10. My nodes will not start and are failing with the following message: monitoring execution failed org.elasticsearch.xpack.monitoring.exporter.ExportException…

---

## [How to add basic user/pass authentication to elastic.yaml](https://discuss.elastic.co/t/how-to-add-basic-user-pass-authentication-to-elastic-yaml/257662)

<div class="topic-metadata">

**Author:** [@yattaes](https://discuss.elastic.co/u/yattaes)\
**Replies:** 2\
**Last updated:** [December 7, 2020, 1:07am UTC](https://discuss.elastic.co/t/how-to-add-basic-user-pass-authentication-to-elastic-yaml/257662 "2020-12-07T01:07:03Z")

</div>

Hi, I am using the yaml file below to deploy ElasticSearch to Azure Kubernetes. I can reach the Elasticsearch with port forwarding "localhost:9200" without authentication. How can I add a basic user/pass authenticatio…

---

## [Finding size of total documents in an index](https://discuss.elastic.co/t/finding-size-of-total-documents-in-an-index/257776)

<div class="topic-metadata">

**Author:** [@usamaahmadkhan](https://discuss.elastic.co/u/usamaahmadkhan)\
**Replies:** 3\
**Last updated:** [December 6, 2020, 9:29pm UTC](https://discuss.elastic.co/t/finding-size-of-total-documents-in-an-index/257776 "2020-12-06T21:29:15Z")

</div>

Hi, I want to find the sum of the sizes of all the documents containing a specific field. e.g. for an index .index-dec-6-2020 I want to get the sum of the size of all the documents containing the filed delay: 5 Can s…

---

## [Python3 query with large results, best approach](https://discuss.elastic.co/t/python3-query-with-large-results-best-approach/257402)

<div class="topic-metadata">

**Author:** [@stcdarrell](https://discuss.elastic.co/u/stcdarrell)\
**Replies:** 10\
**Last updated:** [December 6, 2020, 7:01pm UTC](https://discuss.elastic.co/t/python3-query-with-large-results-best-approach/257402 "2020-12-06T19:01:45Z")

</div>

hi, i'm throwing a huge amount of log data into ES each month. i'm trying to create a python script to build a report at the end of the month. my first query i need to make is to query the index and get all the unique …

---

## [Elasticsearch on AWS + raspberry pi](https://discuss.elastic.co/t/elasticsearch-on-aws-raspberry-pi/257485)

<div class="topic-metadata">

**Author:** [@Ettore\_Ciarcia](https://discuss.elastic.co/u/Ettore_Ciarcia)\
**Replies:** 9\
**Last updated:** [December 6, 2020, 5:26pm UTC](https://discuss.elastic.co/t/elasticsearch-on-aws-raspberry-pi/257485 "2020-12-06T17:26:24Z")

</div>

Hello everyone. I intend to send the weather data collected by a raspberry pie on ec2 instances hosting elasticsearch to view the temperature graphs on kibana. My idea is to make a comparison between the internal temper…

---

## [Issue when indexing booleans to elastic](https://discuss.elastic.co/t/issue-when-indexing-booleans-to-elastic/256634)

<div class="topic-metadata">

**Author:** [@mariskaas](https://discuss.elastic.co/u/mariskaas)\
**Replies:** 1\
**Last updated:** [December 6, 2020, 4:08pm UTC](https://discuss.elastic.co/t/issue-when-indexing-booleans-to-elastic/256634 "2020-12-06T16:08:24Z")

</div>

Hi there, I've been having a problem regarding getting data in elastic as a boolean. I have gotten it to work only when using logstash, and explicitly converting fields to boolean both in logstash and in a created mapp…

---

## [Specifying IndicesOptions in Java Rest API call](https://discuss.elastic.co/t/specifying-indicesoptions-in-java-rest-api-call/257782)

<div class="topic-metadata">

**Author:** [@amishar](https://discuss.elastic.co/u/amishar)\
**Replies:** 0\
**Last updated:** [December 6, 2020, 3:59pm UTC](https://discuss.elastic.co/t/specifying-indicesoptions-in-java-rest-api-call/257782 "2020-12-06T15:59:07Z")

</div>

Is there a way to specify IndicesOptions when making a rest api call through low level rest client in Elasticsearch 6.8(I see this option in ES7 docs)? We are migrating from transport client to rest client and we were ab…

---

## [How to get the number of routing shards for an index](https://discuss.elastic.co/t/how-to-get-the-number-of-routing-shards-for-an-index/257634)

<div class="topic-metadata">

**Author:** [@Chelambarasan\_CR](https://discuss.elastic.co/u/Chelambarasan_CR)\
**Replies:** 1\
**Last updated:** [December 6, 2020, 3:13pm UTC](https://discuss.elastic.co/t/how-to-get-the-number-of-routing-shards-for-an-index/257634 "2020-12-06T15:13:48Z")

</div>

ES version: 7.6.1 I have mentioned the number of routing shards while index creation as below PUT my\_source\_index { "settings": { "index.number\_of\_shards" : 9, "index.number\_of\_routi…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=747)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=749)
