# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=968

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 969

---

## [Restore snapshots on a different environment](https://discuss.elastic.co/t/restore-snapshots-on-a-different-environment/225325)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 12\
**Last updated:** [April 2, 2020, 10:09pm UTC](https://discuss.elastic.co/t/restore-snapshots-on-a-different-environment/225325 "2020-04-02T22:09:11Z")

</div>

Hey All, I want to take a snapshot and restore on a different environment. What are the steps I should follow? I already created the snapshots on the original environment. I have multiple files created on each node (…

---

## [Copy index fields from one ES to another](https://discuss.elastic.co/t/copy-index-fields-from-one-es-to-another/225954)

<div class="topic-metadata">

**Author:** [@cyberzlo](https://discuss.elastic.co/u/cyberzlo)\
**Replies:** 9\
**Last updated:** [April 2, 2020, 9:01pm UTC](https://discuss.elastic.co/t/copy-index-fields-from-one-es-to-another/225954 "2020-04-02T21:01:43Z")

</div>

How can I download index "Fields" frome one ES and upload it to another? I would like not to direct copy between instances, but store it as some config to use in many ES which don't have connection between another insta…

---

## [Geo Distance Query and OR Syntax?](https://discuss.elastic.co/t/geo-distance-query-and-or-syntax/226282)

<div class="topic-metadata">

**Author:** [@west415](https://discuss.elastic.co/u/west415)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 8:37pm UTC](https://discuss.elastic.co/t/geo-distance-query-and-or-syntax/226282 "2020-04-02T20:37:33Z")

</div>

I am using Elasticsearch 7.6 and trying to run a query that runs a geo\_distance query to find matching documents within an exact city OR within a distance range of 25 miles in this case. In layman's terms, it would be "…

---

## [Elasticsearch clustering and storage issues](https://discuss.elastic.co/t/elasticsearch-clustering-and-storage-issues/226216)

<div class="topic-metadata">

**Author:** [@snambu5878](https://discuss.elastic.co/u/snambu5878)\
**Replies:** 4\
**Last updated:** [April 2, 2020, 6:17pm UTC](https://discuss.elastic.co/t/elasticsearch-clustering-and-storage-issues/226216 "2020-04-02T18:17:23Z")

</div>

Hi Everyone, We are doing a POC to analyse and visualize 64 million records (175 colomns) of data on a 3 node cluster. Below are the settings: Each node capacity: CPU: 10 cores; RAM: 64Gig; Storage: 150GB I am using l…

---

## [How to set default pipeline even for indices that don't exist yet](https://discuss.elastic.co/t/how-to-set-default-pipeline-even-for-indices-that-dont-exist-yet/226249)

<div class="topic-metadata">

**Author:** [@Goishin](https://discuss.elastic.co/u/Goishin)\
**Replies:** 2\
**Last updated:** [April 2, 2020, 6:12pm UTC](https://discuss.elastic.co/t/how-to-set-default-pipeline-even-for-indices-that-dont-exist-yet/226249 "2020-04-02T18:12:33Z")

</div>

Hi all, I'm using ElasticSearch in AWS. It's the default cluster type that you get for free. It is almost entirely managed automatically. My logs go to cloudwatch, and then a lambda streams my log data into ES. I don't …

---

## [Distinct values of a field](https://discuss.elastic.co/t/distinct-values-of-a-field/226264)

<div class="topic-metadata">

**Author:** [@liorg2](https://discuss.elastic.co/u/liorg2)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 5:55pm UTC](https://discuss.elastic.co/t/distinct-values-of-a-field/226264 "2020-04-02T17:55:20Z")

</div>

is there a way to get a list of distinct values of a field except the term aggregation? I'm referring to a use case when I don't need the doc\_count, but only list of values (I assume that calculating the doc\_count requi…

---

## [Curator: action allocated not working](https://discuss.elastic.co/t/curator-action-allocated-not-working/226017)

<div class="topic-metadata">

**Author:** [@Dmytro\_Kolodiaziev](https://discuss.elastic.co/u/Dmytro_Kolodiaziev)\
**Replies:** 10\
**Last updated:** [April 2, 2020, 5:24pm UTC](https://discuss.elastic.co/t/curator-action-allocated-not-working/226017 "2020-04-02T17:24:48Z")

</div>

Hi, I have problems with a curator, when I try to allocate my indices with a curator from hot to spinning, I have message "allocation" completed." but, indices didn't move to a different server My infrastructure: elast…

---

## [UAX URL Email Tokenizer not working](https://discuss.elastic.co/t/uax-url-email-tokenizer-not-working/226239)

<div class="topic-metadata">

**Author:** [@Jose\_Salgodo](https://discuss.elastic.co/u/Jose_Salgodo)\
**Replies:** 2\
**Last updated:** [April 2, 2020, 5:08pm UTC](https://discuss.elastic.co/t/uax-url-email-tokenizer-not-working/226239 "2020-04-02T17:08:13Z")

</div>

for some reason when i have the UAX URL Email tokenizer and then i had my lower case analyzer the UAX URL Email tokenizer just stops working "settings": { "analysis": { "ana…

---

## [How to enrich/auto-generate fields before index?](https://discuss.elastic.co/t/how-to-enrich-auto-generate-fields-before-index/226252)

<div class="topic-metadata">

**Author:** [@redec](https://discuss.elastic.co/u/redec)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 4:47pm UTC](https://discuss.elastic.co/t/how-to-enrich-auto-generate-fields-before-index/226252 "2020-04-02T16:47:28Z")

</div>

I'm fairly new to elasticsearch, so apologies if this is a dumb question...Is there a way to automatically generate a field based on other fields, prior to the document being indexed? I would like to generate a string b…

---

## [Elastisearch deployment through boshreleases is failing](https://discuss.elastic.co/t/elastisearch-deployment-through-boshreleases-is-failing/226248)

<div class="topic-metadata">

**Author:** [@nirish](https://discuss.elastic.co/u/nirish)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 4:05pm UTC](https://discuss.elastic.co/t/elastisearch-deployment-through-boshreleases-is-failing/226248 "2020-04-02T16:05:33Z")

</div>

I am currently deploying elasticsearch(logsearch) using bosh-releases I am using logsearch boshrelease v 208.0.0. This deployment creates folowing instances in AWS elasticsearch\_data/1 kibana/0 ingestor/0 elasticsear…

---

## [Moving from 6.7 to 7.0 & Doc Type Confusion](https://discuss.elastic.co/t/moving-from-6-7-to-7-0-doc-type-confusion/226229)

<div class="topic-metadata">

**Author:** [@kurtiskurtis](https://discuss.elastic.co/u/kurtiskurtis)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 2:24pm UTC](https://discuss.elastic.co/t/moving-from-6-7-to-7-0-doc-type-confusion/226229 "2020-04-02T14:24:12Z")

</div>

Hello, I am looking to upgrade my cluster from 6.7 to 7.0 I have ~200 indexes each with a doc type associated to it. /index\_name/document\_name /index\_name2/doctument\_name2. .... What happens to these document types …

---

## [Elasticseach backup Sanpshot retension policy](https://discuss.elastic.co/t/elasticseach-backup-sanpshot-retension-policy/226158)

<div class="topic-metadata">

**Author:** [@harish\_KR](https://discuss.elastic.co/u/harish_KR)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 2:17pm UTC](https://discuss.elastic.co/t/elasticseach-backup-sanpshot-retension-policy/226158 "2020-04-02T14:17:07Z")

</div>

Hi How can we set a grooming policy for elastic backup snapshots? We are storing backup snapshots on Azure Blob, but its size keeps growing. Do let us know way to handle the grooming of snapshots based on dates.

---

## [FSCrawler-Unable to parse response body for Response](https://discuss.elastic.co/t/fscrawler-unable-to-parse-response-body-for-response/226212)

<div class="topic-metadata">

**Author:** [@Sarath\_Pullabhotla](https://discuss.elastic.co/u/Sarath_Pullabhotla)\
**Replies:** 5\
**Last updated:** [April 2, 2020, 2:16pm UTC](https://discuss.elastic.co/t/fscrawler-unable-to-parse-response-body-for-response/226212 "2020-04-02T14:16:24Z")

</div>

My Elastic search (7.4.2) is running on docker container on port 9201 and I am trying to start fscrawler on the same, but its resulting in the below issue. $ bin/fscrawler conf\_test --debug=true 07:20:53,773 WARN…

---

## [How to set elasticsearch user "elastic" password in Dockerfile](https://discuss.elastic.co/t/how-to-set-elasticsearch-user-elastic-password-in-dockerfile/226206)

<div class="topic-metadata">

**Author:** [@Raushan](https://discuss.elastic.co/u/Raushan)\
**Replies:** 3\
**Last updated:** [April 2, 2020, 1:42pm UTC](https://discuss.elastic.co/t/how-to-set-elasticsearch-user-elastic-password-in-dockerfile/226206 "2020-04-02T13:42:54Z")

</div>

Hi, I am using Dockerfile for elasticsearch containerization where i am using elasticsearch.yml file to copy in /usr/share/elasticsearch/config/. How can i set user and password for the user elastic?

---

## [Best method to free up disk](https://discuss.elastic.co/t/best-method-to-free-up-disk/226169)

<div class="topic-metadata">

**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\
**Replies:** 5\
**Last updated:** [April 2, 2020, 1:41pm UTC](https://discuss.elastic.co/t/best-method-to-free-up-disk/226169 "2020-04-02T13:41:14Z")

</div>

Hello, I have 1 index per day. I would like to delete all data that is more than a month old for reasons of disk space. What is the best method for this:

---

## ["\[match\_phrase\] query doesn't support multiple fields](https://discuss.elastic.co/t/match-phrase-query-doesnt-support-multiple-fields/226175)

<div class="topic-metadata">

**Author:** [@Raady\_s](https://discuss.elastic.co/u/Raady_s)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 1:07pm UTC](https://discuss.elastic.co/t/match-phrase-query-doesnt-support-multiple-fields/226175 "2020-04-02T13:07:52Z")

</div>

I have profiles which have fields ListExperience and derived(some have missing derived). I am making query in the elasticsearch so that it matches my title in ListExperience.Title and exists some values in derived.soc e…

---

## [How to use NOW/d in elasticsearch search query](https://discuss.elastic.co/t/how-to-use-now-d-in-elasticsearch-search-query/226176)

<div class="topic-metadata">

**Author:** [@Sridhar](https://discuss.elastic.co/u/Sridhar)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 1:05pm UTC](https://discuss.elastic.co/t/how-to-use-now-d-in-elasticsearch-search-query/226176 "2020-04-02T13:05:57Z")

</div>

Dear all, I'm trying to get today's data based on the keywords. here in below code, I have hardcoded the timestamp.. but I want to fetch the data for entier today. please help. GET indicesname/\_search { "query": { …

---

## [Authenticate Elasticsearch from spring boot](https://discuss.elastic.co/t/authenticate-elasticsearch-from-spring-boot/226196)

<div class="topic-metadata">

**Author:** [@AshishUser](https://discuss.elastic.co/u/AshishUser)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 1:00pm UTC](https://discuss.elastic.co/t/authenticate-elasticsearch-from-spring-boot/226196 "2020-04-02T13:00:58Z")

</div>

I have setup open distro version 1.4, ES version 7.4 with LDAP authentication and authorization and it is working perfectly fine. Kibana/logstash able to connect to my elasticsearch using ldap service account (which has…

---

## [Secure user for Beats (lowest privileges as possible)](https://discuss.elastic.co/t/secure-user-for-beats-lowest-privileges-as-possible/226215)

<div class="topic-metadata">

**Author:** [@gerard1](https://discuss.elastic.co/u/gerard1)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 12:54pm UTC](https://discuss.elastic.co/t/secure-user-for-beats-lowest-privileges-as-possible/226215 "2020-04-02T12:54:07Z")

</div>

By default, following the Elastic guide for Elastic Cloud, Filebeat uses the elastic account, which is high privileged account. If one of the servers where Filebeat is located gets compromised, attackers would be able to…

---

## [Reindexing docs to new index using alias name with "is\_write\_index" clause (without reindex API)](https://discuss.elastic.co/t/reindexing-docs-to-new-index-using-alias-name-with-is-write-index-clause-without-reindex-api/225870)

<div class="topic-metadata">

**Author:** [@raulk89](https://discuss.elastic.co/u/raulk89)\
**Replies:** 2\
**Last updated:** [April 2, 2020, 12:19pm UTC](https://discuss.elastic.co/t/reindexing-docs-to-new-index-using-alias-name-with-is-write-index-clause-without-reindex-api/225870 "2020-04-02T12:19:34Z")

</div>

Hi Elastic 6.8.7 Let's say I have single index a. Then there is for example 1 document with id: 1. (in real life there would be hundred thousands of documents of course) Then at some time, let's say we need to reinde…

---

## [Primary shard size much bigger than replica](https://discuss.elastic.co/t/primary-shard-size-much-bigger-than-replica/226202)

<div class="topic-metadata">

**Author:** [@saiergon](https://discuss.elastic.co/u/saiergon)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 11:40am UTC](https://discuss.elastic.co/t/primary-shard-size-much-bigger-than-replica/226202 "2020-04-02T11:40:34Z")

</div>

Elasticsearch version ( bin/elasticsearch --version ): 5.2.0 JVM version ( java -version ): 1.8.0\_102 the primary shard size much bigger than the replica, like below, but the documents number is same： use segment …

---

## [Tunnel between aws ec2 instances and Elasticsearch Service](https://discuss.elastic.co/t/tunnel-between-aws-ec2-instances-and-elasticsearch-service/226203)

<div class="topic-metadata">

**Author:** [@Sajeeva\_Lakmal](https://discuss.elastic.co/u/Sajeeva_Lakmal)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 11:38am UTC](https://discuss.elastic.co/t/tunnel-between-aws-ec2-instances-and-elasticsearch-service/226203 "2020-04-02T11:38:16Z")

</div>

We have an elasticsearch service deployment at elastic.co. During the creation of the deployment "AWS" was chosen as the cloud platform. We are given an endpoint URL that resolves to a public IP address. Also, we have an…

---

## [Number of results return in ES](https://discuss.elastic.co/t/number-of-results-return-in-es/226195)

<div class="topic-metadata">

**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 10:58am UTC](https://discuss.elastic.co/t/number-of-results-return-in-es/226195 "2020-04-02T10:58:37Z")

</div>

Hello, Can anyone help me in this? Is there any limitation for number of results to see in elasticsearch? Currently total 9999 results are showing in my case. But results are more than 9999 for my query. How to incr…

---

## [Failed to re-index : field cannot be changed from type \[long\] to \[double\]](https://discuss.elastic.co/t/failed-to-re-index-field-cannot-be-changed-from-type-long-to-double/226174)

<div class="topic-metadata">

**Author:** [@Yamuna\_Mallikarjun](https://discuss.elastic.co/u/Yamuna_Mallikarjun)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 8:26am UTC](https://discuss.elastic.co/t/failed-to-re-index-field-cannot-be-changed-from-type-long-to-double/226174 "2020-04-02T08:26:46Z")

</div>

I am trying to reindex from ES version 2.4.1 to ES version 6.6.0. I have some 5 indices. out of 5 one index is partially migrated. Re-index output: \`\`\` { "took" : 6207, "timed\_out" : false, "total" : 50396, "updated" …

---

## [Transport Error and ConnectionError from python](https://discuss.elastic.co/t/transport-error-and-connectionerror-from-python/226139)

<div class="topic-metadata">

**Author:** [@apremgeorge](https://discuss.elastic.co/u/apremgeorge)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 8:24am UTC](https://discuss.elastic.co/t/transport-error-and-connectionerror-from-python/226139 "2020-04-02T08:24:50Z")

</div>

Hi, I am exporting data from python to elasticsearch, using data has 3 files, file sizes are 156mb, 2mb, 157mb created an index and mapping, all files are base64 format strings, my mapping settings are and uplo…

---

## [Rolling update: from 5.6 to 6.8.5](https://discuss.elastic.co/t/rolling-update-from-5-6-to-6-8-5/226167)

<div class="topic-metadata">

**Author:** [@gmartini](https://discuss.elastic.co/u/gmartini)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 7:22am UTC](https://discuss.elastic.co/t/rolling-update-from-5-6-to-6-8-5/226167 "2020-04-02T07:22:12Z")

</div>

Hi, we've migrated our production server cluster (1 master node, 3 data node, 2TB data) from 5.6 to 6.8.5 by using the rolling-update procedure (https://www.elastic.co/guide/en/elasticsearch/reference/6.8/rolling-upgrade…

---

## [Kibana indexes](https://discuss.elastic.co/t/kibana-indexes/226154)

<div class="topic-metadata">

**Author:** [@Israel\_Calvete](https://discuss.elastic.co/u/Israel_Calvete)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 5:01am UTC](https://discuss.elastic.co/t/kibana-indexes/226154 "2020-04-02T05:01:12Z")

</div>

I'm trying figure out how backup kibana config. My first aproach is make a dump of kibana index but... I don't have a .kibana index. Instead I have.. .kibana\_1 .kibana\_2 .kibana\_task\_manager\_1 Besides, although I ca…

---

## [Send log openshift to an external ELK](https://discuss.elastic.co/t/send-log-openshift-to-an-external-elk/226160)

<div class="topic-metadata">

**Author:** [@thierrys](https://discuss.elastic.co/u/thierrys)\
**Replies:** 0\
**Last updated:** [April 2, 2020, 6:49am UTC](https://discuss.elastic.co/t/send-log-openshift-to-an-external-elk/226160 "2020-04-02T06:49:52Z")

</div>

I have an ELK 7.6.1 outside Openshift. I want to install a agent (logstash / fluentd ?) on openshift to send the logs to the external ELK. So the elk is independent from the Openshift.

---

## [Search for \[error\] in message content](https://discuss.elastic.co/t/search-for-error-in-message-content/224879)

<div class="topic-metadata">

**Author:** [@Tihomir\_Ilchev](https://discuss.elastic.co/u/Tihomir_Ilchev)\
**Replies:** 6\
**Last updated:** [April 2, 2020, 6:42am UTC](https://discuss.elastic.co/t/search-for-error-in-message-content/224879 "2020-04-02T06:42:45Z")

</div>

Hello, I am new in ELK and I am sorry if my question was already asked. I am facing issue by creating a query for displaying the messages which contain \[error\] (including the square brackets) string in the message part…

---

## [Can Rally run same test more than once, and can it save generated data for use in another run](https://discuss.elastic.co/t/can-rally-run-same-test-more-than-once-and-can-it-save-generated-data-for-use-in-another-run/226129)

<div class="topic-metadata">

**Author:** [@davidmarsh](https://discuss.elastic.co/u/davidmarsh)\
**Replies:** 1\
**Last updated:** [April 2, 2020, 6:36am UTC](https://discuss.elastic.co/t/can-rally-run-same-test-more-than-once-and-can-it-save-generated-data-for-use-in-another-run/226129 "2020-04-02T06:36:02Z")

</div>

Does Rally have an option to run the same test more than once? Can it write the generated data to disk to be used in a subsequent run? In other words could you run one race then at some later time, re-run the exact same…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=967)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=969)
