# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1249

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1250

---

## [Question about compression of field with same value for every document](https://discuss.elastic.co/t/question-about-compression-of-field-with-same-value-for-every-document/187680)

<div class="topic-metadata">

**Author:** [@sm3388](https://discuss.elastic.co/u/sm3388)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 9:09pm UTC](https://discuss.elastic.co/t/question-about-compression-of-field-with-same-value-for-every-document/187680 "2019-06-26T21:09:57Z")

</div>

I have a field that is common to all of my indices. The field always has a value that is a complex object that itself has fields on it that are string arrays: commonField: { a: \['a', 'b', 'c'\], b: \['a', 'b'\] …

---

## [Setting up a second instance of ES 6.7.2 on RHEL 6.10](https://discuss.elastic.co/t/setting-up-a-second-instance-of-es-6-7-2-on-rhel-6-10/187678)

<div class="topic-metadata">

**Author:** [@rennishj](https://discuss.elastic.co/u/rennishj)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 8:54pm UTC](https://discuss.elastic.co/t/setting-up-a-second-instance-of-es-6-7-2-on-rhel-6-10/187678 "2019-06-26T20:54:21Z")

</div>

All, I am trying to set up a second instance of ES 6.7.2 on a single node( RHEL 6.10) using the tar.gz archive file. We already have the first instance using the RPM package and is working fine. We have to set up anothe…

---

## [Trouble Handling Large Volume data - Slow Kibana Dashboard](https://discuss.elastic.co/t/trouble-handling-large-volume-data-slow-kibana-dashboard/187635)

<div class="topic-metadata">

**Author:** [@shikhar\_singh](https://discuss.elastic.co/u/shikhar_singh)\
**Replies:** 4\
**Last updated:** [June 26, 2019, 7:53pm UTC](https://discuss.elastic.co/t/trouble-handling-large-volume-data-slow-kibana-dashboard/187635 "2019-06-26T19:53:44Z")

</div>

Hello , I have an index which is giving me some trouble. The index gets somewhere around 40 GB of data per hour. I have a 3 node setup. With 32 GB of RAM on each node and 12 cores for processing. I have allocated 20GB…

---

## [Joining elasticsearch indeces](https://discuss.elastic.co/t/joining-elasticsearch-indeces/187666)

<div class="topic-metadata">

**Author:** [@Cagatay\_Atabay](https://discuss.elastic.co/u/Cagatay_Atabay)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 7:36pm UTC](https://discuss.elastic.co/t/joining-elasticsearch-indeces/187666 "2019-06-26T19:36:41Z")

</div>

Hi, I have one index as oracle\_table. I am using jdbc connector in logstash to gather data from db to oracle\_table index. query is working every minute. I need one information from another db. I can create another index…

---

## [Installing elastic search](https://discuss.elastic.co/t/installing-elastic-search/187654)

<div class="topic-metadata">

**Author:** [@AbuBakar2101](https://discuss.elastic.co/u/AbuBakar2101)\
**Replies:** 1\
**Last updated:** [June 26, 2019, 7:09pm UTC](https://discuss.elastic.co/t/installing-elastic-search/187654 "2019-06-26T19:09:30Z")

</div>

I am having trouble downloading Elasticsearch 7.2 on Windows 10. Do you have step by step directions to help downloading it? All the videos and forums I have checked are out of date.

---

## [Nested filter on sub document with the max value of a field for each document](https://discuss.elastic.co/t/nested-filter-on-sub-document-with-the-max-value-of-a-field-for-each-document/187644)

<div class="topic-metadata">

**Author:** [@catagm](https://discuss.elastic.co/u/catagm)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 6:02pm UTC](https://discuss.elastic.co/t/nested-filter-on-sub-document-with-the-max-value-of-a-field-for-each-document/187644 "2019-06-26T18:02:19Z")

</div>

Hi, First post so have mercy :sweat\_smile: I have a mapping like: "docType": { "properties": { "nestedField": { "type": "nested", "include\_in\_parent": true, "properties": { …

---

## [Get all attribute keys and key values within specific search](https://discuss.elastic.co/t/get-all-attribute-keys-and-key-values-within-specific-search/187627)

<div class="topic-metadata">

**Author:** [@sgws](https://discuss.elastic.co/u/sgws)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 4:24pm UTC](https://discuss.elastic.co/t/get-all-attribute-keys-and-key-values-within-specific-search/187627 "2019-06-26T16:24:58Z")

</div>

I have this "articles" and attributes: ----------------------------- name = galaxy note attributes type = phone weight = 140gm ----------------------------- name = shirt attributes type = clothing size …

---

## [Help Creating a File Based User](https://discuss.elastic.co/t/help-creating-a-file-based-user/186311)

<div class="topic-metadata">

**Author:** [@ryh](https://discuss.elastic.co/u/ryh)\
**Replies:** 8\
**Last updated:** [June 26, 2019, 4:14pm UTC](https://discuss.elastic.co/t/help-creating-a-file-based-user/186311 "2019-06-26T16:14:24Z")

</div>

Hi All, I can't seem to get this working via Docker. Here's my Dockerfile. FROM docker.elastic.co/elasticsearch/elasticsearch:7.1.1 COPY --chown=elasticsearch:elasticsearch users /usr/share/elasticsearch/config/ COPY…

---

## [Best Practices for storing and searching text in XML documents](https://discuss.elastic.co/t/best-practices-for-storing-and-searching-text-in-xml-documents/187336)

<div class="topic-metadata">

**Author:** [@ecbrodie](https://discuss.elastic.co/u/ecbrodie)\
**Replies:** 1\
**Last updated:** [June 26, 2019, 4:11pm UTC](https://discuss.elastic.co/t/best-practices-for-storing-and-searching-text-in-xml-documents/187336 "2019-06-26T16:11:58Z")

</div>

I would like to know what the best practices are for storing a large text blob field into an Elasticsearch document field and executing text queries against that text. I am particularly concerned with storing the text of…

---

## [Query with match and wildcard](https://discuss.elastic.co/t/query-with-match-and-wildcard/187325)

<div class="topic-metadata">

**Author:** [@kay-is](https://discuss.elastic.co/u/kay-is)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 3:47pm UTC](https://discuss.elastic.co/t/query-with-match-and-wildcard/187325 "2019-06-26T15:47:06Z")

</div>

I have some tagged images in my Elasticsearch and want to query them with a wildcard and an exact match. POST images/image { "fileName": "1319410514097402934+test", "tags": \["someTag", "someOtherTag"\] } POST images/…

---

## [Elasticsearch Cluster design - Need help](https://discuss.elastic.co/t/elasticsearch-cluster-design-need-help/187612)

<div class="topic-metadata">

**Author:** [@mhsh64](https://discuss.elastic.co/u/mhsh64)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 3:21pm UTC](https://discuss.elastic.co/t/elasticsearch-cluster-design-need-help/187612 "2019-06-26T15:21:36Z")

</div>

Hi guys, I am in a process to design a Elastic Stack and also Elasticsearch cluster. I need your recommendations and expertise, please: I have three VMs ( RedHat) and my plan is to install Elasticsearch, Logstash, Kib…

---

## [Curl command not running from python script](https://discuss.elastic.co/t/curl-command-not-running-from-python-script/187551)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 5\
**Last updated:** [June 26, 2019, 2:43pm UTC](https://discuss.elastic.co/t/curl-command-not-running-from-python-script/187551 "2019-06-26T14:43:01Z")

</div>

I tried to run a curl command from a python script to fetch anomaly results. The code is as follows: BODY= '{"size": 10000, "query": {"bool": {"filter": \[{"term": {"result\_type": "record"}},{"range": {"record\_score": {"…

---

## [\[Machine Learning\] No document detection](https://discuss.elastic.co/t/machine-learning-no-document-detection/187519)

<div class="topic-metadata">

**Author:** [@fbonningues](https://discuss.elastic.co/u/fbonningues)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 2:30pm UTC](https://discuss.elastic.co/t/machine-learning-no-document-detection/187519 "2019-06-26T14:30:14Z")

</div>

Hi, I have activated the trial licence to make some test with Machine Learning feature. I have a continus data feed with defined templates, each document having a field with a specific value (in this case, a shop\_id). …

---

## [Elasticsearch housekeeping](https://discuss.elastic.co/t/elasticsearch-housekeeping/185518)

<div class="topic-metadata">

**Author:** [@dey\_subhro](https://discuss.elastic.co/u/dey_subhro)\
**Replies:** 7\
**Last updated:** [June 26, 2019, 2:29pm UTC](https://discuss.elastic.co/t/elasticsearch-housekeeping/185518 "2019-06-26T14:29:09Z")

</div>

Hi, I am using Amazon ES, can someone tell me what is the ideal way of automatically deleting the old indexes from the cluster considering Amazon ES does not provide the ILM features ? I have 25 GB of daily index and I…

---

## [Elasticsearch 7.1 failed to start](https://discuss.elastic.co/t/elasticsearch-7-1-failed-to-start/187586)

<div class="topic-metadata">

**Author:** [@skdasari](https://discuss.elastic.co/u/skdasari)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 1:58pm UTC](https://discuss.elastic.co/t/elasticsearch-7-1-failed-to-start/187586 "2019-06-26T13:58:48Z")

</div>

Hello Guys, I am trying to configure Elasticsearch 7.1 in one of our test VM's. I have created a repo file and installed the package through yum in centos 7. After installing I tried setting up the yml file in the /etc/…

---

## [How to create a snapshot only for previous day index using curator](https://discuss.elastic.co/t/how-to-create-a-snapshot-only-for-previous-day-index-using-curator/187237)

<div class="topic-metadata">

**Author:** [@irobot678](https://discuss.elastic.co/u/irobot678)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 1:54pm UTC](https://discuss.elastic.co/t/how-to-create-a-snapshot-only-for-previous-day-index-using-curator/187237 "2019-06-26T13:54:20Z")

</div>

HI , i want to create a snapshot daily of my previous day index but the snapshot indices are incremental. i need help to solve it ,is there any way we can configure to snapshot only previous day indices or delete the u…

---

## [API search with null values](https://discuss.elastic.co/t/api-search-with-null-values/186064)

<div class="topic-metadata">

**Author:** [@ocaiquemello](https://discuss.elastic.co/u/ocaiquemello)\
**Replies:** 0\
**Last updated:** [June 17, 2019, 12:31pm UTC](https://discuss.elastic.co/t/api-search-with-null-values/186064 "2019-06-17T12:31:17Z")

</div>

Good day everyone! I'm trying to build a search API with NodeJS but I need to validate the values the users are sending, so if they send a null value, the API will only query for the other values. How can I do that? Than…

---

## [Reindexing process stops in middle. Cluster health unstable](https://discuss.elastic.co/t/reindexing-process-stops-in-middle-cluster-health-unstable/187566)

<div class="topic-metadata">

**Author:** [@gurunga011](https://discuss.elastic.co/u/gurunga011)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 12:38pm UTC](https://discuss.elastic.co/t/reindexing-process-stops-in-middle-cluster-health-unstable/187566 "2019-06-26T12:38:38Z")

</div>

Hi, I am trying to reindex 20million documents(size of 5 TB) from kibana console using re-index api. After only little over 1 million, it stops. My cluster health keeps fluctuating from GREEN to NOT CONNECTED in every 5…

---

## [Datafeed exception](https://discuss.elastic.co/t/datafeed-exception/187309)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 3\
**Last updated:** [June 26, 2019, 12:02pm UTC](https://discuss.elastic.co/t/datafeed-exception/187309 "2019-06-26T12:02:40Z")

</div>

I was running a job for some days and suddenly I got the following error on job management page besides my job, but I find the job is running. Can you state the cause for this error?

---

## [Convert timestamp into date](https://discuss.elastic.co/t/convert-timestamp-into-date/187306)

<div class="topic-metadata">

**Author:** [@Bharath\_Kumar\_R](https://discuss.elastic.co/u/Bharath_Kumar_R)\
**Replies:** 3\
**Last updated:** [June 26, 2019, 12:00pm UTC](https://discuss.elastic.co/t/convert-timestamp-into-date/187306 "2019-06-26T12:00:35Z")

</div>

I tried to extract anomaly results using the following request: GET .ml-anomalies-.write-my\_job\_low\_sum/\_search?human { "size": 10000 } One of the results I got was: "\_index" : ".ml-anomalies-custom-low\_sum\_results…

---

## [Elasticsearch data folder naming convention 5.6](https://discuss.elastic.co/t/elasticsearch-data-folder-naming-convention-5-6/187549)

<div class="topic-metadata">

**Author:** [@Prashant\_Rana](https://discuss.elastic.co/u/Prashant_Rana)\
**Replies:** 1\
**Last updated:** [June 26, 2019, 11:54am UTC](https://discuss.elastic.co/t/elasticsearch-data-folder-naming-convention-5-6/187549 "2019-06-26T11:54:55Z")

</div>

Hi, I have noticed that the naming pattern for the folders of indices is the id of the index in ES 5.6 as compared to ES 2.2(where it was the index name). I wanted to know if there is a setting with which we can retain…

---

## [GROUP BY in Elasticsearch using 'aggs' is not working for me in PHP](https://discuss.elastic.co/t/group-by-in-elasticsearch-using-aggs-is-not-working-for-me-in-php/187495)

<div class="topic-metadata">

**Author:** [@ShashankAC](https://discuss.elastic.co/u/ShashankAC)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 7:06am UTC](https://discuss.elastic.co/t/group-by-in-elasticsearch-using-aggs-is-not-working-for-me-in-php/187495 "2019-06-26T07:06:01Z")

</div>

I have an elasticsearch query in PHP like this. $params = \[ 'index' =\> $table\_name, 'type' =\> '\_doc', 'size' =\> 4894, 'body' =\> \[ 'query' =\> \[ 'aggs' =\> \[ 'some\_key' =\> \[ 'bool' =\> \[ 'filter' =\> \[ \['terms' =\> …

---

## [Nested query without knowing the path](https://discuss.elastic.co/t/nested-query-without-knowing-the-path/187550)

<div class="topic-metadata">

**Author:** [@muthualagappan](https://discuss.elastic.co/u/muthualagappan)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 10:55am UTC](https://discuss.elastic.co/t/nested-query-without-knowing-the-path/187550 "2019-06-26T10:55:32Z")

</div>

How to query the nested objects without knowing the nested path? In our example there are multiple nested levels and the query should be executed on all the nested paths. The below example works as the path is specified…

---

## [How to access input field value in script in elasticsearch](https://discuss.elastic.co/t/how-to-access-input-field-value-in-script-in-elasticsearch/187547)

<div class="topic-metadata">

**Author:** [@spsanthoshi](https://discuss.elastic.co/u/spsanthoshi)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 10:43am UTC](https://discuss.elastic.co/t/how-to-access-input-field-value-in-script-in-elasticsearch/187547 "2019-06-26T10:43:40Z")

</div>

I'm using bool query and I want to use matched result value in a script in elastic search { "query": { "nested": { "path": "Names", "query": { "function\_score": { "script\_score": { "script": { …

---

## [Cross cluster search and index wildcards (elastic 6.6.x)](https://discuss.elastic.co/t/cross-cluster-search-and-index-wildcards-elastic-6-6-x/187540)

<div class="topic-metadata">

**Author:** [@trocade](https://discuss.elastic.co/u/trocade)\
**Replies:** 0\
**Last updated:** [June 26, 2019, 10:15am UTC](https://discuss.elastic.co/t/cross-cluster-search-and-index-wildcards-elastic-6-6-x/187540 "2019-06-26T10:15:40Z")

</div>

So I am playing around a little with wildcards in our cluster setup (1 ccs, 3 data cluster) When I do cross-cluster searches on indexes using wildcards I am a bit curious of the behavior. Let's say we have 6 months of …

---

## [Type cannot be specified during template creation](https://discuss.elastic.co/t/type-cannot-be-specified-during-template-creation/187525)

<div class="topic-metadata">

**Author:** [@yeziblo](https://discuss.elastic.co/u/yeziblo)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 10:12am UTC](https://discuss.elastic.co/t/type-cannot-be-specified-during-template-creation/187525 "2019-06-26T10:12:54Z")

</div>

Hi everyone, I want to create a template using the PutIndexTemplateRequest API. But when the template was created, I found that the mapping.type was "\_doc". I try to add type in the mapping json string as follows: { …

---

## [Microsoft Elastic Update](https://discuss.elastic.co/t/microsoft-elastic-update/187476)

<div class="topic-metadata">

**Author:** [@abhimanyu.arora](https://discuss.elastic.co/u/abhimanyu.arora)\
**Replies:** 1\
**Last updated:** [June 26, 2019, 9:45am UTC](https://discuss.elastic.co/t/microsoft-elastic-update/187476 "2019-06-26T09:45:08Z")

</div>

Hi I have a cluster running on microsoft azure built using the microsoft marketplace offering. My cluster is running 7.0 version which I want to upgrade to 7.1.1 Any idea how to do it?

---

## [Error when using ScrollAll for millions of records](https://discuss.elastic.co/t/error-when-using-scrollall-for-millions-of-records/187220)

<div class="topic-metadata">

**Author:** [@SudevPK](https://discuss.elastic.co/u/SudevPK)\
**Replies:** 2\
**Last updated:** [June 26, 2019, 9:17am UTC](https://discuss.elastic.co/t/error-when-using-scrollall-for-millions-of-records/187220 "2019-06-26T09:17:07Z")

</div>

Error scrolling search on /\_search/scroll?pretty=true with slice 4 was not valid on scroll iteration 1

---

## [Issue when i start trying to make a post commande](https://discuss.elastic.co/t/issue-when-i-start-trying-to-make-a-post-commande/187514)

<div class="topic-metadata">

**Author:** [@busan](https://discuss.elastic.co/u/busan)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 9:02am UTC](https://discuss.elastic.co/t/issue-when-i-start-trying-to-make-a-post-commande/187514 "2019-06-26T09:02:53Z")

</div>

Hi, first of all i'am a complete beginner, like i have never use something like elasticsearch before. I'm on a ubuntu 16.04 Xenial server behind a corporate proxy. So i have followed this tutorial: how to install elas…

---

## [ES 6.5 unassigned\_shards":1000 do not get assigned - status yellow](https://discuss.elastic.co/t/es-6-5-unassigned-shards-1000-do-not-get-assigned-status-yellow/187478)

<div class="topic-metadata">

**Author:** [@Stefan\_Bauer](https://discuss.elastic.co/u/Stefan_Bauer)\
**Replies:** 6\
**Last updated:** [June 26, 2019, 8:54am UTC](https://discuss.elastic.co/t/es-6-5-unassigned-shards-1000-do-not-get-assigned-status-yellow/187478 "2019-06-26T08:54:32Z")

</div>

Hi, for unknown reasons after the last restart, elasticsearch has unassigned shards that do not get assigned and cluster status stays yellow. It's a single node host with no further adjustments. root@kibana03:/# curl -…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1248)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1250)
