# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1012

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1013

---

## [First Time Upgrade](https://discuss.elastic.co/t/first-time-upgrade/219552)

<div class="topic-metadata">

**Author:** [@devin](https://discuss.elastic.co/u/devin)\
**Replies:** 2\
**Last updated:** [February 19, 2020, 1:40pm UTC](https://discuss.elastic.co/t/first-time-upgrade/219552 "2020-02-19T13:40:43Z")

</div>

Hello, i am using ES 2.2.0 and i have to upgrade it to 6.5, i read that first i would need to upgrade to 5.x and then from there i will need to upgrade to 6.5. But my problem is that i am totally new user to Elasticsearc…

---

## [Not able to sort date(dd-MMM-YYYY) column using elastic search java api](https://discuss.elastic.co/t/not-able-to-sort-date-dd-mmm-yyyy-column-using-elastic-search-java-api/219964)

<div class="topic-metadata">

**Author:** [@Dev2](https://discuss.elastic.co/u/Dev2)\
**Replies:** 1\
**Last updated:** [February 19, 2020, 1:07pm UTC](https://discuss.elastic.co/t/not-able-to-sort-date-dd-mmm-yyyy-column-using-elastic-search-java-api/219964 "2020-02-19T13:07:20Z")

</div>

Not able to sort date(dd-MMM-YYYY) column using elastic search java api.Please help me.

---

## [Setting up Elasticsearch with Docker on local machine - Container stops and throws error](https://discuss.elastic.co/t/setting-up-elasticsearch-with-docker-on-local-machine-container-stops-and-throws-error/219954)

<div class="topic-metadata">

**Author:** [@bvelastic](https://discuss.elastic.co/u/bvelastic)\
**Replies:** 6\
**Last updated:** [February 19, 2020, 12:50pm UTC](https://discuss.elastic.co/t/setting-up-elasticsearch-with-docker-on-local-machine-container-stops-and-throws-error/219954 "2020-02-19T12:50:38Z")

</div>

Hello, I am new to elastic search and docker and I want to setup up ELK using Docker on my laptop only to play around. I am followed the instructions on the Elastic documentation but I am receiving an error when I try …

---

## [Fscrawler for ES clustering](https://discuss.elastic.co/t/fscrawler-for-es-clustering/216939)

<div class="topic-metadata">

**Author:** [@pyerunka](https://discuss.elastic.co/u/pyerunka)\
**Replies:** 40\
**Last updated:** [February 19, 2020, 11:07am UTC](https://discuss.elastic.co/t/fscrawler-for-es-clustering/216939 "2020-02-19T11:07:40Z")

</div>

Hello, I have configured ES cluster with 3 nodes. I want to index files using fscrawler. Is there any setting i need to do to mention all 3 nodes in fscrawler config file? Thanks, Priyanka

---

## [Reading es by spark SQL is too slow](https://discuss.elastic.co/t/reading-es-by-spark-sql-is-too-slow/219945)

<div class="topic-metadata">

**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\
**Replies:** 0\
**Last updated:** [February 19, 2020, 11:05am UTC](https://discuss.elastic.co/t/reading-es-by-spark-sql-is-too-slow/219945 "2020-02-19T11:05:53Z")

</div>

Hello, i have a question about spark - es. I write code like below # Initializing PySpark from pyspark import SparkContext, SparkConf, SQLContext # Spark Config conf = SparkConf().setAppName("es\_app") sc = SparkConte…

---

## [Limit query results while paginating them](https://discuss.elastic.co/t/limit-query-results-while-paginating-them/219739)

<div class="topic-metadata">

**Author:** [@ovinz](https://discuss.elastic.co/u/ovinz)\
**Replies:** 5\
**Last updated:** [February 19, 2020, 9:17am UTC](https://discuss.elastic.co/t/limit-query-results-while-paginating-them/219739 "2020-02-19T09:17:19Z")

</div>

Hello, I'd like to limit my query results to the first 500 documents and use the pagination (for instance from=0&size=30). My use case : I want to hide the total of documents I don't use yet any relevancy aggs (scorin…

---

## [Search by multiple match step by step fields](https://discuss.elastic.co/t/search-by-multiple-match-step-by-step-fields/219928)

<div class="topic-metadata">

**Author:** [@Mehrdad.dev](https://discuss.elastic.co/u/Mehrdad.dev)\
**Replies:** 0\
**Last updated:** [February 19, 2020, 9:02am UTC](https://discuss.elastic.co/t/search-by-multiple-match-step-by-step-fields/219928 "2020-02-19T09:02:38Z")

</div>

Hi . I have this query for search people in : { "multi\_match" : { "fields" : \["full\_name^3", "user\_name", "title", "first\_name", "last\_name"\], "query" : "%v" } } I need : but i want a better than search query …

---

## [Share data directory between exclusively running instances](https://discuss.elastic.co/t/share-data-directory-between-exclusively-running-instances/219763)

<div class="topic-metadata">

**Author:** [@noelzubinvictor](https://discuss.elastic.co/u/noelzubinvictor)\
**Replies:** 10\
**Last updated:** [February 19, 2020, 8:46am UTC](https://discuss.elastic.co/t/share-data-directory-between-exclusively-running-instances/219763 "2020-02-19T08:46:13Z")

</div>

Problem: The ES instance require lot of memory for quick bulk updates. Otherwise its underutilized. Can i create 2 ES instances with the same shared data directory. Say one with 4Gb(searching) and the other with 32Gb(in…

---

## [Updating field value issue](https://discuss.elastic.co/t/updating-field-value-issue/219896)

<div class="topic-metadata">

**Author:** [@Muhammad\_Ariful\_Isla](https://discuss.elastic.co/u/Muhammad_Ariful_Isla)\
**Replies:** 1\
**Last updated:** [February 19, 2020, 7:17am UTC](https://discuss.elastic.co/t/updating-field-value-issue/219896 "2020-02-19T07:17:46Z")

</div>

I am trying to work with update\_by\_query but cannot make it work. Following is a simple query, curl -X GET "172.17.0.3:9200/useripvsuserid/\_search?pretty" -H 'Content-Type: application/json' -d' { "\_source":"userid",…

---

## [What's the most up to date resource on sizing and configuring an ES cluster?](https://discuss.elastic.co/t/whats-the-most-up-to-date-resource-on-sizing-and-configuring-an-es-cluster/219899)

<div class="topic-metadata">

**Author:** [@raahuls](https://discuss.elastic.co/u/raahuls)\
**Replies:** 1\
**Last updated:** [February 19, 2020, 6:56am UTC](https://discuss.elastic.co/t/whats-the-most-up-to-date-resource-on-sizing-and-configuring-an-es-cluster/219899 "2020-02-19T06:56:53Z")

</div>

I know that I'm asking a rather generic question that can't be answered without understanding my specific use case. However, I'm looking for some lower bounds. What's the minimum number of nodes, size of the node (in ter…

---

## [Elasticsearch complete sentence highlighting in span query](https://discuss.elastic.co/t/elasticsearch-complete-sentence-highlighting-in-span-query/219904)

<div class="topic-metadata">

**Author:** [@kartik\_puri](https://discuss.elastic.co/u/kartik_puri)\
**Replies:** 0\
**Last updated:** [February 19, 2020, 6:41am UTC](https://discuss.elastic.co/t/elasticsearch-complete-sentence-highlighting-in-span-query/219904 "2020-02-19T06:41:09Z")

</div>

We have a situation where we are building a proximity search using the span queries to get the search results. Since we are using the span query we would like to highlight the complete sentence rather than search keyword…

---

## [When i try to execute a query, a html page is loading in response side](https://discuss.elastic.co/t/when-i-try-to-execute-a-query-a-html-page-is-loading-in-response-side/219609)

<div class="topic-metadata">

**Author:** [@Gokulnath](https://discuss.elastic.co/u/Gokulnath)\
**Replies:** 5\
**Last updated:** [February 19, 2020, 6:09am UTC](https://discuss.elastic.co/t/when-i-try-to-execute-a-query-a-html-page-is-loading-in-response-side/219609 "2020-02-19T06:09:45Z")

</div>

I tried to execute a query, but in the response side, one HTML file is loading instead of error or results. but the same query yields results in different environment. Kindly help me on this. Thanks in advance.

---

## [With ES Basic License, Can We Use X-Pack Free Features in Our Commercial Products without Pay](https://discuss.elastic.co/t/with-es-basic-license-can-we-use-x-pack-free-features-in-our-commercial-products-without-pay/219764)

<div class="topic-metadata">

**Author:** [@tang\_cai](https://discuss.elastic.co/u/tang_cai)\
**Replies:** 4\
**Last updated:** [February 19, 2020, 3:12am UTC](https://discuss.elastic.co/t/with-es-basic-license-can-we-use-x-pack-free-features-in-our-commercial-products-without-pay/219764 "2020-02-19T03:12:58Z")

</div>

As described in the title, we want to use the x-pack free features, like upgrade assist，in our commercial product? Can we use it with basic license without pay?

---

## [How to use more than one S3 config?](https://discuss.elastic.co/t/how-to-use-more-than-one-s3-config/219872)

<div class="topic-metadata">

**Author:** [@smlbiobot](https://discuss.elastic.co/u/smlbiobot)\
**Replies:** 2\
**Last updated:** [February 19, 2020, 1:52am UTC](https://discuss.elastic.co/t/how-to-use-more-than-one-s3-config/219872 "2020-02-19T01:52:51Z")

</div>

We are currently using Amazon S3 for snapshots, but am investigating the possibility of using a S3-compatible solution instead. When looking at the docs here: https://www.elastic.co/guide/en/elasticsearch/plugins/current…

---

## [How do I consume Heartbeat data for meaningful alerting?](https://discuss.elastic.co/t/how-do-i-consume-heartbeat-data-for-meaningful-alerting/219871)

<div class="topic-metadata">

**Author:** [@geoffmore](https://discuss.elastic.co/u/geoffmore)\
**Replies:** 0\
**Last updated:** [February 18, 2020, 10:02pm UTC](https://discuss.elastic.co/t/how-do-i-consume-heartbeat-data-for-meaningful-alerting/219871 "2020-02-18T22:02:43Z")

</div>

I have created a Watcher that consumes the data from a named, icmp, Heartbeat monitor \[1\] running as a Kubernetes DaemonSet \[2\]. I have not yet gotten approval to post the configuration of the Watcher, so I will provide …

---

## [How do I filter data returned from \_cat endpoints](https://discuss.elastic.co/t/how-do-i-filter-data-returned-from-cat-endpoints/219853)

<div class="topic-metadata">

**Author:** [@geoffmore](https://discuss.elastic.co/u/geoffmore)\
**Replies:** 0\
**Last updated:** [February 18, 2020, 7:25pm UTC](https://discuss.elastic.co/t/how-do-i-filter-data-returned-from-cat-endpoints/219853 "2020-02-18T19:25:36Z")

</div>

An issue at work came up where it was necessary to balance shards to alleviate disk pressure. For the size of our cluster, /\_cat/indices \[1\] returns close to a thousand lines. Looking at this resulted in me finding that …

---

## [How can you monitor user queries when using SSL](https://discuss.elastic.co/t/how-can-you-monitor-user-queries-when-using-ssl/219294)

<div class="topic-metadata">

**Author:** [@kyles](https://discuss.elastic.co/u/kyles)\
**Replies:** 2\
**Last updated:** [February 18, 2020, 6:04pm UTC](https://discuss.elastic.co/t/how-can-you-monitor-user-queries-when-using-ssl/219294 "2020-02-18T18:04:09Z")

</div>

ES version: 7.4.2 12 data nodes We have RBAC and SSL for HTTP and for node communication. We are getting queries ran against our cluster that are causing circuit breakers errors. Is there anything we can do to to trac…

---

## [ES Embedded in 7.0](https://discuss.elastic.co/t/es-embedded-in-7-0/219823)

<div class="topic-metadata">

**Author:** [@ben-charles](https://discuss.elastic.co/u/ben-charles)\
**Replies:** 1\
**Last updated:** [February 18, 2020, 5:56pm UTC](https://discuss.elastic.co/t/es-embedded-in-7-0/219823 "2020-02-18T17:56:49Z")

</div>

Is it possible to run ES embedded in 7.0? I am running into the same situation described in this previous thread. One of the participants mentioned that running ES embedded is deprecated in 7.0. I didn't see any mention …

---

## [Elasticsearch, SAML configuration, help required](https://discuss.elastic.co/t/elasticsearch-saml-configuration-help-required/218934)

<div class="topic-metadata">

**Author:** [@runtman](https://discuss.elastic.co/u/runtman)\
**Replies:** 7\
**Last updated:** [February 18, 2020, 5:22pm UTC](https://discuss.elastic.co/t/elasticsearch-saml-configuration-help-required/218934 "2020-02-18T17:22:18Z")

</div>

Elasticsearch Version: 7.5.2 Kibana Version: 7.5.2 Deployment: Elastic.co Cloud Managed Hello, we are seeing strange issues when using saml on our production deployment, it all worked fine during our trial which is st…

---

## [Problems with from/size pagination on Node.js API](https://discuss.elastic.co/t/problems-with-from-size-pagination-on-node-js-api/219619)

<div class="topic-metadata">

**Author:** [@lleal](https://discuss.elastic.co/u/lleal)\
**Replies:** 3\
**Last updated:** [February 18, 2020, 4:37pm UTC](https://discuss.elastic.co/t/problems-with-from-size-pagination-on-node-js-api/219619 "2020-02-18T16:37:10Z")

</div>

Hi folks, I am currently running in some weird behavior while running paginated searches using the Node.js API. From my tests it seems that the "from" parameter is not being correctly parsed. No matter the value I conf…

---

## [Shared Data-Store for multiple Nodes](https://discuss.elastic.co/t/shared-data-store-for-multiple-nodes/219832)

<div class="topic-metadata">

**Author:** [@KoettingSimon](https://discuss.elastic.co/u/KoettingSimon)\
**Replies:** 2\
**Last updated:** [February 18, 2020, 4:30pm UTC](https://discuss.elastic.co/t/shared-data-store-for-multiple-nodes/219832 "2020-02-18T16:30:01Z")

</div>

Hi All, At the moment we have 3 Elasticsearch-Node (All Master) Each Elasticsearch-Node is installed on a Ubuntu-VM on our central ESXi-Cluster. Each node has a dedicated /data mount to store the Data on a own volume …

---

## [Elasticsearch Curator error](https://discuss.elastic.co/t/elasticsearch-curator-error/219767)

<div class="topic-metadata">

**Author:** [@rj23495](https://discuss.elastic.co/u/rj23495)\
**Replies:** 6\
**Last updated:** [February 18, 2020, 4:13pm UTC](https://discuss.elastic.co/t/elasticsearch-curator-error/219767 "2020-02-18T16:13:46Z")

</div>

Hi all, I am using ELK curator to delete old elasticsearch indices periodically. I am running this as kubernetes cronjob to delete older indices. I am facing the following error- 2020-02-18 15:54:51,628 ERROR …

---

## [Query String OR between main type and nested objects](https://discuss.elastic.co/t/query-string-or-between-main-type-and-nested-objects/216689)

<div class="topic-metadata">

**Author:** [@Cristian\_Rodriguez](https://discuss.elastic.co/u/Cristian_Rodriguez)\
**Replies:** 1\
**Last updated:** [February 18, 2020, 3:56pm UTC](https://discuss.elastic.co/t/query-string-or-between-main-type-and-nested-objects/216689 "2020-02-18T15:56:08Z")

</div>

Hi all. I'm using ElasticSearch 2.4 I need to create a search query between main object and nested object, if I use the AND condition it works correctly, but the problem is if I try to use OR conditional between main o…

---

## [Backup the snapshot files](https://discuss.elastic.co/t/backup-the-snapshot-files/219825)

<div class="topic-metadata">

**Author:** [@VinceDupuis](https://discuss.elastic.co/u/VinceDupuis)\
**Replies:** 1\
**Last updated:** [February 18, 2020, 3:37pm UTC](https://discuss.elastic.co/t/backup-the-snapshot-files/219825 "2020-02-18T15:37:43Z")

</div>

Hello, I would like to know if it's possible to backup the snapshot files to have a second copy of it just by doing a copy of the files?

---

## [Index Lifecycle Policies](https://discuss.elastic.co/t/index-lifecycle-policies/219817)

<div class="topic-metadata">

**Author:** [@ElasticBoj](https://discuss.elastic.co/u/ElasticBoj)\
**Replies:** 0\
**Last updated:** [February 18, 2020, 3:11pm UTC](https://discuss.elastic.co/t/index-lifecycle-policies/219817 "2020-02-18T15:11:45Z")

</div>

We have created a Life Cycle Policy with a Index Template which updates multiple index patterns in different environment( say Dev, QA, Stage). Since rollover will work on a single pattern, would like to know the approach…

---

## [E-commerce logging strategy](https://discuss.elastic.co/t/e-commerce-logging-strategy/219003)

<div class="topic-metadata">

**Author:** [@Chaim](https://discuss.elastic.co/u/Chaim)\
**Replies:** 6\
**Last updated:** [February 18, 2020, 11:49am UTC](https://discuss.elastic.co/t/e-commerce-logging-strategy/219003 "2020-02-18T11:49:23Z")

</div>

Our Current Setup We have an elastic cloud deployment, collecting browsing logs for an e-commerce website, on a regular day our log reaches ~100GB Given the huge amount of data, we only keep 3 days of logs then ar…

---

## [Is it possible use anomaly detection as query?](https://discuss.elastic.co/t/is-it-possible-use-anomaly-detection-as-query/219666)

<div class="topic-metadata">

**Author:** [@tfe2012](https://discuss.elastic.co/u/tfe2012)\
**Replies:** 1\
**Last updated:** [February 18, 2020, 1:43pm UTC](https://discuss.elastic.co/t/is-it-possible-use-anomaly-detection-as-query/219666 "2020-02-18T13:43:54Z")

</div>

Hi I have log index with mapping like this: { "responseCode", "time", "serverName" } If I look to server respose code statistic graph like this: Green: 404, Blue: 200 Is it possible to use ML algorithm for qu…

---

## [Search for parts of a string field](https://discuss.elastic.co/t/search-for-parts-of-a-string-field/219670)

<div class="topic-metadata">

**Author:** [@fabriciofs](https://discuss.elastic.co/u/fabriciofs)\
**Replies:** 6\
**Last updated:** [February 18, 2020, 1:42pm UTC](https://discuss.elastic.co/t/search-for-parts-of-a-string-field/219670 "2020-02-18T13:42:16Z")

</div>

Hello guys, I'm new to the Elasticsearch world and I'm sorry if my doubt is very basic. I need to create an index on there will be a type that will store a product catalog. In this there will be several fields but what …

---

## [Custom preference key in searching](https://discuss.elastic.co/t/custom-preference-key-in-searching/219794)

<div class="topic-metadata">

**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\
**Replies:** 1\
**Last updated:** [February 18, 2020, 1:37pm UTC](https://discuss.elastic.co/t/custom-preference-key-in-searching/219794 "2020-02-18T13:37:09Z")

</div>

When using a custom preference key in searches, ES ends up querying all the N shards of the index right? Surely out of N, few will be replicas, few will be primary How does ES achieve this just using the string we pass?…

---

## [Elasticsearch service will not start on Ubuntu server 18.04](https://discuss.elastic.co/t/elasticsearch-service-will-not-start-on-ubuntu-server-18-04/219541)

<div class="topic-metadata">

**Author:** [@miceffre](https://discuss.elastic.co/u/miceffre)\
**Replies:** 4\
**Last updated:** [February 17, 2020, 9:02pm UTC](https://discuss.elastic.co/t/elasticsearch-service-will-not-start-on-ubuntu-server-18-04/219541 "2020-02-17T21:02:16Z")

</div>

I get the following error: "Job for elasticsearch.service failed because the control process exited with error code." When I try to start elasticsearch on my Ubuntu 18.04 server. I have tried uninstalling and re-insta…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1011)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1013)
