# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1898 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1899 --- ## [Highlighting on a copy\_to Field](https://discuss.elastic.co/t/highlighting-on-a-copy-to-field/106583)
**Author:** [@zillion582](https://discuss.elastic.co/u/zillion582)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 8:01pm UTC](https://discuss.elastic.co/t/highlighting-on-a-copy-to-field/106583 "2017-11-06T20:01:14Z")
Hello, Is it possible to highlight a copy\_to field? I have a title which I want to be able to analyze two different ways. One with stop words and stemming, and one without. I can effectively query the search results ag… --- ## [Retention in elastic-search](https://discuss.elastic.co/t/retention-in-elastic-search/106497)
**Author:** [@fhalde](https://discuss.elastic.co/u/fhalde)\ **Replies:** 3\ **Last updated:** [November 6, 2017, 6:43pm UTC](https://discuss.elastic.co/t/retention-in-elastic-search/106497 "2017-11-06T18:43:44Z")
It would be great to have a feature wherein while creating a request, one can also specify its lifespan after which it gets deleted automatically. Right now, one has to manually go and delete indices --- ## [How do i convert this query into filtered query](https://discuss.elastic.co/t/how-do-i-convert-this-query-into-filtered-query/105074)
**Author:** [@Rohit\_Singh](https://discuss.elastic.co/u/Rohit_Singh)\ **Replies:** 2\ **Last updated:** [November 6, 2017, 5:25pm UTC](https://discuss.elastic.co/t/how-do-i-convert-this-query-into-filtered-query/105074 "2017-11-06T17:25:08Z")
GET logstash-audit-\*/\_search { "from": 0, "size": 100, "query": { "bool": { "must": \[{ "bool": { "should": \[{ "term": { "trans\_iduid.raw": "test-000" } … --- ## [Updated documentation for script manipulation using java api](https://discuss.elastic.co/t/updated-documentation-for-script-manipulation-using-java-api/106560)
**Author:** [@eric.santos](https://discuss.elastic.co/u/eric.santos)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 4:45pm UTC](https://discuss.elastic.co/t/updated-documentation-for-script-manipulation-using-java-api/106560 "2017-11-06T16:45:52Z")
Hello, can someone envolved in the es project provide some updated documentation for scripting manipulation? this one is very outdated -\> https://www.elastic.co/guide/en/elasticsearch/client/java-api/current/indexed-scr… --- ## [Timeout Errors when creating lots of new Indices?](https://discuss.elastic.co/t/timeout-errors-when-creating-lots-of-new-indices/105804)
**Author:** [@alexkeyes](https://discuss.elastic.co/u/alexkeyes)\ **Replies:** 9\ **Last updated:** [November 6, 2017, 4:01pm UTC](https://discuss.elastic.co/t/timeout-errors-when-creating-lots-of-new-indices/105804 "2017-11-06T16:01:26Z")
Hello, when I have an Elasticsearch cluster with nothing but .kibana and .marvel indicies in it, my consumer reading in the files will periodically encounter exceptions and close, due to the fact that ES is closing the c… --- ## [How to perform anomaly analysis by having a single metric as a benchmark](https://discuss.elastic.co/t/how-to-perform-anomaly-analysis-by-having-a-single-metric-as-a-benchmark/106126)
**Author:** [@anomalyml](https://discuss.elastic.co/u/anomalyml)\ **Replies:** 3\ **Last updated:** [November 6, 2017, 2:56pm UTC](https://discuss.elastic.co/t/how-to-perform-anomaly-analysis-by-having-a-single-metric-as-a-benchmark/106126 "2017-11-06T14:56:39Z")
Hi, I have an excel sheet data with below column names: \ \ \ I create a mapping in Elasticsearch database as below: Date: 'Date' datatype Metric\_1: 'Double' datatype Metric\_2: 'Long'… --- ## [Check whether document exists from Python client?](https://discuss.elastic.co/t/check-whether-document-exists-from-python-client/106544)
**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 2:40pm UTC](https://discuss.elastic.co/t/check-whether-document-exists-from-python-client/106544 "2017-11-06T14:40:47Z")
You're supposed to use a HEAD request to check whether a document exists, but I can't find a way of doing this from the Python client? The documentation of Elasticsearch.exists() doesn't say which it uses, but some of … --- ## [Recovery failed, no activity after 30m, networking seems fine](https://discuss.elastic.co/t/recovery-failed-no-activity-after-30m-networking-seems-fine/106540)
**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\ **Replies:** 1\ **Last updated:** [November 6, 2017, 2:35pm UTC](https://discuss.elastic.co/t/recovery-failed-no-activity-after-30m-networking-seems-fine/106540 "2017-11-06T14:35:22Z")
Last night I started restoring a snapshot of 12 small indices to a 6-node cluster (v.2.3.1) running on m4.2xlarge AWS instance types, each with 2TB disk. The shards won't allocate to any node. Every node has plenty of … --- ## [Manage\_index\_templates fine grained control](https://discuss.elastic.co/t/manage-index-templates-fine-grained-control/106531)
**Author:** [@altfatterz](https://discuss.elastic.co/u/altfatterz)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/manage-index-templates-fine-grained-control/106531 "2017-11-06T13:23:48Z")
Is it possible for the manage\_index\_templates to be more fine-grained , meaning one user should be only able to create/update/delete/modify a template with with a specific template pattern? --- ## [Unit test watcher](https://discuss.elastic.co/t/unit-test-watcher/105035)
**Author:** [@SKing](https://discuss.elastic.co/u/SKing)\ **Replies:** 4\ **Last updated:** [November 6, 2017, 1:23pm UTC](https://discuss.elastic.co/t/unit-test-watcher/105035 "2017-11-06T13:23:01Z")
Is it possible to unit test watcher scripts? If so how are people doing this? There doesn't seem to be a framework in place and not a lot of information on it, if there is. Thanks --- ## [Update\_by\_query in ElasticSearch](https://discuss.elastic.co/t/update-by-query-in-elasticsearch/106530)
**Author:** [@ssg](https://discuss.elastic.co/u/ssg)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 1:19pm UTC](https://discuss.elastic.co/t/update-by-query-in-elasticsearch/106530 "2017-11-06T13:19:14Z")
Hi All, I am newbie to ElasticSearch . I am trying to update all the records using following inline script. ES Version : 5.1.1 POST http://localhost:9200/index\_1,index\_2/type/\_update\_by\_query?ignore\_unavailable=true … --- ## [Autocomplete suggesters vs Edge NGram](https://discuss.elastic.co/t/autocomplete-suggesters-vs-edge-ngram/106527)
**Author:** [@buinauskas\_evaldas](https://discuss.elastic.co/u/buinauskas_evaldas)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 1:13pm UTC](https://discuss.elastic.co/t/autocomplete-suggesters-vs-edge-ngram/106527 "2017-11-06T13:13:55Z")
What's the right way to implement autocomplete in Elasticsearch nowadays? For instance I've got a document which contains document : { "Title": "French Gummy Bears" } And I would want to have it searchable regardles… --- ## [How to fetch data from multiple index using join like sql](https://discuss.elastic.co/t/how-to-fetch-data-from-multiple-index-using-join-like-sql/106131)
**Author:** [@kanchan](https://discuss.elastic.co/u/kanchan)\ **Replies:** 17\ **Last updated:** [November 6, 2017, 12:44pm UTC](https://discuss.elastic.co/t/how-to-fetch-data-from-multiple-index-using-join-like-sql/106131 "2017-11-06T12:44:31Z")
Hi Team, I am using below query to fetch data from sql. select W.WALLET\_LOCATION\_ID, W.Region, UWL.HIERARCHY from Wallet\_Location\_Dim W inner join User\_Wallet\_Location UWL on W.WALLET\_LOCATION\_ID = UWL.WALLET\_LOCATI… --- ## [High ram.percent, low heap.percent, low system ram usage. What is ram.percent?](https://discuss.elastic.co/t/high-ram-percent-low-heap-percent-low-system-ram-usage-what-is-ram-percent/106511)
**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\ **Replies:** 2\ **Last updated:** [November 6, 2017, 11:56am UTC](https://discuss.elastic.co/t/high-ram-percent-low-heap-percent-low-system-ram-usage-what-is-ram-percent/106511 "2017-11-06T11:56:27Z")
I had a 5 node cluster that went TU over the weekend (Tits Up). Version: 2.3.1 AWS instance type: m4.2xlarge vm.swappiness is set correctly (according to advice given here: https://www.elastic.co/guide/en/elasticsearc… --- ## [Elastic search percolate - Performance](https://discuss.elastic.co/t/elastic-search-percolate-performance/106517)
**Author:** [@pradeepmurugesan](https://discuss.elastic.co/u/pradeepmurugesan)\ **Replies:** 1\ **Last updated:** [November 6, 2017, 11:52am UTC](https://discuss.elastic.co/t/elastic-search-percolate-performance/106517 "2017-11-06T11:52:22Z")
Hello, we are trying out the elastic search (version 5.5) percolate for our notification feature. But we see the performance is really slow. {"query": { "bool": { "must": \[ { … --- ## [Nested query with decay function score fails with scaled\_float type](https://discuss.elastic.co/t/nested-query-with-decay-function-score-fails-with-scaled-float-type/106506)
**Author:** [@1jon](https://discuss.elastic.co/u/1jon)\ **Replies:** 2\ **Last updated:** [November 6, 2017, 11:28am UTC](https://discuss.elastic.co/t/nested-query-with-decay-function-score-fails-with-scaled-float-type/106506 "2017-11-06T11:28:14Z")
Here is the guts of a nested function score query, which works: "query": { "function\_score": { "field\_value\_factor": { "field": "variants.x.laba", }, "query": { "bool": {… --- ## [\[Java\] BulkProcessor- custom data in request-response items](https://discuss.elastic.co/t/java-bulkprocessor-custom-data-in-request-response-items/105963)
**Author:** [@Eduard\_Kubanda](https://discuss.elastic.co/u/Eduard_Kubanda)\ **Replies:** 4\ **Last updated:** [November 6, 2017, 9:34am UTC](https://discuss.elastic.co/t/java-bulkprocessor-custom-data-in-request-response-items/105963 "2017-11-06T09:34:55Z")
Hi there, I have working code to index documents using BulkProcessor. I need to ensure a kind of correctness of bulk indexing - I need to report failed documents. I can access response items in afterBulk callback (if t… --- ## [Terms filter lookup vs other options](https://discuss.elastic.co/t/terms-filter-lookup-vs-other-options/106493)
**Author:** [@Sathish.Babu](https://discuss.elastic.co/u/Sathish.Babu)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 9:24am UTC](https://discuss.elastic.co/t/terms-filter-lookup-vs-other-options/106493 "2017-11-06T09:24:30Z")
In myworld, there are many cities and each city can have zero-to-millions of residents. Each city has a property called "GenderOfMayor", and residents have some properties like name,age. All of my search cases are to f… --- ## [Snapshot & restore](https://discuss.elastic.co/t/snapshot-restore/106206)
**Author:** [@Damien](https://discuss.elastic.co/u/Damien)\ **Replies:** 6\ **Last updated:** [November 6, 2017, 8:57am UTC](https://discuss.elastic.co/t/snapshot-restore/106206 "2017-11-06T08:57:07Z")
Hi, I use snapshot & restore module for Elasticsearch 2.3 to backup our server every day. We rotate every 7 backup. The rotate works, i can verify with this command: curl -XGET 'localhost:9200/\_snapshot/my\_backup/\_al… --- ## [Ingest node script processor issue](https://discuss.elastic.co/t/ingest-node-script-processor-issue/106442)
**Author:** [@Ashish\_Barnwal](https://discuss.elastic.co/u/Ashish_Barnwal)\ **Replies:** 2\ **Last updated:** [November 6, 2017, 8:24am UTC](https://discuss.elastic.co/t/ingest-node-script-processor-issue/106442 "2017-11-06T08:24:47Z")
Hi All, I'm trying to create new fields and corresponding value based on the values present in two different arrays while parsing the data in ingest node pipeline. For e.g., Array1 = \[num1,num2\] and Array2 = \[10,20\] Ex… --- ## [Elasticsearch Version Supported with Rally](https://discuss.elastic.co/t/elasticsearch-version-supported-with-rally/105983)
**Author:** [@Deb](https://discuss.elastic.co/u/Deb)\ **Replies:** 3\ **Last updated:** [November 6, 2017, 8:04am UTC](https://discuss.elastic.co/t/elasticsearch-version-supported-with-rally/105983 "2017-11-06T08:04:25Z")
Does all features of Rally work with Elasticsearch 2.3.x or 5.0.0 is the minimum ES version for rally? I could not find anything related to this in the doc --- ## [Comparing standard vs folding analyzer](https://discuss.elastic.co/t/comparing-standard-vs-folding-analyzer/106475)
**Author:** [@Atul\_Harsha](https://discuss.elastic.co/u/Atul_Harsha)\ **Replies:** 3\ **Last updated:** [November 6, 2017, 7:39am UTC](https://discuss.elastic.co/t/comparing-standard-vs-folding-analyzer/106475 "2017-11-06T07:39:33Z")
Mapping PUT /my\_index/\_mapping/my\_type { "properties": { "title": { "type": "string", "analyzer": "standard", "fields": { "folded": { "type": "string", … --- ## [Which ELK files are need to download for Unix server](https://discuss.elastic.co/t/which-elk-files-are-need-to-download-for-unix-server/106464)
**Author:** [@Ganesh2303](https://discuss.elastic.co/u/Ganesh2303)\ **Replies:** 3\ **Last updated:** [November 6, 2017, 7:22am UTC](https://discuss.elastic.co/t/which-elk-files-are-need-to-download-for-unix-server/106464 "2017-11-06T07:22:57Z")
HI Team, I want run the ELK in in UNIX server. Kindly help me which files i need to download to setup in my server. Whether RPM file will work in linux or not? --- ## [X-PACK 5.6.3out put time out when collecting data how to change the time of collecting data. ES 5.6.3](https://discuss.elastic.co/t/x-pack-5-6-3out-put-time-out-when-collecting-data-how-to-change-the-time-of-collecting-data-es-5-6-3/105992)
**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\ **Replies:** 7\ **Last updated:** [November 6, 2017, 7:11am UTC](https://discuss.elastic.co/t/x-pack-5-6-3out-put-time-out-when-collecting-data-how-to-change-the-time-of-collecting-data-es-5-6-3/105992 "2017-11-06T07:11:36Z")
\[2017-11-01T07:46:50,053\]\[ERROR\]\[o.e.x.m.c.i.IndexStatsCollector\] \[xxxxxxxxxxxxxxxxxxxxx\] collector \[index-stats\] timed out when collecting data \[2017-11-01T07:50:19,540\]\[ERROR\]\[o.e.x.m.c.i.IndexStatsCollector\] \[xxxxxxxx… --- ## [X-pack not available](https://discuss.elastic.co/t/x-pack-not-available/106453)
**Author:** [@f26227279](https://discuss.elastic.co/u/f26227279)\ **Replies:** 2\ **Last updated:** [November 6, 2017, 6:36am UTC](https://discuss.elastic.co/t/x-pack-not-available/106453 "2017-11-06T06:36:17Z")
My OS is windows 10. x-pack not available. \[image\] thank you in advance! --- ## [Help to Implement New Similarity Function](https://discuss.elastic.co/t/help-to-implement-new-similarity-function/106465)
**Author:** [@ESlearner](https://discuss.elastic.co/u/ESlearner)\ **Replies:** 0\ **Last updated:** [November 6, 2017, 6:07am UTC](https://discuss.elastic.co/t/help-to-implement-new-similarity-function/106465 "2017-11-06T06:07:19Z")
Hello - I am trying to implement a new similarity function . Here is the formula : f(q,d)=1/ |d| log2(clicksd+1) ∑ TF log2(N+1/ DFt+1) t∈q t,d After looking at the link https://github.com/stefan… --- ## [Best way to backup the elastic search data(Entire Nodes Folder) from one machine to another machine?](https://discuss.elastic.co/t/best-way-to-backup-the-elastic-search-data-entire-nodes-folder-from-one-machine-to-another-machine/105049)
**Author:** [@PrabakarKaruppasamy](https://discuss.elastic.co/u/PrabakarKaruppasamy)\ **Replies:** 3\ **Last updated:** [October 25, 2017, 6:06pm UTC](https://discuss.elastic.co/t/best-way-to-backup-the-elastic-search-data-entire-nodes-folder-from-one-machine-to-another-machine/105049 "2017-10-25T18:06:25Z")
Hi All, What is the best way to backup the entire data (/var/lib/elasticsearch/nodes) from one machine to another machine in elasticsearch 5.4.0 How to take the backup of entire node folder and restore it. Thanks --- ## [Java High/Low Level REST Client support for script score](https://discuss.elastic.co/t/java-high-low-level-rest-client-support-for-script-score/104397)
**Author:** [@hanozo](https://discuss.elastic.co/u/hanozo)\ **Replies:** 1\ **Last updated:** [October 23, 2017, 7:59am UTC](https://discuss.elastic.co/t/java-high-low-level-rest-client-support-for-script-score/104397 "2017-10-23T07:59:21Z")
Dear friends, The Java High Level REST Client documentation does mention Function Score query under Using Java Builders -\> Building Queries. I'm interested in script\_score functionality. Is it really supported? Or I jus… --- ## [Elastic search port 9200 and 9300](https://discuss.elastic.co/t/elastic-search-port-9200-and-9300/105203)
**Author:** [@Darth\_Vader](https://discuss.elastic.co/u/Darth_Vader)\ **Replies:** 2\ **Last updated:** [October 25, 2017, 12:18pm UTC](https://discuss.elastic.co/t/elastic-search-port-9200-and-9300/105203 "2017-10-25T12:18:55Z")
\[Screenshot (106)\] In screenshot, it can be seen that there are two different ports for 1)TransportService 2)Netty4HTTPService What are those things and why two different ports? Which port should I connect Kibana to? I… --- ## [Hardware Question](https://discuss.elastic.co/t/hardware-question/105940)
**Author:** [@Illidan](https://discuss.elastic.co/u/Illidan)\ **Replies:** 2\ **Last updated:** [November 1, 2017, 6:22pm UTC](https://discuss.elastic.co/t/hardware-question/105940 "2017-11-01T18:22:36Z")
I going to deploy on Azure and I have only 150$ per month (no single dollar more). I planning to deploy production deployment, at this moment with fairly light workload. I reviewed Azure Virtual Machines, and there are … [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1897) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1899)