# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1354 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1355 --- ## [7.0 Upgrade Assistant open shards](https://discuss.elastic.co/t/7-0-upgrade-assistant-open-shards/172442)
**Author:** [@VamPikmin](https://discuss.elastic.co/u/VamPikmin)\ **Replies:** 4\ **Last updated:** [March 25, 2019, 11:50pm UTC](https://discuss.elastic.co/t/7-0-upgrade-assistant-open-shards/172442 "2019-03-25T23:50:02Z")
Number of open shards exceeds cluster soft limit warning Documentation There are \[9374\] open shards in this cluster, but the cluster is limited to \[1000\] per data node, for \[1000\] maximum. Hi everyone, I'm using onl… --- ## [How to use the RestHighLevelClient for the cloud?](https://discuss.elastic.co/t/how-to-use-the-resthighlevelclient-for-the-cloud/173027)
**Author:** [@Joseph\_Mak](https://discuss.elastic.co/u/Joseph_Mak)\ **Replies:** 7\ **Last updated:** [March 25, 2019, 8:18pm UTC](https://discuss.elastic.co/t/how-to-use-the-resthighlevelclient-for-the-cloud/173027 "2019-03-25T20:18:32Z")
I use the Java RestHighLevelClient, and it works fine with localhost elastic search (in which I pass "localhost" and 9200, "http") like the example in here https://www.elastic.co/guide/en/elasticsearch/client/java-rest/… --- ## [Help|Odd behavior using search\_after with score](https://discuss.elastic.co/t/help-odd-behavior-using-search-after-with-score/173816)
**Author:** [@Simon\_Poissant](https://discuss.elastic.co/u/Simon_Poissant)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 7:29pm UTC](https://discuss.elastic.co/t/help-odd-behavior-using-search-after-with-score/173816 "2019-03-25T19:29:10Z")
Hi everyone, I'm trying to use search\_after with the following sorting params: "sort": \[{ "\_score": { "order": "desc" } }, { "\_id": { "order": "asc" } }\], I've noticed that sometimes I will d… --- ## [Returning field names in highlight](https://discuss.elastic.co/t/returning-field-names-in-highlight/173341)
**Author:** [@neesha](https://discuss.elastic.co/u/neesha)\ **Replies:** 6\ **Last updated:** [March 25, 2019, 7:27pm UTC](https://discuss.elastic.co/t/returning-field-names-in-highlight/173341 "2019-03-25T19:27:40Z")
I have a query that runs against a field called content. Content contains many subfields, for example message, name, description, story, caption. When it ES finds matches, the highlight result looks like this: highlight… --- ## [Rollup index](https://discuss.elastic.co/t/rollup-index/173804)
**Author:** [@SNJY](https://discuss.elastic.co/u/SNJY)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 7:23pm UTC](https://discuss.elastic.co/t/rollup-index/173804 "2019-03-25T19:23:35Z")
Hi - I am trying to test feature of Rollup Index in ES6.6. From kibana, I created rollup job of metricbeat data based on time series @timestamp. While adding rollup index in grafana data source, there is error message "… --- ## [CURATOR: How to DELETE 2 days ago logs](https://discuss.elastic.co/t/curator-how-to-delete-2-days-ago-logs/173557)
**Author:** [@daniel.gutierrez](https://discuss.elastic.co/u/daniel.gutierrez)\ **Replies:** 3\ **Last updated:** [March 25, 2019, 7:17pm UTC](https://discuss.elastic.co/t/curator-how-to-delete-2-days-ago-logs/173557 "2019-03-25T19:17:48Z")
Hello! I hope someone can help me I need to take snapshot only for 1 day per day and I need to delete logs for 1 day per day In other words I want to take snapshots of today a month ago And delete logs of today a mo… --- ## [ThreadContext API](https://discuss.elastic.co/t/threadcontext-api/173694)
**Author:** [@Simone\_Scarduzio](https://discuss.elastic.co/u/Simone_Scarduzio)\ **Replies:** 5\ **Last updated:** [March 25, 2019, 7:11pm UTC](https://discuss.elastic.co/t/threadcontext-api/173694 "2019-03-25T19:11:12Z")
Hi, this is a follow up question from https://github.com/elastic/elasticsearch/issues/40391. I'm struggling to understand how to properly use the org.elasticsearch.common.util.concurrent.ThreadContext API. The javadoc … --- ## [Discrepancy in using Top Hits with Query](https://discuss.elastic.co/t/discrepancy-in-using-top-hits-with-query/173754)
**Author:** [@hell\_abhi](https://discuss.elastic.co/u/hell_abhi)\ **Replies:** 8\ **Last updated:** [March 25, 2019, 4:59pm UTC](https://discuss.elastic.co/t/discrepancy-in-using-top-hits-with-query/173754 "2019-03-25T16:59:22Z")
Note - I moved all the results to Pastebin, due to the word count limit of this site, sorry for the inconvenience. When I am running the following query, for grouping by creator\_cust\_id in a specific date range: { … --- ## [Docker-compose fails with ingest-attachment](https://discuss.elastic.co/t/docker-compose-fails-with-ingest-attachment/173598)
**Author:** [@SteveMapes](https://discuss.elastic.co/u/SteveMapes)\ **Replies:** 4\ **Last updated:** [March 25, 2019, 4:31pm UTC](https://discuss.elastic.co/t/docker-compose-fails-with-ingest-attachment/173598 "2019-03-25T16:31:59Z")
I'm having real troubles trying to get the ingest-attachment plugin working with docker via docker-compose. I can get ES working without any plugins using the following YML file version: '3' services: elasticsearch: … --- ## [SearchRequest.templateSource was deprecated, how to now?](https://discuss.elastic.co/t/searchrequest-templatesource-was-deprecated-how-to-now/173656)
**Author:** [@shachr](https://discuss.elastic.co/u/shachr)\ **Replies:** 2\ **Last updated:** [March 25, 2019, 4:29pm UTC](https://discuss.elastic.co/t/searchrequest-templatesource-was-deprecated-how-to-now/173656 "2019-03-25T16:29:59Z")
Im trying to update a 2.3.0 plugin to 6.6.1, and I can't find the new way of executing a template, current code: ByteReferece byteRef = ... SearchRequest searchRequest = new SearchRequest(); searchRequest.templateSou… --- ## [Tough Memlock issue in Docker Swarm on Centos](https://discuss.elastic.co/t/tough-memlock-issue-in-docker-swarm-on-centos/173788)
**Author:** [@Zorlack](https://discuss.elastic.co/u/Zorlack)\ **Replies:** 4\ **Last updated:** [March 25, 2019, 4:11pm UTC](https://discuss.elastic.co/t/tough-memlock-issue-in-docker-swarm-on-centos/173788 "2019-03-25T16:11:02Z")
Hello, I'm having trouble lighting up a Elastic Search stack on Docker. The error I'm seeing is this: \[2019-03-25T15:10:08,955\]\[WARN \]\[o.e.b.JNANatives \] \[unknown\] Unable to lock JVM Memory: error=12, reason=C… --- ## [Assign new field in one item based on aggregation](https://discuss.elastic.co/t/assign-new-field-in-one-item-based-on-aggregation/173789)
**Author:** [@stschelm](https://discuss.elastic.co/u/stschelm)\ **Replies:** 0\ **Last updated:** [March 25, 2019, 3:39pm UTC](https://discuss.elastic.co/t/assign-new-field-in-one-item-based-on-aggregation/173789 "2019-03-25T15:39:17Z")
Hi there, I have some log entries in elasticserarch, based on a well-defined start message and up to three follow-up messages (each an individual doc). I want to aggregate over a time field for items with the same uniq… --- ## [How to use the elasticsearch Attachment Processor with node.js](https://discuss.elastic.co/t/how-to-use-the-elasticsearch-attachment-processor-with-node-js/173609)
**Author:** [@Joao\_D\_Junior](https://discuss.elastic.co/u/Joao_D_Junior)\ **Replies:** 9\ **Last updated:** [March 25, 2019, 3:27pm UTC](https://discuss.elastic.co/t/how-to-use-the-elasticsearch-attachment-processor-with-node-js/173609 "2019-03-25T15:27:56Z")
I'm making an application to search for words or phrases in .PDF files and I made the following code (Found on the internet): const elasticsearch = require('elasticsearch'); const fse = require('fs-extra') let clie… --- ## [Scroll vs search\_after memory](https://discuss.elastic.co/t/scroll-vs-search-after-memory/173765)
**Author:** [@xodn0812](https://discuss.elastic.co/u/xodn0812)\ **Replies:** 3\ **Last updated:** [March 25, 2019, 3:10pm UTC](https://discuss.elastic.co/t/scroll-vs-search-after-memory/173765 "2019-03-25T15:10:05Z")
Questions related to elasticsearch search. In an instance using 4Gb memory, elasticsearch dies with OOM when querying data over 4Gb with scroll API, What about search\_arter ?? Would not it be okay to search 50Gb for s… --- ## [Enabling Disaster recovery for Elasticsearch cluster in production](https://discuss.elastic.co/t/enabling-disaster-recovery-for-elasticsearch-cluster-in-production/173778)
**Author:** [@Veera\_Neerukonda](https://discuss.elastic.co/u/Veera_Neerukonda)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 3:01pm UTC](https://discuss.elastic.co/t/enabling-disaster-recovery-for-elasticsearch-cluster-in-production/173778 "2019-03-25T15:01:44Z")
Team, I have elasticsearch cluster with one master and two slaves(one data node). I am running those in CentOS VM's. I need to enable DR in a different region. What could be the best way to do that? I am using opensourc… --- ## [Add ignore\_above option for ICUCollationKeyword field](https://discuss.elastic.co/t/add-ignore-above-option-for-icucollationkeyword-field/172163)
**Author:** [@clement\_tourriere](https://discuss.elastic.co/u/clement_tourriere)\ **Replies:** 2\ **Last updated:** [March 25, 2019, 2:40pm UTC](https://discuss.elastic.co/t/add-ignore-above-option-for-icucollationkeyword-field/172163 "2019-03-25T14:40:54Z")
Hello, ICUCollationKeyword field (https://www.elastic.co/guide/en/elasticsearch/plugins/current/analysis-icu-collation-keyword-field.html) is great for sorting field. But for the moment it has a major drawback since it … --- ## [Ingest attachment doesnt support pattern for selecting field in case multiple attachment fields](https://discuss.elastic.co/t/ingest-attachment-doesnt-support-pattern-for-selecting-field-in-case-multiple-attachment-fields/173453)
**Author:** [@chetanc](https://discuss.elastic.co/u/chetanc)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 2:06pm UTC](https://discuss.elastic.co/t/ingest-attachment-doesnt-support-pattern-for-selecting-field-in-case-multiple-attachment-fields/173453 "2019-03-25T14:06:30Z")
Use case: If there are multiple fields in json which has to be mapped as attachment. And those keys are dynamic in nature or follow some convention, then those can not be used in ingest attachment plugin. For e.g. if I… --- ## [Taking the snapshot of elasticDB](https://discuss.elastic.co/t/taking-the-snapshot-of-elasticdb/173759)
**Author:** [@Chandan\_Kumar](https://discuss.elastic.co/u/Chandan_Kumar)\ **Replies:** 4\ **Last updated:** [March 25, 2019, 2:01pm UTC](https://discuss.elastic.co/t/taking-the-snapshot-of-elasticdb/173759 "2019-03-25T14:01:22Z")
Is there a way to quiesce the elasticDB, before taking any snapshots at storage level? --- ## [Scoring documents based on the intersection of a multi-value field](https://discuss.elastic.co/t/scoring-documents-based-on-the-intersection-of-a-multi-value-field/173761)
**Author:** [@bostanio](https://discuss.elastic.co/u/bostanio)\ **Replies:** 0\ **Last updated:** [March 25, 2019, 1:35pm UTC](https://discuss.elastic.co/t/scoring-documents-based-on-the-intersection-of-a-multi-value-field/173761 "2019-03-25T13:35:50Z")
Hi All, I'm trying to model a social network and query it with the search results order with 1st degree connections first 2nd degree connects next and then all other results. "mappings": { "entity": { "properties… --- ## [Elasticsearch | Highlight of integer fields when wildcard is used](https://discuss.elastic.co/t/elasticsearch-highlight-of-integer-fields-when-wildcard-is-used/169762)
**Author:** [@Nikesh](https://discuss.elastic.co/u/Nikesh)\ **Replies:** 5\ **Last updated:** [March 25, 2019, 1:57pm UTC](https://discuss.elastic.co/t/elasticsearch-highlight-of-integer-fields-when-wildcard-is-used/169762 "2019-03-25T13:57:01Z")
I have indexed a document containing integers . Mapping of these fields are : "INTEGER\_FIELD": { "type": "integer", "fields": { "keyword": { "type": "keyword", "ignore\_above": 256 } } } Search query is : … --- ## [6.6.1 aggregation performance](https://discuss.elastic.co/t/6-6-1-aggregation-performance/173631)
**Author:** [@kaihong](https://discuss.elastic.co/u/kaihong)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 1:46pm UTC](https://discuss.elastic.co/t/6-6-1-aggregation-performance/173631 "2019-03-25T13:46:21Z")
Hello, I've built up 2 es testing clusters, one 6.3.2 and the other 6.6.1, both on identical hardware(16c64g+ssd). 6.6.1 runs on jdk11+g1gc 6.3.2 runs on jdk8 + cmsgc After running "geonames" benchmark by esrally, I … --- ## [Multiple weighted boolean queries within one search](https://discuss.elastic.co/t/multiple-weighted-boolean-queries-within-one-search/173763)
**Author:** [@JeremyK](https://discuss.elastic.co/u/JeremyK)\ **Replies:** 0\ **Last updated:** [March 25, 2019, 1:38pm UTC](https://discuss.elastic.co/t/multiple-weighted-boolean-queries-within-one-search/173763 "2019-03-25T13:38:55Z")
I would like to have multiple weighted boolean queries within one search. I'm using the ElasticSearch Python client. The use case would be for example as following: Query 1 AND Query 2 --\> Weight 3.0 Query 1 OR Query 2… --- ## [Watcher webhook custom json](https://discuss.elastic.co/t/watcher-webhook-custom-json/173541)
**Author:** [@forestnd](https://discuss.elastic.co/u/forestnd)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 1:33pm UTC](https://discuss.elastic.co/t/watcher-webhook-custom-json/173541 "2019-03-25T13:33:48Z")
Hay all I am trying to get my head around customise the body of an webhook so instead of just ctx i like to out put for example { "name":"ctx.name", "date trigger":"ctx.date", "event level": "ctx.evlevel" } thanks… --- ## [Can't insert date into watch JSON via templating and script](https://discuss.elastic.co/t/cant-insert-date-into-watch-json-via-templating-and-script/173349)
**Author:** [@elvetemedve](https://discuss.elastic.co/u/elvetemedve)\ **Replies:** 3\ **Last updated:** [March 25, 2019, 1:27pm UTC](https://discuss.elastic.co/t/cant-insert-date-into-watch-json-via-templating-and-script/173349 "2019-03-25T13:27:18Z")
I created a new watch for altering the output of a machine learning job. The watch JSON looks like below. { "trigger": { "schedule": { "interval": "1m" } }, "input": { "http": { "request": { "scheme": "http", … --- ## [Xpack.http.proxy set username and password values?](https://discuss.elastic.co/t/xpack-http-proxy-set-username-and-password-values/172814)
**Author:** [@forestnd](https://discuss.elastic.co/u/forestnd)\ **Replies:** 3\ **Last updated:** [March 25, 2019, 1:23pm UTC](https://discuss.elastic.co/t/xpack-http-proxy-set-username-and-password-values/172814 "2019-03-25T13:23:27Z")
Hello All I am trying to setup watch alerts to send webhooks, to an outside provider., But i am behind an locked down proxy, where i need to provide a username and password, to get through. I can see how to set the pro… --- ## [Geo shapes](https://discuss.elastic.co/t/geo-shapes/173740)
**Author:** [@Sergio\_Redondo](https://discuss.elastic.co/u/Sergio_Redondo)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 12:30pm UTC](https://discuss.elastic.co/t/geo-shapes/173740 "2019-03-25T12:30:44Z")
Good morning, I'm trying to visualize geoshapes using beta 7.0. I am following the information of the link: https://www.elastic.co/guide/en/elasticsearch/reference/current/geo-shape.html A geoshape is composed of a type… --- ## [No document found for remote cluster module in elasticsearch](https://discuss.elastic.co/t/no-document-found-for-remote-cluster-module-in-elasticsearch/173662)
**Author:** [@nikhil.k](https://discuss.elastic.co/u/nikhil.k)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 12:06pm UTC](https://discuss.elastic.co/t/no-document-found-for-remote-cluster-module-in-elasticsearch/173662 "2019-03-25T12:06:52Z")
Hi Everyone, There is no document found for remote cluster module in elasticsearch. Version - 6.4.1 However, proper documentation of remote cluster module is given elasticsearch (version-6.6). Regards Nikhil Kapoor --- ## [Unnesting user\_agent fields using ingest processor](https://discuss.elastic.co/t/unnesting-user-agent-fields-using-ingest-processor/173736)
**Author:** [@opfreehere](https://discuss.elastic.co/u/opfreehere)\ **Replies:** 1\ **Last updated:** [March 25, 2019, 11:25am UTC](https://discuss.elastic.co/t/unnesting-user-agent-fields-using-ingest-processor/173736 "2019-03-25T11:25:12Z")
After using user\_agent processor, I am getting the results somewhat like this: "user\_agent" : { "patch" : "1", "major" : "5", "minor" : "1", "os" : "Android 5.1.1", "os\_minor" : "1", "os\_major" : "5", "name" : "A… --- ## [ReIndex API throws strict dynamic mapping exception](https://discuss.elastic.co/t/reindex-api-throws-strict-dynamic-mapping-exception/173729)
**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\ **Replies:** 0\ **Last updated:** [March 25, 2019, 10:43am UTC](https://discuss.elastic.co/t/reindex-api-throws-strict-dynamic-mapping-exception/173729 "2019-03-25T10:43:16Z")
Hi When I try to re-index the .kibana index; I get an exception for all the documents: Could someone please help me how to fix this error; since all my dashboards disappeared and have to restore the .kibana index. Req… --- ## [Keep using auto\_generate\_phrase\_queries](https://discuss.elastic.co/t/keep-using-auto-generate-phrase-queries/173723)
**Author:** [@FK\_Cheng](https://discuss.elastic.co/u/FK_Cheng)\ **Replies:** 0\ **Last updated:** [March 25, 2019, 10:32am UTC](https://discuss.elastic.co/t/keep-using-auto-generate-phrase-queries/173723 "2019-03-25T10:32:22Z")
How can I keep using auto\_generate\_phrase\_queries in query string query after deprecated? [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1353) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1355)