# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1725

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1726

---

## [High level REST client returns error 503 randomly](https://discuss.elastic.co/t/high-level-rest-client-returns-error-503-randomly/127356)

<div class="topic-metadata">

**Author:** [@hanyi8000](https://discuss.elastic.co/u/hanyi8000)\
**Replies:** 0\
**Last updated:** [April 9, 2018, 4:41pm UTC](https://discuss.elastic.co/t/high-level-rest-client-returns-error-503-randomly/127356 "2018-04-09T16:41:06Z")

</div>

Hi all, We use High level REST client to communicate to Elastichsearch 6.0, however it randomly returns 503 error, I'm guessing it's due to some timeout issue but we can not be sure the root cause. Below is our exceptio…

---

## [Google Cloud Storage Repository Plugin - "state" : "PARTIAL"](https://discuss.elastic.co/t/google-cloud-storage-repository-plugin-state-partial/127225)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 10\
**Last updated:** [April 9, 2018, 4:40pm UTC](https://discuss.elastic.co/t/google-cloud-storage-repository-plugin-state-partial/127225 "2018-04-09T16:40:53Z")

</div>

Hello, I'm using Elastic (6.2.2) Stack w/ Google Cloud Storage Repository Plugin | Elasticsearch Plugins and Integrations. I keep getting "PARTIAL" instead of "SUCCESS" state of my snapshot: # time curl --silent --hea…

---

## [Permissions Issue?](https://discuss.elastic.co/t/permissions-issue/127353)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 0\
**Last updated:** [April 9, 2018, 4:15pm UTC](https://discuss.elastic.co/t/permissions-issue/127353 "2018-04-09T16:15:29Z")

</div>

Seeing this repeatedly in Elasticsearch logs: \[2018-04-09T11:13:05,858\]\[DEBUG\]\[o.e.x.s.a.a.OptOutQueryCache\] \[SERVER.FQDN\] \[.monitoring-logstash-6-2018.04.09\] opting out of the query cache. current request doesn't hold …

---

## [Consuming More RAM Than Configured](https://discuss.elastic.co/t/consuming-more-ram-than-configured/124589)

<div class="topic-metadata">

**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\
**Replies:** 9\
**Last updated:** [April 9, 2018, 4:06pm UTC](https://discuss.elastic.co/t/consuming-more-ram-than-configured/124589 "2018-04-09T16:06:23Z")

</div>

Came in this morning to Elasticsearch not running. Checking the event logs, Windows reported Resource-Exhaustion with Elasticsearch consuming 9,965,961,216 bytes (9.2-ish GB) of RAM. JVM Options and the service are bot…

---

## [.NET setting field as Date](https://discuss.elastic.co/t/net-setting-field-as-date/126947)

<div class="topic-metadata">

**Author:** [@Neal\_Walters](https://discuss.elastic.co/u/Neal_Walters)\
**Replies:** 6\
**Last updated:** [April 9, 2018, 3:52pm UTC](https://discuss.elastic.co/t/net-setting-field-as-date/126947 "2018-04-09T15:52:03Z")

</div>

I'm trying to define the field createdDate below as a datetime, using .NET: \[Kibana\_CreatedDate\] Here's my existing code; had trouble finding any examples for the .NET classes. Maybe my date format needs to have the m…

---

## [Does Elasticsearch score different length shingles with the same IDF?](https://discuss.elastic.co/t/does-elasticsearch-score-different-length-shingles-with-the-same-idf/126653)

<div class="topic-metadata">

**Author:** [@Brett\_Anderson](https://discuss.elastic.co/u/Brett_Anderson)\
**Replies:** 3\
**Last updated:** [April 9, 2018, 3:37pm UTC](https://discuss.elastic.co/t/does-elasticsearch-score-different-length-shingles-with-the-same-idf/126653 "2018-04-09T15:37:38Z")

</div>

In Elasticsearch 5.6.5 I'm searching against a field with the following filter applied: "filter\_shingle":{ "max\_shingle\_size":"4", "min\_shingle\_size":"2", "output\_unigrams":"true", "typ…

---

## [Upgrade to x-pack 6.2.3 getting transport errors](https://discuss.elastic.co/t/upgrade-to-x-pack-6-2-3-getting-transport-errors/127346)

<div class="topic-metadata">

**Author:** [@jhn134910](https://discuss.elastic.co/u/jhn134910)\
**Replies:** 0\
**Last updated:** [April 9, 2018, 3:29pm UTC](https://discuss.elastic.co/t/upgrade-to-x-pack-6-2-3-getting-transport-errors/127346 "2018-04-09T15:29:01Z")

</div>

After upgrading from elastic-search 5.4.0 -\> 5.6.8 -\> 6.2.3 it is necessary to add TLS to the elastic-search cluster. I attempted to add TLS configuration to a single node cluster operating in production mode (for test p…

---

## [Search within a specific type from Mustache](https://discuss.elastic.co/t/search-within-a-specific-type-from-mustache/127307)

<div class="topic-metadata">

**Author:** [@najib](https://discuss.elastic.co/u/najib)\
**Replies:** 5\
**Last updated:** [April 9, 2018, 1:00pm UTC](https://discuss.elastic.co/t/search-within-a-specific-type-from-mustache/127307 "2018-04-09T13:00:37Z")

</div>

Hi there, Is it possible to make a Search query using a Mustache script but restrict the Search to give only results within a specific Type? My Java client code would send the type name to the Mustache script as a para…

---

## [Une connexion existante a dû être fermée par l’hôte distant](https://discuss.elastic.co/t/une-connexion-existante-a-du-etre-fermee-par-l-hote-distant/127323)

<div class="topic-metadata">

**Author:** [@chrigui94](https://discuss.elastic.co/u/chrigui94)\
**Replies:** 3\
**Last updated:** [April 9, 2018, 2:44pm UTC](https://discuss.elastic.co/t/une-connexion-existante-a-du-etre-fermee-par-l-hote-distant/127323 "2018-04-09T14:44:17Z")

</div>

I always receive this problem and I can't find a solution for this : \[2018-04-09T11:31:33,435\]\[WARN \]\[o.e.h.n.Netty4HttpServerTransport\] \[SST-P1307000FW\] caught exception while handling client http traffic, closing conn…

---

## [How to replacement - with 0 by gsub processor in ingest pipeline?](https://discuss.elastic.co/t/how-to-replacement-with-0-by-gsub-processor-in-ingest-pipeline/127251)

<div class="topic-metadata">

**Author:** [@jackyshen](https://discuss.elastic.co/u/jackyshen)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 2:36pm UTC](https://discuss.elastic.co/t/how-to-replacement-with-0-by-gsub-processor-in-ingest-pipeline/127251 "2018-04-09T14:36:50Z")

</div>

Some of the value for field price is "-",so I want to replace it with 0 by gsub processor ,then I write the following code, however it doesn't work, how to write code? { "gsub": { "field": "price", "pattern": "-", …

---

## [Date time format new](https://discuss.elastic.co/t/date-time-format-new/126867)

<div class="topic-metadata">

**Author:** [@Senthiles](https://discuss.elastic.co/u/Senthiles)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 2:34pm UTC](https://discuss.elastic.co/t/date-time-format-new/126867 "2018-04-09T14:34:01Z")

</div>

Hi, Can any one suggest how to retrieve a date from index with formated. below is my mapping and value stored in index. my mapping "createddate": { "type": "date" }, "createddate": "2018-03-30T08:30:46.865Z"

---

## [Can't set Centralized pipeline management](https://discuss.elastic.co/t/cant-set-centralized-pipeline-management/126909)

<div class="topic-metadata">

**Author:** [@Joff](https://discuss.elastic.co/u/Joff)\
**Replies:** 1\
**Last updated:** [April 9, 2018, 2:11pm UTC](https://discuss.elastic.co/t/cant-set-centralized-pipeline-management/126909 "2018-04-09T14:11:55Z")

</div>

Hi, I'm trying to set Centralized pipeline management but it is still not working. I'm using Elastic Cloud trial version and Logstash running on a local vm my logstash.yml looks like: xpack.management.elasticsearch.…

---

## [Aggregation queries question](https://discuss.elastic.co/t/aggregation-queries-question/126962)

<div class="topic-metadata">

**Author:** [@nathen.hinson](https://discuss.elastic.co/u/nathen.hinson)\
**Replies:** 5\
**Last updated:** [April 9, 2018, 1:39pm UTC](https://discuss.elastic.co/t/aggregation-queries-question/126962 "2018-04-09T13:39:55Z")

</div>

Hello, I have roughly 68 million documents across four indices that have identical mappings, for example: { 'log\_time': '2017-01-06T09:23:00Z', 'extra': {}, 'used': False, 'who': u'Bruno', 'interaction\_id': u'Fift…

---

## [Elastcisearch - curator script for delete indices](https://discuss.elastic.co/t/elastcisearch-curator-script-for-delete-indices/127289)

<div class="topic-metadata">

**Author:** [@unix196](https://discuss.elastic.co/u/unix196)\
**Replies:** 5\
**Last updated:** [April 9, 2018, 1:27pm UTC](https://discuss.elastic.co/t/elastcisearch-curator-script-for-delete-indices/127289 "2018-04-09T13:27:48Z")

</div>

Good day. elasticsearch 5.3.0 elasticsearch-curator (4.2.6) We have python script for delete old indices from Elasticsearch. Python script receive list of indices that need remove: delete = curator.DeleteIndices(indic…

---

## [Elasticsearch doc update fails with illegal\_argument\_exception](https://discuss.elastic.co/t/elasticsearch-doc-update-fails-with-illegal-argument-exception/127262)

<div class="topic-metadata">

**Author:** [@rgaduput](https://discuss.elastic.co/u/rgaduput)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 1:10pm UTC](https://discuss.elastic.co/t/elasticsearch-doc-update-fails-with-illegal-argument-exception/127262 "2018-04-09T13:10:49Z")

</div>

Hi, We are updating Elastic document using ES python client, and facing below issue during the update. TransportError(400, u'illegal\_argument\_exception', u'\[93f58351-0db1-423e-ae5c-ebb1c3dea103\]\[172.17.0.2:9300\]\[indice…

---

## [Search for available dates?](https://discuss.elastic.co/t/search-for-available-dates/127317)

<div class="topic-metadata">

**Author:** [@remco\_zwaan](https://discuss.elastic.co/u/remco_zwaan)\
**Replies:** 7\
**Last updated:** [April 9, 2018, 12:48pm UTC](https://discuss.elastic.co/t/search-for-available-dates/127317 "2018-04-09T12:48:54Z")

</div>

Hi , We want to make a search engine for available rooms based on date user input. I have searched and come up with this solution. PUT /rooms { "mappings": { "room": { "properties": { "room\_num": …

---

## [Unable to restore snaphost](https://discuss.elastic.co/t/unable-to-restore-snaphost/127249)

<div class="topic-metadata">

**Author:** [@baskar](https://discuss.elastic.co/u/baskar)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 12:08pm UTC](https://discuss.elastic.co/t/unable-to-restore-snaphost/127249 "2018-04-09T12:08:59Z")

</div>

HI ,Please help on this issue ... unable restore \< hduser@HMCOHWPC0218:~/Scripts$ curl -XPOST "192.168.XX.XX:9200/\_snapshot/my\_backup/20180405-000501/\_restore?wait\_for\_completion=true" {"snapshot":{"snapshot":"201804…

---

## [Can we pass index as a range](https://discuss.elastic.co/t/can-we-pass-index-as-a-range/127271)

<div class="topic-metadata">

**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\
**Replies:** 1\
**Last updated:** [April 9, 2018, 11:43am UTC](https://discuss.elastic.co/t/can-we-pass-index-as-a-range/127271 "2018-04-09T11:43:51Z")

</div>

Hi , Here is the scenario. I have following indexes event-2017-12-31 event-2018-01-01 event-2018-01-02 .... .... event-2018-01-31 I want to search the data between index range event-2017-12-31 - event-2018-01-1…

---

## [Difference between consecutive records using derivative aggregation](https://discuss.elastic.co/t/difference-between-consecutive-records-using-derivative-aggregation/123901)

<div class="topic-metadata">

**Author:** [@vinayakfutak](https://discuss.elastic.co/u/vinayakfutak)\
**Replies:** 0\
**Last updated:** [March 14, 2018, 12:24pm UTC](https://discuss.elastic.co/t/difference-between-consecutive-records-using-derivative-aggregation/123901 "2018-03-14T12:24:24Z")

</div>

These are the records inserted in my index { { "\_index": "device\_beacon\_log\_test", "\_type": "device\_beacon\_log\_test", "\_id": "AWIJlB6WpDisa0DNP7rG", "\_score": 1, "\_source": { "place\_id": 61, "device\_time": "2018…

---

## [Painless query very slowly](https://discuss.elastic.co/t/painless-query-very-slowly/127295)

<div class="topic-metadata">

**Author:** [@fapwlh](https://discuss.elastic.co/u/fapwlh)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 10:17am UTC](https://discuss.elastic.co/t/painless-query-very-slowly/127295 "2018-04-09T10:17:07Z")

</div>

I'm a beginner, when I use painless script to search ,very slowly ,but use date\_histogram very quickly. \`POST /productinfo/\_search { "aggs": { "groupbyyear":{ "terms": { "script": { "lang": "painless", "source":"…

---

## [Limits of Users and Roles while using X-Pack Plugin](https://discuss.elastic.co/t/limits-of-users-and-roles-while-using-x-pack-plugin/127085)

<div class="topic-metadata">

**Author:** [@amitmjadav](https://discuss.elastic.co/u/amitmjadav)\
**Replies:** 2\
**Last updated:** [April 9, 2018, 10:16am UTC](https://discuss.elastic.co/t/limits-of-users-and-roles-while-using-x-pack-plugin/127085 "2018-04-09T10:16:18Z")

</div>

Hi, Can any one let me know Wile using X-pack plugin with elasticsearch 1:How many roles can be created.Is there any limit to create roles? 2:Can a user have multiple roles? 3:How many users can be created.IS there a…

---

## [Migration from transport to rest](https://discuss.elastic.co/t/migration-from-transport-to-rest/127298)

<div class="topic-metadata">

**Author:** [@ts\_rana](https://discuss.elastic.co/u/ts_rana)\
**Replies:** 0\
**Last updated:** [April 9, 2018, 10:01am UTC](https://discuss.elastic.co/t/migration-from-transport-to-rest/127298 "2018-04-09T10:01:50Z")

</div>

Could anyone help me to find corresponding rest API for this (prepare index with indexWriteAlias)??? protected void indexDoc(String indexWriteAlias) { client.prepareIndex(indexWriteAlias, "rollover") .setSource("{"foo…

---

## [Delete field from the index](https://discuss.elastic.co/t/delete-field-from-the-index/126847)

<div class="topic-metadata">

**Author:** [@surajdalvi](https://discuss.elastic.co/u/surajdalvi)\
**Replies:** 4\
**Last updated:** [April 9, 2018, 9:56am UTC](https://discuss.elastic.co/t/delete-field-from-the-index/126847 "2018-04-09T09:56:50Z")

</div>

Hi, I am having one index which consists 20 fields.The index having 2000 documents into it and I want to delete one field from that index. I don't want to update each document. Can anyone please tell me how I can remov…

---

## [Elasticsearch 6.2.2 nodes crash after reaching ulimit setting](https://discuss.elastic.co/t/elasticsearch-6-2-2-nodes-crash-after-reaching-ulimit-setting/124172)

<div class="topic-metadata">

**Author:** [@iamredlus](https://discuss.elastic.co/u/iamredlus)\
**Replies:** 11\
**Last updated:** [April 9, 2018, 9:35am UTC](https://discuss.elastic.co/t/elasticsearch-6-2-2-nodes-crash-after-reaching-ulimit-setting/124172 "2018-04-09T09:35:24Z")

</div>

Hi, We're experiencing a critical production issue in elasticsearch 6.2.2 related to open\_file\_descriptors. The cluster is an exact replica (as much as possible) of a 5.2.2 cluster, and documents are indexed into both c…

---

## [Format bytes in templates pattern](https://discuss.elastic.co/t/format-bytes-in-templates-pattern/127211)

<div class="topic-metadata">

**Author:** [@zifou](https://discuss.elastic.co/u/zifou)\
**Replies:** 6\
**Last updated:** [April 9, 2018, 8:38am UTC](https://discuss.elastic.co/t/format-bytes-in-templates-pattern/127211 "2018-04-09T08:38:13Z")

</div>

Hi All, Can someone explain me how to add the format byte to my index template, because i need each day change each index to specify that OUT\_BYTES and IN\_BYTES is a byte field, here is my template. Another, all my new …

---

## [Disable node during GC](https://discuss.elastic.co/t/disable-node-during-gc/126963)

<div class="topic-metadata">

**Author:** [@ebuildy](https://discuss.elastic.co/u/ebuildy)\
**Replies:** 2\
**Last updated:** [April 9, 2018, 8:31am UTC](https://discuss.elastic.co/t/disable-node-during-gc/126963 "2018-04-09T08:31:35Z")

</div>

In a 10 nodes cluster, with ES 1.5, Java 1.8, 8g of heap: Sometime when we receive big traffic, a node does a stop-the-world GC during 10 secondes, but it seems other nodes are still using it to query, hence the node is…

---

## [What is the security realm recommended in ES 5.6](https://discuss.elastic.co/t/what-is-the-security-realm-recommended-in-es-5-6/117841)

<div class="topic-metadata">

**Author:** [@Javier\_Parrondo](https://discuss.elastic.co/u/Javier_Parrondo)\
**Replies:** 9\
**Last updated:** [April 9, 2018, 8:30am UTC](https://discuss.elastic.co/t/what-is-the-security-realm-recommended-in-es-5-6/117841 "2018-04-09T08:30:09Z")

</div>

Hello! I would like to know what is the recommended realm for the elasticsearch security with XPACK in Elasticsearch 5.6. I have known the file realm but i have no clear if migrate it towards the API User Management. I…

---

## [Path logs Failure](https://discuss.elastic.co/t/path-logs-failure/127050)

<div class="topic-metadata">

**Author:** [@pablo\_gracia](https://discuss.elastic.co/u/pablo_gracia)\
**Replies:** 1\
**Last updated:** [April 9, 2018, 8:22am UTC](https://discuss.elastic.co/t/path-logs-failure/127050 "2018-04-09T08:22:47Z")

</div>

I have my logs stored with rsyslog at the path /var/log/udp.log, but when i configure my elasticsearch.yml on the "paths" part I wrote down on the part path.logs /var/log/udp.log, I restart my elasticsearch and status it…

---

## [Port is already occupied when connecting to ElasticSearch with the help of Jolokia jvm agent](https://discuss.elastic.co/t/port-is-already-occupied-when-connecting-to-elasticsearch-with-the-help-of-jolokia-jvm-agent/127097)

<div class="topic-metadata">

**Author:** [@Nikita\_Krasnov](https://discuss.elastic.co/u/Nikita_Krasnov)\
**Replies:** 1\
**Last updated:** [April 9, 2018, 8:18am UTC](https://discuss.elastic.co/t/port-is-already-occupied-when-connecting-to-elasticsearch-with-the-help-of-jolokia-jvm-agent/127097 "2018-04-09T08:18:49Z")

</div>

I want to monitor jvm health of Elasticsearch 6x with the help of jolokia java jvm agent 1.5.0. For taking all metrics from Jolokia I use Metricbeat-6.2.3 and then will put all of them to Elasticsearch. Everything is ins…

---

## [ElasticSearch 5.5 returns 0 hits under high concurrency conditions](https://discuss.elastic.co/t/elasticsearch-5-5-returns-0-hits-under-high-concurrency-conditions/127127)

<div class="topic-metadata">

**Author:** [@trangvenn](https://discuss.elastic.co/u/trangvenn)\
**Replies:** 1\
**Last updated:** [April 9, 2018, 8:07am UTC](https://discuss.elastic.co/t/elasticsearch-5-5-returns-0-hits-under-high-concurrency-conditions/127127 "2018-04-09T08:07:34Z")

</div>

HI, Under high concurrency conditions on a Spark EMR cluster, elasticsearch is returning 0 hits for a query that would succeed otherwise. The query we are using involves geospatial joins across pre-indexed geoshapes. W…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1724)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1726)
