# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1925

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1926

---

## [Sandbox for painless?](https://discuss.elastic.co/t/sandbox-for-painless/103405)

<div class="topic-metadata">

**Author:** [@abkrim](https://discuss.elastic.co/u/abkrim)\
**Replies:** 2\
**Last updated:** [October 10, 2017, 6:59pm UTC](https://discuss.elastic.co/t/sandbox-for-painless/103405 "2017-10-10T18:59:31Z")

</div>

Is there any site or method to make sandbox with Painless? Can I test the scripts as if it were the javascript language? How can I test my scripts? For example in some functions I wondered if the value is correct. bo…

---

## [Elasticsearch for Apache Hadoop 5.6.3 released](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-5-6-3-released/103419)

<div class="topic-metadata">

**Author:** [@james.baiera](https://discuss.elastic.co/u/james.baiera)\
**Replies:** 0\
**Last updated:** [October 10, 2017, 6:48pm UTC](https://discuss.elastic.co/t/elasticsearch-for-apache-hadoop-5-6-3-released/103419 "2017-10-10T18:48:20Z")

</div>

I am proud to announce that ES-Hadoop 5.6.3 has been released! You can read more about these releases here.

---

## [0 hits, 14693688 total on index with 700 documents](https://discuss.elastic.co/t/0-hits-14693688-total-on-index-with-700-documents/102608)

<div class="topic-metadata">

**Author:** [@spappier](https://discuss.elastic.co/u/spappier)\
**Replies:** 14\
**Last updated:** [October 10, 2017, 6:36pm UTC](https://discuss.elastic.co/t/0-hits-14693688-total-on-index-with-700-documents/102608 "2017-10-10T18:36:21Z")

</div>

Hi, I'm having the following problem on an Elasticsearch 5.4.3 cluster. When making a query where some shards don't return any hits they seem to return an incorrect total. This happens only on some nodes and restarting t…

---

## [Dangling Index Imported Leads to Unassigned Shards](https://discuss.elastic.co/t/dangling-index-imported-leads-to-unassigned-shards/101880)

<div class="topic-metadata">

**Author:** [@corona](https://discuss.elastic.co/u/corona)\
**Replies:** 18\
**Last updated:** [October 10, 2017, 6:19pm UTC](https://discuss.elastic.co/t/dangling-index-imported-leads-to-unassigned-shards/101880 "2017-10-10T18:19:44Z")

</div>

Hello, I'm seeing around 1380 shards unassigned after a recent restart of a node in the cluster. This cluster has 20 nodes with 49122 shards with around 17TB of data. We're currently running version 2.4.0. With one node…

---

## [Search for Fields Containing Multiple Lines with Regexp](https://discuss.elastic.co/t/search-for-fields-containing-multiple-lines-with-regexp/103414)

<div class="topic-metadata">

**Author:** [@cb2015](https://discuss.elastic.co/u/cb2015)\
**Replies:** 0\
**Last updated:** [October 10, 2017, 5:57pm UTC](https://discuss.elastic.co/t/search-for-fields-containing-multiple-lines-with-regexp/103414 "2017-10-10T17:57:42Z")

</div>

Hi All, I have this query that I am working on: GET web-jsp-2017.10.04/\_search { "query" : { "regexp": { "stacktrace":{ "value" : "java.net.socket.+", "flags": "ALL" } } } } Thi…

---

## [Launching tests in qa/smoke-test-reindex-with-all-modules](https://discuss.elastic.co/t/launching-tests-in-qa-smoke-test-reindex-with-all-modules/103410)

<div class="topic-metadata">

**Author:** [@pozhidaevak](https://discuss.elastic.co/u/pozhidaevak)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 5:52pm UTC](https://discuss.elastic.co/t/launching-tests-in-qa-smoke-test-reindex-with-all-modules/103410 "2017-10-10T17:52:24Z")

</div>

I want to launch tests from the next YAML file qa/smoke-test-reindex-with-all-modules/src/test/resources/rest-api-spec/test/update\_by\_query/10\_script.yml. I tried to do so by launching one of the following commands: gr…

---

## [Shard reallocation stops](https://discuss.elastic.co/t/shard-reallocation-stops/103137)

<div class="topic-metadata">

**Author:** [@phil.lavin](https://discuss.elastic.co/u/phil.lavin)\
**Replies:** 10\
**Last updated:** [October 10, 2017, 5:50pm UTC](https://discuss.elastic.co/t/shard-reallocation-stops/103137 "2017-10-10T17:50:31Z")

</div>

Very confused here. Just upgraded the RAM in one node in a 2 node cluster. Node was shut down cleanly and brought up cleanly after the upgrade. When the node is started, shards start reallocating from the other node. How…

---

## [/\_snapshot endpoint API documentation](https://discuss.elastic.co/t/snapshot-endpoint-api-documentation/103404)

<div class="topic-metadata">

**Author:** [@SimoneCafiero](https://discuss.elastic.co/u/SimoneCafiero)\
**Replies:** 4\
**Last updated:** [October 10, 2017, 5:05pm UTC](https://discuss.elastic.co/t/snapshot-endpoint-api-documentation/103404 "2017-10-10T17:05:41Z")

</div>

Hi guys, is there a complete documentation of the following API endpoint: /\_snapshot I would like to know if it's possible to edit backup metadata names (snap-CUSTOM\_NAME or meta-CUSTOM\_NAME instead of having a rando…

---

## [Can't hit some endpoints in ES 5.6.2 externally](https://discuss.elastic.co/t/cant-hit-some-endpoints-in-es-5-6-2-externally/102897)

<div class="topic-metadata">

**Author:** [@Nikolay\_Klimchuk](https://discuss.elastic.co/u/Nikolay_Klimchuk)\
**Replies:** 6\
**Last updated:** [October 10, 2017, 4:40pm UTC](https://discuss.elastic.co/t/cant-hit-some-endpoints-in-es-5-6-2-externally/102897 "2017-10-10T16:40:25Z")

</div>

I have bizarre problem after installing ES 5.6.2 on AWS EC2 instance for the first time. Request: http://34.207.177.92:9200/\_cluster Response: {"error":{"root\_cause":\[{"type":"illegal\_argument\_exception","reason":"No e…

---

## [Getting "parser not found" error on a filter date range aggregation](https://discuss.elastic.co/t/getting-parser-not-found-error-on-a-filter-date-range-aggregation/103399)

<div class="topic-metadata">

**Author:** [@pdesoyres](https://discuss.elastic.co/u/pdesoyres)\
**Replies:** 4\
**Last updated:** [October 10, 2017, 3:40pm UTC](https://discuss.elastic.co/t/getting-parser-not-found-error-on-a-filter-date-range-aggregation/103399 "2017-10-10T15:40:48Z")

</div>

I have the following mapping : { "my\_index": { "mappings": { "my\_type": { "properties": { "date": { "type": "date", "format": "strict\_date\_optional\_time||epoch\_milli…

---

## [How to partial update all the document within a type in a single query?](https://discuss.elastic.co/t/how-to-partial-update-all-the-document-within-a-type-in-a-single-query/103398)

<div class="topic-metadata">

**Author:** [@vaibhav\_goel](https://discuss.elastic.co/u/vaibhav_goel)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 3:30pm UTC](https://discuss.elastic.co/t/how-to-partial-update-all-the-document-within-a-type-in-a-single-query/103398 "2017-10-10T15:30:56Z")

</div>

I want to update a field of all the document in a particular type in a single query .. how can i do this ??

---

## [INFO: os::commit\_memory(X, X, 0) failed; error='Cannot allocate memory' (errno=12)](https://discuss.elastic.co/t/info-os-commit-memory-x-x-0-failed-error-cannot-allocate-memory-errno-12/102759)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 3:20pm UTC](https://discuss.elastic.co/t/info-os-commit-memory-x-x-0-failed-error-cannot-allocate-memory-errno-12/102759 "2017-10-10T15:20:16Z")

</div>

I'm trying to follow Google Cloud Storage Repository Plugin | Elasticsearch Plugins and Integrations \[5.6\] | Elastic and while executing command, I'm getting following error: # docker exec -it elasticsearch bin/elastics…

---

## [ES cluster](https://discuss.elastic.co/t/es-cluster/103395)

<div class="topic-metadata">

**Author:** [@trelo](https://discuss.elastic.co/u/trelo)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 3:06pm UTC](https://discuss.elastic.co/t/es-cluster/103395 "2017-10-10T15:06:24Z")

</div>

Hi, experts! I'm newbie in ES and I need your advice. I've an app which is hosting in two different sites(A and B). In site A I've a single master ES node which is handling all requests from both A and B site(multiple b…

---

## [Bootstrap.mlock setting](https://discuss.elastic.co/t/bootstrap-mlock-setting/103073)

<div class="topic-metadata">

**Author:** [@corona](https://discuss.elastic.co/u/corona)\
**Replies:** 2\
**Last updated:** [October 10, 2017, 2:48pm UTC](https://discuss.elastic.co/t/bootstrap-mlock-setting/103073 "2017-10-10T14:48:21Z")

</div>

Hello, We are currently running a cluster with 20 nodes 49800 shards and version 2.4.0. Recently I set the bootstrap.mlockall setting to true. Over the span of a month, I've observed the nodes with this setting have sl…

---

## [Upgrade elasticsearch from 1.3.2 to 2.x](https://discuss.elastic.co/t/upgrade-elasticsearch-from-1-3-2-to-2-x/103387)

<div class="topic-metadata">

**Author:** [@juanito](https://discuss.elastic.co/u/juanito)\
**Replies:** 4\
**Last updated:** [October 10, 2017, 2:42pm UTC](https://discuss.elastic.co/t/upgrade-elasticsearch-from-1-3-2-to-2-x/103387 "2017-10-10T14:42:04Z")

</div>

Hi When I run the migration tool, I get some warnings, I have fix the biggest issues. But I need some assistants: The fst and compressed fielddata formats are no longer supported and will be ignored Here is the mapp…

---

## [Snapshot - Repository S3 (Strategy)](https://discuss.elastic.co/t/snapshot-repository-s3-strategy/103184)

<div class="topic-metadata">

**Author:** [@lazam](https://discuss.elastic.co/u/lazam)\
**Replies:** 6\
**Last updated:** [October 10, 2017, 2:33pm UTC](https://discuss.elastic.co/t/snapshot-repository-s3-strategy/103184 "2017-10-10T14:33:01Z")

</div>

Hi! I'm doing a backup in our S3. So far we're using a monthly index, but we're planning to do a daily backup using curator. Versions: Elasticsearch 5.6.1 Curator 5.2 Here are some questions: Is it good to do a da…

---

## [Inner Hits including parent document](https://discuss.elastic.co/t/inner-hits-including-parent-document/100765)

<div class="topic-metadata">

**Author:** [@visitek](https://discuss.elastic.co/u/visitek)\
**Replies:** 2\
**Last updated:** [October 10, 2017, 2:31pm UTC](https://discuss.elastic.co/t/inner-hits-including-parent-document/100765 "2017-10-10T14:31:28Z")

</div>

Is there possible to get work something like this? I've tried inner\_hits also from parent to child, but still no effect. ES 5.6 I thing, something is disabled, because inner\_hits are not applied. I can not find whats w…

---

## [Cannot Save Data Frame to Elasticsearch during spark streaming](https://discuss.elastic.co/t/cannot-save-data-frame-to-elasticsearch-during-spark-streaming/103377)

<div class="topic-metadata">

**Author:** [@srinathji](https://discuss.elastic.co/u/srinathji)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 2:26pm UTC](https://discuss.elastic.co/t/cannot-save-data-frame-to-elasticsearch-during-spark-streaming/103377 "2017-10-10T14:26:52Z")

</div>

Hi All, please help me , i am getting below error while saving dataframe to Elastic search while spark streaming: org.elasticsearch.hadoop.EsHadoopIllegalArgumentException: Cannot determine write shards for \[custAct\_in…

---

## [Does my structure false?](https://discuss.elastic.co/t/does-my-structure-false/103364)

<div class="topic-metadata">

**Author:** [@mat.bst](https://discuss.elastic.co/u/mat.bst)\
**Replies:** 3\
**Last updated:** [October 10, 2017, 2:17pm UTC](https://discuss.elastic.co/t/does-my-structure-false/103364 "2017-10-10T14:17:37Z")

</div>

Hi everyone ! i would like to know if my json datafile structure is false to be use correctly by ES/Kibana. Below my JSON structure: { "2017-10-04T08:15:03.079+0000":{ "Countrie-one":\[ { "server":"name-one", "use…

---

## [Search time with multiple aliases](https://discuss.elastic.co/t/search-time-with-multiple-aliases/103362)

<div class="topic-metadata">

**Author:** [@Cristiana\_Tiugan](https://discuss.elastic.co/u/Cristiana_Tiugan)\
**Replies:** 0\
**Last updated:** [October 10, 2017, 11:53am UTC](https://discuss.elastic.co/t/search-time-with-multiple-aliases/103362 "2017-10-10T11:53:58Z")

</div>

Hello, I have an index with 20 000 000 documents, each document having ~5 nested objects. As you can imagine, the update takes a long time, sometimes around 2 minutes. I was thinking on spliting the big index in multi…

---

## [Querying documents for the past 10 minutes is not working](https://discuss.elastic.co/t/querying-documents-for-the-past-10-minutes-is-not-working/103288)

<div class="topic-metadata">

**Author:** [@cocoonryan](https://discuss.elastic.co/u/cocoonryan)\
**Replies:** 9\
**Last updated:** [October 10, 2017, 11:05am UTC](https://discuss.elastic.co/t/querying-documents-for-the-past-10-minutes-is-not-working/103288 "2017-10-10T11:05:04Z")

</div>

i have a query like this to query documents within the past 10 minutes, but it returns documents outside the 10 minutes range. { "\_source": \["timestamp"\], "query": { "range":{ "timestamp":{ "gt": "now-10m" } } } …

---

## [License update error](https://discuss.elastic.co/t/license-update-error/103308)

<div class="topic-metadata">

**Author:** [@nsivabalan](https://discuss.elastic.co/u/nsivabalan)\
**Replies:** 6\
**Last updated:** [October 10, 2017, 9:41am UTC](https://discuss.elastic.co/t/license-update-error/103308 "2017-10-10T09:41:57Z")

</div>

Hi Team, Getting below error while updating license. { "error": { "root\_cause": \[{ "type": "illegal\_argument\_exception", "reason": "failed to parse license source" }\], "type": "illegal\_argument\_exception", "reas…

---

## [Elasticsearch single test error](https://discuss.elastic.co/t/elasticsearch-single-test-error/103233)

<div class="topic-metadata">

**Author:** [@8a98bb2968a03fe24acf](https://discuss.elastic.co/u/8a98bb2968a03fe24acf)\
**Replies:** 3\
**Last updated:** [October 10, 2017, 9:39am UTC](https://discuss.elastic.co/t/elasticsearch-single-test-error/103233 "2017-10-10T09:39:44Z")

</div>

hi there I want to run a single test case so I read a document about testing and I found this command. gradle test -Dtests.class=org.elasticsearch.package.ClassName I want to test this class NumberFieldMapperTests s…

---

## [Is there a way to do group by aggregations and get all the documents that belong to particular group aggregate?](https://discuss.elastic.co/t/is-there-a-way-to-do-group-by-aggregations-and-get-all-the-documents-that-belong-to-particular-group-aggregate/103266)

<div class="topic-metadata">

**Author:** [@kant\_kodali](https://discuss.elastic.co/u/kant_kodali)\
**Replies:** 3\
**Last updated:** [October 10, 2017, 7:23am UTC](https://discuss.elastic.co/t/is-there-a-way-to-do-group-by-aggregations-and-get-all-the-documents-that-belong-to-particular-group-aggregate/103266 "2017-10-10T07:23:59Z")

</div>

Is there a way to do group by aggregations and get all the documents that belong to particular group aggregate ? so this is not like group by aggregation where for each group you get some aggregate/metrics but also I wa…

---

## [Trying to understand Painless](https://discuss.elastic.co/t/trying-to-understand-painless/103256)

<div class="topic-metadata">

**Author:** [@abkrim](https://discuss.elastic.co/u/abkrim)\
**Replies:** 2\
**Last updated:** [October 10, 2017, 6:37am UTC](https://discuss.elastic.co/t/trying-to-understand-painless/103256 "2017-10-10T06:37:15Z")

</div>

I need to perform a series of complex calculations to perform document matching. After many attempts, I have seen that the best way was to work with Painless since I have to combine many types of document, some of type …

---

## [Elastic not creating fields](https://discuss.elastic.co/t/elastic-not-creating-fields/101085)

<div class="topic-metadata">

**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Replies:** 8\
**Last updated:** [October 10, 2017, 6:16am UTC](https://discuss.elastic.co/t/elastic-not-creating-fields/101085 "2017-10-10T06:16:48Z")

</div>

Hello, I'm having a problem I can't figure out at all. I'm using a KV filter in logstash to separate Firwall log files. Tests using stdout result in logs being parsed as expected. However, when I change the output to e…

---

## [Why auto delete the monitoring data about es and kibana how to change it](https://discuss.elastic.co/t/why-auto-delete-the-monitoring-data-about-es-and-kibana-how-to-change-it/103280)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 3:10am UTC](https://discuss.elastic.co/t/why-auto-delete-the-monitoring-data-about-es-and-kibana-how-to-change-it/103280 "2017-10-10T03:10:13Z")

</div>

\[2017-10-10T01:00:00,001\]\[INFO \]\[o.e.x.m.e.l.LocalExporter\] cleaning up \[2\] old indices \[2017-10-10T01:00:00,003\]\[INFO \]\[o.e.c.m.MetaDataDeleteIndexService\] \[xxx.xxx\] \[.monitoring-kibana-2-2017.10.02/ozkaTfbFRb2u35iQclZv…

---

## [How can I construct a filter that matches a bucket from a date\_histogram aggregation?](https://discuss.elastic.co/t/how-can-i-construct-a-filter-that-matches-a-bucket-from-a-date-histogram-aggregation/103272)

<div class="topic-metadata">

**Author:** [@simonwillison](https://discuss.elastic.co/u/simonwillison)\
**Replies:** 1\
**Last updated:** [October 10, 2017, 2:10am UTC](https://discuss.elastic.co/t/how-can-i-construct-a-filter-that-matches-a-bucket-from-a-date-histogram-aggregation/103272 "2017-10-10T02:10:22Z")

</div>

Say for example I have a date\_histogram aggregation that looks like this: { "date\_histogram": { "field": "request\_datetime", "interval": "hour" } } I get back buckets that look l…

---

## [Curator: Should I exclude System Indicies](https://discuss.elastic.co/t/curator-should-i-exclude-system-indicies/103264)

<div class="topic-metadata">

**Author:** [@jnpetty](https://discuss.elastic.co/u/jnpetty)\
**Replies:** 3\
**Last updated:** [October 9, 2017, 10:32pm UTC](https://discuss.elastic.co/t/curator-should-i-exclude-system-indicies/103264 "2017-10-09T22:32:56Z")

</div>

I want Curator to delete all indicies after 60 days, but should I exclude some of the system indicies?

---

## [Full list of headers for \_cat/indices](https://discuss.elastic.co/t/full-list-of-headers-for-cat-indices/103242)

<div class="topic-metadata">

**Author:** [@Maxwell\_Flanders](https://discuss.elastic.co/u/Maxwell_Flanders)\
**Replies:** 4\
**Last updated:** [October 9, 2017, 9:54pm UTC](https://discuss.elastic.co/t/full-list-of-headers-for-cat-indices/103242 "2017-10-09T21:54:56Z")

</div>

I was looking at the documentation for the \_cat/indices api (https://www.elastic.co/guide/en/elasticsearch/reference/current/cat-indices.html), and I see that the normal list of headers returned is: health status index …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1924)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1926)
