# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1699

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1700

---

## [Support Diagnostic tool](https://discuss.elastic.co/t/support-diagnostic-tool/130598)

<div class="topic-metadata">

**Author:** [@Rahul\_Pm](https://discuss.elastic.co/u/Rahul_Pm)\
**Replies:** 3\
**Last updated:** [May 4, 2018, 10:00am UTC](https://discuss.elastic.co/t/support-diagnostic-tool/130598 "2018-05-04T10:00:04Z")

</div>

Hi, I'm trying to run the support diagnostic tool on my ELK node. The JAVA\_HOME variable is set. But i get an error that says: " Could not find or load main com.elastic.support.diagnostics.diagnosticapp " Please help…

---

## [\[Jobs\] Add threshold information to calculate anomlay score](https://discuss.elastic.co/t/jobs-add-threshold-information-to-calculate-anomlay-score/130288)

<div class="topic-metadata">

**Author:** [@yazid](https://discuss.elastic.co/u/yazid)\
**Replies:** 2\
**Last updated:** [May 4, 2018, 9:30am UTC](https://discuss.elastic.co/t/jobs-add-threshold-information-to-calculate-anomlay-score/130288 "2018-05-04T09:30:43Z")

</div>

Hello Do you know if I can add a threshold information to calculate anomaly score? Example: I'm analysing a metric with values between 1 to 450. Generaly values are between 435-450. But actually all values higher than…

---

## [Cluster block exception](https://discuss.elastic.co/t/cluster-block-exception/130569)

<div class="topic-metadata">

**Author:** [@shwesinhan](https://discuss.elastic.co/u/shwesinhan)\
**Replies:** 8\
**Last updated:** [May 4, 2018, 9:19am UTC](https://discuss.elastic.co/t/cluster-block-exception/130569 "2018-05-04T09:19:34Z")

</div>

hi there! now i got cluster\_block\_exception in kibana. but when i check the space, it is available 93.2gb. shards disk.indices disk.used disk.avail disk.total disk.percent host ip node 287 …

---

## [Querying Public Data with Elasticsearch](https://discuss.elastic.co/t/querying-public-data-with-elasticsearch/130580)

<div class="topic-metadata">

**Author:** [@Ole](https://discuss.elastic.co/u/Ole)\
**Replies:** 1\
**Last updated:** [May 4, 2018, 8:57am UTC](https://discuss.elastic.co/t/querying-public-data-with-elasticsearch/130580 "2018-05-04T08:57:46Z")

</div>

Hi. I hope this is the right place for this kind of question. If not I would be happy to redirected to the correct location. I'm a beginner in this field so even though I've searched for the solution I want to ask here …

---

## [Same name fields in two mappings disable indexing in one mapping](https://discuss.elastic.co/t/same-name-fields-in-two-mappings-disable-indexing-in-one-mapping/130560)

<div class="topic-metadata">

**Author:** [@Yogesh\_BG](https://discuss.elastic.co/u/Yogesh_BG)\
**Replies:** 7\
**Last updated:** [May 4, 2018, 7:58am UTC](https://discuss.elastic.co/t/same-name-fields-in-two-mappings-disable-indexing-in-one-mapping/130560 "2018-05-04T07:58:57Z")

</div>

Hi I have two mappings, mapping1 and mapping2... mapping1 goes to index1 and mapping2 to index2. But mapping1 and mapping2 are same. Want to enable index in mapping1 and disable in mapping2. How to do this?

---

## [Can I configure ES cache auto expire for prevent running GC?](https://discuss.elastic.co/t/can-i-configure-es-cache-auto-expire-for-prevent-running-gc/130556)

<div class="topic-metadata">

**Author:** [@GHShin](https://discuss.elastic.co/u/GHShin)\
**Replies:** 5\
**Last updated:** [May 4, 2018, 7:57am UTC](https://discuss.elastic.co/t/can-i-configure-es-cache-auto-expire-for-prevent-running-gc/130556 "2018-05-04T07:57:29Z")

</div>

Hello, We using ES for logging system. When ES receive many search request, ES bulk throughput performance is down heavily. Many GC perform at that time. We think like this. ES nodes perform searching request and tr…

---

## [Unable to delete data older than 7 days from elastic search](https://discuss.elastic.co/t/unable-to-delete-data-older-than-7-days-from-elastic-search/130452)

<div class="topic-metadata">

**Author:** [@pratsy](https://discuss.elastic.co/u/pratsy)\
**Replies:** 5\
**Last updated:** [May 4, 2018, 7:21am UTC](https://discuss.elastic.co/t/unable-to-delete-data-older-than-7-days-from-elastic-search/130452 "2018-05-04T07:21:35Z")

</div>

Unable to delete data older than 7 days from elasticsearch using following command curl -XDELETE 'http://localhost:9200/\*' -d ' { "query": { "range": { "@timestamp": { "lt": "now-7d" } } …

---

## [Rebalance the data within the shards?](https://discuss.elastic.co/t/rebalance-the-data-within-the-shards/130567)

<div class="topic-metadata">

**Author:** [@Stzx](https://discuss.elastic.co/u/Stzx)\
**Replies:** 2\
**Last updated:** [May 4, 2018, 7:09am UTC](https://discuss.elastic.co/t/rebalance-the-data-within-the-shards/130567 "2018-05-04T07:09:30Z")

</div>

Is there a way to rebalance the data within the shards? Just like: Source: shard total 0 45488 1 0 2 512 3 0 4 4000 Target: shard total 0 10000 1 10000 2 10000 3 10000 4 10000 …

---

## [\[doc\]\[xxxxx\], source\[n/a, actual length: \[5.1kb\], max length: 2kb\]}\]](https://discuss.elastic.co/t/doc-xxxxx-source-n-a-actual-length-5-1kb-max-length-2kb/130421)

<div class="topic-metadata">

**Author:** [@liweigao](https://discuss.elastic.co/u/liweigao)\
**Replies:** 2\
**Last updated:** [May 4, 2018, 2:32am UTC](https://discuss.elastic.co/t/doc-xxxxx-source-n-a-actual-length-5-1kb-max-length-2kb/130421 "2018-05-04T02:32:21Z")

</div>

Hello Everyone, I have a trouble. This is my logs \[2018-05-03T16:47:04,105\]\[DEBUG\]\[o.e.a.b.TransportShardBulkAction\] \[sc\_cms\_api-2018.05.03\]\[4\] failed to execute bulk item (index) BulkShardRequest \[\[sc\_cms\_api-2018.05.…

---

## [How to use search query in case insesitive for keyword](https://discuss.elastic.co/t/how-to-use-search-query-in-case-insesitive-for-keyword/130568)

<div class="topic-metadata">

**Author:** [@RameshNagargoje](https://discuss.elastic.co/u/RameshNagargoje)\
**Replies:** 1\
**Last updated:** [May 4, 2018, 6:43am UTC](https://discuss.elastic.co/t/how-to-use-search-query-in-case-insesitive-for-keyword/130568 "2018-05-04T06:43:16Z")

</div>

Here is my search query used in python to find error count. res = es.search(index="qvs-data", timeout=50000, body={ "highlight":{"pre\_tags":\["@kibana-highlighted-field@"\], "post\_tags":\["@/kibana-highlighted-field@"\], …

---

## [ElasticSearch ERROR RollingFileManager](https://discuss.elastic.co/t/elasticsearch-error-rollingfilemanager/130554)

<div class="topic-metadata">

**Author:** [@thompsonlau](https://discuss.elastic.co/u/thompsonlau)\
**Replies:** 0\
**Last updated:** [May 4, 2018, 4:06am UTC](https://discuss.elastic.co/t/elasticsearch-error-rollingfilemanager/130554 "2018-05-04T04:06:49Z")

</div>

Find the following error message in log after starting Elasticsearch. What's the problem and how to solve it? May 04 12:25:46 QVELKSRH01 elasticsearch\[19365\]: 2018-05-04 12:25:46,640 main ERROR RollingFileManager (/var…

---

## [Cluster health RED, UNASSIGNED shards from CLUSTER\_RECOVERED](https://discuss.elastic.co/t/cluster-health-red-unassigned-shards-from-cluster-recovered/129389)

<div class="topic-metadata">

**Author:** [@bistaumanga](https://discuss.elastic.co/u/bistaumanga)\
**Replies:** 4\
**Last updated:** [May 4, 2018, 3:34am UTC](https://discuss.elastic.co/t/cluster-health-red-unassigned-shards-from-cluster-recovered/129389 "2018-05-04T03:34:54Z")

</div>

I have a elasticsearch with 3 nodes, first one is master, and all are data nodes. I create a snapshot of first node and created new vm in different data center (backed by openstack), and copied the elasticsearch data dir…

---

## [Process Cluster Event Timeout Exception on put-mapping](https://discuss.elastic.co/t/process-cluster-event-timeout-exception-on-put-mapping/127227)

<div class="topic-metadata">

**Author:** [@ashokm](https://discuss.elastic.co/u/ashokm)\
**Replies:** 11\
**Last updated:** [May 3, 2018, 9:12pm UTC](https://discuss.elastic.co/t/process-cluster-event-timeout-exception-on-put-mapping/127227 "2018-05-03T21:12:43Z")

</div>

Hi All, Occasionally I am getting following exception on my 6 node ES cluster 2.4.6 2018-04-08 03:04:09,903\]\[DEBUG\]\[action.admin.indices.mapping.put\] \[PROD Node1\] failed to put mappings on indices \[\[index\_XXXXX\]\], type…

---

## [Elastic Cloud - Machine Learning](https://discuss.elastic.co/t/elastic-cloud-machine-learning/130478)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 8:19pm UTC](https://discuss.elastic.co/t/elastic-cloud-machine-learning/130478 "2018-05-03T20:19:09Z")

</div>

Hi Guys, I realise there have been a few topics on this, all of which have been closed. The last predicted date I saw for this was October '17. Is there an updated scheduled date for the release of machine learning to …

---

## [Requesting background info on \`search.max\_buckets\` change](https://discuss.elastic.co/t/requesting-background-info-on-search-max-buckets-change/130334)

<div class="topic-metadata">

**Author:** [@steven-collins-omega](https://discuss.elastic.co/u/steven-collins-omega)\
**Replies:** 4\
**Last updated:** [May 3, 2018, 4:59pm UTC](https://discuss.elastic.co/t/requesting-background-info-on-search-max-buckets-change/130334 "2018-05-03T16:59:23Z")

</div>

So the default value of search.max\_buckets is -1 currently (6.x), which means there is no limit. We've been starting to get warnings that the default value will change to 10,000 in future versions (we currently have a te…

---

## [Understanding Elasticsearch scaling](https://discuss.elastic.co/t/understanding-elasticsearch-scaling/130498)

<div class="topic-metadata">

**Author:** [@jlixfeld](https://discuss.elastic.co/u/jlixfeld)\
**Replies:** 0\
**Last updated:** [May 3, 2018, 4:59pm UTC](https://discuss.elastic.co/t/understanding-elasticsearch-scaling/130498 "2018-05-03T16:59:07Z")

</div>

Hi there, I have an ES instance that chokes out on CPU when it is doing searches that span a long timeframe (\> 12 hours): top - 12:36:34 up 6 days, 5:00, 1 user, load average: 2.41, 1.73, 0.89 Tasks: 166 total, 1 …

---

## [Can multi-fields be used to overcome index.mapping.total\_fields.limit?](https://discuss.elastic.co/t/can-multi-fields-be-used-to-overcome-index-mapping-total-fields-limit/130454)

<div class="topic-metadata">

**Author:** [@Cristi\_Cioriia](https://discuss.elastic.co/u/Cristi_Cioriia)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 3:54pm UTC](https://discuss.elastic.co/t/can-multi-fields-be-used-to-overcome-index-mapping-total-fields-limit/130454 "2018-05-03T15:54:15Z")

</div>

Hi, We're storing into ES documents that contain an event field that is a JSON object that can have a free-form structure, e.g. a document might have a JSON object which contains a name field, while another json might …

---

## [Poor Performance - Cluster](https://discuss.elastic.co/t/poor-performance-cluster/130491)

<div class="topic-metadata">

**Author:** [@L33T](https://discuss.elastic.co/u/L33T)\
**Replies:** 3\
**Last updated:** [May 3, 2018, 3:46pm UTC](https://discuss.elastic.co/t/poor-performance-cluster/130491 "2018-05-03T15:46:53Z")

</div>

Hi, Most of my system is dragging, especially when running large queries... Does my data seem out of control? I only have 12 winlogbeat clients pushing event logs into the stack.. elasticsearch 2 nodes 1,269 indices …

---

## [Cross-cluster/Tribe search between 2.x and newer](https://discuss.elastic.co/t/cross-cluster-tribe-search-between-2-x-and-newer/130490)

<div class="topic-metadata">

**Author:** [@Merclangrat](https://discuss.elastic.co/u/Merclangrat)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 3:48pm UTC](https://discuss.elastic.co/t/cross-cluster-tribe-search-between-2-x-and-newer/130490 "2018-05-03T15:48:04Z")

</div>

We have big Elasticsearch 2.x cluster which can't be upgraded right now, and I was working with cross-cluster search between 2.x and 6.x. I tried 5.x as cross-cluster (and tribe), it works with 5 and 6, but it doesn't c…

---

## [\[ANNOUNCEMENT\] New analysis plugin : dandelion](https://discuss.elastic.co/t/announcement-new-analysis-plugin-dandelion/130404)

<div class="topic-metadata">

**Author:** [@ZarHenry96](https://discuss.elastic.co/u/ZarHenry96)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 3:03pm UTC](https://discuss.elastic.co/t/announcement-new-analysis-plugin-dandelion/130404 "2018-05-03T15:03:55Z")

</div>

Hi, I've just released an analysis plugin that integrates Dandelion entity extraction service into elasticsearch. It provides an analyzer that allows semantic searches based on the entities extracted from the input tex…

---

## [Rally Actors exit prematurely](https://discuss.elastic.co/t/rally-actors-exit-prematurely/126985)

<div class="topic-metadata">

**Author:** [@arshdeeptinna](https://discuss.elastic.co/u/arshdeeptinna)\
**Replies:** 14\
**Last updated:** [May 3, 2018, 3:02pm UTC](https://discuss.elastic.co/t/rally-actors-exit-prematurely/126985 "2018-05-03T15:02:59Z")

</div>

I've written a new track and been trying to use that to run benchmarks against existing aws elasticsearch cluster. Default rally tracks work fine however for the custom tracks i see something like this 018-04-05 18:32:2…

---

## [Mininimum hardware requirement for ELK stack 6.3 version](https://discuss.elastic.co/t/mininimum-hardware-requirement-for-elk-stack-6-3-version/130468)

<div class="topic-metadata">

**Author:** [@HRG](https://discuss.elastic.co/u/HRG)\
**Replies:** 0\
**Last updated:** [May 3, 2018, 2:10pm UTC](https://discuss.elastic.co/t/mininimum-hardware-requirement-for-elk-stack-6-3-version/130468 "2018-05-03T14:10:33Z")

</div>

Experts: I would like to size production server(ELK stask) with the below info wanted to keep 3 months files on the Elasticstack. Total size around 2.5GB data for 3 months Single server(not sure which windows or R…

---

## [Painless - how to access "@timestamp" field in script](https://discuss.elastic.co/t/painless-how-to-access-timestamp-field-in-script/130263)

<div class="topic-metadata">

**Author:** [@SKumarMN](https://discuss.elastic.co/u/SKumarMN)\
**Replies:** 3\
**Last updated:** [May 3, 2018, 2:04pm UTC](https://discuss.elastic.co/t/painless-how-to-access-timestamp-field-in-script/130263 "2018-05-03T14:04:00Z")

</div>

Hi All, I have an index with a mapping for the field "@timestamp": { "format": "epoch\_millis", "type": "date" } Using painless i want to update it. However when i try to access this field in the script it throws an…

---

## [Routing to an index partition](https://discuss.elastic.co/t/routing-to-an-index-partition/130299)

<div class="topic-metadata">

**Author:** [@dimalini](https://discuss.elastic.co/u/dimalini)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 2:02pm UTC](https://discuss.elastic.co/t/routing-to-an-index-partition/130299 "2018-05-03T14:02:34Z")

</div>

Hi, I came across "index.routing\_partition\_size" and would like to experiment the same for our scenario. Prev when we used custom routing, we leveraged the \_search\_shards api to get to know the routingId to shardId mapp…

---

## [ElasticSearch to FileSystem(EC2) snapshot is dump or sync?](https://discuss.elastic.co/t/elasticsearch-to-filesystem-ec2-snapshot-is-dump-or-sync/130232)

<div class="topic-metadata">

**Author:** [@pratsy](https://discuss.elastic.co/u/pratsy)\
**Replies:** 3\
**Last updated:** [May 3, 2018, 1:27pm UTC](https://discuss.elastic.co/t/elasticsearch-to-filesystem-ec2-snapshot-is-dump-or-sync/130232 "2018-05-03T13:27:14Z")

</div>

Hi Community, I am trying to take a snapshot from elastic search to EC2 instance and then want to update to S3. curl -XPUT 'http://localhost:9200/\_snapshot/s3-backup/snapshot\_1?wait\_for\_completion=true' Above command …

---

## [How to improve performance?](https://discuss.elastic.co/t/how-to-improve-performance/129685)

<div class="topic-metadata">

**Author:** [@flochon](https://discuss.elastic.co/u/flochon)\
**Replies:** 19\
**Last updated:** [May 3, 2018, 12:52pm UTC](https://discuss.elastic.co/t/how-to-improve-performance/129685 "2018-05-03T12:52:31Z")

</div>

Hello, I use Elasticsearch last version and my cluster contains 3 nodes. I receive 100GB of data per day. Actually, I have 6GB of heap size. My Elasticsearch has a lot of latence when I search data. I would like to kn…

---

## [Post Avro Protocol Can't get text on a START\_OBJECT](https://discuss.elastic.co/t/post-avro-protocol-cant-get-text-on-a-start-object/129845)

<div class="topic-metadata">

**Author:** [@OliverG](https://discuss.elastic.co/u/OliverG)\
**Replies:** 1\
**Last updated:** [May 3, 2018, 12:10pm UTC](https://discuss.elastic.co/t/post-avro-protocol-cant-get-text-on-a-start-object/129845 "2018-05-03T12:10:16Z")

</div>

Good Morning, I am looking for some insight into why posting this json document doesn't work in certain scenarios. We are working with ElasticSearch and wanting to store an Avro protocol. This is what the Avro protoco…

---

## [Percentile\_ranks for values in database](https://discuss.elastic.co/t/percentile-ranks-for-values-in-database/128900)

<div class="topic-metadata">

**Author:** [@debuggio](https://discuss.elastic.co/u/debuggio)\
**Replies:** 4\
**Last updated:** [May 3, 2018, 11:44am UTC](https://discuss.elastic.co/t/percentile-ranks-for-values-in-database/128900 "2018-05-03T11:44:57Z")

</div>

Hi guys! I have data that looks like this: { "user" : { "id: 1, "money": 100, "points": 50 }, ..................... } I'm trying to build a query with ranks for each of these columns (money and points). So I wo…

---

## [\[solved\] Problems with "/" as value / apache logs in logstash](https://discuss.elastic.co/t/solved-problems-with-as-value-apache-logs-in-logstash/129931)

<div class="topic-metadata">

**Author:** [@Sushimaster](https://discuss.elastic.co/u/Sushimaster)\
**Replies:** 3\
**Last updated:** [May 3, 2018, 10:57am UTC](https://discuss.elastic.co/t/solved-problems-with-as-value-apache-logs-in-logstash/129931 "2018-05-03T10:57:39Z")

</div>

Hi, I'm pipelining Apache logfiles from logstash to elasticsearch, implemented very close to the example in the logstash docs. Now when the "request" field just has an / (slash) as value, it appears in the Discover tab …

---

## [NoSuchFileException translog.ckp missing problem](https://discuss.elastic.co/t/nosuchfileexception-translog-ckp-missing-problem/130433)

<div class="topic-metadata">

**Author:** [@itplayer](https://discuss.elastic.co/u/itplayer)\
**Replies:** 0\
**Last updated:** [May 3, 2018, 10:56am UTC](https://discuss.elastic.co/t/nosuchfileexception-translog-ckp-missing-problem/130433 "2018-05-03T10:56:11Z")

</div>

Hi folks, I encountered an exception which is index recover failed due to translog EOFexception, I did some research and it seems to be corrupted translog. I tried to delete the translog directory(and all files contai…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1698)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1700)
